Senior Data Engineer

Job description / Role

Description

We are a global technology consultancy firm with offices in Middle East, Asia, Europe, and USA. We deliver business benefits through innovation. We leverage cutting-edge technology-led solutions delivered by a team of skilled professionals, from sustainable software development to cloud services and operational excellence strategy. We have extensive expertise in capital markets and in particular trading and risk management functions.

Senior Data Engineer will play a critical role in designing, building, and maintaining scalable data pipelines and analytics solutions using Azure and Databricks ecosystem. Collaborate closely with business stakeholders to ensure data is accessible, reliable, and optimized for performance.

Requirements

• 6+ years of experience in data engineering or related roles.
• Proven expertise in Azure Data Factory and Azure Databricks.
• Strong proficiency in Python for data engineering tasks.
• Solid understanding of SQL and relational databases.
• Exposure to real-time data processing frameworks (e.g., Spark Streaming, Kafka).
• Experience in maintaining and supporting production-grade data pipelines.
• Familiarity with trading business domain, including market data, trade lifecycle, and financial instruments.
• Experience with version control systems (e.g., Git) and CI/CD pipelines.
• Excellent problem-solving skills and attention to detail.