Senior Pipeline Engineer

Job description / Role

• Lead the development and implementation of robust and scalable data pipelines, ensuring seamless data flow from source to destination, optimizing performance and minimizing bottlenecks.
• Design, build, and maintain automated data ingestion processes, including data validation, transformation, and cleansing, to guarantee data integrity and reliability.
• Proactively identify and resolve pipeline performance issues, optimizing code and infrastructure to maintain data processing efficiency and reduce latency.
• Collaborate with cross-functional teams, including data scientists, analysts, and engineers, to understand data needs and translate them into effective pipeline solutions.
• Develop and maintain comprehensive documentation, including pipeline architecture, data flows, and operational procedures, to promote knowledge sharing and facilitate troubleshooting.
• Implement monitoring and alerting systems to proactively identify and address pipeline failures, ensuring data availability and timely resolution of issues.
• Stay abreast of the latest advancements in pipeline technologies and tools, recommending and implementing new solutions to improve data processing capabilities.
• Provide technical guidance and mentorship to junior engineers, fostering their growth and development within the data engineering team.
• Conduct thorough code reviews and ensure adherence to coding standards and best practices, maintaining high-quality code and minimizing technical debt.
• Manage and optimize cloud infrastructure resources for pipeline execution, ensuring cost-effectiveness and scalability of data processing operations.

• Bachelor's or Master's degree in Mechanical Engineering, or a related field, providing a strong foundation in piping engineering principles.
• Proven experience (10 years) in designing, building, and maintaining data pipelines, showcasing expertise in data integration and processing.
• Familiarity with data warehousing and ETL processes, including data modeling and schema design, ensuring data quality and consistency.
• Strong problem-solving and analytical skills, demonstrating the ability to identify and resolve complex technical issues effectively.
• Excellent communication and collaboration skills, showcasing the ability to work effectively with cross-functional teams and stakeholders.
• Possesses a proactive and results-oriented mindset, with a strong commitment to delivering high-quality work and meeting deadlines.

Salary:
AED 16,000 to 18,000 per month inclusive of fixed allowances.
Additional benefits: Annual airfare, medical insurance, other benefits as per UAE labor law

About the Company

A leading engineering company in UAE.