Big Data Engineer - Informatica

Michael Page

UAE

Ref: HP350-4632

Job description / Role

Employment: Full Time

As the Big Data Engineer, you will play a pivotal role as part of data engineering team build data lakes on Cloudera for Enterprise analytics.

Support & sustain the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Informatica BDM.

Client Details

One of the largest financial institutions within the Middle East that are now looking to grow their Data capability in the region.

Description

* Building and optimizing 'big data' data pipeline architectures and data sets; both batch-oriented and real time using Informatica BDM & BDS.
* Leverage Hadoop ecosystem knowledge to design, and develop capabilities to deliver our solutions using Spark, Scala, Python, Hive, Kafka and other things in the Hadoop ecosystem.
* Extensive experience working with Big Data tools and building data solutions for advanced analytics like Cloudera, Snowflake - Experience on Cloudera is a plus
* Work hands on with tools such as Spark, Scala, Python & Hive SQL in addition to Informatica platform
* Development and expertise in Kafka brokers, ZooKeepers, KSQL, KStream and Kafka Control center. Provide expertise on custom connectors using the Kafka core concepts and API
* Extensive experience on streaming processing & analytics using KAFKA, Spark streaming, Striim and working knowledge on Kafka Rest proxy.
* Build strong relationships with the interfacing application development teams, both upstream and downstream as well as other support teams.

Job Offer

In addition to a fantastic Big Data Engineer opportunity working with varied projects, this role will pay an attractive salary and offer occasional travel

Requirements

* Minimum of 6 years Informatica ETL development experience "PowerCenter"
* Minimum 3 years' Experience in Development using Informatica components such as CDC PWX, EDC, Big Data Quality, etc.
* Minimum 3 years' experience in Development in Informatica Big Data Management using Informatica Developer
* At least 2 previous implementations for Informatica Power Exchange for CDC and Power Exchange for Web Services is a must

About the Company

Michael Page is one of the world's leading professional recruitment consultancies, specializing in the placement of candidates in permanent, contract, temporary and interim positions with clients around the world.

The Group has operations in the UK, Continental Europe, Asia-Pacific and the Americas. In the Middle East we focus on the areas of:

Finance & Accounting Banking & Financial Services Procurement Property & Construction Engineering & Supply Chain Oil & Gas Technical and Engineering Human Resources Sales Marketing Technology Secretarial Executive Search Legal

The Group operates through 161 offices in 33 countries and employs over 5,000 employees worldwide.

Get personalised updates on latest vacancies
Job Alerts by Email
  • Personalised updates on latest career opportunities
  • Insights on hiring and employment activity in your industry
  • Typically sent twice a month
Engineer salaries in UAE

Average monthly compensation
AED 7,000

Breakdown available for industries, cities and years of experience