Senior Data Engineer
Job description / Role
Emphasis for this role is Data Lake architecture and implementation, data ingestion into Data Lake and knowledge of relevant services in MS Azure. In this role you will provide technical leadership and thought leadership as a senior member in areas such as data access & ingestion, data processing, data integration, data modelling, database design & implementation, data visualization, and advanced analytics.
- Expert level understanding of Data Lake, AZURE and responsible for ingestion, writing Python scripts, using databricks, data modelling, ETL
- Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.
- Designing and building of data pipelines using API ingestion and Streaming ingestion methods.
- Strong command of relational databases and SQL. Extract, Transform, and Load (ETL) data into a relational database.
- Proficiency with Python or R, especially for data manipulation and analysis, and ability to build, maintain and deploy sequences of automated processes with these tools
- Experience working in an agile development environments (Kanban, Scrum, etc.)
About the Company
eMagine Solutions is one of the leading authorities on leadership and talent globally. Our combined resources of over 100 years professional experience mean that our clients trust us with finding them the top talent globally and candidates trust us to find them the right opportunity in a timely and confidential manner.
Throughout our offices we provide complete solutions for our clients, including traditional temporary and permanent recruitment, executive search, recruitment process outsourcing (RPO), salary survey's, market mapping and training and development courses.
Our global client list work with us not only because of our expertise but also because of our honesty, integrity and passion.
Get personalised updates on latest vacancies
Data Engineer - Data Ingestion SSIS, Azure
|Abu Dhabi||27 Mar|
ETL / Power BI / Business Intelligence Business Analyst
Reneco International Wildlife Consultants
|Abu Dhabi||28 Mar|
Data Entry and Analyst
Baden BPO & Software