Senior Data Engineer

Job description / Role

Emphasis for this role is Data Lake architecture and implementation, data ingestion into Data Lake and knowledge of relevant services in MS Azure. In this role you will provide technical leadership and thought leadership as a senior member in areas such as data access & ingestion, data processing, data integration, data modelling, database design & implementation, data visualization, and advanced analytics.

Requirements

- Expert level understanding of Data Lake, AZURE and responsible for ingestion, writing Python scripts, using databricks, data modelling, ETL
- Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.
- Designing and building of data pipelines using API ingestion and Streaming ingestion methods.
- Strong command of relational databases and SQL. Extract, Transform, and Load (ETL) data into a relational database.
- Proficiency with Python or R, especially for data manipulation and analysis, and ability to build, maintain and deploy sequences of automated processes with these tools
- Experience working in an agile development environments (Kanban, Scrum, etc.)

About the Company

eMagine Solutions is one of the leading authorities on leadership and talent globally. Our combined resources of over 100 years professional experience mean that our clients trust us with finding them the top talent globally and candidates trust us to find them the right opportunity in a timely and confidential manner.

Throughout our offices we provide complete solutions for our clients, including traditional temporary and permanent recruitment, executive search, recruitment process outsourcing (RPO), salary survey's, market mapping and training and development courses.

Our global client list work with us not only because of our expertise but also because of our honesty, integrity and passion.