Data Engineer (SAAL)

Job description / Role

About Saal.ai
Saal.ai is a U.A.E based organization focusing on an AI framework capable of performing cognitive tasks via multimodal sensor inputs .We strive towards Artificial General Intelligence using learning paradigms such as Active Learning, Meta-Learning and Reinforcement Learning. Our mission is to make technology think and learn where human-machine interaction creates exponential growth and opportunities for humanity.

Job Purpose

As a Saal.ai Data Engineer you should have hands-on development responsibility for setting up and owning the process of Development of various Big Data assets integrated with Best Practices, Clean Code Principles, TDD and Junit Tests, Tools, ETL Pipelines, Integration with Upstream and Downstream Applications like Reporting, Visualization, Data Lake etc. The Data Engineer will support our Big Data Architects and will ensure optimal data processing coding and pipeline is developed and deployed in consistency with Data Lake Design and Architecture. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of playing individual contributor ship, self-learning, optimizing or even re-designing our company data architecture to support our next generation of products and data initiatives.

Key Responsibilities

Job Specific Responsibilities

• Work integratedly with teams like AI, BigData, QA, Devops etc.
• Actively participate in Project Planning Meetings
• Play Individual Contributor role in Agile Execution
• Work with different Big Data frameworks like Apache Hadoop and Spark.
• Execute Clean Code, TDD, Junit and leverage best patterns for writing code.
• Work with QA in resolving issues
• Work with Devops in automation

Key Performance Indicator

• Advance working knowledge of Open Source Data Lake Systems such as Apache Hadoop, Apache Spark, Apache Kafka, Apache Zookeeper
• Advance working knowledge of Vendor specific Data Lake technologies from Hortonworks, Cloudera and Mapr
• Advance working knowledge of Python and either Java8 or Scala2.0
• Advance working knowledge of Linux Operating System such as Centos
• Advance working knowledge of Design Patterns, Solid Principles, Clean Code, Test Driven Development
• Advance working knowledge of Security, SSL, Encryption

Requirements

Education, Experience and Required Skills

Educational Qualification

• We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.

Experience

• Min 5 years of experience working with Apache Hadoop, Apache Spark, Apache Kafka, Apache Zookeeper
• At least 5+ years in hands on programming experience in Python or one of Scala or Java 8
• Atleast 3+ years of hands on experience on working with Data Lake systems like Hortonworks or Cloudera or Mapr
• Atleast 3+ years of hands on experience on ETL tools like Apache Scoop, Apache Flume, Apache NiFi

Essential Skills & Experience

• RDBMS SQL
• Python and Scala2.x/Java8 Programming
• Linux / Shell Scripting
• Clean Code + TDD
• CI/CD + SonarQube
• Apache Hadoop, Apache Spark, Apache Kafka, Apache Zookeeper
• Hortonworks or Cloudera or Mapr
• Apache Scoop, Apache Flume and Apache NIFI
• Ability to write Apache Spark Code and Test Cases

Desirable Skills

• Knowledge of Reporting and Visualization Tools like Tableau etc.
• Knowledge of Cloud Technologies such as AWS or Microsoft Azure
• Microsoft Specific PowerPoint, Excel

Good to have:

• Openness towards R and D and Learning new technology
• Self-Motivated
• Good Communication

About the Company

Algorythma is a first-rate end-to-end technology service company, Algorythma creates impactful products backed with experience from leading corporations and institutions across the globe.

Our team is passionate, highly skilled and specialized when it comes to creating technologies that deliver turnkey solutions and lead corporations through elevating change on a large scale. It's worth mentioning that, the team is driven by the desire to build exceptional products. We are committed to building market leaders in industries we operate, and we continue to evolve our technology and business models to deliver value to our eco-system.

At Algorythma, technology is at the heart of all that we do. From identifying issues that impact lives, to supporting experts in creating solutions, we focus on building products and teams that transform industries and the boundaries of business with technology.