Senior Big Data Developer

{{ flashMessage.message }}

JOB DESCRIPTION / ROLE

Employment: Full Time

As a trusted partner to entities across public and private sectors, Pegasus (A DarkMatter Group Company) provides cutting edge and future proof data analytics software and services aimed at providing flawless actionable intelligence. We help our clients to answer their most pressing data queries - at speed. We provide instant value by unravelling key insights from an abundance of data sources, building the next generation of lawful enforcement, fraud management, cyber security and data management solutions. We are ambitious, with a strong desire and belief in establishing the leading global Data Science, Big Data and Analytics powerhouse with the key focus on applied machine learning and artificial intelligence.

Whether you are working in our headquarters located in the iconic Aldar HQ building in Abu Dhabi, or one of our international offices you will be joining a firm that is constantly looking to push boundaries. Our people define us. They are talented adventurers who are shaping the tech landscape from Abu Dhabi with their considerable expertise and experience. For them, Pegasus is a place where they can make their big data dreams come true. We embrace and foster the entrepreneurial spirit that propels our people and our company forward. Our industry is ever evolving, and so are we.

In this role, you will:

- Be passionate in applying software engineering skills to solve real life big data analytical problems
- Be part of our core engineering team who are building one of the largest Big Data analytics system in the world.
- Write code to process billions of data records daily from heterogeneous sources.
- Deploy ETL solutions to work on clusters with hundreds of nodes, storing petabytes of data.
- Collaborate with Product Managers, Architects and Software Engineers to research, design and improve core big data analytics functionalities along with implementing features of big data analytic applications in the area of ingestion, enrichment, search, and/or analytics.

REQUIREMENTS

To bring your dream to life, you'll need:

- 6+ years' experience in Java and/or Scala, with OOD/OOP design skills, with proficiency in Linux environment along with knowledge of writing unit test and testable code.
- Hands on experience in building big data applications on your current job role.
- Strong experience in Spark Core, Spark Streaming. Alternatively Flink, Storm, Apache Beam can be considered.
- Strong experience in Kafka.
- Strong experience in HBase or Cassandra.
- Strong experience working with Cloudera, Hortonworks or similar Big Data platform managers.
- Experience in ElasticSearch or Solr.
- Experience in using Spring framework.
- Desirable Spark SQL, Spark ML, and/or Spark GraphX.
- Experience with development and configuration tools (Git, Jira, Jenkins, etc.) and Continuous Integration practices.

Working in Abu Dhabi

At Pegasus, we're turning our biggest ideas into reality in the fastest moving and most dynamic city on the planet. Working here, you'll lead technical innovation in the region while taking advantage of all Abu Dhabi has to offer. From first class healthcare and education, to superior living accommodations and cultural attractions, you'll find your ideal career and more in this global crossroads. The UAE is one of the safest and most secure areas in the world. And with its location between Europe, Africa and Asia, you'll expand your worldview in just a short flight. But you won't have to venture far from the city to experience its diversity. You'll find people of over 50 nationalities working in the DarkMatter Group. Join us and see that while far away from the concrete tech jungle, Abu Dhabi is an oasis where your latest innovations will thrive and grow.

ABOUT THE COMPANY

DarkMatter is transforming the cyber security landscape. Headquartered in the UAE and operating globally, we're the region's first and only fully integrated digital defence and cyber security consultancy and implementation firm. Our elite team of global experts deliver advanced, next-generation solutions to governments and enterprises across the cyber security spectrum.

We help clients simplify the enormous complexity of today's ever-evolving cyber threats. Our vision is to protect the future by securing its technologies. Innovation and Research are cornerstones to our development and the activities in these areas underpin our entire range of offerings, including Secure Communications, Public Key Infrastructure and Big Data & Analytics products.

Advertise Here
INSTALL APP
×