Data Engineer - Banking

Job description / Role

• Responsible to prepare the data and “big data” infrastructure to connect systems and enable data analysis by Data Scientists
• Responsible to design, build, integrate data from various resources, and manage data integrations

KEY RESPONSIBILITIES:
• Build and maintain the organization’s data pipeline systems (data pipelines encompass the journey and processes that data undergoes within a company)
• Gather and collect the data, store it, does batch processing or real -time processing on it, and serves it via an API to a data scientist who can easily query it
• Ensure the data organization is using is clean, reliable, and prepped for whatever use cases may present themselves
• Run ETL (Extract, Transform and Load) on top of big datasets and create big data warehouses that can be used for reporting or analysis by data scientists
• Continuously optimize the performance of company's big data ecosystem., including writing complex queries to make sure it is easily accessible and works smoothly
• Review the solution requirements and architecture to ensure selection of appropriate technology, efficient use of resources and integration of multiple systems and technology

Requirements

• Bachelor’s degree in Computer Science/Engineering, Applied Mathematics/Physics or Statistics
• Master’s degree preferred Experience:
• Strong background or relevant experience (3-4 years) in software engineering
• Should have prior working experience within: ETL, big data environments, cloud data stores, different RDBMS and OLAP solutions Competencies:
• Big data tools: Strong proficiency in Hadoop, MapReduce, Hive, Pig, Data streaming, NoSQL, SQL, programming
• End-to-end data architecture pipeline: Extensive knowledge on databases and best engineering practices including but not limited to handling and logging errors, monitoring the system, building human-fault-tolerant pipelines etc

About the Company

Building businesses, changing lives

At Tandem, we’ve built a vast network of top-tier professionals across the globe. We empower businesses to thrive by delivering unmatched talent solutions. With our global reach, collaborative approach, and unwavering commitment to excellence, we drive transformative growth and shape exceptional teams.

Who we are.

We are a team of industry experts, driven by a passion for innovation and excellence. We are dedicated to providing unique talent solutions and nurturing collaborative partnerships that redefine success.