Lead Data Engineer

ExlService Holdings, Inc.; Pune District; On-site; INR 800,000 - 1,200,000; Full time

Job summary

ExlService Holdings, Inc. is seeking a data engineer with a minimum of 5 years' experience in developing and maintaining high-quality data pipelines. Candidates should have strong expertise in distributed systems such as Hadoop, Spark, and Hive, along with proficiency in Python and experience in cloud platforms like AWS.

The candidate should also possess skills in Git, JIRA, and Jenkins, and have a solid understanding of Agile methodologies. This role demands excellent collaborative and problem-solving abilities.

Qualifications

• Minimum 5 years of experience in coding and data pipeline implementation.
• Ability to work collaboratively in cross-functional teams.
• Strong problem-solving and communication skills.

Skills

Distributed systems experience

Python

Cloud platforms (AWS)

Databricks and/or Snowflake

Git

JIRA

Jenkins

Shell scripting

Agile methodology

Test-driven development

Job description

In-depth working experience of distributed systems Hadoop, Spark, Hive, DBT and Airflow/Dagster

At least 5 years of solid production quality coding experience in data pipeline implementation in Python

Experience working with public cloud platforms, preferably AWS

Experience working with Databricks and/or Snowflake

Experience in Git, JIRA, Jenkins, shell scripting

Familiarity with Agile methodology, test-driven development, source control management and test automation

Experience supporting and working with cross-functional teams in a dynamic environment

You have excellent collaborative problem solving and communication skills and are empathetic to others

You have a track record of building fast, reliable, and high-quality data pipelines