2867 - Senior Data Engineer

EXL; Pune District; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

A leading IT services firm in Pune is seeking a Data Engineer with over 5 years of experience to develop and maintain scalable data pipelines. The ideal candidate has strong skills in AWS, Spark, and Python, and is familiar with Agile methodologies. This full-time position offers an opportunity to work in a dynamic environment while focusing on data quality and efficient processes.

Qualifications

• 5+ years of relevant experience in data engineering.
• Strong skills in building data pipelines.
• Solid understanding of test-driven development and automated testing.

Responsibilities

• Develop and maintain scalable data pipelines.
• Validate data and monitor data quality.
• Write unit/integration tests and document work.
• Perform root cause analysis on data and processes.

Skills

Data pipeline development

AWS

Spark

Python

SQL

GIT

JIRA

Jenkins

Shell scripting

Agile methodology

Job description

Get AI-powered advice on this job and more exclusive features.

Responsibilities

• Develops and maintains scalable data pipelines and builds out new integrations and processes required for optimal extraction, transformation, and loading of data from a wide variety of data sources using HQL and 'Big Data' technologies
• Implements processes and systems to validate data, monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it
• Write unit/integration tests, contribute to engineering wiki, and document work
• Performs root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement

Who You Are

• You’re passionate about Data and building efficient data pipelines
• You have excellent listening skills and empathetic to others
• You believe in simple and elegant solutions and give paramount importance to quality
• You have a track record of building fast, reliable, and high-quality data pipelines
• Passionate with good understanding of data, with a focus on having fun, while delivering incredible business results

Must have skills

• A Data Engineer with 5+ years of relevant experience who is excited to apply their current skills and to grow their knowledge base.
• Experience in AWS/Spark/Python/SQL/ development
• Experience in GIT, JIRA, Jenkins, Shell scripting
• Familiar with Agile methodology, test-driven development, source control management and automated testing

Nice to have skills

• Seniority level

Seniority level

• Mid-Senior level

Employment type

• Full-time

Industries

• IT Services and IT Consulting

Referrals increase your chances of interviewing at EXL by 2x

Get notified about new Data Engineer jobs in Pune, Maharashtra, India.