Data Engineer with AWS, Databricks, Pyspark- 7+ exp required - Remote

ALPHA IT CONSULTANTS PVT LTD; Sahibzada Ajit Singh Nagar; Remote; INR 1,200,000 - 1,800,000; Full time

Job summary

A leading IT consulting firm in India is seeking a skilled Data Engineer with at least 7 years of experience in ETL/ELT development and expertise in AWS and Databricks. The role demands strong analytical capabilities for troubleshooting data pipelines and requires deep knowledge in Python, Spark, and SQL. This full-time position offers a challenging environment where collaboration with development teams and business stakeholders is essential to meet operational goals and ensure quality support.

Qualifications

• 8+ years of IT experience, with 7+ as an ETL/ELT developer or data engineer.
• 3+ years of Databricks data engineering experience.
• Expert in AWS Databricks, Python, Spark.

Responsibilities

• Transform conceptual designs into reliable data processes.
• Communicate and resolve production issues timely.
• Monitor production jobs and provide production support.

Skills

ETL/ELT development

Databricks

Python

Spark

SQL

UNIX Shell scripting

Data pipeline troubleshooting

Tools

AWS

Hadoop EMR

Hive

Presto

Job description

Data Engineer with AWS, Databricks, Pyspark - 7+ exp required - Remote

We are searching for a Data Engineer who is a self-starter, fueled by collaboration, able to transform conceptual designs into reliable, scalable processes that meet or exceed customer needs. A person should be very good at analytical, problem solving and troubleshooting data pipelines root cause analysis and resolutions. Working with various Development team, Technology partners and business stakeholders to deliver unified and timely support, while upholding quality and resolution standards to fulfill the operational needs of our business stakeholders.

Person should have:

• 8+ Years of IT experience, with 7+ years of experience as an ETL/ELT developer/data engineer.
• 3+ years of Databricks data engineering experience (Databricks Data Engineer and/or Spark Developer certification preferred)
• Working knowledge of the Finance or Insurance industry
• Expert in AWS Databricks, Python, Spark, Hadoop EMR, Hive, Presto
• Strong SQL, and UNIX Shell scripting experience
• Performance tuning data pipelines, track record communicating issues & follow-up through issue resolution.
• Production Support for applications, monitor production jobs, triage issues to appropriate team & resolve any issues in a timely manner

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Information Technology