Data Engineer

Employ; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Employ is seeking a Data Engineer in Hyderabad to design, build, and optimize scalable data pipelines using Databricks, PySpark, Python, and SQL. The role emphasizes workflow orchestration with Airflow, ETL/ELT processing, data modeling, and quality checks to deliver reliable data-driven solutions.

You will collaborate with cross-functional teams, ensure performance tuning, and contribute to data warehousing and cloud platform initiatives. Strong analytic and problem-solving skills are essential.

Qualifications

• Hands-on Databricks and PySpark experience.
• Strong Python and SQL proficiency.
• Experience with data warehousing and cloud platforms.

Responsibilities

• Develop and optimize data pipelines using Databricks, Python, and SQL.
• Design and manage workflow orchestration using Apache Airflow.
• Build scalable ETL/ELT processes for data ingestion and transformation.
• Monitor, troubleshoot, and improve data pipeline performance.
• Implement data quality checks and validation frameworks.
• Collaborate with cross-functional teams to deliver data-driven solutions.

Skills

Databricks

PySpark

Python

SQL

ETL/ELT

Orchestration

Data modeling

Performance tuning

Tools

Airflow

Delta Lake

CI/CD

Job description

We are looking for a Data Engineer with strong experience in Databricks, Airflow, Python, and SQL to build and maintain scalable data pipelines and data processing solutions. The ideal candidate will have expertise in ETL/ELT development, workflow orchestration, data modeling, and performance optimization.

Key Responsibilities:

• Develop and optimize data pipelines using Databricks, Python, and SQL.
• Design and manage workflow orchestration using Apache Airflow.
• Build scalable ETL/ELT processes for data ingestion and transformation.
• Monitor, troubleshoot, and improve data pipeline performance.
• Implement data quality checks and validation frameworks.
• Collaborate with cross-functional teams to deliver data-driven solutions.

Required Skills:

• Strong hands‑on experience with Databricks and PySpark.
• Expertise in Apache Airflow DAG development and orchestration.
• Proficiency in Python and advanced SQL.
• Experience with data warehousing and cloud-based data platforms.
• Knowledge of performance tuning, data modeling, and ETL best practices.

Preferred Skills:

• Experience with AWS, Azure, or GCP.
• Familiarity with Delta Lake, CI/CD, and Agile methodologies.