Data Engineer

Hire Today; India; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

Hire Today in India is seeking a data engineer to design, develop, and maintain scalable ETL/ELT pipelines using Databricks, Python, PySpark, Airflow, SQL, and Amazon S3.

You will build reliable data workflows, optimize processing, model data, ensure quality, and collaborate with cross-functional teams while contributing to engineering documentation and best practices. The role demands strong problem solving and a passion for clean data.

Qualifications

• Experience building ETL/ELT pipelines with Databricks and PySpark.
• Strong SQL skills and data modeling proficiency.
• Experience with Airflow for scheduling data workflows and S3 data storage.

Responsibilities

• Design and maintain ETL/ELT pipelines.
• Build scalable data processing solutions with Databricks and PySpark.
• Develop Apache Airflow DAGs.
• Write and optimize SQL queries.
• Manage Amazon S3 data storage and ingestion.
• Ensure data quality and reliability.
• Collaborate with cross-functional teams.
• Contribute to documentation and engineering best practices.

Skills

Databricks

Python

PySpark

Airflow

SQL

Amazon S3

Job description

Design, develop, and maintain scalable data engineering solutions using Databricks, Python, PySpark, Airflow, SQL, and Amazon S3 to build reliable ETL/ELT pipelines and optimize data workflows.

Responsibilities

• Design and maintain ETL/ELT pipelines
• Build scalable data processing solutions with Databricks and PySpark
• Develop Apache Airflow DAGs
• Write and optimize SQL queries
• Perform data modeling
• Manage Amazon S3 data storage and ingestion
• Ensure data quality and reliability
• Collaborate with cross-functional teams
• Contribute to documentation and engineering best practices.