Databricks Data Engineer

Infosys; Pune District, Bengaluru, Delhi; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Infosys in Pune is seeking a Data Engineer to design, develop, and maintain data pipelines using Databricks, PySpark, and Spark SQL on cloud platforms.

You will build scalable ETL/ELT solutions, optimize performance, and collaborate with cross-functional teams to deliver business requirements.

Qualifications

• 2–5 years of experience in Data Engineering.
• Hands-on experience with Databricks and PySpark.
• Strong SQL and Spark SQL knowledge.
• Experience in ETL development and data integration.
• Exposure to cloud environments.

Responsibilities

• Design, develop, and maintain data pipelines using Databricks.
• Build ETL/ELT solutions for processing large datasets.
• Develop scalable data transformation workflows using PySpark and Spark SQL.
• Work with Delta Lake and cloud-based data platforms.
• Integrate data from multiple source systems.
• Optimize data processing performance and reliability.
• Collaborate with cross-functional teams to deliver business requirements.

Skills

Databricks

PySpark

SQL

Spark SQL

ETL

Data integration

Delta Lake

Azure Data Factory

Tools

Azure Data Factory

Job description

Role & Responsibilities :

• Design, develop, and maintain data pipelines using Databricks.
• Build ETL/ELT solutions for processing large datasets.
• Develop scalable data transformation workflows using PySpark and Spark SQL.
• Work with Delta Lake and cloud-based data platforms.
• Integrate data from multiple source systems.
• Optimize data processing performance and reliability.
• Collaborate with cross-functional teams to deliver business requirements.

Preferred Candidate Profile:

• 2-5 years of experience in Data Engineering.
• Hands-on experience with Databricks and PySpark.
• Strong SQL and Spark SQL knowledge.
• Experience in ETL development and data integration.
• Exposure to Azure Data Factory and cloud environments.
• Strong analytical and problem-solving skills.