Databricks Developer (2 To 5 Years)

Infosys; Dadri, Hyderabad, Bengaluru; Remote; INR 1,200,000 - 1,800,000; Full time

Job summary

Infosys is seeking a Databricks Developer with 2-5 years of data engineering experience to build scalable pipelines using Databricks on cloud platforms. The role focuses on PySpark, SQL, ETL development, and Delta Lake architecture to ensure robust data processing and analytics delivery.

The candidate will collaborate with business stakeholders and data teams to define data requirements, implement governance, and optimize performance and costs across distributed environments.

Qualifications

• 2–5 years of experience in data engineering and big data.
• Hands-on Databricks, PySpark, SQL, and ETL development expertise.
• Experience with cloud platforms (Azure/AWS) and scalable data pipelines.

Responsibilities

• Design, develop, and maintain data pipelines using Databricks across cloud platforms.
• Develop ETL/ELT processes with PySpark and Spark SQL.
• Ingest, transform, and process large-scale datasets.
• Optimize Databricks jobs and clusters for performance and cost efficiency.
• Implement Delta Lake architecture for reliable data processing.
• Collaborate with stakeholders and analytics teams to understand data needs.
• Ensure data quality, governance, and security best practices.
• Troubleshoot production issues and provide timely resolutions.
• Participate in code reviews and adhere to development standards.
• Create and maintain technical documentation for solutions and processes.

Skills

Databricks

PySpark

SQL

ETL

Cloud platforms

Tools

Delta Lake

Azure Databricks

AWS Databricks

Job description

Job Title: Databricks Developer
Experience: 2-5 Years
Location: PAN India
Employment Type: Full-Time

Job Summary

We are looking for a motivated Databricks Developer with 2-5 years of experience in data engineering and big data technologies. The ideal candidate should have hands-on expertise in Databricks, PySpark, SQL, ETL development, and cloud platforms. The role involves building scalable data pipelines, optimizing data workflows, and supporting analytics and business intelligence initiatives.

Key Responsibilities

• Design, develop, and maintain data pipelines using Azure Databricks/AWS Databricks.
• Develop ETL/ELT processes using PySpark and Spark SQL.
• Ingest, transform, and process large-scale structured and unstructured datasets.
• Optimize Databricks jobs and clusters for performance and cost efficiency.
• Implement and manage Delta Lake architecture for reliable data processing.
• Collaborate with business stakeholders, data analysts, and engineering teams to understand data requirements.
• Ensure data quality, governance, and security best practices.
• Troubleshoot production issues and provide timely resolutions.
• Participate in code reviews and adhere to development standards.
• Create and maintain technical documentation for solutions and processes.