Databricks Developer (2 To 3 Years)

Infosys; Dadri, Pune District, Bengaluru; Hybrid; INR 600,000 - 1,200,000; Full time

Job summary

Infosys is seeking a Databricks Developer in PAN India to design and implement scalable data pipelines using Databricks and PySpark. The role requires 2-3 years of hands-on experience with Spark SQL, Delta Lake, and cloud platforms.

You will collaborate with data analysts and engineering teams to deliver reliable data solutions, optimize performance, and ensure data quality and governance across data platforms.

Qualifications

• 2-3 years of experience in data engineering and big data technologies.
• Hands-on expertise in Databricks, PySpark, SQL, ETL development, and cloud platforms.
• Experience building scalable data pipelines and optimizing data workflows.

Responsibilities

• Design, develop, and maintain data pipelines using Azure Databricks and AWS Databricks.
• Develop ETL/ELT processes using PySpark and Spark SQL.
• Ingest, transform, and process large-scale structured and unstructured datasets.
• Optimize Databricks jobs and clusters for performance and cost efficiency.
• Implement and manage Delta Lake architecture for reliable data processing.
• Collaborate with stakeholders, analysts, and engineers to capture data requirements.
• Ensure data quality, governance, and security best practices.
• Troubleshoot production issues and provide timely resolutions.
• Participate in code reviews and adhere to development standards.
• Create and maintain technical documentation for solutions and processes.

Skills

Databricks development

PySpark

Python

Spark SQL

DataFrames

ETL concepts

SQL

Git

Linux

Tools

Databricks Workspace

Databricks Jobs

Databricks Notebooks

Databricks Workflows

Job description

Job Title: Databricks Developer
Experience: 2-3 Years
Location: PAN India
Employment Type: Full-Time

Job Summary

We are looking for a motivated Databricks Developer with 23 years of experience in data engineering and big data technologies. The ideal candidate should have hands‑on expertise in Databricks, PySpark, SQL, ETL development, and cloud platforms. The role involves building scalable data pipelines, optimizing data workflows, and supporting analytics and business intelligence initiatives.

Key Responsibilities

• Design, develop, and maintain data pipelines using Azure Databricks/AWS Databricks.
• Develop ETL/ELT processes using PySpark and Spark SQL.
• Ingest, transform, and process large‑scale structured and unstructured datasets.
• Optimize Databricks jobs and clusters for performance and cost efficiency.
• Implement and manage Delta Lake architecture for reliable data processing.
• Collaborate with business stakeholders, data analysts, and engineering teams to understand data requirements.
• Ensure data quality, governance, and security best practices.
• Troubleshoot production issues and provide timely resolutions.
• Participate in code reviews and adhere to development standards.
• Create and maintain technical documentation for solutions and processes.

Required Skills

• 2–3 years of experience in Databricks development.
• Strong proficiency in PySpark and Python.
• Hands‑on experience with Databricks Workspace, Jobs, Notebooks, and Workflows.
• Strong knowledge of Spark SQL, DataFrames, and distributed computing concepts.
• Experience with Delta Lake and data lake architectures.
• Strong SQL skills and experience with relational databases.
• Understanding of ETL/ELT frameworks and data warehousing concepts.
• Experience with version control tools such as Git.
• Knowledge of Linux/Unix environments.
• Strong analytical and problem‑solving skills.