Python Databricks Developer

Ascendion; Bengaluru; On-site; INR 1,200,000 - 1,500,000; Full time

Job summary

Ascendion seeks a Python Databricks Developer to build and optimize data pipelines using Python, Databricks, PySpark, and Apache Spark. The role emphasizes ETL/ELT design, data integration, and scalable data processing across cloud-based environments.

Collaborating with data engineers, analysts, and stakeholders, you will ensure data quality and security while continuously improving pipelines and workflows in a fast-paced data-driven setting.

Qualifications

• Strong experience with Python and PySpark.
• Hands-on Databricks experience.
• Strong SQL and relational DB knowledge.
• Experience in ETL/ELT and data pipeline development.
• Knowledge of cloud platforms such as Azure, AWS, or GCP.
• Experience with Delta Lake and Databricks Workflows preferred.
• Good problem-solving and communication skills.

Responsibilities

• Develop and maintain scalable data pipelines using Python, Databricks, and PySpark.
• Design and implement ETL/ELT workflows for large-scale data processing.
• Develop and optimize Databricks notebooks, jobs, and workflows.
• Work with Apache Spark for distributed data processing.
• Integrate data from multiple sources and build reliable data solutions.
• Perform data transformation, cleansing, validation, and optimization.
• Troubleshoot pipeline failures and performance issues.
• Collaborate with data engineers, analysts, and business stakeholders.
• Follow data quality, security, and development best practices.

Skills

Python

PySpark

Databricks

Apache Spark

SQL

ETL/ELT

Azure

AWS

GCP

Delta Lake

Databricks Workflows

Problem solving

Communication

Tools

Databricks

Delta Lake

REST APIs

Git

Cache development

Job description

Role Overview

We are looking for a Python Databricks Developer with strong experience in data engineering, ETL development, and cloud-based data platforms. The candidate will be responsible for developing and optimizing data pipelines using Python, Databricks, and Apache Spark.

Role Overview

We are looking for a Python Databricks Developer with strong experience in data engineering, ETL development, and cloud-based data platforms. The candidate will be responsible for developing and optimizing data pipelines using Python, Databricks, and Apache Spark.

Key Responsibilities

• Develop and maintain scalable data pipelines using Python, Databricks, and PySpark.
• Design and implement ETL/ELT workflows for large-scale data processing.
• Develop and optimize Databricks notebooks, jobs, and workflows.
• Work with Apache Spark for distributed data processing.
• Integrate data from multiple sources and build reliable data solutions.
• Perform data transformation, cleansing, validation, and optimization.
• Troubleshoot pipeline failures and performance issues.
• Collaborate with data engineers, analysts, and business stakeholders.
• Follow data quality, security, and development best practices.

Required Skills

• Strong experience with Python and PySpark.
• Hands-on experience with Databricks.
• Good understanding of Apache Spark and distributed data processing.
• Strong SQL skills and experience with relational databases.
• Experience in ETL/ELT and data pipeline development.
• Knowledge of cloud platforms such as Azure, AWS, or GCP.
• Experience with Delta Lake and Databricks Workflows is preferred.
• Good problem-solving and communication skills.

Experience: 4–8 years

Role: Python Databricks Developer

Python,

SQL, Databricks, Apache Spark, REST APIs, Data Modeling, Git, Cache development

Good to have – LLM Integration,