ETL Azure Databricks - Senior Consultant

Winfo Solutions; Telangana; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Winfo Solutions is seeking an experienced ETL Data / Platform Engineer to build and maintain scalable data pipelines and platforms with a strong emphasis on Databricks.

The role requires hands-on work with PySpark, Python and SQL, integrating data across sources into data lakes and data warehouses on cloud platforms such as Azure, AWS or GCP. You will implement data quality checks and collaborate with data engineers and business teams.

Qualifications

• 4-8 years of experience in Data Engineering / ETL.
• Strong hands-on Databricks - Mandatory.
• Good experience in PySpark, Python, and SQL.
• Strong knowledge of ETL/ELT concepts and data pipelines.
• Experience with Data Lake / Data Warehouse.
• Experience with Azure, AWS, or GCP.
• Good understanding of data integration, data modeling, and data quality.

Responsibilities

• Develop and maintain ETL/ELT data pipelines using Databricks.
• Work with PySpark, Python, and SQL for data processing and transformation.
• Integrate data from multiple sources into data lakes and data warehouses.
• Develop, optimize, and monitor data pipelines.
• Implement data quality checks, error handling, and performance optimization.
• Work with cloud platforms such as Azure, AWS, or GCP.
• Collaborate with data engineers, architects, and business teams.
• Follow Git, CI/CD, and deployment best practices.

Skills

Databricks

PySpark

Python

SQL

ETL/ELT concepts

Data Lake/Data Warehouse

Cloud platforms (Azure/AWS/GCP)

Tools

Azure Data Factory

AWS Glue

Delta Lake

Apache Spark

Kafka

Airflow

CI/CD/DevOps

Job description

Job Summary

We are looking for an experienced

ETL Data / Platform Engineer

Experience

4-8 Years

Job Summary

We are looking for an experienced ETL Data / Platform Engineer with strong hands-on experience in Databricks to build and maintain scalable data pipelines and data platforms.

Key Responsibilities

• Develop and maintain ETL/ELT data pipelines using Databricks.
• Work with PySpark, Python, and SQL for data processing and transformation.
• Integrate data from multiple sources into data lakes and data warehouses.
• Develop, optimize, and monitor data pipelines.
• Implement data quality checks, error handling, and performance optimization.
• Work with cloud platforms such as Azure, AWS, or GCP.
• Collaborate with data engineers, architects, and business teams.
• Follow Git, CI/CD, and deployment best practices.

Mandatory Skills

• 4-8 years of experience in Data Engineering / ETL.
• Strong hands-on experience with Databricks - Mandatory.
• Good experience in PySpark, Python, and SQL.
• Strong knowledge of ETL/ELT concepts and data pipelines.
• Experience with Data Lake / Data Warehouse.
• Experience with Azure, AWS, or GCP.
• Good understanding of data integration, data modeling, and data quality.

Good to Have

• Experience with Azure Data Factory / AWS Glue.
• Knowledge of Delta Lake.
• Experience with Apache Spark / Kafka.
• Experience with Airflow.
• Knowledge of CI/CD and DevOps.