Azure Data Engineer

Talentmatics; Bengaluru; On-site; INR 1,500,000 - 2,800,000; Full time

Job summary

Talentmatics is seeking a Data Engineer with 9-12 years of experience to design and implement scalable ETL/ELT pipelines on Azure-based data platforms. The role requires hands-on work with Azure Databricks, Azure Data Factory, Synapse Analytics, and modern data architectures.

You will design data lakes/lakehouses, manage data ingestion, and ensure robust data warehousing solutions using Snowflake, Redshift, or BigQuery. Strong Git/CI/CD practices and Airflow experience are a plus.

Qualifications

• 9-12 years of experience as a Data Engineer or similar.
• Hands-on design and development of scalable ETL/ELT pipelines.
• Proficient in Python, SQL, Spark, and Azure data services.
• Experience with Azure Databricks, Azure Data Factory, Synapse Analytics.
• Understanding of Data Lake/Lakehouse architectures and data warehousing.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
• Develop data transformations using Python, SQL, and Apache Spark.
• Build and manage data pipelines with Azure Data Factory and Azure Databricks.
• Work with Azure Synapse Analytics for processing and analytics.
• Design Data Lake and Lakehouse architectures; implement data ingestion and integration.
• Apply data warehousing concepts and dimensional modeling.

Skills

Python

SQL

Spark/PySpark

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

ETL/ELT

Data Warehousing

Dimensional Modeling

Snowflake

Redshift

BigQuery

Data Lake/Lakehouse

Git

CI/CD

Airflow

Tools

Azure Data Factory

Azure Databricks

Snowflake

Redshift

BigQuery

Synapse Analytics

Airflow

Git

Job description

We are looking for 9-12 years of experienced Data Engineer with strong expertise in Python, SQL, Spark, Azure Data Engineering, and modern data platforms. The ideal candidate should have hands‑on experience designing and developing scalable ETL/ELT pipelines, working with Azure Databricks, Azure Data Factory, Synapse Analytics, and implementing Data Lake/Lakehouse architectures.

Required Skills

• Strong hands‑on experience with Python, SQL, and Spark/PySpark.
• Experience with Azure Data Factory and Azure Databricks.
• Experience with Azure Synapse Analytics or equivalent cloud data platforms.
• Strong understanding of ETL/ELT concepts and data integration.
• Good knowledge of Data Warehousing and Dimensional Modeling.
• Experience with at least one modern cloud data warehouse such as Snowflake, Synapse, Redshift, or BigQuery.
• Strong understanding of Data Lake and Lakehouse architecture.
• Experience with Git and CI/CD practices.
• Experience with workflow orchestration tools such as Airflow or Azure Data Factory.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
• Develop data transformation and processing solutions using Python, SQL, and Apache Spark/PySpark.
• Build and manage data pipelines using Azure Data Factory (ADF) and Azure Databricks.
• Work with Azure Synapse Analytics or equivalent cloud data platforms for data processing and analytics.
• Design and implement Data Lake and Lakehouse architectures for structured and unstructured data.
• Develop efficient data ingestion, transformation, cleansing, and integration processes.
• Work with cloud data warehouses such as Snowflake, Azure Synapse, Redshift, or BigQuery.
• Apply data warehousing concepts, dimensional modeling, and schema design