Data Engineer-Azure Databricks

Tredence; Bengaluru; On-site; INR 900,000 - 1,200,000; Full time

Job summary

Tredence in Bangalore is seeking an Associate Data Engineer specializing in Azure Databricks to design, build, and maintain robust data pipelines and infrastructure that power analytics and ML across the organization.

You will work with data scientists and analysts, optimize ETL/ELT processes, and ensure data quality, governance, and cost efficiency on cloud platforms such as Azure, with CI/CD practices for data pipelines.

Qualifications

• 1–2 years of experience in data engineering or related field.
• Strong SQL and programming (Python/PySpark) proficiency.
• Hands-on with distributed processing frameworks like Spark.
• Experience with orchestration tools (Airflow, Azure Data Factory).
• Experience with cloud data platforms (Azure) and data warehouses.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines from diverse sources.
• Develop and optimize data models and schemas for analytics.
• Build and maintain data infrastructure on cloud platforms (Azure, AWS, or GCP).
• Ensure data quality, reliability, and observability via monitoring and testing.
• Collaborate with data scientists and analysts to provision clean datasets.
• Implement data governance, security, and access controls best practices.
• Optimize pipeline performance and manage data processing costs.
• Contribute to CI/CD practices for data pipeline deployment.

Skills

SQL

Python

PySpark

Apache Spark

Airflow

Azure Data Factory

Azure Databricks

Data modeling

Tools

Azure Databricks

Snowflake

BigQuery

Redshift

Job description

Role: Associate Data Engineer -Azure Databricks

Exp Level: 1-2 Yrs

Work Location: Bangalore

Notice Period: Immediate

We are looking for a Data Engineer to design, build, and maintain robust data pipelines and infrastructure. You will enable reliable, scalable, and high-quality data flows that power analytics and machine learning across the organization.

Key Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines to ingest data from diverse sources.
• Develop and optimize data models and schemas for analytics and reporting use cases.
• Build and maintain data infrastructure on cloud platforms (Azure, AWS, or GCP).
• Ensure data quality, reliability, and observability through monitoring, testing, and validation frameworks.
• Collaborate with data scientists and analysts to provision clean, well-structured datasets.
• Implement data governance, security, and access control best practices.
• Optimize pipeline performance and manage cost efficiency of data processing workloads.
• Contribute to CI/CD practices for data pipeline deployment and version control.

Required Skills & Qualifications

• 1-2 years of experience in data engineering or a related field.
• Strong proficiency in SQL and at least one programming language (Python, Pyspark).
• Hands-on experience with distributed data processing frameworks (Apache Spark, or similar).
• Experience building pipelines using orchestration tools (Airflow, Azure Data Factory, or similar).
• Experience working with cloud data platforms (Azure) and modern data warehouses (Snowflake, BigQuery, Redshift, or Databricks).
• Solid understanding of data modeling concepts (dimensional modeling, star/snowflake schemas).
• Familiarity with version control (Git) and CI/CD practices.