Data Engineer

Celebal Technologies; Dadri, Jaipur, Bengaluru; On-site; INR 1,500,000 - 2,200,000; Full time

Job summary

Celebal Technologies is seeking a Data Engineer (Mid-Senior) with 3-7 years of experience to design and implement scalable data platforms on Databricks and Azure.

You will build end-to-end data pipelines, model data with Delta Lake, and enable analytics and AI workloads across the organization. Strong Python/SQL and collaboration with cross-functional teams are required.

Qualifications

• Must have hands-on experience with building scalable data platforms and data pipelines.
• Experience with cloud-native data solutions on Databricks and Azure.
• Proficiency in Python, SQL and PySpark for analytics workloads.

Responsibilities

• Design, develop, and optimize end-to-end data pipelines and ETL/ELT frameworks.
• Build scalable data solutions using Databricks and Azure services.
• Develop and maintain data models, Delta Lake implementations, and cloud data platforms.
• Enable data integration, transformation, and orchestration across sources.
• Collaborate with business and technical teams to support analytics and AI initiatives.
• Ensure data quality, governance, security, and operational excellence.

Skills

Databricks

Azure Cloud

Python

SQL

PySpark

ETL/ELT Development

Data Pipelines

Data Modeling

Delta Lake

Azure Data Factory

Azure Data Lake Storage

Data Integration

Batch & Streaming

Tools

Databricks

Azure Cloud

Python

SQL

PySpark

Delta Lake

Azure Data Factory

Azure Data Lake Storage

Databricks Workflows

Airflow

Job description

Data Engineer (Mid-Senior) | Celebal Technologies

Experience: 3-7 Years

Celebal Technologies is looking for a skilled Data Engineer with strong expertise in building scalable data platforms, modern data pipelines, and cloud-native data solutions. The ideal candidate should have hands‑on experience with Databricks, Azure, PySpark, and large-scale data processing for analytics and AI‑driven workloads.

Key Responsibilities

• Design, develop, and optimize end‑to‑end data pipelines and ETL/ELT frameworks.
• Build scalable and reliable data solutions using Databricks and Azure services.
• Develop and maintain data models, Delta Lake implementations, and cloud data platforms.
• Enable high‑quality data integration, transformation, and orchestration across multiple sources.
• Collaborate with business and technical teams to support analytics, reporting, and AI initiatives.
• Ensure data quality, governance, security, and operational excellence.

Must-Have Skills

• Strong hands‑on experience with:
  • Databricks
  • Azure Cloud
  • Python, SQL, and PySpark
  • ETL/ELT Development
  • Data Pipelines & Data Integration
  • Data Modeling
  • Delta Lake
  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS)
• Experience building and maintaining cloud‑based data platforms.
• Knowledge of batch and streaming data processing.
• Strong communication and stakeholder management skills.

Good‑to‑Have Skills

• Spark performance tuning and optimization.
• Orchestration tools such as Airflow or Databricks Workflows.
• CI/CD and DevOps practices for data engineering.
• Data governance, security, and compliance frameworks.
• Experience supporting analytics, machine learning, and AI workloads.
• Databricks Certification (Associate/Professional) is a plus.

What We're Looking For

• Strong problem‑solving and analytical mindset.
• Ability to work in a fast‑paced, client‑facing environment.
• Passion for building reliable, scalable, and high‑performance data solutions.