Data Engineer

embIND Embitel Technologies (India) Private Limited; Bengaluru; On-site; INR 800,000 - 1,200,000; Full time

Benefits offered by this job

Freedom to challenge norms

Collaborative work environment

Opportunities for growth

Job summary

embIND Embitel Technologies (India) Private Limited is seeking a Data Engineer responsible for designing and optimizing data pipelines within the automotive sector. You will build ETL/ELT pipelines using PySpark and Databricks, maintain CI/CD processes, and work with Azure services for data processing.

The ideal candidate has strong experience in Azure data services and proficiency in SQL and Python. Embracing challenges and teamwork is essential in our dynamic work environment.

Qualifications

• Strong experience with PySpark and Databricks for distributed data processing.
• Hands-on expertise in Azure data services like ADLS and ADF.
• Proficiency in SQL, Python, and data modeling.

Responsibilities

• Design, build, and optimize ETL/ELT pipelines for automotive data.
• Implement CI/CD pipelines for automated data workflows.
• Develop interactive Power BI dashboards for real-time analytics.

Skills

PySpark

Databricks

Azure data services

SQL

Python

Power BI

CI/CD processes

Data modeling

Job description

The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and analytics solutions within the automotive domain.

Key Responsibilities

• Design, build, and optimize ETL/ELT pipelines using PySpark and Databricks for large-scale automotive datasets.
• Implement and maintain CI/CD pipelines for automated data workflows.
• Work with Azure Data Lake, Azure Synapse, Azure Data Factory, and Databricks for data ingestion, transformation, and processing.
• Perform statistical analysis, build predictive models, and identify trends in vehicle test drive behavior, environmental conditions, and key performance indicators.
• Develop interactive Power BI dashboards using DAX, KPIs, and real-time analytics for engineering and business stakeholders.
• Collaborate with data scientists, software engineers, and product stakeholders while maintaining clear, structured documentation of data flows and processes.

Required Skills

• Strong experience with PySpark, Databricks, and distributed data processing.
• Hands‑on expertise in Azure data services (ADLS, ADF, Synapse).
• Proficiency in SQL, Python, and data modeling.
• Experience building dashboards in Power BI using DAX.
• Understanding of CI/CD processes and DevOps practices for data engineering.

Preferred Qualifications

• Automotive domain experience.
• Knowledge of machine learning workflows.
• Familiarity with Delta Lake, Unity Catalog, and data governance best practices.

Working with Embitel

• Freedom to challenge norms, make mistakes, learn and grow.
• There is no ‘I’ in the word ‘Team’ and no hierarchy at Embitel.
• Employees of Embitel are partners of our excellence and growth, and they are at the core of our mission and vision.
• Visit us at: www.embitel.com
• Follow us on LinkedIn: https://www.linkedin.com/company/embitel-technologies-india