Data Engineer

Datamatics

Bengaluru, Mumbai

Hybrid

INR 900,000 - 1,400,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Datamatics in Bengaluru is seeking a data engineer to design, develop, and maintain scalable data pipelines using Databricks, Delta Lake and PySpark. You will build efficient data transformations with SQL and Spark SQL to support batch and operational processing.

The role emphasizes applying software engineering best practices, reusable code, testing and automation to ensure reliable data delivery across systems.

Qualifications

  • Experience designing scalable data pipelines using Databricks and Delta Lake.
  • Proficiency with SQL and Spark SQL for transformations.
  • Experience with batch and real-time/operational data processing.
  • Advocates software engineering best practices like testing and automation.

Responsibilities

  • Develop and maintain scalable data pipelines.
  • Transform data using SQL/Spark SQL.
  • Support batch and operational data processing requirements.
  • Apply engineering best practices in data delivery.

Skills

Databricks
Delta Lake
PySpark
SQL
Spark SQL
Data pipelines

Tools

Databricks
Delta Lake
PySpark

Job description

  • Design, develop and maintain scalable, reliable data pipelines using Databricks, Delta Lake and PySpark.
  • Build efficient and optimised data transformation processes using SQL and Spark SQL.
  • Develop robust data solutions that support both batch and operational data processing requirements.
  • Apply software engineering best practices to data engineering delivery, including reusable code, testing and automation.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - Databricks
Data Engineer - Databricks

PwC • Hyderabad, Pune District, Bengaluru

On-site
INR 1,200,000 - 2,400,000
Data Engineer | PySpark | Databricks | Azure Data Factory
Data Engineer | PySpark | Databricks | Azure Data Factory

Infosys • Hyderabad, Pune District, Bengaluru

Hybrid
INR 1,200,000 - 2,400,000
Data Engineer
Data Engineer

Larsen & Toubro Limited • Bengaluru

On-site
INR 1,500,000 - 2,600,000
Data Engineer
Data Engineer

Qrewz Ventures • Indore

Hybrid
INR 900,000 - 1,500,000
Databricks Engineer
Databricks Engineer

Infosys • Bengaluru

On-site
INR 2,800,000 - 4,400,000
Data Engineer
Data Engineer

Moolya Software Testing • Bengaluru

On-site
INR 1,200,000 - 2,400,000
Databricks Data Engineer
Databricks Data Engineer

Infosys • Pune District, Bengaluru

On-site
INR 900,000 - 1,400,000
Data Engineer+Data Analyst
Data Engineer+Data Analyst

EXL • Maharashtra

On-site
INR 1,200,000 - 1,800,000
Senior Data Brick Engineer
Senior Data Brick Engineer

Zenithive Engineering • Ahmedabad District

On-site
INR 1,200,000 - 2,400,000
Data Engineer_105823
Data Engineer_105823

MyCareernet • Kochi

On-site
INR 900,000 - 1,500,000