Data Engineer- Databricks

Annalect, Omnicom Media Group India Private Limited.

Hyderabad

On-site

INR 1,200,000 - 2,000,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Annalect, Omnicom Media Group India Private Limited. is seeking a Data Engineer in Hyderabad to build and test Databricks pipelines, covering ingestion, transformation and gold-layer modeling.

You will work with PySpark/SQL, Delta Lake, and collaborate in an agile team to deliver data products with strong quality checks and security practices. The role emphasizes rapid growth in a data-driven environment, with careful attention to data governance and documentation.

Qualifications

  • 2-4 years of data engineering experience, including hands-on work with Spark/PySpark and SQL.
  • Hands-on Databricks experience (Delta Lake, notebooks, jobs/workflows).
  • Working understanding of data warehousing/lakehouse concepts (Bronze/Silver/Gold or comparable layered modeling).
  • Experience working in an agile team with daily standups and sprint-based delivery.
  • Strong written and verbal English communication skills.

Responsibilities

  • Build and test Databricks pipelines (PySpark/SQL, Delta Lake) for ingestion, transformation, and modeling tasks assigned during sprint planning.
  • Write and maintain data quality checks and tests for pipelines built.
  • Participate in daily standups, reporting progress accurately, asking questions when requirements are unclear, and flagging blockers promptly.
  • Follow the platform's data security model (RLS/CLS) and coding/documentation standards set by the Lead and Senior Engineers.
  • Support integration testing and reconciliation checks for Boomi-based data flows (e.g., JDE-Concur, JDE-UKG) as assigned.
  • Apply feedback from code reviews to subsequent work.
  • Document pipelines clearly enough for another engineer to assume ownership.

Skills

Data engineering
Spark/PySpark
SQL
Databricks
Delta Lake
Agile/Scrum
English communication

Tools

Boomi
JDE
Power BI
Unity Catalog

Job description

Overview

The Data Engineer builds and tests data pipelines in Databricks, covering ingestion, transformation, and Gold-layer modeling, against tasks assigned by the Lead Engineer at the start of each sprint and refined daily. This role suits an early-to-mid career engineer seeking rapid growth. The Data Engineer is expected to ask questions when requirements are unclear and to raise blockers promptly rather than delay progress.

Responsibilities
  • Build and test Databricks pipelines (PySpark/SQL, Delta Lake) for ingestion, transformation, and modeling tasks assigned during sprint planning.
  • Write and maintain data quality checks and tests for pipelines built.
  • Participate in daily standups, reporting progress accurately, asking questions when requirements are unclear, and flagging blockers promptly.
  • Follow the platform's data security model (RLS/CLS) and coding/documentation standards set by the Lead and Senior Engineers.
  • Support integration testing and reconciliation checks for Boomi-based data flows (e.g., JDE-Concur, JDE-UKG) as assigned.
  • Apply feedback from code reviews to subsequent work.
  • Document pipelines clearly enough for another engineer to assume ownership.
Qualifications

Required Qualifications

  • 2-4 years of data engineering experience, including hands-on work with Spark/PySpark and SQL.
  • Hands-on Databricks experience (Delta Lake, notebooks, jobs/workflows).
  • Working understanding of data warehousing/lakehouse concepts (Bronze/Silver/Gold or comparable layered modeling).
  • Experience working in an agile team with daily standups and sprint-based delivery.
  • Strong written and verbal English communication skills.

Preferred Qualifications

  • Databricks Certified Data Engineer Associate.
  • Exposure to financial or ERP source data - JD Edwards (JDE), EcoSys, or Microsoft Dynamics - or general ledger/cost data.
  • Exposure to an EPC, construction, energy, or other asset-heavy industry.
  • Familiarity with Unity Catalog-based security (RLS/CLS) or Power BI/Genie reporting on governed data.
  • Exposure to Boomi or another iPaaS/integration middleware platform.

Professional Attributes:

  • Asks questions early when a task is unclear rather than proceeding on assumptions.
  • Demonstrates visible progress daily rather than only at sprint boundaries.
  • Applies feedback from the Lead and Senior Engineers quickly and consistently.
  • Seeks increasing ownership and more complex problems over time.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer- Databricks
Data Engineer- Databricks

Omnicomglobalsolutions • Hyderabad

On-site
INR 900,000 - 1,500,000
Databricks Data Engineer
Databricks Data Engineer

Emergys • Pune District

On-site
INR 1,400,000 - 2,100,000
Senior Data Engineer
Senior Data Engineer

CoffeeBeans • Bengaluru

On-site
INR 1,800,000 - 2,400,000
Data Engineer
Data Engineer

Calidad Infotech • Ahmedabad

On-site
INR 1,600,000 - 2,400,000
Databricks data engineer
Databricks data engineer

NYX TECH SOLUTION • Pune District

On-site
INR 1,200,000 - 2,100,000
Senior Data Engineer
Senior Data Engineer

Amgen Technology • Hyderabad

Hybrid
INR 2,500,000 - 4,000,000
Databricks Data Engineer
Databricks Data Engineer

Infosys • Pune District, Bengaluru

On-site
INR 900,000 - 1,400,000
Senior Data Engineer
Senior Data Engineer

Coffeebeans Consulting • Bengaluru

On-site
INR 3,000,000 - 6,000,000
Technical Data Engineer -Databricks
Technical Data Engineer -Databricks

ShyftLabs • Coimbatore

On-site
INR 900,000 - 1,500,000
Insurance package
Data Architect with Databricks
Data Architect with Databricks

Unique Erp Technologies • Hyderabad

On-site
INR 1,800,000 - 4,000,000