Walk-in | Data Engineer

CODERS BRAIN

Pune District

Hybrid

INR 2,500,000 - 4,000,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CODERS BRAIN is seeking a Senior Data Engineer in Pune to lead migration of an Oracle-based data warehouse to Databricks on the Allianz Data Platform (ADP). The role focuses on building scalable ETL/ELT pipelines, translating Oracle logic to Databricks, and ensuring data quality for analytics and AI/ML use cases.

The candidate will collaborate with architects and stakeholders, document migration patterns, and ensure best practices are followed for maintainability and reusability.

Qualifications

  • Graduate or Postgraduate in Engineering or a Postgraduate in non-engineering disciplines.
  • Experience of 5-9 years of experience in ITIL process/application support/Deployment activities.
  • Positive attitude, proactively provides solutions.

Responsibilities

  • Analyse the current Oracle data warehouse (including PostgreSQL source feeds and SAS ETLgenerated structures) and design the target model in Databricks.
  • Build and optimise ETL/ELT pipelines in Databricks (Spark SQL, PySpark) to migrate core data warehouse tables and datamarts from Oracle to Databricks.
  • Translate Oracle SQL/PL-SQL logic into Databricks Spark SQL and PySpark, ensuring functional equivalence and performance optimisation.
  • Ensure data quality, performance, and reliability of the new Databricks-based data warehouse, enabling downstream analytics and AI/ML use cases.
  • Collaborate closely with the Enterprise Architect, ADP platform team and business stakeholders to align with architecture, standards, and best practices.
  • Document migration patterns, data models, and operational procedures to support long-term maintainability and reusability.

Skills

Databricks
SQL
Data Warehousing
Spark SQL
PySpark
ETL/ELT
Oracle SQL

Education

Engineering degree
Postgraduate in non-engineering disciplines

Job description

Overall Objectives of job

We are looking for a Senior Data Engineer with strong Databricks, SQL and data warehousing experience to lead the migration of an existing Oracle-based data warehouse to Databricks on the Allianz Data Platform (ADP). Experience with modern data engineering practices and AI-enabling data platforms is highly desirable.

Duties and responsibilities
  • Analyse the current Oracle data warehouse (including PostgreSQL source feeds and SAS ETLgenerated structures) and design the target model in Databricks.
  • Build and optimise ETL/ELT pipelines in Databricks (Spark SQL, PySpark) to migrate core data warehouse tables and datamarts from Oracle to Databricks.
  • Translate Oracle SQL/PL-SQL logic into Databricks Spark SQL and PySpark, ensuring functional equivalence and performance optimisation.
  • Ensure data quality, performance, and reliability of the new Databricks-based data warehouse, enabling downstream analytics and AI/ML use cases.
  • Collaborate closely with the Enterprise Architect, ADP platform team and business stakeholders to align with architecture, standards, and best practices.
  • Document migration patterns, data models, and operational procedures to support long-term maintainability and reusability.
Qualification, Experience, Technical and Functional Skills Must Have
  • Graduate or Postgraduate in Engineering or a Postgraduate in non-engineering disciplines.
  • Experience of 5-9 years of experience in ITIL process/application support/Deployment activities.t.
  • Positive attitude, proactively provides solutions.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Track Lead - Extract Transform Load (ETL), Data Lakes
Track Lead - Extract Transform Load (ETL), Data Lakes

HCLTech • India

On-site
INR 900,000 - 1,400,000
Senior Data Engineer
Senior Data Engineer

Techblocks • Ahmedabad

On-site
INR 1,200,000 - 2,100,000
Sr. Data / Data Solutions Architect - Databricks
Sr. Data / Data Solutions Architect - Databricks

EPAM Systems Inc • Coimbatore District

On-site
INR 3,000,000 - 7,000,000
Senior Data Architect
Senior Data Architect

Tredence Inc. • Bengaluru

On-site
INR 2,400,000 - 4,800,000
Sr. Data / Data Solutions Architect - Databricks
Sr. Data / Data Solutions Architect - Databricks

EPAM Systems • India

On-site
INR 4,000,000 - 7,000,000
Databricks - Data Engineer
Databricks - Data Engineer

Tredence Inc. • Bengaluru

On-site
INR 1,500,000 - 2,500,000
Senior Data Engineer
Senior Data Engineer

Diggibyte Technologies Private Limited • Bengaluru, Ahmedabad District

On-site
INR 1,000,000 - 1,500,000
Databricks (Remote)
Databricks (Remote)

PradeepIt Global Consulting Pvt Ltd. • Bengaluru

Remote
INR 1,200,000 - 1,800,000
Data Engineer - Databricks
Data Engineer - Databricks

Accenture PLC • Bengaluru

On-site
INR 1,500,000 - 2,100,000
Senior Data Architect (Databricks, Azure, AWS)
Senior Data Architect (Databricks, Azure, AWS)

Happiest Minds Technologies • Bengaluru

On-site
INR 4,500,000 - 7,000,000