Senior Data Engineer

Hitachi Digital Services

Hyderabad, Bengaluru

On-site

INR 1,800,000 - 3,200,000

Full time

8 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Fivetran experience (nice to have)
Prefect for orchestration (nice tohave

Job summary

Hitachi Digital Services in Hyderabad is seeking a senior Data Engineer to lead a data platform team and drive end-to-end data solutions. You will work hands-on with Databricks, DBT, and Azure Data Services to design robust ETL/ELT pipelines.

Collaboration with stakeholders, implementation of data governance and security best practices, and ensuring scalable data warehousing are essential. Proficiency in SQL, Python, and CI/CD automation is required.

Qualifications

  • Strong experience with Databricks (PySpark / Spark SQL).
  • Hands-on expertise in DBT.
  • Expertise in Azure DevOps (Repos, Pipelines, CI/CD).
  • Proficiency in SQL and Python.
  • Experience with Azure Data Services (Data Lake, Data Factory).
  • Strong knowledge of Data warehousing and ETL/ELT concepts.
  • Knowledge of Data governance and security best practices.
  • Design and Leading the team of Data Engineers.
  • Manage stakeholder interactions independently.

Responsibilities

  • Strong experience with Databricks (PySpark / Spark SQL).
  • Hands-on expertise in DBT.
  • Expertise in Azure DevOps (Repos, Pipelines, CI/CD).
  • Proficiency in SQL and Python.
  • Experience with Azure Data Services (Data Lake, Data Factory).
  • Strong knowledge of Data warehousing and ETL/ELT concepts.
  • Knowledge of Data governance and security best practices.
  • Design and Leading the team of Data Engineers.
  • Manage stakeholder interactions independently.

Skills

Databricks
DBT
Azure DevOps
SQL
Python
Azure Data Services
CI/CD
Data warehousing & ETL/ELT concepts

Job description

Required Skills:

Databricks (PySpark / Spark SQL) ,DBT, Azure Devops , SQL, Python , Azure Data Services(ADF) , CI/CD, Data warehousing and ETL/ELT concepts

Role & responsibilities
  • Strong experience with Databricks (PySpark / Spark SQL)
  • Hands-on expertise in DBT
  • Expertise in Azure DevOps (Repos, Pipelines, CI/CD)
  • Proficiency in SQL and Python
  • Experience with Azure Data Services (Data Lake, Data Factory)
  • Strong knowledge of Data warehousing and ETL/ELT concepts
  • Knowledge of Data governance and security best practices
  • Design and Leading the team of Data Engineers
  • Manage stakeholder interactions independently.
Good to Have
  • Experience with Fivetran for data ingestion
  • Experience with Prefect for workflow orchestration
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

CloudBoson • Dadri

On-site
INR 1,800,000 - 3,000,000
Data Engineer-Information Technology
Data Engineer-Information Technology

Emcure Pharmaceuticals Limited • Pune District

On-site
INR 1,400,000 - 2,000,000
Data Engineer - Databricks
Data Engineer - Databricks

Onedatasoftware • Coimbatore District

On-site
INR 1,000,000 - 1,500,000
Data Engineer
Data Engineer

Intact Insurance • India

On-site
INR 1,500,000 - 2,300,000
Data Engg With Databricks - Technical Lead-Data Engg
Data Engg With Databricks - Technical Lead-Data Engg

Birlasoft • Pune District

On-site
INR 1,200,000 - 1,800,000
Senior Data Brick Engineer
Senior Data Brick Engineer

Zenithive Engineering • Ahmedabad District

On-site
INR 1,200,000 - 2,400,000
Senior Data Engineer
Senior Data Engineer

Kanini Software Solutions • Pune District, Chennai, Bengaluru

Hybrid
INR 3,500,000 - 7,000,000
Lead Data Engineer
Lead Data Engineer

Mployee.me • Mumbai

On-site
INR 1,500,000 - 2,100,000
Lead Data Engineer
Lead Data Engineer

IRT Digital Analytics Solutions • Mumbai Suburban

On-site
INR 1,000,000 - 1,500,000
Data Engineer
Data Engineer

Ambiquest Hyderabad • Dadri, Hyderabad, Bengaluru

Hybrid
INR 2,800,000 - 4,600,000