Databricks Data Engineer

Hitachisolutions

Pune District

On-site

INR 2,500,000 - 4,000,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Hitachisolutions in Pune, Maharashtra, India seeks a highly experienced Data Engineer to join our product organization in a full-time role. You will design, develop, and maintain Databricks-based data pipelines and Delta Lake architectures for large-scale analytics.

The ideal candidate has 5+ years in data engineering, strong Python and Spark skills, and hands-on experience with Airflow or similar tools, SQL, and cloud platforms (Azure preferred, AWS/GCP accepted).

Qualifications

  • 5+ years of Data Engineering experience with 4+ years building Databricks data pipelines.
  • Hands-on Python, PySpark, or SparkSQL experience; Scala is a plus.
  • 4+ years of experience with Big Data pipelines or DAG tools (Airflow, Dbt, Data Factory).
  • 4+ years of Spark experience, especially Databricks Spark and Delta Lake.
  • 5+ years of software development experience with Python 3.x, Django/Flask, FastAPI, and SQL/ORM.

Responsibilities

  • Collaborate with engineers to architect and implement complex systems with minimal oversight.
  • Design, develop, and maintain data pipeline products for large-scale analytics.
  • Partner with analytics, data science, and engineering teams to meet data needs.
  • Dedicate time to stay current with evolving data engineering technologies.
  • Enjoy strong independence and contribute to the organization’s technical maturity.

Skills

Databricks
Python
PySpark
SparkSQL
SQL
Cloud platforms (Azure/AWS/GCP)
Scala

Tools

Airflow
Dbt
Data Factory

Job description

Job Description

We are looking for a highly experienced Data Engineer to join our product organization in a full-time role. This position focuses on Big Data systems design and data architecture, with a special emphasis on Spark and Delta/Data Lake technology.In this role, you will help design, develop, enhance, and maintain complex data pipeline and API products that manage business-critical operations and large-scale analytics. We are looking for applicants who demonstrate a capability to learn new concepts quickly and bring a robust background in data engineering or software engineering expertise.

Responsibilities
  • Collaborate: Work collaboratively with other engineers to architect and implement complex systems with minimal oversight, while partnering with team leadership to identify how best to improve and expand platform capabilities.
  • Build & Design: Design, develop, and maintain complex data pipeline products that support business-critical operations and large-scale analytics applications.
  • Support the Team: Partner with analytics, data science, and engineering teams to understand and solve their unique data needs and challenges.
  • Continuous Learning: Dedicate time to staying current with the latest developments in the space and embrace new concepts to keep up with fast-moving data engineering technology.
  • Autonomy: Enjoy a role that offers strong independence and autonomy while contributing to the technical maturity of the organization.
Qualifications & Skills
  • Experience: 5+ years of Data Engineering experience, including 4+ years designing and building Databricks data pipelines is essential. While Azure cloud experience is preferred, we are happy to consider experience with AWS, GCP, or other cloud platforms.
  • Technical Stack: 4+ years of hands-on experience with Python, Pyspark, or SparkSQL is key. Experience with Scala is a plus.
  • 4+ years of experience with Big Data pipelines or DAG Tools (such as Airflow, Dbt, Data Factory, or similar).
  • 4+ years of Spark experience, especially with Databricks Spark and Delta Lake.
  • 4+ years of hands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes.
  • 5+ years of relevant software development experience, including Python 3.x, Django/Flask Frameworks, FastAPI (or other standard industry API), and relational databases (SQL/ORM).
Additional Skills (Great to have)
  • Experience with Microsoft Fabric specifically with Pyspark on Fabric and Fabric Pipelines
  • Experience with conceptual, logical, and/or physical database designs.
  • Strong SQL experience, specifically writing complex, highly optimized queries across large volumes of data.
  • Strong data modeling/profiling capabilities using Kimball/star schema methodology as well as medallion architecture.
  • Professional experience with Kafka, EventHub or other live streaming technologies.
  • Familiarity with database deployment pipelines (e.g., dacpac or similar).
  • Experience with unit testing or data quality frameworks.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Data Engineer
Databricks Data Engineer

Hitachi Solutions • Pune District

On-site
INR 2,500,000 - 4,000,000
Performance bonuses
Regular trainings
Competitive compensation
Databricks - Data Engineer
Databricks - Data Engineer

Tredence Inc. • Bengaluru

On-site
INR 1,500,000 - 2,500,000
Sr. Databricks Engineer
Sr. Databricks Engineer

ExlService Holdings, Inc. • Pune District

Hybrid
INR 3,500,000 - 6,500,000
Databricks data engineer
Databricks data engineer

NYX TECH SOLUTION • Pune District

On-site
INR 1,200,000 - 2,100,000
Databricks Engineer
Databricks Engineer

Infosys • Bengaluru

On-site
INR 2,800,000 - 4,400,000
Databricks Data Engineer
Databricks Data Engineer

Emergys • Pune District

On-site
INR 1,400,000 - 2,100,000
Senior Databricks Engineer
Senior Databricks Engineer

Value Vision • Bengaluru

On-site
INR 4,200,000 - 6,600,000
Data Architect with Databricks
Data Architect with Databricks

Unique Erp Technologies • Hyderabad

On-site
INR 1,800,000 - 4,000,000
Senior Data Brick Engineer
Senior Data Brick Engineer

Zenithive Engineering • Ahmedabad District

On-site
INR 1,200,000 - 2,400,000
Databricks Engineer
Databricks Engineer

Fa Ewjt Saasfaprod1 • Chennai

On-site
INR 3,500,000 - 6,000,000