Data Engineer (Databricks)

Bridgenext; Pune District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Bridgenext, a digital consulting services leader, is seeking a Software Developer to design, build, and maintain cloud-based data solutions on the Databricks platform in Pune.

You'll work with Spark, PySpark, Python, and SQL to create robust data pipelines, follow Delta Lake best practices, and collaborate with product managers and other engineers to deliver scalable data services for clients.

Qualifications

• Bachelor's degree in CS/Engineering or related field.
• 4–6 years in software or data engineering.
• Hands-on Databricks, Spark, PySpark experience.
• Proficiency in Python and SQL.
• Exposure to cloud platforms (AWS/Azure/GCP).
• Experience with Git.
• Willingness to learn CI/CD and Airflow.
• Strong problem-solving and analytical skills.

Responsibilities

• Develop, test, and maintain data pipelines using Databricks and Spark under supervision.
• Write clean PySpark and SQL for ingestion, transformation, and loading tasks.
• Build and maintain Databricks notebooks and jobs for data processing workflows.
• Implement Delta Lake best practices for reliable data storage.
• Participate in code reviews and incorporate feedback to improve quality.
• Troubleshoot and resolve data pipeline issues.
• Help implement monitoring and logging for data pipelines.
• Collaborate with data engineers, product managers, and other developers on tasks.
• Continuously learn and apply Databricks features like Delta Live Tables and SQL Analytics.

Skills

Databricks platform

PySpark

Python

SQL

Spark fundamentals

Cloud exposure

Git

CI/CD basics

Data warehousing concepts

Education

Bachelor's degree in CS/Engineering

Tools

Databricks notebooks

Databricks jobs

Delta Lake

Airflow

Job description

Company Overview

Bridgenext is a digital consulting services leader that helps clients innovate with intention and realize their digital aspirations by creating digital products, experiences, and solutions around what real people need. Our global consulting and delivery teams facilitate highly strategic digital initiatives through digital product engineering, automation, data engineering, and infrastructure modernization services, while elevating brands through digital experience, creative content, and customer data analytics services.

Company Overview

Bridgenext is a digital consulting services leader that helps clients innovate with intention and realize their digital aspirations by creating digital products, experiences, and solutions around what real people need. Our global consulting and delivery teams facilitate highly strategic digital initiatives through digital product engineering, automation, data engineering, and infrastructure modernization services, while elevating brands through digital experience, creative content, and customer data analytics services.

Don't just work, thrive. At Bridgenext, you have an opportunity to make a real difference - driving tangible business value for clients, while simultaneously propelling your own career growth. Our flexible and inclusive work culture provides you with the autonomy, resources, and opportunities to succeed.

Position Description

We are seeking a motivated Software Developer to help design, build, and maintain data pipelines and cloud-based data solutions on the Databricks platform. This role is a great fit for an engineer who has hands‑on experience with Spark and Python and is looking to grow their expertise in modern data engineering practices, working under the guidance of senior engineers.

Key Responsibilities

• Develop, test, and maintain data pipelines using Databricks and Spark under the guidance of senior engineers
• Write clean, efficient PySpark and SQL code for data ingestion, transformation, and loading tasks
• Build and maintain Databricks notebooks and jobs for routine data processing workflows
• Assist with implementing and following Delta Lake best practices for reliable data storage
• Participate in code reviews and incorporate feedback to improve code quality and performance
• Support the troubleshooting and resolution of data pipeline issues
• Help implement basic monitoring and logging for data pipelines
• Collaborate with data engineers, product managers, and other developers on assigned tasks
• Continuously learn and apply Databricks features such as Delta Live Tables and SQL Analytics

Must-Have Skills

• 4-6 years of experience in software or data engineering, ideally including exposure to cloud-based environments
• Hands‑on experience working with the Databricks platform, including notebooks, jobs, and basic Delta Lake concepts
• Working knowledge of Apache Spark fundamentals and PySpark
• Proficiency in Python and SQL
• Basic understanding of data warehousing concepts and common data storage formats (Parquet, JSON, CSV)
• Some exposure to a major cloud platform (AWS, Azure, or GCP)
• Experience with version control systems (Git)
• Willingness to learn CI/CD practices and workflow orchestration tools (e.g., Airflow, Databricks Workflows)
• Good problem‑solving and analytical skills

Education

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field

Preferred Skills

• Databricks Certified Data Engineer Associate certification
• Exposure to streaming technologies such as Kafka or Kinesis
• Familiarity with Airflow or similar orchestration tools

Professional Skills

• Solid written, verbal, and presentation communication skills
• Strong team and individual player
• Maintains composure during all types of situations and is collaborative by nature
• High standards of professionalism, consistently producing high quality results
• Self-sufficient, independent, requiring little supervision or intervention
• Demonstrates flexibility and openness to bring creative solutions to address issues

Bridgenext is an Equal Opportunity Employer