Data Engineer (Databricks)

Bridgenext; Pune District; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Bridgenext seeks a motivated Software Developer to design, build, and maintain data pipelines and cloud data solutions on Databricks. This role fits an engineer with Spark and Python experience who wants to grow in modern data engineering under senior engineers.

Responsibilities include building pipelines with Databricks and Spark, writing PySpark/SQL, maintaining notebooks and jobs, and applying Delta Lake best practices for reliable storage.

Qualifications

• 4-6 years of experience in software or data engineering, ideally with cloud environments.
• Hands-on experience with Databricks platform, notebooks, jobs, and Delta Lake concepts.
• Proficiency in Python and SQL; understanding of data warehousing concepts.

Responsibilities

• Develop, test, and maintain data pipelines using Databricks and Spark under guidance of senior engineers
• Write clean PySpark and SQL code for ingestion, transformation, and loading tasks
• Build and maintain Databricks notebooks and jobs for data processing workflows
• Assist with Delta Lake best practices for reliable data storage
• Participate in code reviews and improve code quality and performance
• Support troubleshooting and resolution of data pipeline issues
• Help implement basic monitoring and logging for pipelines
• Collaborate with data engineers, product managers, and other developers on tasks
• Continuously learn and apply Databricks features such as Delta Live Tables and SQL Analytics

Skills

Databricks

Apache Spark

Python

SQL

Data engineering

CI/CD

Airflow

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Git

Airflow

Databricks Workflows

Job description

Company Overview

At Bridgenext, we engineer Growth Operating Systems. Most enterprises have spent millions on their revenue stack and still aren't seeing the growth they expected. They have tools that function, but no system that wins. We help growth-hungry companies close that gap by turning fragmented platforms, siloed teams, and disconnected data into one integrated Growth OS. More than a technology company or marketing agency, we're a global digital consultancy with experts in engineering, data, AI, creative and more.

Our teams are made up of experts who believe in engineering impact, starting with putting people at the center of everything we do. Every team member directly shapes our work, culture, and values. Nothing matters more to us than a kind, respectful, fulfilling environment that supports everyone. Our flexible, inclusive culture gives you the autonomy, resources, and opportunities to thrive.

Position Description

We are seeking a motivated Software Developer to help design, build, and maintain data pipelines and cloud-based data solutions on the Databricks platform. This role is a great fit for an engineer who has hands-on experience with Spark and Python and is looking to grow their expertise in modern data engineering practices, working under the guidance of senior engineers.

Key Responsibilities:

• Develop, test, and maintain data pipelines using Databricks and Spark under the guidance of senior engineers
• Write clean, efficient PySpark and SQL code for data ingestion, transformation, and loading tasks
• Build and maintain Databricks notebooks and jobs for routine data processing workflows
• Assist with implementing and following Delta Lake best practices for reliable data storage
• Participate in code reviews and incorporate feedback to improve code quality and performance
• Support the troubleshooting and resolution of data pipeline issues
• Help implement basic monitoring and logging for data pipelines
• Collaborate with data engineers, product managers, and other developers on assigned tasks
• Continuously learn and apply Databricks features such as Delta Live Tables and SQL Analytics

Must Have Skills:

• 4-6 years of experience in software or data engineering, ideally including exposure to cloud-based environments
• Hands-on experience working with the Databricks platform, including notebooks, jobs, and basic Delta Lake concepts
• Working knowledge of Apache Spark fundamentals and PySpark
• Proficiency in Python and SQL
• Basic understanding of data warehousing concepts and common data storage formats (Parquet, JSON, CSV)
• Some exposure to a major cloud platform (AWS, Azure, or GCP)
• Experience with version control systems (Git)
• Willingness to learn CI/CD practices and workflow orchestration tools (e.g., Airflow, Databricks Workflows)
• Good problem-solving and analytical skills

Education:

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field

Preferred Skills:

• Databricks Certified Data Engineer Associate certification
• Exposure to streaming technologies such as Kafka or Kinesis
• Familiarity with Airflow or similar orchestration tools

Professional Skills:

• Solid written, verbal, and presentation communication skills
• Strong team and individual player
• Maintains composure during all types of situations and is collaborative by nature
• High standards of professionalism, consistently producing high quality results
• Self-sufficient, independent requiring very little supervision or intervention
• Demonstrate flexibility and openness to bring creative solutions to address issues

Bridgenext is an Equal Opportunity Employer