Senior Data Engineer – Databricks & SaaS (Software-as-a-Service) Integrations (Pune)

Codvo Private Limited; Pune District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

A technology company is seeking a Senior Data Engineer to design and operate secure data integrations between Databricks and SaaS platforms. The ideal candidate will have extensive experience with Databricks, backend development, and API design. Responsibilities include managing data pipelines, ensuring data quality, and collaborating with various teams to achieve reliable integrations. Candidates should be ready to tackle complex data challenges in a dynamic environment.

Qualifications

• Strong experience with Databricks, Apache Spark, and data pipelines.
• Backend development experience in Python, Java, or Scala.
• Experience integrating data platforms with SaaS application backends.

Responsibilities

• Design and implement integrations between Databricks workflows and SaaS backends.
• Enable batch and streaming data flows, event triggers, and API-based communication.
• Troubleshoot pipeline failures and performance bottlenecks.

Skills

Strong experience with Databricks

Backend development (Python, Java, Scala)

Experience with REST APIs

Understanding of enterprise security

Experience with AWS or Azure cloud platforms

Job description

Job Title: Senior Data Engineer – Databricks & SaaS (Software-as-a-Service) Integrations

About Us

At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.

Role Overview

We are seeking a Senior Data Engineer with strong Databricks and backend integration experience to design, build, and operate secure, scalable data integrations between Databricks data pipelines and Software-as-a-Service (SaaS) application platforms. This role focuses on batch and streaming data flows, API-driven integrations, event-based triggers, and enterprise-grade data reliability.

Key Responsibilities

• Design and implement integrations between Databricks workflows and SaaS application backends
• Enable batch and streaming data flows, event triggers, and API-based communication
• Build backend services such as REST APIs, webhooks, and data interfaces
• Implement data quality, validation, monitoring, and observability mechanisms
• Design secure and auditable pipelines including authN, authZ, and RBAC
• Troubleshoot pipeline failures, performance bottlenecks, and data inconsistencies
• Collaborate with application, platform, and data engineering teams

Required Skills & Experience

• Strong experience with Databricks, Apache Spark, and data pipelines
• Backend development experience (Python, Java, or Scala)
• Experience integrating data platforms with SaaS application backends
• Strong knowledge of REST APIs and event-driven architectures
• Experience working with AWS or Azure cloud platforms
• Understanding of enterprise security (authN, authZ, RBAC)
• Experience with spec-driven development and coding agents

Nice to Have

• Event-driven systems using Kafka, SNS, SQS, or similar
• Experience with streaming and real-time data processing
• Exposure to data observability and monitoring tools

What Success Looks Like

• Reliable, secure, and scalable Databricks–SaaS integrations
• High data quality and observability across pipelines
• Well-designed APIs and workflows supporting business growth