Senior Databricks Engineer

Codvo Private Limited; Pune District; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

Codvo Private Limited is looking for a Full-Stack Data Engineer specializing in Data & ML Automation in Pune, Maharashtra. The role focuses on developing automation tools, implementing data and ML workflows, and creating dashboards and internal applications using modern frameworks. Ideal candidates will have experience with Databricks APIs, Terraform, and CI/CD workflows. This position offers an opportunity to work in a dynamic environment that values innovation and engineering best practices.

Qualifications

• Experience with Databricks APIs and automation of data workflows.
• Ability to build and implement testing frameworks.
• Proficiency in developing quick internal applications using modern frameworks.

Responsibilities

• Develop CLI tools to automate workflows.
• Automate Databricks workflows and MLOps operations.
• Design integration tests and validation frameworks.

Skills

CLI tooling

Automation

Data workflows

Web interfaces

React

Tools

Databricks SDK

Terraform

Job description

Data & ML Automation (Databricks) (Pune)

Pune, Maharashtra

Work Type: Full Time

Job Title: Full-Stack Data Engineer – Data & ML Automation (Databricks)

Overview

We are seeking a Fullstack Data Engineer who can operate at the intersection of data engineering, fullstack development, and testing/automation. This role will focus on building internal automation tooling, validating data and ML workflows, and developing lightweight web interfaces or dashboards that help teams interact with data and model outputs more effectively. The ideal candidate is a versatile engineer who can seamlessly switch between CLI tooling, pipeline testing, backend glue code, and rapid visualization apps.

Key Responsibilities

Automation & Tooling

• Develop CLI tools, scripts, and utilities to automate repetitive workflows across the data platform, including:
  • Pipeline execution
  • Governance and metadata synchronization
  • Environment setup
  • Test harness creation
• Automate Databricks workflows, job deployments, environment provisioning, and MLOps operations using:
  • Databricks APIs
  • Terraform
  • Databricks SDK

Data & ML Workflow Testing

• Design and implement:
  • Integration tests
  • End‑to‑end pipeline tests
  • Validation frameworks for Databricks ETL/ELT pipelines and ML inference workflows
• Improve reliability, observability, and overall engineering productivity across the data & ML team.

Internal Tools & Dashboards

• Build quick internal applications using React, Streamlit, or similar frameworks to:
  • Visualize data flows
  • Provide model inference demos
  • Enable operational or configuration controls
• Develop internal productivity and monitoring dashboards

Engineering Practices

• Apply best practices around:
  • Spec‑driven development
  • Coding agents and automation patterns
  • CI/CD workflows for data/ML systems

Nice‑to‑Have Skills

• Experience creating dashboards and visualizations using Databricks AI/BI or any modern BI tool (Power BI, Tableau, Looker, etc.)