Senior Data Engineer (Databricks)

Codvo.ai; Pune District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Codvo.ai is seeking a Senior Data Engineer (Databricks) located in Pune District, Maharashtra. The ideal candidate will have 4-8 years of experience building scalable data pipelines on the Databricks platform and optimizing data workflows. This role involves collaborating with cross-functional teams to deliver data-driven solutions.

Key responsibilities include developing ETL pipelines, managing data governance, and integrating AWS data services. Strong skills in Python and Databricks are essential. Candidates should also be proficient in data lake and lakehouse architecture.

Qualifications

• 4-8+ years of experience in data engineering, particularly using Databricks.
• Strong proficiency in Python for ETL pipelines.
• Hands-on experience with Unity Catalog and AWS services.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks and Python.
• Build and optimize ETL workflows for both structured and unstructured data.
• Collaborate with cross-functional teams to deliver high-quality data solutions.

Skills

Databricks platform

Python for data engineering

Unity Catalog

AWS services (S3, IAM, VPC)

Data Lake / Lakehouse architecture

Dashboard building

Job description

Senior Data Engineer (Databricks)

Experience: 4-8+ yrs

About Us

At Codvo, we build scalable, future-ready digital platforms that drive real business impact. We foster a culture of innovation, collaboration, and ownership—where designers work closely with product and engineering teams to deliver high-quality, user‑centered experiences. If you thrive in complex product environments and care deeply about design quality from concept to production, this role is for you.

About the Role

We are looking for a Senior Data Engineer with strong expertise in Databricks and modern data platforms. The ideal candidate will be responsible for building scalable data pipelines, optimizing data workflows, and enabling data-driven decision-making across the organization.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks and Python
• Build and optimize ETL workflows for structured and unstructured data
• Work with Databricks Lakehouse architecture and implement best practices
• Manage and implement data governance using Unity Catalog
• Integrate AWS data services such as S3, IAM, VPC, and other relevant services
• Collaborate with cross‑functional teams to deliver high‑quality data solutions
• Build dashboards and support data visualization requirements
• Ensure data quality, reliability, and performance optimization

Must‑Have Skills

• Strong experience with Databricks platform
• Proficiency in Python for data engineering and ETL pipelines
• Hands‑on experience with Unity Catalog
• Good knowledge of AWS services (S3, IAM, VPC, Glue/Lambda – preferred)
• Solid understanding of Data Lake / Lakehouse architecture
• Experience in building dashboards and reporting solutions

Nice to Have

• Experience with REST API development (Flask, FastAPI, etc.)
• Knowledge of authentication/authorization (OAuth, API keys, IAM roles)
• Strong query optimization and performance tuning skills
• Experience with PySpark optimization
• Exposure to ML/AI pipelines
• Familiarity with Databricks AI/BI capabilities

Good to Have

• Strong problem‑solving and analytical skills
• Excellent communication and collaboration abilities