Databricks Developer (AWS Databricks Platform & Apps)

i2d consulting; Hyderabad; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

i2d consulting in Hyderabad, India is seeking an experienced Databricks Developer with hands-on experience in Databricks on AWS and Databricks Apps Development to join our data engineering team.

The role focuses on building and deploying Databricks Apps in production, developing scalable ETL/ELT pipelines, and delivering business-facing data applications. Strong Python/SQL skills and a cloud-first mindset are essential.

Qualifications

• Databricks Apps development in production environments
• Databricks on AWS platform experience
• Strong Python and SQL skills
• ETL/ELT pipeline development and data integration
• Experience with data validation and data governance concepts
• Experience with dashboards and data applications

Responsibilities

• Design, develop, and maintain scalable Databricks solutions on AWS
• Develop, deploy, and support Databricks Apps for business users
• Build and optimize Databricks notebooks, workflows, jobs, and Delta Lake tables
• Create scalable ETL/ELT pipelines for product data ingestion and publishing
• Implement monitoring, automation, and performance optimization for Databricks workloads
• Collaborate with data engineers, platform teams, and stakeholders to deliver data applications

Job description

Job Description – Databricks Developer (AWS Databricks Platform & Apps)

We are urgently looking for an experienced Databricks Developer with strong hands‑on experience in Databricks on AWS and, most importantly, Databricks Apps Development.

The customer is specifically seeking candidates who have practical, production‑level experience building and deploying Databricks Apps on the AWS cloud platform. Experience limited to Databricks notebooks, pipelines, or general data engineering alone will not be sufficient.

Key Responsibilities

• Design, develop, and maintain scalable Databricks solutions on AWS.
• Develop, deploy, and support Databricks Apps for business users.
• Build applications for:
• Data validation and enrichment
• Approval and workflow management
• Self‑service data access and operational processes
• Develop and optimise Databricks notebooks, workflows, jobs, and Delta Lake tables.
• Build and maintain scalable ETL/ELT pipelines for product data ingestion, transformation, and publishing.
• Implement monitoring, alerting, automation, and performance optimisation for Databricks workloads.
• Design and implement data quality checks, validation frameworks, and governance controls.
• Create dashboards and visualisations supporting business KPIs and operational reporting.
• Enable self‑service capabilities for teams including Marketing, Product Management, and Data Governance.
• Collaborate with data engineers, platform teams, product teams, and business stakeholders to deliver scalable data applications.

Mandatory Skills & Experience

• Strong hands‑on experience with Databricks Apps development in a production environment.
• Proven experience working with Databricks on AWS Cloud.
• Strong knowledge of the Databricks platform, including:
• Databricks Apps
• Notebooks
• Workflows and Jobs
• Databricks SQL
• Strong programming experience with Python and/or SQL.
• Experience building ETL/ELT and data transformation pipelines.
• Experience integrating Databricks applications with data sources, APIs, and business workflows.
• Experience with data validation, enrichment, approval workflows, and data quality solutions.
• Strong understanding of AWS services and cloud‑based data platforms.
• Experience with monitoring, automation, and performance optimisation of Databricks workloads.

Highly Preferred

• Experience with Unity Catalog and Databricks governance.
• Experience developing dashboards and business‑facing data applications.
• Experience with CI/CD and DevOps practices for Databricks deployments.
• Experience with AWS IAM, security, and cloud networking concepts.
• Experience working in product data, marketing data, master data, or data governance environments.

Candidates should have actual experience in designing, developing, deploying, and supporting business‑facing applications using Databricks Apps, rather than only general Databricks notebook, ETL, or data engineering experience.