Senior Data Engineer

Atcon Global; India; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Atcon Global is seeking an experienced Data Engineer to design, build, and evolve a modern data platform using Databricks on Microsoft Azure. You will work across data ingestion, platform engineering, governance, and Data & AI readiness in collaboration with Cloud, Infrastructure, Security, Networking, Architecture, and Data teams.

The role emphasizes building scalable ingestion frameworks, creating reusable patterns, onboarding new data sources, and improving reliability, observability, and

Qualifications

• Strong hands-on Databricks experience.

Responsibilities

• Design, build, and evolve a modern data platform across ingestion, governance, and Data & AI readiness.

Skills

Databricks

Python/PySpark

SQL

Git

Data engineering best practices

Production-grade pipelines

Cross-functional collaboration

Tools

Azure Data Factory

Databricks

Job description

We are looking for an experienced Data Engineer to help design, build, and evolve a modern data platform based on Databricks and Microsoft Azure.

This is not only a pipeline-development role. You will work across data ingestion, platform engineering, governance, and Data & AI readiness, collaborating with Cloud, Infrastructure, Security, Networking, Architecture, and Data teams.

What you’ll do

Data Ingestion Engineering

• Design, develop, and maintain scalable Databricks ingestion frameworks
• Build and support Azure Data Factory (ADF) pipelines
• Design reusable ingestion patterns for file-based and other data sources
• Onboard new data sources and ingestion patterns
• Improve reliability, observability, performance, and maintainability of data pipelines
• Help define and implement capabilities for a scalable, secure, and governed analytical platform
• Collaborate with Cloud, Infrastructure, Security, Networking, and Enterprise Architecture teams
• Support platform architecture and foundational components for analytics, data products, and AI initiatives
• Define and promote engineering standards, reusable components, and best practices
• Automate platform and data-governance processes where possible
• Evaluate and implement new Databricks capabilities
• Explore and enhance Unity Catalog and data-governance capabilities
• Assess Data Quality Monitoring and data-classification capabilities
• Evaluate data-retention and lifecycle-management approaches
• Prototype new platform, automation, and AI-related capabilities
• Contribute to improving the platform's overall Data & AI readiness

What we look for

• Strong hands-on Databricks experience
• Python / PySpark
• SQL
• Git and modern development practices
• Strong understanding of data engineering best practices
• Experience designing production-grade data pipelines and reusable frameworks
• Ability to collaborate effectively with cross-functional technical teams

Nice to have

• Unity Catalog and Data Governance experience