Senior Data Engineer
Antal International
A complete application in a minute — tailored resume and cover letter, ready to send.
Job summary
Qualifications
- 10+ years designing and delivering enterprise data & analytics platforms.
- Proven expertise in Azure Databricks and Delta Lake architectures.
- Strong experience in modernizing legacy EDW environments.
Responsibilities
- Design and govern enterprise-scale cloud data platforms.
- Lead the migration of legacy Enterprise Data Warehouses to Azure.
- Provide technical leadership and mentoring to a team of data engineers.
Skills
Education
Tools
Job description
Are you a visionary cloud data architect ready to shape the future of enterprise analytics? We’re seeking a passionate Lead Engineer – Azure Databricks to join our high-impact Business Analytics/BI team as a senior technical leader. This is a career-defining opportunity to architect scalable, secure, and high-performance cloud data platforms that power reporting, advanced analytics, and AI/ML innovation across the organization.
In this strategic role, you will own the end-to-end cloud data architecture strategy, drive our analytics modernization journey, and lead the migration of legacy Enterprise Data Warehouses to a modern Azure Databricks Lakehouse ecosystem. You’ll partner closely with IT leadership, business stakeholders, and analytics teams to deliver best-in-class, governed data solutions that accelerate insights and business value.
Exp: 9 to 13 years
Location: Gurugram
Shift: 2-11pm
- Design and govern enterprise-scale cloud data platforms (data lakes, Lakehouse, and cloud data warehouses) supporting BI/EDW, analytics, and AI/ML workloads
- Architect and implement Databricks Lakehouse solutions using Delta Lake and Medallion (Bronze/Silver/Gold) patterns
- Lead the full lifecycle of legacy EDW migration to Azure, including phased strategies, data refactoring, and seamless integration with enterprise systems
- Establish architecture standards, best practices, CI/CD pipelines, and data governance frameworks (Unity Catalog, RBAC, encryption)
- Provide day-to-day technical leadership, mentoring, and prioritization to a team of data engineers and vendor partners
- Deliver high-performance batch and real-time ingestion pipelines using PySpark, SQL, Databricks Workflows, Delta Live Tables, and Structured Streaming
- Optimize cost, performance, and reliability while enabling self-service analytics and trusted data products for BI teams
- 10+ years designing and delivering enterprise data & analytics platforms, with proven hands-on expertise in Azure Databricks, Delta Lake, and Lakehouse architectures
- Advanced proficiency in SQL, Python, PySpark, Spark SQL, and modern cloud data services
- Strong experience modernizing legacy EDW environments and building governed, scalable data platforms
- Demonstrated leadership in architecture reviews, design discussions, and guiding cross-functional teams
- Solid understanding of data governance, security, compliance, and quality frameworks
- Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field
- Experience with SAP ERP analytics integration (S/4HANA or ECC) is a strong asset; familiarity with Power BI/Tableau and Microsoft Fabric is a plus
- Bonus: Exposure to AI/ML-ready data platforms or Agentic AI concepts
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
