Azure Databricks, Genie

Infosys; Maharashtra; On-site; INR 1,600,000 - 2,400,000; Full time

Job summary

Infosys is seeking a senior data engineering professional to lead end-to-end data solutions on Azure Databricks using Genie. The role requires ownership of production-grade delivery and mentorship to ensure high engineering standards across the team.

The candidate will design scalable data pipelines, optimize performance, and drive cost efficiency while maintaining data quality and reliability across multiple use cases.

Qualifications

• 5–8 years of experience in data engineering/analytics engineering with production-grade delivery.
• Strong hands-on experience with Azure Databricks and Genie.
• Solid Databricks development and operationalization (jobs, workflows, notebooks).
• Ability to lead technical discussions, perform reviews, and guide implementation best practices.
• Education: BTech, MTech, MCA, MSc.

Responsibilities

• Lead end-to-end implementation of data engineering solutions on Azure Databricks.
• Drive technical design discussions and translate business requirements into Databricks/Genie-based solutions.
• Provide technical guidance, code reviews, and mentorship to ensure engineering standards across the team.
• Build and optimize notebooks, jobs, and workflows leveraging Azure Databricks and Genie capabilities.
• Develop reusable components and patterns to accelerate delivery across use cases.
• Troubleshoot production issues, perform root-cause analysis, and implement preventive improvements.
• Establish monitoring and operational practices for pipeline health, failures, and SLAs.
• Ensure data quality checks and validation steps are embedded into pipelines and workflows.

Skills

Azure Databricks

Genie

Leadership

Data workflows

Notebooks

Performance tuning

Cost optimization

Mentoring

Code reviews

Education

B.Tech/M.Tech/MCA/MSc

Tools

Databricks

Genie

Job description

• Primary skills: Azure Databricks, Genie
  

Key Responsibilities: Solution Delivery & Leadership

• Lead end-to-end implementation of data engineering solutions on Azure Databricks, ensuring scalability, reliability, and maintainability.
• Drive technical design discussions and translate business requirements into well-structured Databricks/Genie-based solutions.
• Provide technical guidance, code reviews, and mentorship to ensure consistent engineering standards across the team. Databricks & Genie Development
• Build and optimize notebooks, jobs, and workflows leveraging Azure Databricks and Genie capabilities.
• Develop reusable components and patterns to accelerate delivery across multiple use cases.
• Troubleshoot production issues, perform root‑cause analysis, and implement preventive improvements. Performance, Quality & Operations
• Optimize cluster configurations, job performance, and resource usage to balance speed and cost.
• Establish monitoring and operational practices for pipeline health, failures, and SLAs.
• Ensure data quality checks and validation steps are embedded into pipelines and workflows. Minimum Qualifications:
• 5–8 years of overall experience in data engineering / analytics engineering roles with ownership of production‑grade delivery.
• Strong hands‑on experience with Azure Databricks and Genie for building and managing data workflows.
• Solid experience with Databricks development and operationalization (jobs, workflows, notebooks).
• Ability to lead technical discussions, perform reviews, and guide implementation best practices.
• Education: BTECH, MTECH, MCA, MSC. Preferred Qualifications:
• Experience designing scalable data processing patterns and reusable frameworks within Databricks environments.
• Proven track record of performance tuning and cost optimization for Databricks workloads in enterprise settings.
• Experience establishing engineering standards (branching, reviews, release practices) and mentoring team members.
• Strong stakeholder management skills with the ability to align technical delivery to business outcomes.
• Exposure to production support models, incident handling, and continuous improvement for data platforms.