Senior Azure Data Engineer

Affine Analytics; Hyderabad, Gurugram District, Bengaluru; Hybrid; INR 4,000,000 - 6,000,000; Full time

Job summary

Affine Analytics in Hyderabad/Bangalore/Gurgaon seeks a Senior Data Engineer to lead data engineering efforts and mentor the team, shaping robust data solutions for AI and analytics.

You will collaborate with business stakeholders, design scalable pipelines, and drive DevOps practices while ensuring secure, governance-ready architectures across cloud data platforms.

Qualifications

• 8+ years of Data & Analytics experience with 5+ years hands-on with Azure data engineering technologies.
• 5+ years of experience leading data engineering teams or similar technical roles.
• Strong hands-on experience with Python, SQL, and PySpark.
• Strong understanding of Databricks Unity Catalog for data governance and security, along with CI/CD using DevOps.
• Experience in designing scalable, secure data architectures and building AI-ready data platforms.
• Proven ability to work with business and technical stakeholders to gather requirements and translate them into high-impact data solutions.
• Strong sense of ownership, accountability, and execution discipline across multiple initiatives.
• Excellent communication skills, with the ability to handle high-impact business stakeholder interactions effectively.

Responsibilities

• Partner closely with business to understand problems, shape requirements, and define data solutions with clear outcomes.
• Lead and mentor the data engineering team, driving engineering best practices and delivery excellence.
• Provide technical leadership across architecture, development, troubleshooting, and delivery to drive execution speed and quality.
• Collaborate with Data Architects, Data Scientists, and Product Owners to enable business adoption of AI and advanced analytics-driven decision making.
• Drive innovation and continuous improvement by challenging existing processes and proposing new solutions.
• Maintain and evolve the data platform for business reporting and AI workloads.
• Partner with Data Product Owners to define clear technical designs and execution plans aligned with business outcomes.
• Design and maintain scalable data ingestion frameworks supporting both batch and streaming use cases.

Skills

Python

SQL

PySpark

Azure data engineering

Databricks Unity Catalog

CI/CD / DevOps

Data architecture

Leadership

Tools

Databricks

CI/CD Tools

Job description

Title: Senior Data Engineer

Exp: 10+ Years

Location: Hyderabad/Bangalore/Gurgaon

Responsibilities:

1.Partner closely with business to understand problems, shape requirements, and define data solutions with clear outcomes.

2.Lead and mentor the data engineering team, driving engineering best practices and delivery excellence.

3.Provide technical leadership across architecture, development, troubleshooting, and delivery to drive execution speed and quality.

4.Collaborate with Data Architects, Data Scientists, and Product Owners to enable business adoption of AI and advanced analyticsdriven decision making.

5.Drive innovation and continuous improvement by challenging existing processes and proposing new solutions.

6.Maintain and evolve the data platform for business reporting and AI workloads.

7.Partner with Data Product Owners to define clear technical designs and execution plans aligned with business outcomes.

8.Design and maintain scalable data ingestion frameworks supporting both batch and streaming use cases.

Experience & Skills:

1. 8+ years of experience in Data & Analytics, including 5+ years of hands‑on experience with Azure data engineering technologies.

2. 5+ years of experience leading data engineering teams or similar technical roles.

3. Strong hands‑on experience with Python, SQL, and PySpark.

4. Strong understanding of Databricks Unity Catalog for data governance and security, along with CI/CD using DevOps.

5. Experience in designing scalable, secure data architectures and building AI‑ready data platforms.

6. Proven ability to work with business and technical stakeholders to gather requirements and translate them into high‑impact data solutions.

7. Strong sense of ownership, accountability, and execution discipline across multiple initiatives.

8. Excellent communication skills, with the ability to handle high‑impact business stakeholder interactions effectively.

Regards
Jecintha