Data Engineer Qnity

Affine Analytics; Hyderabad, Bengaluru; On-site; INR 450,000 - 600,000; Full time

Job summary

Affine Analytics in Hyderabad, India, seeks an experienced Data & Analytics leader to drive data solutions and mentor the engineering team. You will shape requirements, deliver scalable AI-enabled data platforms, and ensure governance and security across the stack.

You will collaborate with data architects, scientists, and product owners to enable business adoption of analytics and drive delivery excellence through ownership and accountability.

Qualifications

• 8 years of experience in Data & Analytics with hands-on Azure data engineering experience.
• Hands-on experience with Python, SQL and PySpark.
• Strong understanding of Databricks Unity Catalog for data governance and security, plus CI/CD using DevOps.
• Experience in designing scalable, secure data architectures and AI-ready data platforms.
• Proven ability to translate business and technical needs into high-impact data solutions.
• Strong ownership, accountability, and execution discipline across multiple initiatives.
• Excellent communication skills for high-impact stakeholder interactions.

Responsibilities

• Partner with business to understand problems, shape requirements, and define data solutions with clear outcomes.
• Lead and mentor the data engineering team, driving engineering best practices and delivery excellence.
• Provide technical leadership across architecture, development, troubleshooting, and delivery to drive speed and quality.
• Collaborate with Data Architects, Data Scientists, and Product Owners to enable AI-driven decision making.
• Drive innovation and continuous improvement by challenging processes and proposing new solutions.
• Maintain and evolve the data platform for business reporting and AI workloads.
• Partner with Data Product Owners to define designs and execution plans aligned with outcomes.
• Design and maintain scalable data ingestion frameworks for batch and streaming use cases.

Skills

Azure data engineering

Python

SQL

PySpark

Databricks Unity Catalog

DevOps CI/CD

Data architecture

Stakeholder communication

Tools

Azure DevOps

Job description

Responsibilities:

• Partner closely with business to understand problems, shape requirements, and define data solutions with clear outcomes.
• Lead and mentor the data engineering team, driving engineering best practices and delivery excellence.
• Provide technical leadership across architecture, development, troubleshooting, and delivery to drive execution speed and quality.
• Collaborate with Data Architects, Data Scientists, and Product Owners to enable business adoption of AI and advanced analyticsdriven decision making.
• Drive innovation and continuous improvement by challenging existing processes and proposing new solutions.
• Maintain and evolve the data platform for business reporting and AI workloads.
• Partner with Data Product Owners to define clear technical designs and execution plans aligned with business outcomes.
• Design and maintain scalable data ingestion frameworks supporting both batch and streaming use cases.

Experience & Skills:

• 8 years of experience in Data & Analytics, including hands‑on experience with Azure data engineering technologies.
• Strong hands‑on experience with Python, SQL, and PySpark.
• Strong understanding of Databricks Unity Catalog for data governance and security, along with CI/CD using DevOps.
• Experience in designing scalable, secure data architectures and building AI‑ready data platforms.
• Proven ability to work with business and technical stakeholders to gather requirements and translate them into high‑impact data solutions.
• Strong sense of ownership, accountability, and execution discipline across multiple initiatives.
• Excellent communication skills, with the ability to handle high‑impact business stakeholder interactions effectively.

SKILLS AND EXPERTISE

Mandatory Skillset:

• Recent 5+ years of experience in Azure services/tools
• Python
• SQL
• PySpark.
• DatabricksUnity Catalog for data governance and security
• Strong sense of ownership, accountability, and execution discipline across multiple initiatives.