Sr AI Data Engineer

Techblocks; Hyderabad; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Keka Inc. in Hyderabad, India is seeking a senior Data Engineer with 7+ years of experience to design and optimize data pipelines, governance, and analytics.

You will work with Databricks, PySpark, and SQL across ERP, planning and HR systems, collaborating with business and technical stakeholders to translate requirements into robust data solutions.

The role emphasizes secure data access, ML/AI agent workflows, and enterprise Fabric-based analytics.

Qualifications

• 7+ years of experience in Data Engineering.

Skills

Data Engineering

Databricks

PySpark

Databricks Workflows

Unity Catalog

SQL Development

Dimensional Modeling

Star Schemas

SCD

Data Ingestion Pipelines

Data Transformation Pipelines

ERP Integration

HR Systems Integration

Microsoft Fabric

OneLake

Fabric Lakehouses

LLM/AI Agents (Python)

MCP Servers (Python)

Data Governance

Data Quality

Data Lineage

Stakeholder Communication

LangChain

LangGraph

AI Governance

Databricks Governance

TBM Classification

Tools

Python

Job description

• 7+ years of experience in Data Engineering.
• Minimum 3 years of hands-on experience with Databricks.
• Strong hands-on experience with:
• PySpark
• Databricks Workflows
• Unity Catalog
• Strong SQL development and optimization skills.
• Strong experience in dimensional data modelling and star schemas.
• Hands-on experience with Slowly Changing Dimensions (SCD).
• Experience building production-grade data ingestion and transformation pipelines.
• Experience integrating multiple enterprise source systems, preferably ERP, planning and HR systems.
• Hands-on experience integrating Databricks with Microsoft Fabric.
• Good understanding of:
• Microsoft OneLake
• Fabric Lakehouses
• OneLake shortcuts
• Proven hands-on experience building LLM/AI agents using Python.
• Proven hands-on experience building MCP servers using Python in a real-world project.
• Understanding of secure and governed access for AI agents and tools.
• Strong understanding of data quality, reconciliation, lineage and data governance.
• Ability to work with business and technical stakeholders to translate requirements into data solutions.

Strongly Preferred Skills

• Experience in Finance, FP&A or financial data engineering.
• Strong understanding of:
• GL structures
• Budgets
• Forecasts
• Allocations
• Experience with TBM (Technology Business Management) classification or similar financial classification frameworks.
• Experience building AI-powered data engineering or ingestion solutions.
• Experience with agentic workflows for data mapping, classification and anomaly detection.
• Experience with additional LLM frameworks such as LangChain, LangGraph or similar.
• Experience with enterprise AI governance and secure AI/data access.
• Experience with Databricks data governance and lineage.
• Experience implementing automated data reconciliation and financial controls.
• Experience working with Microsoft Fabric-based enterprise analytics environments.