Lead Data Engineer

Paltech Consulting; Hyderabad; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

Paltech Consulting in Hyderabad, India seeks a senior data architecture professional to architect and scale modern data solutions across cloud platforms, while guiding AI-driven automation and robust data pipelines.

You will lead architectural strategy, oversee hands-on engineering, and mentor senior engineers to align technology with client needs and market trends in a dynamic environment.

Responsibilities

• Architect and scale data solutions (ETL/ELT pipelines, data lakes, warehouses) across cloud platforms like Databricks, Snowflake, BigQuery, and Microsoft Fabric.
• Define standard patterns for integrating operational application layers with analytical data systems.
• Maintain a hybrid approach, staying hands-on with architecture blueprints, system design, prototyping, and code reviews.
• Lead by example with clean code, CI/CD pipelines, containerization (Kubernetes/Docker), and reliable distributed systems.
• Drive production deployment of Agentic AI frameworks, autonomous workflows, and prompt engineering protocols.
• Architect robust Retrieval-Augmented Generation (RAG) pipelines bridging microservices with analytical data stores.
• Mentor, guide, and upskill senior engineers, tech leads, and software architects.
• Collaborate with Practice Owners and business leaders to align engineering with client needs and emerging tech trends.

Job description

ey Responsibilities

1. Architectural Strategy & Design

• Architect and scale modern data solutions (ETL/ELT pipelines, data lakes, and data warehouses) across multiple major cloud platforms like Databricks, Snowflake, BigQuery, or Microsoft Fabric.


• Define standard patterns for integrating operational application layers with analytical data systems seamlessly.

2. Hands-on Execution & Engineering Excellence

• Maintain a hybrid approach by remaining hands-on with architecture blueprints, system design, prototyping, and high-impact code reviews.


• Lead by example to champion clean code, robust CI/CD pipelines, containerization (Kubernetes/Docker), and reliable distributed systems.


• Troubleshoot complex architectural bottlenecks across application and data layers.

3. AI & Intelligent Automation

• Drive the production deployment of Agentic AI frameworks, autonomous workflows, and sophisticated prompt engineering protocols.


• Architect robust Retrieval-Augmented Generation (RAG) pipelines that bridge enterprise application microservices with large-scale analytical data stores safely and securely.

4. Technical Leadership & Calibration

• Mentor, guide, and upskill senior engineers, tech leads, and software architects.


• Collaborate closely with Practice Owners and Business Leaders to align engineering capabilities with client demands and emerging technology trends.