Data Engineer

Guidehouse; Chennai; On-site; INR 1,100,000 - 2,100,000; Full time

Benefits offered by this job

In‑house physician

Healthy meals at workplace

Employee Assistance Program

Learning & development

Job summary

Guidehouse India is seeking a hands-on Data Engineer to build and maintain data ingestion pipelines and end-to-end Bronze/Silver/Gold transformations on Azure-based platforms. You will collaborate with analytics teams to ensure reliable, reusable datasets and maintain clear documentation.

The role emphasizes CI/CD, data quality validation, and secure development practices, with opportunities to contribute to enterprise AI solutions. Chennai-based, with travel up to 10%.

Qualifications

• Hands-on experience building data ingestion pipelines and transformations.
• Strong SQL skills and Python/PySpark.
• Experience with Azure-based data platforms and Databricks.
• Experience with lakehouse architecture and Bronze/Silver/Gold transformation patterns.
• Proficient in GitHub, CI/CD, testing and environment promotion.
• Ability to document transformations and data lineage.
• Strong problem-solving and collaboration.

Responsibilities

• Build and maintain source ingestion pipelines using approved integration patterns for enterprise applications, databases, APIs, and files.
• Develop and maintain Bronze/Silver/Gold transformations using approved frameworks and reusable engineering practices.
• Implement validation and data-quality controls, including completeness, accuracy, consistency, and reconciliation checks.
• Follow GitHub-based CI/CD, testing, release management, and environment promotion processes.
• Monitor production pipelines, investigate failures, troubleshoot issues, and implement corrective actions.
• Support assigned semantic models, including data preparation, refresh dependencies, and troubleshooting in partnership with Analytics.
• Maintain technical documentation, source-to-target mappings, transformation logic, lineage, operating procedures, and job aids.
• Follow established security, access, naming, and development standards.
• Partner with the Principal Data Platform Architect to ensure engineering deliverables align with approved architecture and platform guardrails.
• Collaborate with business and analytics stakeholders to clarify data requirements and deliver reliable, reusable datasets.

Skills

SQL

Python

PySpark

Azure Databricks

CI/CD

Data Modeling

Data Quality

Tools

Databricks

GitHub

Job description

Job Family:

IT Architecture/Cloud (India)

Travel Required:

Up to 10%

Clearance Required:

None

The Data Engineer will build, maintain, and support data pipelines and transformations that enable reliable analytics, reporting, and AI solutions across the enterprise data platform. The role will focus on data ingestion, Bronze/Silver/Gold transformations, data quality, deployment, production operations, assigned semantic models, and technical documentation.

This is a hands-on data engineering role. The Data Engineer will deliver solutions using approved frameworks, architecture patterns, and standards established by the Principal Data Platform Architect, partnering with platform, analytics, security, and business teams.

Key Responsibilities

• Build and maintain source ingestion pipelines using approved integration patterns for enterprise applications, databases, APIs, and files.
• Develop and maintain Bronze/Silver/Gold transformations using approved frameworks and reusable engineering practices.
• Implement validation and data-quality controls, including completeness, accuracy, consistency, and reconciliation checks.
• Follow GitHub-based CI/CD, testing, release management, and environment promotion processes.
• Monitor production pipelines, investigate failures, troubleshoot issues, and implement corrective actions.
• Support assigned semantic models, including data preparation, refresh dependencies, and troubleshooting in partnership with Analytics.
• Maintain technical documentation, source-to-target mappings, transformation logic, lineage, operating procedures, and job aids.
• Follow established security, access, naming, and development standards.
• Partner with the Principal Data Platform Architect to ensure engineering deliverables align with approved architecture and platform guardrails.
• Collaborate with business and analytics stakeholders to clarify data requirements and deliver reliable, reusable datasets.

Required Experience

• Hands‑on experience building and supporting enterprise data ingestion pipelines and transformations.
• Strong SQL skills and experience with Python, PySpark, or comparable data engineering tools.
• Experience working with Azure‑based data platforms, Databricks, Microsoft Fabric, or comparable technologies.
• Experience implementing lakehouse architecture and Bronze/Silver/Gold transformation patterns.
• Experience integrating data from databases, APIs, files, and enterprise applications.
• Experience implementing data validation, data‑quality controls, and reconciliation processes.
• Experience using GitHub, version control, CI/CD, testing, and environment promotion processes.
• Experience monitoring and troubleshooting production pipelines, including failed jobs, refresh issues, and data discrepancies.
• Ability to support assigned semantic models and their upstream data dependencies.
• Ability to maintain clear technical documentation and follow established security, governance, and development standards.
• Strong problem‑solving, communication, and collaboration skills.

Preferred Experience

• Experience integrating data from Dataverse, Microsoft 365, Power Platform, ADLS Gen2, or Azure SQL.
• Experience with Databricks workflows, Delta Lake, Unity Catalog, Microsoft Fabric pipelines, or OneLake.
• Experience supporting Power BI semantic models.
• Experience with metadata, lineage, and Microsoft Purview or comparable governance tools.
• Experience working in regulated environments and following established compliance controls.
• Microsoft Azure, Databricks, or Microsoft Fabric data engineering certifications.

Success Measures

• Source ingestion pipelines run reliably and meet agreed delivery schedules.
• Bronze/Silver/Gold transformations follow approved frameworks and produce accurate, reusable datasets.
• Data‑quality controls detect issues promptly and support timely resolution.
• Changes follow established GitHub CI/CD, testing, and promotion processes.
• Production pipeline issues are identified, investigated, and resolved within agreed service expectations.
• Assigned semantic models receive reliable data and refresh support.
• Technical documentation, lineage, and job aids remain accurate and current.
• Engineering delivery consistently follows security, access, naming, and development standards.

About Guidehouse India

At Guidehouse India, we’re redefining what’s possible by creating opportunities that change lives. Guidehouse is a global professional services firm that delivers advisory, technology, and managed services to clients across both the commercial and public sectors. Our teams turn bold ideas into solutions that transform industries, strengthen communities, and drive meaningful impact worldwide.

Across our Chennai, Trivandrum, and Gurugram locations, you’ll find opportunities where your passion and curiosity help shape what comes next. With cutting edge benefits, innovative learning and development programs, and a people first culture, we empower our people to lead with purpose.

We continue to expand our teams and capabilities across India, investing in state‑of‑the‑art offices and high impact work. Here, you’ll collaborate with experts from around the world, build deep expertise, explore new domains, and accelerate your professional growth while making a real impact.

What We Offer

At Guidehouse India, we are committed to supporting the well‑being of our people and their families at every stage of life. We offer competitive compensation and a comprehensive benefits package designed to help you thrive both inside and outside the workplace.

Our benefits include resources such as in house physician consultations, nutritious food options at the workplace, and confidential counseling through our Employee Assistance Program, along with other wellness focused offerings that support your overall well being.

Our comprehensive learning and development programs ensure you’re continuously upskilled and ready to tackle what’s next, so you can shape your own career path while contributing to meaningful, purpose driven work.

Contact Us

If you have visited our website to explore career opportunities or to apply for a position and have questions, please contact the Guidehouse Recruiting team at [e-mail]. All information you provide will be kept confidential and used only as required to support the recruitment process.

To learn more about Guidehouse in India, visit www.guidehouse.com/india.