Lakehouse Data Infrastructure Engineer

Guidehouse; United States; On-site; USD 113,000 - 188,000; Full time

Benefits offered by this job

Medical insurance

401(k)

Parental leave

Tuition reimbursement

Paid holidays

Job summary

Guidehouse is seeking a Data Infrastructure Engineer in the United States to build and operate a scalable data platform powering AI/ML analytics modules. You will design ingestion pipelines, ETL/ELT processes, and a lakehouse on AWS, with governance via a metadata repository and security controls.

You will collaborate with cross-functional teams, implement IaC and CI/CD for data workflows, and contribute to reliable, auditable data services across environments.

Qualifications

• Bachelor's degree in Engineering, IT, CS or related field.
• Minimum of 6 years' experience building production data pipelines or data platforms.
• Strong experience with data ingestion and ETL/ELT workflows, data modeling and transformation best practices.
• Hands-on experience building a data lake / delta lake (lakehouse) on AWS using object storage and modern table formats.
• Proficiency in SQL and at least one programming language (Python preferred; Scala/Java acceptable).
• Experience with metadata management, governance: cataloging, lineage, ownership, access controls, classification and policy enforcement.
• Experience implementing automated AWS provisioning using IaC across multiple environments.
• Experience building or operating CI/CD pipelines for data workflows including testing and deployment automation.
• Solid security fundamentals: IAM, encryption, secrets management, secure SDLC practices.

Responsibilities

• Build & Operate Data Pipelines (Batch + Streaming).
• Design and implement ingestion from APIs, relational databases, file drops, event streams, and external partners.
• Build and optimize ETL/ELT pipelines for analytics-ready datasets.
• Deliver a modern lakehouse on AWS (S3) with delta lake concepts, ACID tables, schema evolution, and time travel.
• Establish a managed metadata repository and governance controls (catalog, lineage, access, classification).
• Implement automated cloud provisioning with IaC and robust CI/CD for data pipelines.
• Improve observability with metrics, logs, dashboards, runbooks, and incident response readiness.
• Collaborate with engineering, security, and other teams; maintain engineering documentation.

Skills

Data pipelines

ETL/ELT

SQL

Python

CI/CD

Metadata governance

Education

Bachelor's degree in Engineering, IT, CS

Tools

Databricks

Terraform

Jenkins

AWS CodePipeline

Docker

Git

Job description

Guidehouse is seeking a Data Infrastructure Engineer in the United States to build and operate a scalable data platform powering AI/ML analytics modules. You will design ingestion pipelines, ETL/ELT processes, and a lakehouse on AWS, with governance via a metadata repository and security controls.

You will collaborate with cross-functional teams, implement IaC and CI/CD for data workflows, and contribute to reliable, auditable data services across environments.