Senior Lakehouse Infra Engineer — Remote

Upstart; Austin, San Francisco, New York (TX, CA, NY); Hybrid; CAD 236,000 - 327,000; Full time

Benefits offered by this job

Competitive compensation

401k match

Healthcare coverage

Remote-friendly

Job summary

Upstart is seeking a Senior Infrastructure Engineer to own and evolve our Lakehouse infrastructure across Databricks environments, including a regulated setup. You’ll drive robust IaC, security controls, and cost optimization while collaborating with data, ML, analytics, and security teams.

You will automate audits, improve platform reliability, and mentor junior engineers in a fast-paced, remote-friendly setting as part of our Data Platform Engineering group.

Qualifications

• Bachelor's degree or equivalent practical experience in computing.
• 5+ years in infrastructure, DevOps, or data platform engineering.
• Hands-on with lakehouse platforms (Databricks, Snowflake, Delta Lake).
• Experience with AWS services and IaC tools like Terraform or CDK.

Responsibilities

• Own Lakehouse infrastructure components end to end, from requirements through rollout.
• Enforce no-click-ops and expand infrastructure as code across environments.
• Automate evidence gathering for OCC, SOX, SOC audits in access and change management.
• Optimize costs and improve platform efficiency (compute rightsizing, Graviton, spot instances).
• Collaborate with Data Engineering, Security, Compliance, and ML/Analytics teams.
• Mentor engineers and evangelize best practices across the team.

Skills

Problem solving

Cloud architecture

Security best practices

Education

Bachelor's degree in Computer Science or related field

Tools

AWS

Python

Terraform/CDK

CI/CD

Kubernetes

Job description

Upstart is seeking a Senior Infrastructure Engineer to own and evolve our Lakehouse infrastructure across Databricks environments, including a regulated setup. You’ll drive robust IaC, security controls, and cost optimization while collaborating with data, ML, analytics, and security teams.

You will automate audits, improve platform reliability, and mentor junior engineers in a fast-paced, remote-friendly setting as part of our Data Platform Engineering group.