Remote Lead Data Engineer - Cloud & AI Pipelines

University of Texas; Town of Texas (WI); Remote; USD 125,000 - 144,000; Full time

Benefits offered by this job

Competitive health benefits

Tuition assistance

Flexible spending account

Job summary

The Lead Data Engineer at University of Texas at Austin drives the design and delivery of scalable data pipelines within UT’s cloud data ecosystem. You will lead data engineers and collaborate with data architects, analytics teams, and stakeholders to enable data-driven decision making across the university.

Remote work options are available, with a strong emphasis on AI-enabled data platforms. You will mentor engineers, advance data governance, and ensure quality through CI/CD and observability

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or equivalent professional experience.
• 5+ years of experience designing, implementing, and optimizing complex data pipelines or enterprise-scale data platforms.
• 5 years of experience in cloud-based data engineering using Databricks and AWS (Glue, S3, Lambda, Redshift).

Responsibilities

• Design, architect, and deliver production-grade, scalable data pipelines and AI-ready data platforms using Databricks, AWS cloud-native services and modern data engineering frameworks.
• Lead end-to-end implementation of lakehouse data pipelines, ensuring performance, reliability, and cost efficiency.
• Champion industry best practices for data engineering and data quality governance.
• Conduct peer code reviews to maintain code quality and consistency across the team.
• Lead knowledge-sharing sessions on AI/ML integration and data lakehouse architecture.

Skills

Python

PySpark

SQL

Data modeling

Cloud data pipelines

Education

Bachelor’s or Master’s in CS/IS/Engineering

Tools

Databricks

AWS

Unity Catalog

Delta Lake

GitHub Actions

Terraform

CDK

Job description

The Lead Data Engineer at University of Texas at Austin drives the design and delivery of scalable data pipelines within UT’s cloud data ecosystem. You will lead data engineers and collaborate with data architects, analytics teams, and stakeholders to enable data-driven decision making across the university.

Remote work options are available, with a strong emphasis on AI-enabled data platforms. You will mentor engineers, advance data governance, and ensure quality through CI/CD and observability