Senior Data Engineer – Lakehouse & AI Platform

Baker Tilly (US); California; On-site; USD 185,000 - 230,000; Full time

Job summary

Baker Tilly is hiring a Sr Data Engineer to join the AI Product Group and build scalable data infrastructure powering AI applications. You will design production pipelines, implement governance, and develop a knowledge layer for AI agents, collaborating with global teams to deliver reliable data solutions.

The role emphasizes strong data engineering fundamentals, Python/SQL proficiency, and hands-on delivery in a fast-paced environment, with exposure to lakehouse and AI-ready data platforms.

Qualifications

• 3 years of hands-on data or software engineering in production pipelines.
• Experience with lakehouse platforms and production data pipelines.
• Proficiency in Python and SQL for production-grade solutions.
• Knowledge of data modeling and scalable data structures.
• Experience with Azure cloud data services and Unity Catalog (preferred).
• Experience with data quality, lineage, and governance practices.

Responsibilities

• Design, build, and maintain scalable batch and incremental data pipelines.
• Develop lakehouse architecture and data models.
• Ensure data quality, lineage, and provenance across data products.
• Build knowledge graphs and retrieval pipelines for AI apps.
• Own production delivery, monitoring, and runbooks.
• Collaborate with globally distributed teams and external partners.

Skills

Python

SQL

Data modeling

Batch & incremental pipelines

Lakehouse architecture

Data governance

Data quality

Azure cloud

Knowledge graphs

Entity resolution

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Apache Spark

Delta Lake

Unity Catalog

Job description

Baker Tilly is hiring a Sr Data Engineer to join the AI Product Group and build scalable data infrastructure powering AI applications. You will design production pipelines, implement governance, and develop a knowledge layer for AI agents, collaborating with global teams to deliver reliable data solutions.

The role emphasizes strong data engineering fundamentals, Python/SQL proficiency, and hands-on delivery in a fast-paced environment, with exposure to lakehouse and AI-ready data platforms.