Senior Data Engineer: AI Pipelines & Databricks

Jobtailor; Utah; On-site; USD 120,000 - 180,000; Full time

Job summary

Jobtailor is seeking a data & ML platform engineer to design and maintain scalable data ingestion, transformation, and modeling pipelines. You will collaborate with data scientists, ML engineers, and business stakeholders to deliver robust data assets and AI-enabled solutions.

The role emphasizes cloud-based infrastructure, Databricks, PySpark, and modern tooling for end-to-end ML lifecycles, including feature stores and model observability. Utah location with on-site work expectations.

Qualifications

• Experience designing and building scalable data ingestion and transformation pipelines.
• Strong SQL development and query optimization skills.
• Experience with Databricks and large-scale data processing.
• Knowledge of data lake, lakehouse, data warehouse, and data mart architectures.
• Experience with ML feature stores and data quality testing.
• Ability to translate business processes into data/ML solutions.

Responsibilities

• Collaborate with cross-functional teams to enable effective use of core data assets.
• Design, develop, and maintain scalable data ingestion and transformation pipelines.
• Build and optimize data lake, lakehouse, warehouse, and data mart architectures.
• Develop and maintain data models including facts, dimensions, feature datasets, and domain-specific data products.
• Translate business requirements into design docs and ML feature pipelines.
• Design and manage cloud-based data and ML infrastructure (Databricks preferred).
• Design, build, and operationalize ML pipelines for training, validation, deployment, and observability.
• Support ML model lifecycle management, including versioning and lineage.
• Develop and maintain ML feature stores and reusable feature pipelines.
• Build AI-powered applications and agentic workflows.
• Implement data pipelines for AI systems including unstructured data.
• Develop tests (unit/integration/data quality) and participate in code reviews.

Skills

Python Development

SQL Development

Data Modeling

Data Pipeline Development

MLOps

AI Prompt Frameworks

Cross-Functional Collaboration

Requirement Gathering

Adaptability

Education

Bachelor's Degree in Computer Science

Bachelor's Degree in Information Systems

Quantitative Field

Tools

Databricks

AWS

PySpark

Dbt

Git

Job description

Jobtailor is seeking a data & ML platform engineer to design and maintain scalable data ingestion, transformation, and modeling pipelines. You will collaborate with data scientists, ML engineers, and business stakeholders to deliver robust data assets and AI-enabled solutions.

The role emphasizes cloud-based infrastructure, Databricks, PySpark, and modern tooling for end-to-end ML lifecycles, including feature stores and model observability. Utah location with on-site work expectations.