AI Data Engineer: ML Pipelines & Model Governance

Altimetrik; New Jersey; Presencial; USD 120 000 - 160 000; Tempo integral

Resumo da oferta

Altimetrik is seeking an AI Data Engineer to build and optimize ML data pipelines, focusing on model tracking, lifecycle management, and governance integrations. You will work with data scientists to enable scalable AI infrastructure and ensure data quality across the enterprise.

The role emphasizes hands-on data engineering with deep ML knowledge, feature stores, and real-time monitoring. Collaboration across teams and strong security controls are essential.

Qualificações

• Bachelor's or Master's in Computer Science, Data Science, Machine Learning, or related field.
• 9 years of hands-on data engineering experience, with at least 2 years on AI/ML workloads.
• Proficiency in Python and ML frameworks (PyTorch, TensorFlow, scikit-learn).
• Strong experience with Databricks, Apache Spark, and distributed computing for ML workflows.
• Understanding of ML lifecycle including training, deployment, and monitoring.

Responsabilidades

• Design and implement data pipelines for AI model metadata, training data lineage, and model performance metrics tracking.
• Build data infrastructure on Databricks leveraging Spark for large-scale distributed dataset processing.
• Develop MCP servers and enable AI data distribution via MCP.
• Create feature engineering pipelines and data preprocessing workflows for model training and inference.
• Implement model versioning, experiment tracking, and model registry integration using MLflow.
• Create automated workflows for AI agent discovery, classification, and inventory management.
• Design and maintain knowledge graph structures for AI model relationships and data lineage.
• Build real-time data pipelines for model monitoring, drift detection, and performance tracking.
• Develop data quality frameworks for AI training and validation datasets.
• Collaborate with data scientists to optimize data access patterns and feature stores.
• Implement security and compliance controls for sensitive AI data and artifacts.

Conhecimentos

Python

ML frameworks

Databricks

Apache Spark

SQL

AI governance

Data governance

Model monitoring

Collaboration

Formação académica

Bachelor's or Master's in CS/DS/ML or related field

Ferramentas

Databricks

Apache Spark

MLflow

PyTorch

TensorFlow

scikit-learn

Descrição da oferta de emprego

Altimetrik is seeking an AI Data Engineer to build and optimize ML data pipelines, focusing on model tracking, lifecycle management, and governance integrations. You will work with data scientists to enable scalable AI infrastructure and ensure data quality across the enterprise.

The role emphasizes hands-on data engineering with deep ML knowledge, feature stores, and real-time monitoring. Collaboration across teams and strong security controls are essential.