AI Data Engineer: ML Pipelines & Model Governance

Purple Hires Inc; Princeton (NJ); Hybrid; USD 150,000 - 210,000; Full time

Job summary

Purple Hires Inc in Princeton/NYC hybrid is seeking an AI Data Engineer to build and optimize ML data pipelines, model tracking, and governance integration. This role focuses on AI/ML infrastructures, data lineage, and scalable data processing.

You will collaborate with data scientists to implement feature stores, model versioning, and real-time monitoring while ensuring data quality and secure handling of sensitive AI artifacts.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Science, Machine Learning, or related field.
• 5–7 years of hands‑on data engineering experience with at least 2 years in AI/ML workloads.
• Proficiency in Python and ML frameworks (PyTorch, TensorFlow, scikit‑learn).
• Strong experience with Databricks, Apache Spark, and distributed ML workflows.
• Deep understanding of ML lifecycle: training, deployment, monitoring.
• Experience with feature engineering, data preprocessing, and ML data pipelines.
• Knowledge of vector databases, embeddings, and similarity search for AI apps.
• Proficiency in SQL for structured and unstructured data management.
• Understanding of data governance, model governance, and AI ethics.

Responsibilities

• Design and implement data pipelines for AI model metadata, training data lineage, and model performance tracking.
• Build data infrastructure on Databricks leveraging Spark for large-scale processing.
• Develop MCP servers and enable AI data distribution via MCP.
• Create feature engineering pipelines and data preprocessing workflows for AI training and inference.
• Implement model versioning, experiment tracking, and model registry integration (MLflow or equivalent).
• Create automated workflows for AI agent discovery, classification, and inventory management.
• Design and maintain knowledge graph structures for AI model relationships and data lineage.
• Build real-time data pipelines for AI model monitoring, drift detection, and performance tracking.
• Develop data quality frameworks specific to AI training and validation datasets.
• Collaborate with data scientists to optimize data access and feature store implementations.
• Implement security and compliance controls for sensitive AI data and artifacts.
• Document AI data architectures, schemas, and integration patterns.

Skills

Python

ML Frameworks

Databricks

Spark

SQL

AI Governance

Collaboration

Data Quality

Model Monitoring

Analytics

Education

Bachelor's or Master's in CS/DS/ML

Tools

LangChain

HuggingFace

Neo4j

Amazon Neptune

Azure ML

SageMaker

Vertex AI

Job description

Purple Hires Inc in Princeton/NYC hybrid is seeking an AI Data Engineer to build and optimize ML data pipelines, model tracking, and governance integration. This role focuses on AI/ML infrastructures, data lineage, and scalable data processing.

You will collaborate with data scientists to implement feature stores, model versioning, and real-time monitoring while ensuring data quality and secure handling of sensitive AI artifacts.