Senior AI Data Engineer

HCL Global Systems Inc; Princeton (NJ); On-site; USD 150,000 - 190,000; Full time

Job summary

Visa seeks a Senior AI Data Engineer to design and operate AI/ML data pipelines, model metadata, and data lineage. You will build scalable infrastructure with Databricks and Spark, implement MCP servers for AI data distribution, and apply MLflow for experiment tracking and registry.

Collaboration with data scientists and ML engineers is essential. The ideal candidate has 10+ years in data roles and 5+ years in data engineering, plus experience with ML workloads and governance.

Qualifications

• 10+ years of overall experience in data roles.
• 5+ years hands-on data engineering.
• 2+ years with AI/ML workloads.
• Experience with Databricks and Spark.
• Understanding ML lifecycle: training, deployment, monitoring.

Responsibilities

• Design and build AI/ML data pipelines for model metadata, data lineage, and performance tracking.
• Build scalable data infrastructure using Databricks & Spark.
• Develop MCP servers and enable AI data distribution through MCP.
• Build feature engineering and data preprocessing pipelines.
• Implement MLflow for experiment tracking, model versioning, and model registry.
• Develop AI agent discovery, classification, and inventory workflows.
• Design knowledge graphs for AI model relationships, dependencies, and data lineage.
• Build real-time pipelines for model monitoring, drift detection, and performance tracking.
• Implement AI-specific data quality, governance, security, and compliance frameworks.
• Collaborate closely with Data Scientists, ML Engineers, and Architects

Skills

Data engineering

AI/ML pipelines

ML lifecycle management

Model governance

Real-time data pipelines

Collaboration

Tools

Databricks

Apache Spark

MLflow

MCP

Vector databases

Embeddings

Job description

Visa

Visa: Visa-independent candidates only

Position

Senior AI Data Engineer with strong hands-on experience in Data Engineering, AI/ML pipelines, Databricks, Spark, Python, and ML lifecycle management.

Responsibilities

• Design and build AI/ML data pipelines for model metadata, data lineage, and performance tracking
• Build scalable data infrastructure using Databricks & Apache Spark
• Develop MCP servers and enable AI data distribution through MCP
• Build feature engineering and data preprocessing pipelines
• Implement MLflow for experiment tracking, model versioning, and model registry
• Develop AI agent discovery, classification, and inventory workflows
• Design knowledge graphs for AI model relationships, dependencies, and data lineage
• Build real-time pipelines for model monitoring, drift detection, and performance tracking
• Implement AI-specific data quality, governance, security, and compliance frameworks
• Collaborate closely with Data Scientists, ML Engineers, and Architects

Qualifications

• 10+ years of overall experience
• 5+ years of hands-on Data Engineering experience
• 2+ years working with AI/ML workloads
• Databricks, Apache Spark & distributed computing
• Strong understanding of ML lifecycle: training, deployment & monitoring
• Feature engineering and ML data pipelines
• MLflow / Model Registry / Experiment Tracking
• Experience with vector databases, embeddings & similarity searchUnderstanding of data/model governance and AI security

Nice to Have

• Neo4j / Amazon Neptune / Knowledge Graphs
• AI explainability & interpretability
• Open-source ML contributions or publications

#Hiring #AIJobs #DataEngineer #AIDeveloper #MachineLearning #GenerativeAI #GenAI #Databricks #ApacheSpark #Python #MLflow #MCP #RAG #DataEngineering #MachineLearningJobs #NJJobs #NYCJobs #PrincetonJobs #SAndPGlobal #Altimetrik