MLOps / AI/ML architect

TechDigital Group; San Jose (CA); On-site; USD 120,000 - 150,000; Full time

Job summary

TechDigital Group is seeking a skilled MLOps Architect to join our team in San Jose, California. You will be pivotal in building and maintaining robust machine learning systems, focusing on the full lifecycle of ML pipelines from data ingestion to model serving.

Applicants should have extensive experience with Google Cloud Platform services and a proven track record in designing and implementing end-to-end ML workflows. Knowledge of Docker and CI/CD practices is essential. Join us in shaping the future of AI!

Qualifications

• Strong experience with Google Cloud Platform services in the MLOps and ML domain.
• Hands-on experience with containerization technologies like Docker.
• Familiarity with CI/CD practices and pipeline automation.

Responsibilities

• Design and manage automated data ingestion and validation pipelines.
• Implement feature engineering logic for diverse datasets.
• Configure and manage low-latency production serving environments.

Skills

Google Cloud Platform

MLOps

Machine Learning

Kubernetes

Docker

Continuous Deployment

TensorFlow

Tools

Vertex AI

Kubeflow

Cloud Storage

Artifact Registry

CI/CD

Job description

Mandatory Skills Agentic AI/ADK/Python

We are looking for a skilled MLOps Architect to join our team and help us build, deploy, and maintain robust and scalable machine learning systems. You will be responsible for the full lifecycle of our ML pipelines, from data ingestion to model serving. This is a hands-on role where you will design and implement automated workflows, ensure data quality, and manage model deployments in a production environment.

Responsibilities

• Data and Feature Pipelines: Design, build, and manage automated data ingestion, transformation, and validation pipelines using services like Kubeflow Pipelines and Vertex AI Pipelines.
• Feature Engineering: Implement and containerize feature engineering logic for diverse datasets, ensuring reusability and scalability.
• Data Validation: Integrate and manage data validation processes, including leveraging advanced techniques like AI Agents and the Generative Language API to automatically detect and remediate data quality issues.
• Model Training and Experimentation:
  • Set up and maintain automated continuous training (CT) pipelines using Vertex AI Pipelines (Schedules) and Cloud Scheduler.
  • Implement experiment tracking to log and compare model parameters, metrics, and artifacts.
  • Configure and execute Hyperparameter Tuning jobs using Vertex AI Training to optimize model performance.
• Model Management: Establish a robust Model Versioning system to manage and store model artifacts securely in a centralized repository (Cloud Storage).
• Deployment and Serving:
  • Containerize ML models and their dependencies using Docker and manage images with Artifact Registry.
  • Build and maintain CI/CD workflows for ML models, ensuring seamless and automated deployment.
  • Configure and manage low-latency production serving environments using Vertex AI Endpoints for real-time inference.

Qualifications

• Strong experience with Google Cloud Platform (GCP) services, specifically in the MLOps and ML domain (Vertex AI, Kubeflow, Cloud Storage, Artifact Registry).
• Proven ability to design and implement end-to-end ML pipelines for data management, model training, and deployment.
• Hands-on experience with containerization technologies like Docker.
• Familiarity with CI/CD practices and pipeline automation.
• Knowledge of ML frameworks like TensorFlow, and experience with experiment tracking and hyperparameter tuning.
• Excellent problem-solving skills and a strong understanding of the ML lifecycle.

Experience with the Generative Language API (Gemini model) or other AI Agent integrations is a plus.