Principal AI/ML Leader

Arch Systems, LLC; Virginia (MN); On-site; USD 180,000 - 260,000; Full time

Job summary

Arch Systems, LLC is seeking a Principal AI/ML Leader with 8+ years of experience to design, build, and deploy scalable AI/ML solutions in production environments. You will provide architectural direction while hands‑on contributing to development, integration, deployment, and troubleshooting.

The ideal candidate will lead data pipelines, model development, and secure delivery for federal programs, collaborating with data engineers, software teams, and stakeholders to drive AI strategy and

Qualifications

• 8+ years designing and deploying AI/ML in production environments.
• Experience with federal programs, contracts, or secure delivery environments.
• Strong leadership, mentorship, and cross‑functional collaboration skills.
• Hands‑on coding and system integration across ML lifecycles.

Responsibilities

• Lead design, development, and deployment of ML models using frameworks such as TensorFlow, PyTorch, and scikit‑learn.
• Provide hands‑on architectural direction and contribute directly to coding, model development, deployment, and troubleshooting.
• Build and maintain scalable data pipelines using Kafka, REST APIs, and SFTP for real‑time and batch data ingestion.
• Implement robust data quality and validation frameworks using Great Expectations and Deequ.
• Develop and deploy RESTful APIs for ML model serving using FastAPI and Spring Boot.
• Containerize applications using Docker and orchestrate deployments with Kubernetes and Oracle Kubernetes Engine (OKE).
• Manage cloud infrastructure and AI/ML deployments on Oracle Cloud Infrastructure (OCI).
• Build and maintain CI/CD pipelines using GitHub Actions and Azure DevOps for automated testing and deployment.
• Develop interactive dashboards and visualizations using Dash, Plotly, and React.
• Ensure security and compliance with standards such as NIST SP 800‑53, FIPS 140‑2, DISA STIGs, and RMF.
• Collaborate with cross‑functional teams including data engineers, software developers, architects, federal stakeholders, and business leaders.
• Mentor engineers and establish best practices across AI/ML engineering, MLOps, model lifecycle management, and production deployment.
• Provide technical leadership in AI/ML strategy, solution architecture, implementation planning, and delivery within federal and regulated environments.

Skills

AI/ML leadership

Production ML systems

Data pipeline design

Cloud & containers

Mentoring teams

Federal contracting

REST APIs

Kubernetes

Tools

TensorFlow

PyTorch

scikit-learn

Kafka

REST APIs

Docker

Kubernetes

OCI

GitHub Actions

Azure DevOps

Dash/Plotly/React

Job description

Arch Systems is seeking a highly experienced, hands‑on Principal AI/ML Leader with 8+ years of experience designing, building, and deploying scalable AI/ML solutions in production environments. This role is ideal for a senior technical leader who can provide architectural direction, lead AI/ML solution delivery, and remain deeply hands‑on in development, integration, deployment, and troubleshooting.

The ideal candidate will have strong experience developing machine learning models, building data pipelines, deploying production‑grade AI systems, and working in modern cloud and containerized environments. This individual must also have experience supporting federal customers, federal programs, or federal contracts, with an understanding of secure, compliance‑driven delivery environments.

We are looking for someone who can lead from the front, mentor technical teams, collaborate with stakeholders, and directly contribute to the design, development, and deployment of AI/ML solutions.

Key Responsibilities

• Lead the design, development, and deployment of machine learning models using frameworks such as TensorFlow, PyTorch, and scikit‑learn
• Serve as a hands‑on principal technical leader, contributing directly to architecture, coding, model development, deployment, optimization, and troubleshooting
• Build and maintain scalable data pipelines using Apache Kafka, REST APIs, and SFTP for real‑time and batch data ingestion
• Perform data preprocessing, profiling, feature engineering, and synthetic data generation using tools such as SDV, Faker, and pandas‑profiling
• Implement robust data quality and validation frameworks using Great Expectations and Deequ
• Develop and deploy RESTful APIs for ML model serving using FastAPI and Spring Boot
• Containerize applications using Docker and orchestrate deployments with Kubernetes and Oracle Kubernetes Engine (OKE)
• Manage cloud infrastructure and AI/ML deployments on Oracle Cloud Infrastructure (OCI)
• Build and maintain CI/CD pipelines using GitHub Actions and Azure DevOps for automated testing and deployment
• Develop interactive dashboards and visualizations using Dash, Plotly, and React
• Ensure security and compliance with standards such as NIST SP 800‑53, FIPS 140‑2, DISA STIGs, and RMF
• Collaborate with cross‑functional teams including data engineers, software developers, architects, federal stakeholders, and business leaders
• Mentor engineers and establish best practices across AI/ML engineering, MLOps, model lifecycle management, and production deployment
• Provide technical leadership in AI/ML strategy, solution architecture, implementation planning, and delivery within federal and regulated environments