AI/ML Ops Engineer

Socket.dev; New York (NY); Remote; CAD 120,000 - 170,000; Full time

Benefits offered by this job

Health, Vision, Dental, Life Insurance

401k plan and discretionary time off

Equity participation

Job summary

Blackpoint Cyber is seeking an AI/ML Ops Engineer to own the operational backbone of our AI/ML capability, taking models from training through production deployment and ensuring a scalable, reliable AI lifecycle. You will stand up deployment pipelines, put trained scripts on endpoints, and ensure production-grade monitoring and alerting.

You will report to the VP of AI and Data and collaborate with Engineering, SOC, and APG to advance our AI architecture and governance utilities while building

Qualifications

• 5+ years of hands-on ML Engineering experience with production deployments.
• Ability to own deployment pipelines end-to-end, from training to live endpoints.
• Strong analytical and data-driven decision-making abilities.
• Excellent communication and collaboration with stakeholders at all levels.

Responsibilities

• Own the AI/ML loop end-to-end across all pipelines, from training to deployment and retirement.
• Develop, optimize, and deploy ML models with hands-on experience.
• Design and administer model-building and serving infrastructure for real-time requests.
• Implement containerized Infrastructure as Code (Terraform, GitHub Actions, Docker, Kubernetes).
• Build standardized container pipelines for training, feature engineering, and inference channels with CI/CD.
• Lead test strategy across the ML pipeline and ensure production-grade visibility and alerting.

Skills

ML Engineering

End-to-end deployment

Analytical thinking

Communication skills

Tools

AWS

SageMaker

Bedrock

Kafka

Spark

MLFlow

Sagemaker Pipelines

Terraform

GitHub Actions

Docker

Kubernetes

ECS/EKS

Python

Bash

SQL

SparkSQL

GitFlow

CI/CD

DevOps

Grafana

CloudWatch

Job description

Blackpoint Cyber is the leading provider of world-class cybersecurity threat hunting, detection and remediation technology. Founded by former National Security Agency (NSA) cyber operations experts who applied their learnings to bring national security-grade technology solutions to commercial customers around the world, Blackpoint Cyber is in hyper-growth mode, fueled by a recent $190m series C round.

ROLE SUMMARY

As AI/ML Ops Engineer, you will own the operational backbone of Blackpoint's AI/ML capability — taking models from training through production deployment and owning the full AI/ML loop across every pipeline the team runs at scale. You will be instrumental in building out this new function: standing up deployment pipelines, taking trained scripts and putting them on endpoints that can accept live requests, and ensuring every solution you ship is production-grade, highly available, and well monitored. As the team's scope expands, you will take on ownership of testing across the board and automate training, monitoring, and deployment pipelines across the AI lifecycle. You will report to the Vice President of AI and Data and work closely with Engineering, the Security Operations Center (SOC), and the Adversary Pursuit Group (APG).

WHO YOU ARE

• 5+ years of hands-on ML Engineering experience, including having personally trained and deployed models into a production environment — you know what it takes to take an AI product from prototype to live service.
• A well-architected mindset — built for efficiency, performance, security, and reliability, with genuine comfort owning deployment pipelines end-to-end.
• Strong analytical and problem-solving abilities, with a focus on data-driven decision-making.
• Excellent communication and interpersonal skills, with the ability to influence and collaborate with stakeholders at all levels.

WHAT YOU'LL BRING

Experienced in

• Cloud-based ML Infrastructure (AWS)
• Model Development, Evaluation, & Deployment Operations (SageMaker, Bedrock)
• Inference Streams & Event-Driven Processing (Kafka, Spark)
• MLOps Workflows (MLFlow, Sagemaker Pipelines)
• Infrastructure as Code & Pipeline Automation (Terraform, AI CI/CD, GitHub Actions)
• ML Governance (Data, Model, & Feature Versioning, Monitoring & Testing)
• Containerized Services (Docker, Kubernetes, ECS/EKS)
• Scripting Languages (Python, Bash)
• Query Languages (SQL, SparkSQL)
• GitFlow, CI/CD workflows & DevOps best practices
• Experience with AI-Assisted development life cycle
• Building high-availability, production-grade systems with strong visibility and alerting baked in from day one

Nice to Have

• Transformer Neural Networks
• Agile Scrum/Kanban
• Anthropic, OpenAI, LiteLLM APIs and SDKs
• Experience in Cybersecurity, IoT, or NLP fields
• Grafana or CloudWatch (observability tooling)

HOW YOU'LL MAKE AN IMPACT

Own the AI/ML loop end-to-end at scale — across all pipelines, from model training through deployment, monitoring, and retirement.
Develop, optimize, and deploy ML models, drawing on direct, hands-on experience training models yourself.
Design, build, and administer model-building and serving infrastructure, taking trained scripts and standing them up as live endpoints that can accept real-time requests.
Implement ML workflows as containerized Infrastructure as Code, using Terraform, GitHub Actions, Docker, and Kubernetes.
Build and automate standardized container pipelines for training, feature engineering, and inference channels, with CI/CD managed through GitHub.
Own test strategy across the full ML pipeline — model validation, integration, load, and deployment testing — as the team's testing scope continues to expand.
Build visibility and alerting into every deployed pipeline and hold all AI/ML solutions to a production-grade, highly-available, well-monitored bar.
Develop ML governance utilities for oversight and administration of deployed infrastructure.
Implement data, feature, and model lifecycle best practices.
Contribute to AI architecture and design decisions, taking primary ownership of ML pipeline work.
Collaborate closely with cross-functional teams, including Engineering, Blackpoint Cyber's Security Operations Center (SOC), and the Adversary Pursuit Group (APG).

Blackpoint Cyber welcomes and encourages applications from qualified individuals of all races, colors, religions, sex, sexual orientation, gender identity or expression, national origin, age, marital status, or any other legally protected status. We are committed to equality of opportunity in all aspects of employment.

• For eligible employees in the US, Blackpoint offers competitive Health, Vision, Dental, and Life Insurance plans, a robust 401k plan, Discretionary Time Off, and other minor perks.
• International employees receive competitive benefits in accordance with local market standards and applicable country requirements.
• Blackpoint believes all employees should share in the company’s success – equity participation is available to employees globally, with program details varying by location and employment structure.