Machine Learning Software Engineer II

TrulyHired; United States; On-site; USD 100,000 - 150,000; Full time

Job summary

TrulyHired is seeking a Machine Learning Engineer II to join the CAI machine learning team in the United States. The role focuses on bridging applied research with production systems, involving responsibilities such as transitioning ML models to production, architecting solutions using AWS technologies, and optimizing models for deployment. Ideal candidates will have 2-5 years of experience, proficiency in ML frameworks like PyTorch, and familiarity with cloud and containerization technologies. An equal opportunity employer, TrulyHired values diverse backgrounds and experiences.

Qualifications

• 2-5 years of industry experience in Machine Learning Engineering or Data Science.
• Deep, hands-on experience with the AWS ecosystem.
• Strong proficiency in modern programming languages used in ML.

Responsibilities

• Lead the transition of machine learning models to production systems.
• Architect and deploy ML solutions utilizing AWS ECS and AWS Lambda.
• Optimize PyTorch models for production deployment.

Skills

Machine Learning Engineering

AWS ECS

AWS Lambda

Python

PyTorch

Docker

Event-driven architectures

Tools

AWS SageMaker

Scikit-Learn

TensorFlow

Job description

Job Overview

We are seeking a talented Machine Learning Engineer II to join our CAI machine learning and scoring development team. In this role, you will be the crucial bridge between applied research and production systems. Working alongside a cross-functional group of mathematicians, computer scientists, psychometricians, and statisticians, you will design and deploy custom machine learning solutions for our clients and internal platforms.

The ideal candidate is a full-stack ML practitioner who is equally comfortable discussing algorithmic design with researchers and architecting scalable, low-latency production systems. You will own the full software development lifecycle—transforming research prototypes into optimized, production-ready solutions using modern AWS infrastructure such as SageMaker, ECS, and Lambda, with an emphasis on high-throughput inference and PyTorch-to-ONNX model optimization.

Job Responsibilities

• Full-Lifecycle ML Development: Lead the transition of machine learning models from theoretical prototypes into scalable, high-performance production systems.
• AWS Cloud Architecture & Deployment: Architect and deploy ML solutions utilizing AWS ECS (Elastic Container Service) for containerized workloads and AWS Lambda for serverless, event-driven inference pipelines.
• Model & Inference Optimization: Optimize PyTorch models for production deployment by converting them to ONNX formats. Apply advanced inference optimization techniques (quantization, pruning, ONNX Runtime) and memory-efficient attention mechanisms like Flash Attention to minimize latency and maximize throughput.
• Infrastructure & Engineering Best Practices: Champion infrastructure best practices for machine learning systems, establishing reliable CI/CD pipelines, and ensuring robust, secure, and reproducible deployments across the AWS ecosystem.
• Algorithm Engineering: Design, develop, and evaluate algorithms that generate descriptive, diagnostic, predictive, and prescriptive insights from both structured and unstructured data.
• Robust Software Engineering: Write clean, efficient, and well-tested code. Complete rigorous testing, debugging, and documentation to ensure seamless installation and long-term maintenance.
• Cross-Functional Collaboration: Actively participate in research discussions, requirements gathering, and system design alongside domain experts to build tailored scoring and ML solutions.

Job Requirements

• Experience: 2-5 years of industry experience in Machine Learning Engineering, Software Engineering, or Data Science, with a proven track record of architecting and deploying models to production.
• Cloud & MLOps Infrastructure: Deep, hands-on experience with the AWS ecosystem, specifically AWS ECS and AWS Lambda. Solid understanding of containerization (Docker) and event-driven architectures.
• Programming Proficiency: Strong proficiency in modern programming languages used in ML (e.g., Python, C++, Java) and familiarity with industry-standard coding practices.
• ML Frameworks & Advanced Optimization: Hands-on experience with PyTorch and other machine learning libraries (e.g., Scikit-Learn, TensorFlow). Deep understanding of model optimization pipelines, including PyTorch to ONNX conversions, ONNX Runtime, and scaling attention mechanisms (e.g., Flash Attention).
• Data Systems: Experience working with large-scale computing frameworks, data analysis systems, and relational/non-relational databases.

Nice to Have

• AWS SageMaker: Experience utilizing AWS SageMaker for managed model training and hosting.
• Advanced LLMOps & Fine-Tuning: Hands-on experience applying modern parameter-efficient fine-tuning methods (such as LoRA and qLoRA) to large language models.
• AI Agents: Experience building, integrating, and deploying autonomous or semi-autonomous AI agents to automate complex workflows and connect ML models with external tools/APIs.
• NLP Expertise: Proven experience and familiarity with deep learning technologies applied specifically to Natural Language Processing (NLP) and complex text-based modeling.
• Cross-Disciplinary Collaboration: Experience collaborating with specialized researchers (e.g., psychometricians, statisticians) to operationalize complex mathematical concepts.
• Infrastructure as Code: Experience implementing IaC using tools like Terraform or AWS CloudFormation.
• Model Monitoring: Experience setting up comprehensive model monitoring systems to detect data drift, concept drift, and model degradation in production AWS environments.

An Equal Opportunity Employer

We are dedicated to fostering a culture that celebrates unique backgrounds, ideas, and experiences. All qualified applicants will receive consideration for employment without discrimination on the basis of race, color, religion, sex, gender, gender identity/expression, sexual orientation, national origin, protected veteran status, or disability.