Senior ML Operations Engineer

SPD Technology; United States; Hybrid; USD 120,000 - 150,000; Full time

Job summary

SPD Technology is seeking a Senior ML Operations Engineer to support teams in building AI-driven solutions. The role offers autonomy in decision-making and the opportunity to work within a proactive, collaborative team environment.

Successful candidates will have strong software development experience, particularly in Python, and a deep understanding of machine learning lifecycle operations. A flexible work schedule is permitted, requiring attendance at team meetings as necessary.

Qualifications

• 5+ years of hands-on software development experience with Python.
• Experience designing and building distributed software systems and architectures.
• 3+ years of hands-on experience deploying Machine Learning services in production.

Responsibilities

• Serve as a force multiplier for development teams.
• Provide mentorship, technical guidance, and perform code reviews.
• Design and deliver on projects end-to-end.

Skills

Software development experience with Python

Experience deploying Machine Learning services

Strong problem-solving abilities

Communication and collaboration skills

Education

Degree in Computer Science, Information Systems or Machine Learning

Tools

Kubernetes

Docker

SQL and NoSQL databases

Job description

About Us

At SPD Technology, we bring together a team of like-minded people who are driven by the desire to bring value through their work, united in their commitment to high performance and delivering custom, cutting‑edge tech solutions that drive clients’ growth. We empower our people with a culture of excellence and enable them with the opportunity to uphold their accountability to contribute at each level. We value humanity and collaboration, encourage professional and personal growth, and foster a supportive and flexible work environment where everyone’s contribution is welcomed.

About the Role

As a Senior ML Operations Engineer, you will support teams building and deploying AI‑driven solutions, helping them overcome common challenges in the ML development, deployment, and support lifecycle. This role offers autonomy in decision‑making, encouraging a proactive approach to solving complex issues and finding optimal solutions for scalable systems.

About the Project

PitchBook is a platform for investment professionals. Our software provides access to data and the analytical tools to get answers fast and discover promising opportunities. It uncovers actionable insights and trends hidden within the financial data of more than three million companies. Users worldwide include large corporations, start‑ups, venture capital and private equity firms, investment banks, and many others.

Features of PitchBook:

• Advanced search
• Discovery & insights
• Company profiles
• Workflow & efficiency
• Financials and many more

Team Composition

Engineering Manager, 4 Senior ML Ops Engineers

Work Environment

The role offers a flexible work schedule, allowing you to adapt your working hours with the requirement to attend all team meetings. The team follows a Scrum‑based Agile methodology.

Key Responsibilities

• Serve as a force multiplier for development teams by creating golden paths that remove roadblocks and improve ideation and innovation.
• Collaborate with other engineers, product managers, and internal stakeholders in an Agile environment.
• Provide mentorship, technical guidance, and perform code reviews for team members.
• Design and deliver on projects end‑to‑end with little to no guidance.
• Provide support to teams building and deploying AI applications by addressing common pain points in the MLDLC.
• Learn constantly and be passionate about discovering new tools, technologies, libraries, and frameworks that can be leveraged to improve PitchBook’s AI capabilities.
• Support the vision and values of the company through role‑modeling and encouraging desired behaviors.
• Participate in various cross‑functional company initiatives and projects as requested.
• Contribute to strategic planning in a way that ensures the team is building exceptional products that bring real business value.
• Evaluate frameworks, vendors, and tools that can be used to optimize processes and costs with minimal guidance.

Required Qualifications

• Degree in Computer Science, Information Systems, Machine Learning, or a similar field preferred (or equivalent practical experience).
• 5+ years of hands‑on software development experience with Python (Java experience with strong Python proficiency also considered).
• 4+ years of experience designing and building distributed software systems and architectures.
• 3+ years of hands‑on experience deploying and operating Machine Learning services in production.
• Experience supporting ML lifecycle operations including post‑deployment monitoring and maintenance.
• Experience in cloud‑native stack, with a practical understanding of containerization technologies such as Kubernetes and Docker.
• Demonstrated experience with SQL and NoSQL database design and implementation.
• Ability to decompose complex problems into iterative, well‑defined solutions.
• Strong problem‑solving abilities with focus on building scalable, efficient, and maintainable systems.
• Strong communication and collaboration skills, with the ability to engage effectively with internal customers across various cultures and regions.
• Ability to be a team player who can also work independently.
• Experience working across multiple development teams is a plus.

Bonus Points

• Experience with cloud platforms (AWS, Google Cloud Platform, or Azure).
• Proficiency in GitOps practices and CI/CD pipeline development and management.
• Observability and monitoring: Integration experience with observability tools (Prometheus, Grafana) and building instrumented, production‑ready systems.
• LLM Infrastructure: Experience provisioning and managing Large Language Models through managed services (Azure OpenAI, Google Vertex AI, Amazon Bedrock).
• LLM Tooling: Hands‑on experience with LLM gateways (LiteLLM) and agentic frameworks (LangGraph, LangSmith, or similar).
• Vector Systems: Practical …