Senior ML Platform Engineer - Real-Time Model Serving

Socket.dev; United States; On-site; USD 180,000 - 259,000; Full time

Benefits offered by this job

Bonus or incentive compensation

Equity

Comprehensive benefits package

Job summary

Abnormal AI is seeking a Senior Software Engineer for the Detection Team to architect and scale model serving infrastructure and streaming pipelines. You will collaborate with ML and Data Science teams to translate requirements into reliable, scalable systems and own key projects that push the envelope of real-time AI defense.

You will mentor junior engineers, participate in design reviews, and help advance the velocity and precision of ML training platforms in a fast-paced environment with

Qualifications

• 5+ years of experience as a Software Engineer.
• Experience maintaining large-scale distributed systems on cloud platforms such as AWS, GCP, or Azure.
• Experience with maintaining real-time and near real-time data pipelines or streaming services at high scale.
• Proven ability to collaborate effectively with cross-functional teams, including data scientists, ML engineers, product managers, and other stakeholders.
• Excellent problem-solving skills and the ability to work independently in a fast-paced environment.
• Familiarity with machine learning workflows and requirements to support MLE teams effectively.

Responsibilities

• Architect, design, build, deploy, and maintain Model Serving infrastructure that supports a world-class Detection Engine.
• Own projects that scale our model serving and data processing services to handle 10x the traffic we serve today.
• Build the platform for fighting against rapidly generated AI attacks.
• Own real-time, near real-time streaming pipelines, and online feature serving services.
• Build Abnormal’s ML Training platform, improving MLE velocity and product precision and recall.
• Collaborate closely with MLE and Data Science teams by distilling feedback, correlating it to strategy, and executing.
• Coach and mentor junior engineers via 1on1s, pair programming, high-quality code reviews, and design reviews

Skills

Distributed systems

Real-time data pipelines

Cross-functional collaboration

ML model serving

Security & compliance

Tools

AWS/GCP/Azure

Job description

Abnormal AI is seeking a Senior Software Engineer for the Detection Team to architect and scale model serving infrastructure and streaming pipelines. You will collaborate with ML and Data Science teams to translate requirements into reliable, scalable systems and own key projects that push the envelope of real-time AI defense.

You will mentor junior engineers, participate in design reviews, and help advance the velocity and precision of ML training platforms in a fast-paced environment with