Senior Software Engineer, Model Platform & Real-Time ML

Abnormal AI, Inc.; United States; On-site; USD 180,000 - 259,000; Full time

Job summary

Abnormal AI, Inc. is seeking a Senior Software Engineer for the Detection Team to build world-class ML-serving infrastructure and scalable data processing. You will work with ML engineers and data scientists to deliver real-time features and robust model serving at scale.

You will own critical pipelines, contribute to the ML training platform, and mentor junior engineers while collaborating across cross-functional teams. This role offers a competitive base salary and comprehensive benefits.

Qualifications

• 5+ years of experience as a Software Engineer or in a similar role, with hands-on experience in building ML-engineering focused solutions.
• Experience maintaining large-scale distributed systems on cloud platforms such as AWS, GCP, or Azure, including a strong grasp of cloud-based engineering best practices.
• Experience with maintaining real-time and near real-time data pipelines or streaming services at high scale.
• Proven ability to collaborate effectively with cross-functional teams, including data scientists, machine learning engineers, product managers, and other stakeholders.
• Excellent problem-solving skills and the ability to work independently in a fast-paced environment.
• Familiarity with machine learning workflows and requirements to support MLE teams effectively, including 50K+ QPS.
• Experience with streaming data architectures and real-time processing.
• Knowledge of security and compliance frameworks as they relate to data engineering and data privacy.

Responsibilities

• Architect, design, build, deploy, and maintain Model Serving infrastructure that supports a world-class Detection Engine
• Own projects that scale our model serving and data processing services to handle 10x the traffic we serve today
• Build the platform for fighting against rapidly generated AI attacks
• Own real-time, near real-time streaming pipelines, and online feature serving services
• Build Abnormal's ML Training platform, improving MLE velocity and product precision and recall
• Collaborate closely with MLE and Data Science teams by distilling feedback, correlating it to strategy, and executing
• Coach and mentor junior engineers via 1on1s, pair programming, high-quality code reviews, and design reviews

Skills

Senior SWE

Cloud distributed systems

Real-time pipelines

Cross-functional collaboration

ML workflows

Streaming data

Security & compliance

ML engineering serving

Job description

Abnormal AI, Inc. is seeking a Senior Software Engineer for the Detection Team to build world-class ML-serving infrastructure and scalable data processing. You will work with ML engineers and data scientists to deliver real-time features and robust model serving at scale.

You will own critical pipelines, contribute to the ML training platform, and mentor junior engineers while collaborating across cross-functional teams. This role offers a competitive base salary and comprehensive benefits.