Senior AI Inference Platform Engineer

Bloomberg L.P.; New York (NY); On-site; USD 160,000 - 240,000; Full time

Benefits offered by this job

401(k) + match

Medical, dental, vision insurance

Paid holidays and time off

Life insurance

Wellness programs

Job summary

Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning applications. The ideal candidate will have over 5 years of software engineering experience, expertise in distributed systems, and a strong understanding of performance optimization. Additionally, experience with Kubernetes and machine learning systems is desired. The role offers a salary range of $160,000 - $240,000 annually along with comprehensive benefits.

Qualifications

• 5+ years of professional software engineering experience.
• Experience designing, building, and operating production distributed systems.
• Strong systems intuition and a track record of debugging and optimizing performance-critical services.

Responsibilities

• Design and build scalable infrastructure for both online and offline inference workloads.
• Mentor junior engineers on system design, debugging, and performance optimization.

Skills

Software engineering experience

Distributed systems

Debugging and performance optimization

Object-oriented programming

Machine learning systems

Kubernetes

Education

Degree in Computer Science or Electrical Engineering

Tools

PyTorch

CUDA

NCCL

Job description

Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning applications. The ideal candidate will have over 5 years of software engineering experience, expertise in distributed systems, and a strong understanding of performance optimization. Additionally, experience with Kubernetes and machine learning systems is desired. The role offers a salary range of $160,000 - $240,000 annually along with comprehensive benefits.