Technical Product Manager - GenAI Platforms - AI Infrastructure - CTO Office New York, NY Posted today

Bloomberg

New York (NY)

On-site

USD 140,000 - 295,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Benefits package
401(k) + match
Paid holidays

Job summary

Bloomberg is seeking a Technical Product Manager to define and execute foundational AI Infrastructure capabilities across cloud, compute, and data. You will work with AI product and engineering teams to translate requirements into scalable platform services, enabling experiments, deployment, and operation of AI models in diverse environments.

This cross-cutting role collaborates with engineering, security, and other infrastructure groups to improve latency, throughput, and cost efficiency while

Qualifications

  • 5+ years in technical product management in AI/platforms/cloud.
  • Experience building or operating large-scale platform infrastructure.
  • Experience with public clouds (AWS/GCP/Azure) and multi-cloud.
  • Strong understanding of distributed systems and Kubernetes.
  • Fluency with AI/GenAI systems and production requirements.
  • Proven ability to work cross-functionally with engineering, security, product and platform teams.
  • Excellent communication and storytelling to translate user needs into architecture.

Responsibilities

  • Define and drive the vision for Bloomberg’s AI Infrastructure, across models, compute, and cloud.
  • Translate requirements from AI product/engineering teams into reusable platform capabilities.
  • Deliver scalable, resilient system architecture.
  • Advance hybrid/multi-cloud capabilities and portability across providers.
  • Evaluate AI infra advances and translate them into pragmatic roadmap opportunities.
  • Establish metrics for latency, throughput, availability, and cost efficiency.
  • Align priorities with AI Platforms, Cloud, Security, and other infra teams.
  • Balance standardization with flexibility as workloads evolve.

Skills

Technical product management
Platform infrastructure
Public cloud (AWS/GCP/Azure)
Distributed systems
GenAI/AI systems
Cross-functional collaboration
Communication and storytelling

Education

CS/Engineering degree

Tools

Kubernetes

Job description

Technical Product Manager - GenAI Platforms - AI Infrastructure - CTO Office

Location

New York

Business Area

Product

Ref #

10055039

Description & Requirements
About the Team

Bloomberg’s CTO Office is the future-looking technical and product arm of Bloomberg L.P. We envision, design, and prototype the next generation of infrastructure, hardware, and applications that power the Bloomberg Terminal and beyond. Our work spans AI platforms, cloud infrastructure, open-source stewardship, and generative AI innovation.

For over a decade, Bloomberg has been at the forefront of applying artificial intelligence, ML, and NLP to financial intelligence, powering products in sentiment analysis, classification, document understanding, recommendation, and generative AI. Critical to this effort are our AI platforms, which enable teams to rapidly and robustly build, deploy, evaluate, govern, and operate AI systems at scale.

As Bloomberg expands its investment in Generative and Agentic AI, we are scaling the model, cloud, compute, data, and infrastructure foundations that power the next generation of intelligent products across Terminal, Enterprise, and client-facing experiences.

What’s In It For You

We are looking for a Technical Product Manager to define and execute foundational capabilities for AI Infrastructure: the cloud, compute, data, networking, and runtime foundations behind Bloomberg’s AI platforms and AI-powered products.

You will help shape how teams experiment with, access, deploy, serve, and operate AI models across a range of infrastructure environments, while turning rapidly evolving model, cloud, and compute capabilities into reliable and reusable platform services. You will help define common platform abstractions and paved paths that give product teams consistent ways to access AI infrastructure, while allowing the underlying models, hardware, and cloud environments to evolve.

This role sits at the intersection of AI Platforms, agentic systems, cloud infrastructure, and distributed systems. You will work across engineering and product teams to improve the scalability, reliability, performance, and efficiency of Bloomberg’s AI infrastructure while preserving flexibility as models, providers, hardware, and workload patterns evolve.

This is a cross-cutting role by design. You’ll need to be comfortable working across product and organizational boundaries, identifying common infrastructure needs, establishing platform direction, and driving alignment in an area where both the technology and the architecture are evolving quickly.

Why This Matters

The infrastructure behind modern AI systems is becoming increasingly heterogeneous. Product teams may need to choose between frontier and specialized models, managed APIs and internally hosted models, public and private cloud infrastructure, different accelerator technologies, and different serving or training patterns. Increasingly, teams must also decide where workloads execute and where data resides. Data locality, network topology, accelerator availability, regulatory constraints, and cloud placement can have significant implications for quality, latency, throughput, capacity, availability, security, and cost. Bloomberg needs common infrastructure foundations that allow product teams to take advantage of advances in AI without independently solving model hosting, provider integration, capacity management, reliability, and cloud infrastructure challenges.

We’ll trust you to
  • Define and drive the vision for Bloomberg’s AI Infrastructure, with a focus on infrastructure across models, compute, and cloud
  • Work directly with AI product and engineering teams to understand their requirements for model quality, performance, scale, reliability, and cost, and translate common needs into reusable platform capabilities
  • Partner deeply with engineering to deliver scalable, resilient system architecture
  • Partner with cloud and infrastructure teams to advance hybrid and multi-cloud capabilities, including portability, resilience, scalability, and integration with model and cloud providers
  • Evaluate advances across cloud platforms, model providers, infrastructure services, model-serving technologies, accelerators, and emerging AI infrastructure capabilities, and translate them into pragmatic platform opportunities and roadmap decisions
  • Establish product metrics and strategies for improving latency, throughput, availability, utilization, capacity, and cost efficiency across AI workloads
  • Partner deeply with Engineering and stakeholders across AI Platforms, Cloud, Security, and other infrastructure organizations to align priorities, dependencies, and investments
  • Anticipate how AI workloads and infrastructure requirements will evolve, balancing standardization and paved paths with flexibility and choice
You’ll Need to Have
  • 5+ years of experience in technical product management, ideally within AI, platform, cloud, compute, or infrastructure domains
  • Experience building, operating, or product managing large-scale platform infrastructure used by internal or external developers
  • Experience with public cloud platforms such as AWS, GCP, or Azure, and familiarity with hybrid or multi-cloud architecture
  • Strong understanding of distributed systems, service-to-service communication, API Gateways, Kubernetes, cloud-native architectures, and service reliability
  • Technical fluency in the tradeoffs involved in operating AI workloads, including latency, throughput, availability, scalability, accelerator utilization, and cost
  • Familiarity working with AI or GenAI systems, with LLMs, generative AI, and their production requirements
  • Proven ability to work cross-functionally with engineering, security, product, and platform organizations
  • Excellent communication and storytelling skills, with the ability to translate between user needs, business priorities, and technical architecture, and influence across diverse teams
We’d Love to See
  • A degree in Computer Science, Engineering, related technical disciplines, or prior equivalent practical experience
  • Experience with GPU or accelerator infrastructure, HPC workloads, capacity planning, scheduling, or multi-tenant resource management
  • Experience with AI infrastructure platforms, MLOps, inference or training platforms, model gateways, inference techniques, model-as-a-service offerings, model optimization
  • Contributions to open-source infrastructure, AI, or developer ecosystems
  • Familiarity with financial services or other large-scale, regulated enterprise environments
Why Join Us

You will play a pivotal role in shaping Bloomberg’s AI future by building the infrastructure foundations that enable trusted, scalable, and production-ready AI systems. This is an opportunity to help define how AI systems operate at enterprise scale. You will work alongside world-class engineers, architects, researchers, and product leaders while helping establish the trusted infrastructure foundation that powers Bloomberg’s next generation of AI innovation.

Salary Range = 140,000 - 295,000 USD Annual + Benefits + Bonus

The referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level.

We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation (exempt roles only), paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns.

Discover what makes Bloomberg unique - watch our for an inside look at our culture, values, and the people behind our success.

Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.

Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email amer_recruit@bloomberg.net

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Technical Product Manager, AI Platform
Senior Technical Product Manager, AI Platform

Bloomberg Industry Group, Inc. • Arlington (VA)

On-site
USD 180,000 - 230,000
Product Management Lead- AI Ready Data
Product Management Lead- AI Ready Data

Bloomberg • New York (NY)

On-site
USD 180,000 - 350,000
Comprehensive benefits plan
401(k) + match
Paid holidays and time off
+1
Product Management Lead- AI Ready Data New York, NY Posted today
Product Management Lead- AI Ready Data New York, NY Posted today

Bloomberg • New York (NY)

On-site
USD 180,000 - 350,000
Comprehensive benefits plan
401(k) + match
Paid time off and holidays
Product Manager – Data and Platform Tools – Bloomberg Connects New York, NY Posted today
Product Manager – Data and Platform Tools – Bloomberg Connects New York, NY Posted today

Bloomberg • New York (NY)

On-site
USD 140,000 - 295,000
Senior ML Platform Engineer - Artificial Intelligence
Senior ML Platform Engineer - Artificial Intelligence

Bloomberg • New York (NY)

On-site
USD 160,000 - 240,000
401(k) + match
Paid time off
Medical and dental benefits
+1
Technical Strategist for AI Research - CTO Office New York, NY Posted today
Technical Strategist for AI Research - CTO Office New York, NY Posted today

Bloomberg • New York (NY)

On-site
USD 240,000 - 330,000
401(k) matching
Medical insurance
Dental insurance
+7
Senior Software Engineer - AI Inference New York, NY Posted yesterday
Senior Software Engineer - AI Inference New York, NY Posted yesterday

Bloomberg • New York (NY)

Hybrid
USD 160,000 - 240,000
Medical benefits
401(k) with employer match
Paid time off
Senior Data Management Professional - Data Product Owner (Data AI) Princeton, NJ Posted today
Senior Data Management Professional - Data Product Owner (Data AI) Princeton, NJ Posted today

Bloomberg • Princeton (NJ)

On-site
USD 110,000 - 190,000
Senior Software Engineer – Data and Platform Tools – Bloomberg Connects New York, NY Posted today
Senior Software Engineer – Data and Platform Tools – Bloomberg Connects New York, NY Posted today

Bloomberg • New York (NY)

On-site
USD 160,000 - 240,000
Senior Software Engineer - Cloud Native Compute Infrastructure Core New York, NY Posted today
Senior Software Engineer - Cloud Native Compute Infrastructure Core New York, NY Posted today

Bloomberg • New York (NY)

On-site
USD 160,000 - 240,000