Software Engineer - Platform

International Business Machines Corporation

New York (NY)

On-site

USD 150,000 - 190,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

IBM Software is seeking a Software Engineer on the Platform team to design and implement scalable, cloud-native platform capabilities that power IBM’s AI-driven products. You will influence architecture, delivery, and reliability across global services.

You will collaborate with product, research, and platform groups to translate AI capabilities into production platform primitives, ensuring security, observability, and operability at scale.

Qualifications

  • 4+ years designing distributed systems with high availability and low latency.
  • 5+ years building or operating production Kubernetes or cloud-native infra.
  • Experience with LLM-based reasoning loops, tool usage, and agent architectures.
  • Background in developing or supporting SaaS platforms and multi-tenant offerings.

Responsibilities

  • Own platform architecture end-to-end, including high-throughput, low-latency infrastructure.
  • Lead orchestration layers, runtimes, and multi-agent patterns for scalable workloads.
  • Drive engineering strategy, decompose large problems, and align cross-functional teams.

Skills

Distributed systems
Backend development
Cloud-native
Kubernetes
LLM tooling

Education

Bachelor's degree

Job description

Introduction

At IBM Software, we transform client challenges into solutions. Building the world's leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You'll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM's product and technology landscape. Here, you'l have the tools and opportunities to advance your career while creating software that changes the world.

Introduction

At IBM Software, we transform client challenges into solutions. Building the world's leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You'll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM's product and technology landscape. Here, you'l have the tools and opportunities to advance your career while creating software that changes the world.

Your Role And Responsibilities
  • IBM’s Platform team spans the globe, just like the products we support. We build and power the technology that helps organizations manage, scale, and secure the modern enterprise. As a Software Engineer on Platform@IBM, you’ll play an important role in developing the next generation of platform technology that supports IBM’s products and customers worldwide.
  • Own platform architecture end-to-end: design, build, and operate the high-throughput, low-latency infrastructure that underpins IBM's commercial cloud offerings.
  • Lead systems development — architect and implement the orchestration layers, runtimes, and multi-agent commercial patterns that enable workloads to operate reliably at scale.
  • Drive technical strategy in the face of ambiguity; scope large, loosely defined problems, decompose them into tractable work, and align cross-functional teams around a clear engineering direction.
  • Set the bar for system reliability and scale — define SLOs, lead capacity planning exercises, and engineer for failure across distributed services handling millions of requests per day.
  • Mentor and level up the engineering organization; author RFCs and design documents that raise the technical floor for the entire team.
  • Collaborate with product, research, and adjacent platform teams to translate emerging AI capabilities — including retrieval-augmented generation, agent tool use, and model inference pipelines — into production‑grade platform primitives.
  • Champion engineering excellence: lead code reviews, drive adoption of observability and site reliability practices, and hold a high bar for testability, operability, and security.
Preferred Education

Bachelor's Degree

Required Technical And Professional Expertise
  • Distributed systems & high-scale backend expertise: 4+ years designing distributed systems, including consensus, replication, partitioning, and latency/throughput/consistency trade-offs, plus production experience with systems handling tens of thousands to millions of RPS with 99.9%+ availability and strict latency requirements.
  • Backend development & cloud-native infrastructure: Proficiency in Go, Rust, Java, Python, and/or C++, with 5+ years building or operating production Kubernetes, OpenShift, or equivalent container orchestration and cloud-native infrastructure.
  • Agentic AI & emerging architectures: Familiarity with LLM‑based reasoning loops, tool/function calling, agent‑to‑agent communication, and autonomous task execution frameworks, with the ability to apply these concepts in evolving technical environments.
  • Adaptability & commercialization: Demonstrated success in undefined, fast‑moving environments where requirements evolve, along with experience supporting SaaS commercialization, including packaging, go‑to‑market flows, tenancy, and provisioning.
  • US Federal offerings: Experience supporting US Federal offerings and working closely with government partners in regulated environments.
Preferred Technical And Professional Experience
  • Hands‑on experience architecting multi‑agent or agentic AI systems in production (orchestrators, planners, tool registries, memory/context stores) - 2 years
  • Background in developer platform or internal tooling at scale (CI/CD, observability, secrets management, API gateways, or platform control planes) - 5 years
  • Experience with event‑driven architectures using Kafka, NATS, or similar high‑throughput messaging systems – 5 years
  • Contributions to open‑source platform or infrastructure projects.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Platform Engineer (Github Team)
Platform Engineer (Github Team)

Worldpay (Uk) Limited • San Francisco (CA)

On-site
GBP 40,000 - 70,000
Confluent – Staff Systems Engineer
Confluent – Staff Systems Engineer

International Business Machines Corporation • Armonk (NY)

On-site
USD 150,000 - 190,000
Software Developer Coop Fall 2026
Software Developer Coop Fall 2026

International Business Machines Corporation • Durham (NC)

On-site
USD 20,664 - 41,328
Entry Level Software Developer 2026
Entry Level Software Developer 2026

International Business Machines Corporation • Tucson (AZ)

On-site
USD 80,000 - 120,000
SW Developer Intern | Enterprise Platform-as-a-Service - Durham, NC - 2027
SW Developer Intern | Enterprise Platform-as-a-Service - Durham, NC - 2027

International Business Machines Corporation • Durham (NC)

On-site
USD 32,000 - 42,000
Senior Platform Engineer
Senior Platform Engineer

EPAM Systems Inc • United States

Remote
USD 120,000 - 190,000
Forward Deployed Engineer – AI
Forward Deployed Engineer – AI

International Business Machines Corporation • Charlotte (NC)

Remote
USD 150,000 - 230,000
Remote work
401(k) plan
Health insurance
Senior Forward Deployed Engineer – AI
Senior Forward Deployed Engineer – AI

International Business Machines Corporation • Charlotte (NC)

Remote
USD 180,000 - 240,000
Senior Forward Deployed Engineer
Senior Forward Deployed Engineer

International Business Machines Corporation • New York (NY)

Remote
USD 150,000 - 210,000
Applied AI Specialist-Application Operations
Applied AI Specialist-Application Operations

International Business Machines Corporation • San Francisco (CA)

Remote
USD 120,000 - 180,000