Software Engineer, ML Infrastructure Ideogram Toronto

Neura Market

Toronto

On-site

CAD 120,000 - 180,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Competitive compensation
Equity
Vacation 4 weeks
Health, vision, and dental
RRSP/401(k) with employer match 4%
Top-of-the-line tools
Toronto HQ perks
Autonomy to explore
Learning culture

Job summary

Ideogram is seeking a Software Engineer, ML Infrastructure to build the systems powering training and serving for our generative AI models at scale. You will work across the stack, from designing distributed training infrastructure to optimizing inference pipelines, with reliability, speed, and efficiency at the forefront.

You should combine deep systems expertise with a builder’s mindset and strong technical ownership, thriving in a fast-evolving AI landscape at Ideogram's Toronto HQ.

Qualifications

  • 1–4 years building and shipping large-scale production infrastructure.
  • Experience designing large, highly available distributed systems with Kubernetes/GCP and GPU/TPU workloads.
  • Bachelor's degree in Computer Science, Engineering, related field, or equivalent practical experience.

Skills

Large-scale infra
Distributed systems
Technical ownership
Engineer-to-engineer communication

Education

Bachelor's degree in CS/Engineering or equivalent

Tools

Kubernetes
GCP
GPU/TPU workloads
Linux environments

Job description

About Ideogram

Ideogram’s mission is to make world-class design accessible to everyone, multiplying human creativity. We build proprietary generative media models and AI native creative workflows, tackling unsolved challenges in graphic design. Our team includes builders with a track record of technology breakthroughs including early research in Diffusion Models, Google’s Imagen, and Imagen Video. We care about design, taste, and craft as much as research and engineering – shipping experiences that creatives actually love.


We’ve raised nearly $100M, led by Andreessen Horowitz and Index Ventures. Headquartered in Toronto with a growing team in NYC, we're scaling fast, aiming to triple over the next year. We're a flat team with a culture of high ownership, collaboration, and mentorship.


Try Ideogram at ideogram.ai, and check out the following links to learn more about our work: Ideogram 4.0, Enterprise, and Custom Models.


About The Role

As a Software Engineer, ML Infrastructure at Ideogram, you'll build the systems that power training and serving for our generative AI models at scale. You'll work across the stack, from designing distributed training infrastructure to optimizing inference pipelines that serve millions of users, with a relentless focus on reliability, speed, and efficiency. We're looking for someone who combines deep systems expertise with a builder's mindset, strong technical ownership, and the ability to move fast in an evolving AI landscape.


What We're Looking For

Technical Excellence


  • 1-4 years developing and shipping large-scale production infrastructure.

  • Experience designing large, highly available distributed systems with Kubernetes/GCP, and GPU/TPU workloads on those clusters.

  • Experience in deploying, supporting, and troubleshooting in complex Linux-based computing environments.

  • Experience in worker scaling for training or inference workloads.

  • Fundamental knowledge in ML models and how they run on GPUs.


Ownership and Collaboration


  • Deep sense of ownership - proactively identifies opportunities, suggests improvements, and acts on them.

  • The grit and adaptability to solve complex technical challenges that evolve day to day.

  • Can explain technical concepts to both engineers and non-technical stakeholders

  • Pushes for quality through constructive code review and collaboration

  • Bachelor's degree in Computer Science, Engineering, related field, or equivalent practical experience


Our Culture

We’re a team of exceptionally talented, curious builders who love solving tough problems and turning bold ideas into reality. We move fast, collaborate deeply, and operate without unnecessary hierarchy, because we believe the best ideas can come from anyone.


Everyone at Ideogram rolls up their sleeves to make our products and our customers successful. We thrive on curiosity, creativity, and shared ownership. We believe that small, dedicated teams working together with trust and purpose can move faster, think bigger, and create amazing things.


Ideogram is committed to welcoming everyone — regardless of gender identity, orientation, or expression. Our mission is to create belonging and remove barriers so everyone can create boldly.


What We Offer


  • Competitive compensation and equity designed to recognize the value and impact of your contributions to Ideogram’s success.

  • 4 weeks of vacation to recharge and explore.

  • Comprehensive health, vision, and dental coverage starting on day one.

  • RRSP/401(k) with employer match up to 4% to invest in your future from the moment you join.

  • Top-of-the-line tools and tech to fuel your creativity and productivity.

  • Toronto HQ perks Steps from Union Station and the PATH, with daily in-office lunches and dinners.

  • Autonomy to explore and experiment — whether you’re testing new ideas, running large-scale experiments, or diving into research, you’ll have access to compute/resources you need when there’s a clear business or creative use case. We encourage curiosity and bold thinking.

  • A culture of learning and growth, where curiosity is encouraged and mentorship is part of the journey.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Machine Learning Engineer, Applied AI Ideogram Toronto
Machine Learning Engineer, Applied AI Ideogram Toronto

Neura Market • Toronto

On-site
CAD 120,000 - 170,000
Competitive compensation
4 weeks of vacation
Health, vision, dental coverage
+5
ML Open Source Lead Ideogram Toronto or New York
ML Open Source Lead Ideogram Toronto or New York

Neura Market • Toronto

On-site
CAD 150,000 - 230,000
Equity
4 weeks vacation
Health, vision and dental
+4
Director, Marketing & Communications
Director, Marketing & Communications

Ideon Technologies • Richmond

On-site
CAD 145,000 - 175,000
Equity options
Tuition assistance
Health & dental benefits
+4
Geoscientific Analyst
Geoscientific Analyst

Ideon Technologies • Richmond

Hybrid
CAD 100,000 - 130,000
Tuition support ($2500/year)
Extended health and dental benefits
Min 3 weeks paid time off
+2
Director, Marketing & Communications
Director, Marketing & Communications

Ideon Technologies Inc. • Richmond

Hybrid
CAD 125,000 - 170,000
Tuition support ($2,500/year)
Extended health and dental benefits
Minimum 3 weeks paid time off
+2
Product Manager, Platform Experience & Developer Product
Product Manager, Platform Experience & Developer Product

Cohere • Toronto

Hybrid
CAD 110,000 - 170,000
Lunch stipend
Health and dental benefits
RRSP matching / pension
+5
Software Engineer, Data Infrastructure
Software Engineer, Data Infrastructure

Cohere • Toronto

Hybrid
CAD 80,000 - 110,000
Open and inclusive culture
Weekly lunch stipend
Full health and dental benefits
+4
Data Engineer, Data Foundations
Data Engineer, Data Foundations

Cohere • Toronto, Montreal (administrative region)

Hybrid
CAD 90,000 - 150,000
Lunch stipend
Health and dental benefits
RRSP matching / 401K / Pension scheme
+2
Senior Software Developer (full stack)
Senior Software Developer (full stack)

Ideon Technologies • Richmond

Hybrid
CAD 115,000 - 145,000
Dynamic work environment
Tuition support
Health and dental benefits
+4
Lead Member of Technical Staff, Inference Infrastructure
Lead Member of Technical Staff, Inference Infrastructure

Cohere • Toronto

Hybrid
CAD 130,000 - 160,000
Open and inclusive culture
Weekly lunch stipend
Full health and dental benefits
+4