Machine Learning Research Engineer

Career Techniques

New York (NY)

On-site

USD 200,000 - 300,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Career Techniques in New York is seeking an experienced ML researcher to expand our distributed ML stack, benchmark workloads, and stress-test both software and hardware across the platform. You will build high-level abstractions, integrate tooling with data frameworks, and enable rapid experimentation using Ray.

The role requires hands-on ML experience with PyTorch/TensorFlow, scalable ML deployment, and familiarity with AI agent workflows.

Qualifications

  • Strong software engineering foundation in Python and API design.
  • Hands-on experience with modern frameworks (PyTorch, TensorFlow) and large-scale deployment.
  • Experience scaling ML workloads across GPUs and multi-node clusters.
  • Familiarity with AI agent workflows and LLM tooling.
  • Ability to identify bottlenecks across hardware and software (memory, GPU utilization, data pipelines).

Responsibilities

  • Platform Validation & Infrastructure Benchmarking: test training and inference environments.
  • Streamline Rapid Prototyping for ML Research: build abstractions and integrate core ML tooling.
  • Agentic Workflows for ML Research: leverage AI agents to generate experiments and stress-test clusters.
  • Research Platform Feedback & Insights Sharing: publish empirical findings and advise engineering teams.

Skills

Python
APIs
PyTorch
TensorFlow
Distributed Compute
Ray
Dask

Tools

Ray
Dask
PyTorch Distributed

Job description

You will focus on expanding our ML research platform to benchmark, rapidly prototype, and stress-test both software and hardware layers across our entire distributed ML stack. By leveraging AI agents and auto-research capabilities, you will push our systems to their limits, identify bottlenecks, and create a frictionless environment to test novel machine learning models on realistic, large-scale data.

Responsibilities
  • Platform Validation & Infrastructure Benchmarking:
    • Serve as the primary feedback loop for the entire ML stack.
    • Actively run complex models through our full ML pipeline to comprehensively test both the training and inference environments.
    • Validate the central infrastructure in practice, seeing exactly how new research ideas fare and identifying system bottlenecks before broader rollout to research teams.
  • Streamline Rapid Prototyping for ML Research:
    • Build high-level abstractions that allow users to bypass setup friction.
    • Integrate our core ML tooling directly with our underlying simulation and data frameworks, providing a unified entry point to access our full tech stack.
    • Enable rapid iteration on real-world data and seamless distributed training via Ray.
  • Agentic Workflows for ML Research:
    • Leverage AI agents and auto-research workflows to autonomously generate experiments, stress-test our distributed clusters, and provide data-driven, actionable feedback on what infrastructure needs to be optimized or built next.
  • Research Platform Feedback & Insights Sharing:
    • Act as the critical bridge between infrastructure builders and ML researchers.
    • Be the first to exhaustively test new models and push the platform's limits.
    • Document and publish empirical findings on system capabilities and hardware performance.
    • Take your validated insights to assist engineering teams with platform improvements and advise researchers on how to best leverage the stack.
Qualifications
  • Strong Software Engineering Foundation:
    • Deep proficiency in Python and software design principles.
    • Ability to build clean, scalable APIs and abstractions that other developers and researchers are enthusiastic about using.
  • Applied Machine Learning:
    • Hands-on experience with modern frameworks (PyTorch, TensorFlow, etc.)
    • Strong practical understanding of how to train, evaluate, and deploy models at scale.
  • Distributed Compute:
    • Experience scaling ML workloads across GPUs and multi-node clusters using frameworks like Ray, Dask, or PyTorch Distributed.
  • AI Agent Workflows:
    • Familiarity with LLM tooling, agentic frameworks, and using AI to automate coding, research, or testing tasks.
  • System Profiling & Optimization:
    • Ability to debug and identify bottlenecks across hardware and software layers (e.g., memory limits, GPU utilization, data pipeline latency).

Comp: $200-300K + Bonus

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Research Engineer
Machine Learning Research Engineer

Fintal Partners • New York (NY)

On-site
USD 150,000 - 190,000
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Sierracorp • San Francisco (CA)

On-site
USD 150,000 - 200,000
Member of Technical Staff
Member of Technical Staff

Harrison Clarke • San Francisco (CA)

On-site
USD 180,000 - 280,000
Machine Learning Engineer
Machine Learning Engineer

Goliath Partners Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior/Staff ML Engineer
Senior/Staff ML Engineer

EPM Scientific • California

On-site
USD 180,000 - 260,000
Senior Machine Learning Engineer (AI Infrastructure)
Senior Machine Learning Engineer (AI Infrastructure)

Robinhood • Menlo Park (CA)

On-site
USD 200,000 - 320,000
Sr Software Engineer - ML Infrastructure
Sr Software Engineer - ML Infrastructure

Uber • Sunnyvale (CA)

On-site
USD 180,000 - 260,000
Bonus Program
Equity Awards
401(k) Plan
+1
Member of Technical Staff, ML Engineer
Member of Technical Staff, ML Engineer

Acceler8 Talent • Massachusetts

Hybrid
USD 180,000 - 240,000
ML Research Engineer Brooklyn, NY On-site $235,000 – $295,000 · per year · USD
ML Research Engineer Brooklyn, NY On-site $235,000 – $295,000 · per year · USD

Nodi • New York (NY)

On-site
USD 235,000 - 295,000
Machine Learning Engineer 5 (Senior Manager, IC)
Machine Learning Engineer 5 (Senior Manager, IC)

Information Technology Senior Management Forum • New York (NY)

On-site
USD 230,000 - 262,000