LLM Performance Engineer: GPU Benchmarks & Systems Tooling

The Consensus; New York (NY); On-site; USD 80,000 - 100,000; Full time

Benefits offered by this job

Competitive compensation

100% medical, dental, and vision coverage

Flexible PTO policy

Paid parental leave

Company-facilitated 401(k)

Exposure to ML startups

Job summary

The Consensus is seeking early-career Software Engineers to innovate in performance benchmarking and LLM engineering. This role provides the chance to work at the intersection of hardware and software, focusing on systems that drive AI capabilities.

Ideal candidates are curious about systems, passionate about automation, and familiar with tools like Python and NVIDIA’s ecosystem. Competitive compensation, benefits, and a chance to make a considerable impact await you at The Consensus.

Qualifications

• A strong curiosity about systems and hardware.
• Experience in scripting automation.
• Mathematical understanding related to AI models.

Responsibilities

• Perform benchmarks for LLM quality and custom workloads.
• Validate infrastructure for GPU clusters.
• Develop tools for GPU-enabled environments.
• Build models for performance measurement and testing.

Skills

Understanding of GPU memory subsystems

Automation mindset

Familiarity with Python

Interest in optimization techniques

Education

Bachelor's degree in Computer Science or related field

Tools

NVIDIA software stack

C++

Job description

The Consensus is seeking early-career Software Engineers to innovate in performance benchmarking and LLM engineering. This role provides the chance to work at the intersection of hardware and software, focusing on systems that drive AI capabilities.

Ideal candidates are curious about systems, passionate about automation, and familiar with tools like Python and NVIDIA’s ecosystem. Competitive compensation, benefits, and a chance to make a considerable impact await you at The Consensus.