Software Engineer- LLM Systems (Remote)

NewtonX, Inc.

New York (NY)

Remote

USD 180,000 - 220,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Competitive compensation
Medical, dental, and vision insurance
401k match with immediate vesting
Generous paid time off and parental leave
Positive team culture

Job summary

A leading AI insights firm is seeking a skilled engineer to own the LLM infrastructure for transformative B2B research products. The role requires exceptional coding ability and full-stack experience, with knowledge of AI/ML implementations. Applicants should be adept in React, TypeScript, Python, and have experience with AWS and Docker. Competitive compensation and flexible working conditions across US time zones offer significant growth opportunities within a dynamic, innovative team.

Qualifications

  • 3-4 years of experience shipping production code in a fast-paced environment.
  • Moderate proficiency in React, TypeScript, front-end frameworks; backend experience with Python, Node.js.
  • Experience integrating LLMs and building with OpenAI/Anthropic APIs.

Responsibilities

  • Own the core LLM infrastructure for products that redefine B2B research.
  • Build self-serve features to expedite research processes.
  • Architect automated systems to capture expert opinions.

Skills

Full-stack expertise
Exceptional coding skills
AI/ML implementation
Customer focus

Tools

React
TypeScript
Python
AWS
Docker

Job description

About NewtonX

NewtonX delivers AI-powered B2B insights to the world's most demanding clients—McKinsey, Blackstone, Microsoft, Google, KKR—who use our data to make high-stakes decisions. Our research has been cited by Fortune, Forbes, TechCrunch, Adweek and more. We've built a reputation as the quality standard in the industry. Now we're building AI systems to make that quality infinitely scalable.

NewtonX has raised $47M in funding from VCs like Two Sigma Ventures, Third Prime, XFund and Citi Ventures.

The Role

In this role, you'll own the core LLM infrastructure powering two products redefining B2B research:

Hub – The central cockpit for B2B research. Build self‑serve features that compress weeks into days: question → expert insight → follow‑up, powered by RAG and adaptive workflows.

Prime – Syndicated intelligence at scale. Architect automated systems that continuously capture expert opinions—creating longitudinal datasets and refreshable dashboards that compound in value.

The technical challenge: fusing structured survey data with unstructured expert knowledge, building semantic search across proprietary corpora, and creating AI pipelines that maintain research‑grade quality at scale. If you love building novel data systems that turn raw signals into defensible, high‑margin products, this is where you’ll do the most important work of your career.

What We’re Looking For
Required
  • You write exceptional code, fast. 3‑4 years of experience shipping production code in a fast‑paced environment
  • Full‑stack expertise: moderate proficiency in React, TypeScript, and modern frontend frameworks. Backend experience with Python, Node.js, or similar
  • AI/ML implementation experience: hands‑on experience integrating LLMs, building with OpenAI/Anthropic APIs, or implementing ML models in production. We care more about a demonstrated eagerness to learn and an understanding of complex systems than specific years.
  • Cloud and infrastructure: experience with AWS, Docker, and modern deployment practices
  • Quality mindset: experience with testing, code reviews, and maintaining high code quality standards
  • Customer focus: ability to translate user needs into technical solutions while maintaining engineering best practices
Nice to Have
  • RAG systems, embeddings, semantic search
  • Real‑time data processing or streaming architectures
  • Open‑source contributions in AI/ML

What actually matters

We care less about credentials and more about demonstrated ability. If you've built something interesting with LLMs— a side project, an open‑source contribution, a blog post that shows how you think— put that at the top of your application.

Why Join NewtonX?

  • Frontier technology: work with cutting‑edge AI systems, pushing the boundaries of what's possible in enterprise AI applications
  • Exceptional traction: strong product‑market fit with the world's largest investment banks, hedge funds, and consulting firms
  • World‑class team: we take talent density seriously. Work alongside incredibly smart, driven people who are passionate about their craft
  • High velocity: ship features that directly impact how billion‑dollar decisions are made
  • Growth opportunity: join during a hyper‑growth phase with clear paths for technical and career advancement
  • Impact: your work will directly shape how the world's leading organizations make critical business decisions

What We Offer

  • Competitive compensation with a total compensation range of $180−220k (includes base and annual performance bonus) and equity. (Please note that salary and compensation may vary based on skills, experience, performance, and location.)
  • Excellent medical, dental, and vision insurance.
  • 401k match with immediate vesting.
  • Generous paid time off, holidays, and parental leave.
  • A diverse, collaborative, and positive culture where we invest in and celebrate each other's success.

Flexible work environment where we work hard but have fun (happy hours, team projects, and retreats).

Equal Opportunity

NewtonX is proud to be an equal opportunity workplace. We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity/expression, age, status as a protected veteran, status as an individual with a disability, or any other applicable legally protected characteristics.

Timezone

Location: Remote

Flexible across all US time zones.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Software Engineer - LLM Systems
Software Engineer - LLM Systems

NewtonX • United States

Hybrid
USD 150,000 - 210,000
Medical, dental, and vision insurance
401k match with immediate vesting
Generous PTO and holidays
+1
ML Lead, AI Data Labeling
ML Lead, AI Data Labeling

NewtonX • United States

Remote
USD 120,000 - 160,000
Comprehensive Benefits
401k match with immediate vesting
Paid time off
Client Delivery Associate
Client Delivery Associate

NewtonX • New York (NY)

On-site
USD 65,925 - 80,575
Excellent medical, dental, and vision insurance
401k match with immediate vesting
Paid time off including vacation and parental leave
+2
Strategic Insights and Analytics Manager (Remote)
Strategic Insights and Analytics Manager (Remote)

NewtonX, Inc. • New York (NY)

Remote
USD 85,000 - 130,000
Competitive compensation
Annual performance bonus
Employee equity plan
+1
Staff Software Engineer
Staff Software Engineer

NewtonX, Inc. • New York (NY)

Remote
USD 200,000 - 230,000
Competitive compensation
Excellent medical, dental, and vision insurance
401k match with immediate vesting
+2
Lead Applied AI Engineer
Lead Applied AI Engineer

Junior • New York (NY)

On-site
USD 110,000 - 140,000
Competitive pay and equity
Private healthcare
Gym membership
+2
Full stack engineer
Full stack engineer

Newform • New York (NY)

On-site
USD 100,000 - 160,000
Competitive compensation
Equity opportunities
Health, dental, and vision insurance
+2
Member of Technical Staff
Member of Technical Staff

LeoForce • New York (NY)

On-site
USD 200,000 - 260,000
401k with company match
Medical, dental and vision benefits
Annual team offsites
+2
LLM Platform Engineer
LLM Platform Engineer

Whatnot • Seattle (WA)

Hybrid
USD 245,000 - 345,000
Health Insurance
Work From Home Support
401k with employer match
+1
Lead AI/ML Engineer
Lead AI/ML Engineer

Junior AI • New York (NY)

On-site
USD 100,000 - 140,000
Competitive pay and equity
Private healthcare
Gym membership
+2