Software Engineer - LLM Systems

NewtonX

United States

Hybrid

USD 150,000 - 210,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Medical, dental, and vision insurance
401k match with immediate vesting
Generous PTO and holidays
Diverse, collaborative culture

Job summary

NewtonX is seeking a skilled engineer to own core LLM infrastructure powering two B2B research products. You will ship production-grade code, work across the full stack with React/TypeScript on the frontend and Python/Node.js on the backend, and integrate LLMs via OpenAI/Anthropic APIs.

You will leverage AWS and Docker for scalable deployments, maintain high code quality, and focus on customer-centric technical solutions.

Qualifications

  • 3-4 years of experience shipping production code in a fast-paced environment.
  • Full-stack expertise with React, TypeScript; backend with Python/Node.js.
  • Hands-on experience integrating LLMs; OpenAI/Anthropic APIs; ML models in production.
  • Cloud and infrastructure experience with AWS and Docker; modern deployment practices.
  • Quality mindset with testing, code reviews, and high code quality standards.
  • Customer focus: translate user needs into technical solutions while maintaining best practices.

Skills

Production code
React/TypeScript
Python/Node.js
LLMs integration
AWS & Docker
Testing & code reviews
Customer focus

Tools

OpenAI APIs
Anthropic APIs
Docker
AWS
Kubernetes

Job description

About NewtonX

NewtonX is a B2B insights company trusted by the world's most innovative companies to make high-stakes decisions with confidence. We combine a verified network of business professionals with AI-powered research tools to deliver research intelligence faster, more precise, and more defensible than traditional methods.

Our clients include Google, Microsoft, TikTok, DoorDash, Stripe, and Coinbase. Our research has been cited by Fortune, Forbes, TechCrunch, Adweek, and the Wall Street Journal. NewtonX has raised $47M from investors including Two Sigma Ventures, Third Prime, XFund, and Citi Ventures.

About The Role

In this role, you'll own the core LLM infrastructure powering two products redefining B2B research:

Hub

The central cockpit for B2B research. Build self-serve features that compress weeks into days: question - expert insight - follow-up, powered by RAG and adaptive workflows.

Prime

Syndicated intelligence at scale. Architect automated systems that continuously capture expert opinions—creating longitudinal datasets and refreshable dashboards that compound in value.

The technical challenge: fusing structured survey data with unstructured expert knowledge, building semantic search across proprietary corpora, and creating AI pipelines that maintain research-grade quality at scale. If you love building novel data systems that turn raw signals into defensible, high-margin products, this is where you’ll do the most important work of your career.

What We're Looking For
Required
  • You write exceptional code, fast. 3-4 years of experience shipping production code in a fast-paced environment
  • Full-stack expertise: Moderate proficiency in React, TypeScript, and modern frontend frameworks. Backend experience with Python, Node.js, or similar
  • AI/ML implementation experience: Hands-on experience integrating LLMs, building with OpenAI/Anthropic APIs, or implementing ML models in production. We care more about a demonstrated eagerness to learn and an understanding of complex systems than specific years.
  • Cloud and infrastructure: Experience with AWS, Docker, and modern deployment practices
  • Quality mindset: Experience with testing, code reviews, and maintaining high code quality standards
  • Customer focus: Ability to translate user needs into technical solutions while maintaining engineering best practices
Nice To Have
  • RAG systems, embeddings, semantic search
  • Real-time data processing or streaming architectures
  • Open-source contributions in AI/ML
What Actually Matters

We care less about credentials and more about demonstrated ability. If you've built something interesting with LLMs— a side project, an open-source contribution, a blog post that shows how you think— put that at the top of your application.

Why Join NewtonX?
  • Frontier technology: Work with cutting-edge AI systems, pushing the boundaries of what's possible in enterprise AI applications
  • Exceptional traction: Strong product-market fit with the world's largest investment banks, hedge funds, and consulting firms
  • World-class team: We take talent density seriously. Work alongside incredibly smart, driven people who are passionate about their craft
  • High velocity: Ship features that directly impact how billion-dollar decisions are made
  • Growth opportunity: Join during a hypergrowth phase with clear paths for technical and career advancement
  • Impact: Your work will directly shape how the world's leading organizations make critical business decisions
What We Offer
  • Excellent medical, dental, and vision insurance.
  • 401k match with immediate vesting.
  • Generous Paid time off, holidays, and parental leave.
  • A diverse, collaborative, and positive culture where we invest in and celebrate each other's success.

Flexible work environment where we work hard but have fun (happy hours, team projects, and retreats).

NewtonX is proud to be an equal opportunity workplace. We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity/expression, age, status as a protected veteran, status as an individual with a disability, or any other applicable legally protected characteristics.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Software Engineer- LLM Systems (Remote)
Software Engineer- LLM Systems (Remote)

NewtonX, Inc. • New York (NY)

Remote
USD 180,000 - 220,000
Competitive compensation
Medical, dental, and vision insurance
401k match with immediate vesting
+2
ML Lead, AI Data Labeling
ML Lead, AI Data Labeling

NewtonX • United States

Remote
USD 120,000 - 160,000
Comprehensive Benefits
401k match with immediate vesting
Paid time off
Client Delivery Associate
Client Delivery Associate

NewtonX • New York (NY)

On-site
USD 65,925 - 80,575
Excellent medical, dental, and vision insurance
401k match with immediate vesting
Paid time off including vacation and parental leave
+2
Senior Staff Software Engineer
Senior Staff Software Engineer

NewtonX • New York (NY)

On-site
USD 130,000 - 160,000
Excellent medical, dental, and vision insurance.
401k match with immediate vesting.
Generous Paid time off: vacation, holidays, sick, and parental leave.
Strategic Insights and Analytics Manager (Remote)
Strategic Insights and Analytics Manager (Remote)

NewtonX, Inc. • New York (NY)

Remote
USD 85,000 - 130,000
Competitive compensation
Annual performance bonus
Employee equity plan
+1
Staff Software Engineer
Staff Software Engineer

NewtonX, Inc. • New York (NY)

Remote
USD 200,000 - 230,000
Competitive compensation
Excellent medical, dental, and vision insurance
401k match with immediate vesting
+2
Lead Applied AI Engineer
Lead Applied AI Engineer

Junior • New York (NY)

On-site
USD 110,000 - 140,000
Competitive pay and equity
Private healthcare
Gym membership
+2
Full stack engineer
Full stack engineer

Newform • New York (NY)

On-site
USD 100,000 - 160,000
Competitive compensation
Equity opportunities
Health, dental, and vision insurance
+2
LLM Platform Engineer
LLM Platform Engineer

Whatnot • Seattle (WA)

Hybrid
USD 245,000 - 345,000
Health Insurance
Work From Home Support
401k with employer match
+1
Member of Technical Staff
Member of Technical Staff

LeoForce • New York (NY)

On-site
USD 200,000 - 260,000
401k with company match
Medical, dental and vision benefits
Annual team offsites
+2