Senior Software Developer (Generative AI & LLM expertise)

TechStar Group; United States; Remote; USD 110,000 - 130,000; Full time

Job summary

A leading tech company seeks a Senior Software Developer specializing in generative AI and LLM expertise. The role involves designing AI applications, integrating third-party platforms, and solving complex technical challenges. Ideal candidates will have over 3 years of AI/ML experience and strong independence in project delivery.

Qualifications

• 3+ years of hands-on experience in AI/ML development.
• 1+ year focused on generative AI (LLMs, RAG, agents).
• Proven ability to work independently.

Responsibilities

• Design and implement generative AI applications using LLMs.
• Develop and deploy AI systems based on project requirements.
• Evaluate and integrate third-party AI platforms.

Skills

Generative AI applications

LLMs

AI/ML development

CI/CD pipelines

Git

Vector databases

Tools

React

REST/GraphQL

Cloudwatch

Grafana

Job description

Senior Software Developer (Generative AI & LLM expertise)

Senior Software Developer (Generative AI & LLM expertise)

Get AI-powered advice on this job and more exclusive features.

Role: Senior Software Developer (Generative AI & LLM expertise)

Rate: $110K on our W2 with no other benefits (Strictly W2, No C2C unless they are independent visa holders), Will negotiate the rate for Rockstars.

Location: 100% Remote

Job Responsibilities

• Design and implement generative AI applications using LLMs (e.g., GPT, Claude, LLama), foundation models, and agentic frameworks (LangChain, Amazon Bedrock Agents, Azure Semantic Kernel, AutoGen).

• Develop and deploy AI systems on:

• Evaluate and integrate third-party AI platforms (OpenAI, Anthropic, Cohere) based on project requirements.

• Design and implement LLM evaluation frameworks (RAGAS, hallucination checks, human-in-the-loop).

• Solve complex technical challenges related to scalability, performance, and compliance in AI systems.

• Build and maintain internal tools/UIs (React, REST/GraphQL) to operationalize AI capabilities.

Experience

• 3+ years of hands-on experience in AI/ML development, with 1+ year focused on generative AI (LLMs, RAG, agents).

• Proven ability to work independently—you thrive in ambiguity and drive projects to completion.

• Production experience with:

o Vector databases (OpenSearch, Pinecone, FAISS, Weivate).

• Experience in designing, implementing, and maintaining CI/CD pipelines using modern DevOps tools, with strong proficiency in Git for version control, branching strategies, and collaboration workflows. Familiarity with integrating security best practices throughout the software development lifecycle

• Familiarity with regulated data environments (e.g., HIPAA) is a plus

• Exposure to traditional ML (scikit-learn, pandas, EDA)

• Knowledge of observability tools (Cloudwatch, Grafana ) for monitoring AI systems.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at TechStar Group by 2x

Sign in to set job alerts for “Software Engineer” roles.

Software Engineer - Fullstack, Multiple Locations

United States $81,900.00-$174,600.00 1 week ago

Software Engineer, Early Career - Messaging API

Software Engineer (L5) - Open Connect Platform

United States $100,000.00-$720,000.00 1 week ago

Full-Stack Software Engineer (New graduates: United States)

United States $70,000.00-$100,000.00 2 weeks ago

New York, NY $140,000.00-$185,000.00 1 week ago

Software Engineer (L5) - Ads Identity & Privacy

United States $100,000.00-$720,000.00 2 weeks ago

Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

United States $100,000.00-$720,000.00 2 weeks ago

New York, United States $142,600.00-$196,200.00 1 week ago

United States $140,000.00-$170,000.00 1 month ago

Software Engineer Intern/Co-op (Fall 2025)

New York, NY $145,000.00-$260,000.00 7 months ago

United States $100,000.00-$720,000.00 2 weeks ago

United States $130,000.00-$180,000.00 1 week ago

Software Engineer - AI/ML, Multiple Locations

United States $81,900.00-$174,600.00 1 week ago

United States $90,000.00-$170,000.00 9 months ago

Software Engineer - AI/ML, Multiple Locations

Redmond, WA $81,900.00-$174,600.00 2 weeks ago

United States $110,000.00-$140,000.00 1 day ago

Software Engineer L4/L5, Training Platform, Machine Learning Platform

United States $100,000.00-$720,000.00 1 week ago

Costa Mesa, CA $125,000.00-$155,000.00 1 day ago

United States $164,200.00-$229,900.00 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.