AI Software Engineer (Python, LLM, RAG)

Gambit Technologies; New York (NY); On-site; USD 140,000 - 170,000; Full time

Job summary

Gambit Technologies is seeking a hands-on AI software engineer in NYC to design, build, and ship AI-powered applications end to end. You will work with large language models, construct pipelines and services, and partner with business teams to translate real problems into working products.

This is a production-focused role, where AI is the toolkit and shipping is the job. You will engage across use cases in legal, policy, and mission-driven programs with world-class backing.

Qualifications

• Strong software engineering fundamentals: Python, APIs, production services.
• Hands-on experience building with LLMs: RAG pipelines, prompt engineering, embeddings, agents.
• Experience taking AI features to production, not just proof of concept.
• Comfort working directly with non-technical stakeholders to shape use cases.

Responsibilities

• Design, build, and ship AI-powered applications end to end: working with large language models, building the pipelines and services around them.
• Partner with business teams to turn real problems into working products; shipping is the job.
• Take AI features from idea to production with a hands-on software engineering approach.

Skills

Python

APIs

Production services

LLMs

RAG pipelines

Prompt engineering

Embeddings

Agents

Tools

LangChain

LlamaIndex

Job description

Most AI engineering jobs are demos and prototypes. This one ships. Our client, a world-class organization whose work spans professional information services and global philanthropy, is building AI into the tools thousands of professionals rely on every day, and they need an engineer who can take LLM-powered features from idea to production.

The Role

You'll design, build, and ship AI-powered applications end to end: working with large language models, building the pipelines and services around them, and partnering directly with business teams to turn real problems into working products. This is a hands‑on software engineering role first — AI is the toolkit, shipping is the job.

You'll get rare range here: use cases across legal and policy intelligence, research, and mission-driven programs, with the resources of a world-class technology organization behind you.

What You'll Need

• Strong software engineering fundamentals — Python, APIs, production services
• Hands‑on experience building with LLMs: RAG pipelines, prompt engineering, embeddings, agents
• Experience taking AI features to production, not just proof of concept
• Comfort working directly with non-technical stakeholders to shape use cases
• NYC-based, onsite 3-4 days a week

Bonus Points

• Vector databases, orchestration frameworks (LangChain, LlamaIndex, or similar)

Why This Role

AI roles this hands‑on, with this much organizational backing and this little bureaucracy, are rare. You'll see your work used by real professionals within weeks, not quarters, and you'll be early on a team that's defining how one of the world's most respected organizations uses AI.