Senior AI Engineer

BuildGroup LLC; New York (NY); Remote; USD 120,000 - 180,000; Full time

Job summary

An innovative company is seeking a Senior AI Engineer to lead the development of Generative AI capabilities within their Insight Engine. This role offers the chance to work at the intersection of LLMs, Search, and NLP, creating impactful systems that solve real business challenges. You will be responsible for designing and deploying cutting-edge AI features, ensuring they are robust and effective. Join a dynamic team that values collaboration and innovation, and contribute to shaping the future of AI in enterprise environments. If you're passionate about technology and eager to make a difference, this opportunity is for you.

Benefits

Remote-first flexibility

Competitive compensation

Equity participation

Generous time off

Annual international team meetups

Mental health support

Access to Squirro Academy for continuous learning

Qualifications

• 5+ years of experience in software/ML engineering.
• Strong commitment to testing and validation in production systems.
• Deep hands-on experience in NLP and Generative AI.

Responsibilities

• Design and develop Generative AI capabilities within the Insight Engine.
• Build features using LLMs for search, summarization, and recommendations.
• Deploy and optimize models in production for speed and cost-efficiency.

Skills

NLP

Generative AI

LLM integration

Prompt engineering

Python development

MLOps

Software design patterns

Education

Bachelor's degree in Computer Science or related field

Tools

Langchain

AWS

Azure

GCP

Elasticsearch

Job description

Squirro is redefining how enterprises unlock unstructured data through AI. As a pioneer in Enterprise Generative AI, we help global organizations—from central banks to manufacturing giants—make faster, smarter decisions through contextual, AI-powered insights. Squirro’s Enterprise GenAI Platform combines Search, Retrieval-Augmented Generation (RAG), and LLM-based components to surface actionable insights from unstructured data. Designed to integrate seamlessly with existing systems and workflows, the platform supports key use cases like Knowledge Management, Question Answering, and Summarization. The Squirro platform already offers flexible building blocks for deploying tailored GenAI solutions at enterprise scale.

We’re looking for a Senior AI Engineer to design and develop the Generative AI capabilities within our Insight Engine. You’ll work at the intersection of LLMs, Search, RAG, and NLP, creating production-ready systems that solve real business problems. You will be in the driver’s seat in shaping the future of Squirro’s Enterprise GenAI platform.

What You’ll Do

• Build Generative AI features using LLMs to augment decision-making across use cases like, search, summarization, recommendations, and Q&A.
• Design Retrieval-Augmented Generation (RAG) pipelines to ground LLMs with customer-specific context and data.
• Develop & educate prompt strategies and support the design of abstractions for prompt reuse and testing.
• Deploy and optimize models in production, with a focus on speed, cost-efficiency, and cloud-native scalability (AWS, Azure, GCP).
• Evaluate and monitor models, ensuring accuracy, relevance, and fairness.
• Embed AI guardrails for secure, responsible, and explainable AI systems.
• Collaborate cross-functionally with engineering, product, and customer teams to deliver high-impact features and help the team grow through knowledge sharing, documentation, and pairing on complex problems.

What You Bring

• 5+ years in software/ML engineering developing & deploying production systems.
• Strong commitment to testing, validation, and observability—especially in systems where correctness can be fuzzy.
• Experience designing robust, testable, and observable GenAI systems—where correctness, fallback behavior, and evaluation are essential.
• Deep hands-on experience in NLP and Generative AI, especially with tools like Langchain.
• Experience with LLM integration, prompt engineering, and model fine-tuning.
• A deep interest in software design patterns, abstraction, and crafting developer-friendly APIs is highly valued.
• Strong skills in modern python development (co-routines, functional programming, typing, structured data modeling (e.g., Pydantic), and clean interface design).
• Strong understanding of cloud infrastructure and MLOps practices.
• A pragmatic, product-minded approach to building AI systems that solve real-world problems with an eye for long-term maintainability, developer ergonomics, and clear abstractions.
• (optional) Experience working with vector stores, embeddings, or hybrid search systems (e.g., Elasticsearch + LLMs) is a strong plus.

You’ll Thrive Here If You

• Want to shape how Generative AI is used responsibly and practically in enterprise environments.
• Are energized by hard technical challenges and fast iteration.
• Love bridging the gap between AI innovation and product impact.
• Thrive in collaborative, globally distributed teams with high autonomy.
• Are curious and reflective—eager to dive into the why, not just the how, behind design choices and algorithmic trade-offs.
• Care about clean code, clear communication, and helping your team grow together—whether by writing great docs, sharing context, or pairing on tricky problems.

What You’ll Love About Squirro

• Work on the cutting edge of Generative AI, solving data challenges that matter.
• Join a close-knit, ambitious team committed to innovation and impact.
• Remote-first flexibility with vibrant offices in Zurich, New York, London, and Singapore.
• Competitive compensation, equity participation, generous time off.
• Annual international team meetups, mental health support, and access to Squirro Academy for continuous learning.

About Squirro

Our vision is to spearhead the insights era by making the art of converting data into contextualized insights accessible to all, ensuring the timely delivery of the right information to the right person. To achieve that, we marry data from any source with the user's intent and context to augment decision-making using AI.

Our mission is to empower organizations with AI technology to make smart people smarter, save time, and increase efficiency and effectiveness across the organization.

Squirro works with global organizations, primarily in the Financial Services, Insurance, Telecommunications, and Manufacturing industries. Customers include Bank of England, Standard Chartered Bank, the European Central Bank, Henkel, and Candriam (A New York Life company).

Founded in 2012, Squirro is currently present in Zürich, London, Munich, New York, and Singapore. Further information about AI-driven business insights can be found at https://squirro.com/.