Senior AI/ML Engineer - LLMs for Claims Synthesis

EvolutionIQ; New York (NY); On-site; USD 200,000 - 235,000; Full time

Benefits offered by this job

Sponsorship visa transfer

Tuition reimbursement

Health benefits

401k matching

Parental leave

Catered lunches

Job summary

EvolutionIQ is seeking an experienced AI/ML Engineer to own and advance our medical synthesis product in a fast-growing startup. You will drive projects from ideation through deployment, crafting scalable architectures and production-ready code for hybrid LLM/RAG systems that extract key information from complex medical documents and support human-in-the-loop summarization workflows.

You will collaborate with Product, Engineering, and SMEs to refine requirements, evaluate model outputs, and push

Qualifications

• 5-8+ years of experience writing performant Python code following modern best practices.
• Minimum 1 year of experience building and deploying products powered by large language models (LLMs) in fast-paced, professional environments.
• Proven experience leading technical projects and driving them from concept through production deployment.
• Experience making architectural decisions for AI/ML systems and evaluating technical tradeoffs across scalability, reliability, performance, and maintainability.
• Hands-on experience with statistical machine learning techniques as well as hybrid approaches combining LLMs, retrieval-augmented generation (RAG), and embeddings-based models, including vector search and similarity measures.
• Proven ability to build and integrate API services within service-oriented or microservice architectures.
• Strong skills in evaluating and interpreting LLM outputs and AI model predictions, with a focus on aligning model behavior with real-world business and user outcomes.
• Expertise in prompt engineering and fine-tuning of large language models for domain-specific applications.
• Strong communication and collaboration skills, with the ability to influence technical direction and work effectively with Product, Engineering, SMEs, and other stakeholders.

Responsibilities

• Lead AI/ML projects end-to-end, taking ownership from initial ideation and requirements gathering through architecture, development, deployment, and ongoing optimization
• Make high-level architectural and technical decisions for AI/ML systems, balancing scalability, performance, reliability, maintainability, and business impact
• Design, build, and deploy AI-powered and LLM-driven features for our claim synthesis product, including robust extraction of key information from complex medical documents and human-in-the-loop summarization workflows
• Develop and implement hybrid machine learning solutions that leverage statistical models, LLMs, and embeddings-based retrieval techniques such as RAG to improve system accuracy, scalability, and robustness
• Write clean, scalable, and efficient code while optimizing the performance of existing AI/ML systems in production
• Collaborate closely with data labelers and subject matter experts (SMEs) to rigorously evaluate AI system outputs and continuously improve model performance
• Partner closely with Product, Engineering, and other cross-functional teams to gather requirements, define technical approaches, prioritize work, and rapidly iterate on feedback
• Provide technical leadership and guidance to other engineers, helping establish best practices and driving consistency across AI/ML solutions
• Break down complex, ambiguous problems into well-defined technical solutions and drive projects forward while balancing short-term delivery with long-term architectural considerations
• Translate cutting-edge AI/ML research and novel techniques into production-grade, reliable, and maintainable solutions that operate seamlessly in live customer environments

Skills

Python

LLMs

Technical leadership

AI/ML architecture

Statistical ML

API services

LLM evaluation

Prompt engineering

Cross-functional collaboration

Tools

Vector search

Distributed systems

Job description

EvolutionIQ is seeking an experienced AI/ML Engineer to own and advance our medical synthesis product in a fast-growing startup. You will drive projects from ideation through deployment, crafting scalable architectures and production-ready code for hybrid LLM/RAG systems that extract key information from complex medical documents and support human-in-the-loop summarization workflows.

You will collaborate with Product, Engineering, and SMEs to refine requirements, evaluate model outputs, and push