Jobs bei Amazon in United States

As the Lead Engineer, directing our LLM Services team, you’ll be at the forefront of integrating AI into healthcare delivery. You will work closely with Product and Engineering leadership to co-design, architect and integrate LLM-powered services to our core product. You will lead the architecture and implementation of these services, alongside the LLM Services team, which you will also be responsible for assembling and managing. Specifically, you will:

• Work closely with colleagues across Product and Engineering, in participating in and, subsequently overseeing the architecture and implementation of LLM-powered features and their accompanying services.
• Build robust model evaluation pipelines to measure and improve LLM output safety, quality and consistency.
• Work on prompt engineering, chain-of-thought / prompt chaining, tool-use / function-calling (agentic) implementations.
• Ensure compliance with healthcare regulations while working with LLM outputs.
• Hire members for and manage the LLM team.

Requirements

• Expert knowledge in LLM architectures, fine-tuning principles and methods, agentic system design and LLM evaluation metrics.
• Familiarity with streaming architectures for real-time LLM responses.
• Strong grasp of software engineering best practices, including testing, documentation, and version control.
• Excellent problem-solving skills and attention to detail.
• Strong written and verbal communication skills.

You'd Be a Great Fit If You Have

• Strong academic background related to Machine Learning, NLP, or related fields.
• Passion for entrepreneurship and innovation, manifested through building products utilizing state-of-the-art technology.
• Experience with model fine-tuning and/or implementing RAG (Retrieval Augmented Generation) systems in production.
• Experience with LLM frameworks such as LangGraph, LangChain, LlamaIndex, or similar orchestration tools.
• Familiarity with different LLM providers (OpenAI, Anthropic, etc.) and their APIs.
• Familiarity with the use of Open LLMs, either self-hosted or through a third-party provider, e.g. Amazon Bedrock.
• Knowledge of LLM output validation and safety measures.
• Experience with embeddings and semantic search implementations.
• Experience in managing small teams of self-driven engineers, working in an inclusive, distributed environment.
• Knowledge of healthcare data privacy regulations and security best practices.

Location & Work Style

• All-remote position.
• Occasional late meetings to collaborate with US-based team members.

Summary

Remote job title: Lead LLM Engineer

Job tags: python, llm, machine learning, healthcare, ai