About Signant Health
At Signant Health, we help bring life-changing treatments to patients faster. We are a global evidence generation company supporting clinical trials through smart technology, scientific expertise, and hands-on operational support — because better data leads to better healthcare decisions. Our teams work at the intersection of science, technology, and patient experience, delivering digital solutions that make clinical trials more efficient, accurate, and accessible worldwide. Trusted by leading pharmaceutical companies and CROs, our platforms and services support studies in more than 90 countries and have contributed to hundreds of new drug approvals. If you are motivated by meaningful work, global impact, and innovation in clinical research and digital health, you will find purpose — and opportunity — at Signant Health.
About the Role
We are seeking an AI Engineer to build andoptimizeSignantHealth's AI Platform and agents that automate workflows across our organization. This role sits at the intersection of application development and model optimization, requiring both strong software engineering fundamentals andexpertisein generative AI technologies.You'llbe responsible fordeveloping andoptimizingour AI platform components, developing intelligent agents, implementing RAG systems, and ensuring high-quality, secure, and compliant AI responses through rigorous evaluation frameworks and robust guardrails.
This position offers the opportunity to shape how AI transforms our organization's operations, working on production systems that directlyimpactefficiency and innovation across multiple teams whilemaintainingthe highest standards of data security, privacy, and regulatory compliance.
What you will do:
Application Development
- Design and implement AI-powered agents that automate complex, multi-step workflows across the organization.
- Build RAG (Retrieval-Augmented Generation) systems using vector stores and knowledge bases to ground AI responses in organizational knowledge.
- Develop prompt engineering strategies and context optimization techniques to maximize accuracy and reliability of AI outputs.
- Create integrations between AI systems and existing tools, APIs, and data sources.
- Implement memory systems andstatemanagement for conversational agents and long-running workflows.
Platform Optimization & Evaluation
- Develop comprehensive evaluation frameworks to measure accuracy, relevance, and quality of AI system responses.
- Design and execute experiments tooptimizeagent performance, including A/B testing of different prompting strategies.
- Monitor production AI systems and implement improvements based on performance metrics and user feedback.
- Optimizeinference costs and latency whilemaintainingquality standards.
- Build tooling and dashboards for observability into AI system behavior.
- Engineer datasets for training and fine-tuning language models on organization-specific tasks.
- Implement and evaluate fine-tuning pipelines for LLMs and SLMs (Small Language Models).
- Optimizemodel inference for production environments, balancing speed, cost, and quality.
- Conduct experiments todeterminewhen fine-tuning, prompt engineering, or RAG approaches are most appropriate.
- Stay current with advances in language models and evaluate new models for potential organizational use.
Security & Compliance
- Design and implement guardrails and content filtering mechanisms to prevent harmful or inappropriate AI outputs.
- Develop hallucination detection and mitigation strategies to ensure factual accuracy and reliability of agent responses.
- Establish security policies for AI systems including data access controls, prompt injection prevention, and sensitive information handling.
- Create compliance frameworks that align AI systems with regulatory requirements (GDPR, HIPAA, SOC2, etc.) and industry standards.
- Implement monitoring and alerting systems to detect anomalous AI behavior, security incidents, or compliance violations.
- Conduct AI safety assessments and red-teaming exercises toidentifyvulnerabilities and edge cases.
- Document AI decision-making processes andmaintainaudit trails for regulatory review and internal governance.
- Collaborate with security, legal, and compliance teams to ensure AI systems meet organizational risk management standards.
Collaboration & Technical Leadership
- Partner with business stakeholders toidentifyhigh-impact automation opportunities.
- Document AI system architectures, design decisions, and best practices.
- Contribute to technical standards and guidelines for AI development across the organization.
- Mentor team members on AI technologies and share knowledge through internal presentations or documentation.
- Participate in code reviews and provide feedback on AI system designs.
Preferred Qualifications:
Education
- AWSAI/MLcertifications arepreferred.
Experience
Required:
- 5+ years of software engineering experience with strongproficiencyin Python and production system development.
- 2+ years of hands-on experience building and deploying AI/ML applications in production environments.
- Demonstratedexpertisein prompt engineering, context engineering, andoptimizingLLM-based applications for accuracy and performance.
- Experience implementing RAG (Retrieval-Augmented Generation) systems using vector databases (PostgresSQL(pgvector), AmazonBedrockKnowledgeBases,MongoDB, Pinecone).
- Proventrack recordof building evaluation frameworks and metrics to measure AI system quality, accuracy, and reliability.
- Experience with LLM fine-tuning, dataset engineering, and model evaluation methodologies.
- Strong understanding of AI security principles including guardrails, content filtering, hallucination detection, and prompt injection prevention.
- Experience working with APIs, microservices architectures, and distributed systems.
- Proficiencywith version control (Git), CI/CD pipelines, and modern software development practices.
Preferred:
- Experience building autonomous agents or multi-step AI workflows with tool use and decision-making capabilities.
- Knowledge of inference optimization techniques, model quantization, or deployment optimization for LLMs and SLMs.
- Familiarity with regulatory compliance frameworks (HIPAA, GDPR, SOC2) in the context of AI systems.
- Experience implementing monitoring, logging, and alerting systems for production AI applications.
- Background in healthcare, life sciences, or clinical trial operations.
- Contributions to open-source AI projects or published work in applied AI/ML.
- Experience with AI safety, red-teaming, or adversarial testing methodologies.
- Familiarity with modern AI frameworks (Strands,LangChain,CrewAI,LlamaIndex) and model providers (Amazon Bedrock,Anthropic,OpenAI, Gemini).
Why Signant Health?
At Signant Health, your work has real impact. Everything we build, support, and deliver helps advance clinical research and bring new treatments to patients faster — improving lives around the world. Our teams combine science, technology, and operational expertise to solve complex clinical trial challenges, and every role contributes to that mission. We offer a collaborative, global environment where you can grow your career while working alongside experts across clinical, technology, data, and operations, with opportunities to learn, take ownership, and drive meaningful innovation — not just maintain the status quo. If you are looking for purpose-driven work, smart colleagues, and the opportunity to help shape the future of clinical research and digital health, Signant Health is the place to do it.
At Signant Health, accepting difference isn’t enough—we celebrate it, we support it, and we nurture it for the benefit of our team members, our clients and our community. Signant Health is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or veteran status.