Generative AI Engineer

Jobgether SRL; United States; On-site; USD 140,000 - 200,000; Full time

Benefits offered by this job

Mission-driven work

AWS cloud experience

Professional growth

Job summary

Jobgether SRL seeks a Generative AI Engineer in the United States to design and deploy secure AI solutions for healthcare program information. You will ground LLM outputs with authoritative docs, build robust ingestion pipelines, and craft prompts with context strategies in collaboration with cross-functional teams.

Responsibilities include implementing source-backed responses, grounding outputs, and establishing guardrails for PII/PHI.

Qualifications

• Master's degree in computer science, data science, engineering, or a related technical field.
• At least 5 years of software and cloud-based solution development, incl. hands-on LLM/generative AI work.
• Strong Python proficiency and experience with modern LLM APIs, SDKs, orchestration frameworks, and AI/ML libs (Hugging Face, LangChain, LlamaIndex).
• Hands-on experience designing generative AI systems with embeddings, vector databases, and semantic search.
• Experience with AWS AI/data services (Bedrock, OpenSearch, Kendra, SageMaker, Lambda, S3).
• Prompt engineering, context engineering, LLM evaluation, and grounding in source materials.
• Experience evaluating foundation models for accuracy, latency, cost, and security.
• Agile software development and modern delivery practices; CI/CD tooling (GitHub Actions, CloudFormation, Terraform, Jenkins).
• Strong problem-solving, communication, and collaboration skills; explain AI capabilities to non-tech stakeholders.
• Experience in federal health programs, FedRAMP, NIST controls is a plus.

Responsibilities

• Design, develop, test, deploy, and maintain generative AI solutions grounded in authoritative healthcare documentation.
• Build ingestion pipelines: parsing, chunking, metadata tagging, embeddings, and vector search indexing.
• Translate user needs into prompts, context strategies, system requirements, and evaluation criteria with cross-functional teams.
• Implement AI responses with source citations and links to underlying docs for traceability.
• Implement responsible AI guardrails: content filters, PII/PHI protections, and refusal handling for out-of-scope queries.
• Develop evaluation frameworks and test datasets to measure retrieval quality and answer accuracy.
• Monitor, evaluate, and tune AI solutions balancing accuracy, latency, cost, security, and use-case needs.
• Support multiple foundation models/providers; assess performance vs requirements.
• Operate solutions using approved AWS services, contributing to security authorization and governance docs.
• Write clean, reusable code; contribute to reviews, tests, deployments, and maintenance.
• Communicate AI capabilities, limitations, risks, and performance to stakeholders.

Skills

Python

LLM APIs

Prompt engineering

Agile development

CI/CD pipelines

AWS cloud

Embeddings

Vector databases

RAG systems

Communication

Education

Master's degree in CS/Engineering

Tools

Hugging Face

LangChain

LlamaIndex

OpenSearch

SageMaker

GitHub Actions

Terraform

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Generative AI Engineer based in United States.

This is an opportunity to build secure, trustworthy generative AI solutions that improve how healthcare organizations access and use authoritative program information. You will design and operate AI-powered decision-support capabilities that allow users to navigate complex statutes, regulations, rules, and guidance through natural language. The role combines hands-on software engineering with expertise in LLMs, retrieval-augmented generation, search, evaluation, and responsible AI. You will work closely with project managers, data engineers, developers, analysts, subject matter experts, and client stakeholders to translate real-world needs into reliable AI solutions. Your work will contribute to systems where accuracy, traceability, security, and responsible use are critical. This role is well suited to an experienced AI engineer who enjoys solving complex problems in a collaborative, mission-driven environment.

Accountabilities

• Design, develop, test, deploy, and maintain generative AI solutions that ground large language model responses in authoritative healthcare program documentation.
• Build and maintain document ingestion pipelines covering parsing, chunking, metadata tagging, embedding generation, and vector or semantic search indexing.
• Translate user needs and stakeholder requirements into effective prompts, context strategies, system requirements, and evaluation criteria in collaboration with cross-functional teams and subject matter experts.
• Implement AI responses that include source citations and direct links to underlying documentation, ensuring that users can trace answers back to authoritative materials.
• Design and implement responsible AI guardrails, including content filtering, scope restrictions, PII and PHI protections, and appropriate refusal handling for out-of-scope questions.
• Develop evaluation frameworks and test datasets to measure retrieval quality, answer accuracy, groundedness, consistency, and overall system performance.
• Continuously monitor, evaluate, and tune AI solutions to improve reliability while balancing accuracy, latency, cost, security, and specific use-case requirements.
• Design AI applications capable of supporting multiple foundation models and providers and evaluate model performance against business and technical requirements.
• Deploy and operate solutions using approved AWS services and within applicable federal security controls, contributing to documentation required for security authorization and AI governance reviews.
• Implement logging, monitoring, and audit trails that support transparency, operational oversight, cost management, and responsible AI governance.
• Write clean, reusable, well-documented code and contribute to code reviews, automated testing, deployment processes, and ongoing system maintenance.
• Collaborate with technical and non-technical stakeholders to communicate AI capabilities, limitations, risks, and performance clearly.
• Stay current with emerging generative AI technologies, foundation models, development frameworks, security practices, and federal AI guidance.

Requirements

• You have a master's degree in computer science, data science, engineering, or another relevant technical field.
• You have at least 5 years of experience developing software and cloud-based solutions, including recent hands-on experience designing and deploying LLM or generative AI applications.
• You have strong proficiency in Python and experience working with modern LLM APIs, SDKs, orchestration frameworks, and AI/ML libraries such as Hugging Face, LangChain, LlamaIndex, or equivalent technologies.
• You have hands-on experience designing and deploying generative AI systems involving embeddings, vector databases, and hybrid or semantic search.
• You have experience with AWS AI and data services such as Amazon Bedrock, Amazon OpenSearch, Amazon Kendra, SageMaker, Lambda, or S3.
• You have practical experience with prompt engineering, context engineering, LLM evaluation, and techniques for reducing hallucinations and ensuring responses remain grounded in source material.
• You understand how to evaluate and select foundation models based on factors including accuracy, latency, cost, security, and specific application requirements.
• You have experience working within Agile software development environments and understand modern software engineering and delivery practices.
• You have experience building and maintaining CI/CD pipelines and deploying infrastructure using tools such as GitHub Actions, CloudFormation, Terraform, and/or Jenkins.
• You have strong problem-solving, communication, and collaboration skills, including the ability to explain complex AI capabilities and limitations to non-technical stakeholders.
• You can work effectively both independently and as part of a multidisciplinary team, with strong attention to detail and a professional approach to documentation and presentation.
• Experience supporting federal health programs, including program policy, regulatory guidance, or customer and stakeholder support operations, is highly desirable.
• Experience deploying AI solutions in federal environments, including FedRAMP-authorized services, ATO or security authorization processes, and NIST 800-53 controls, is preferred.
• Familiarity with responsible AI and federal AI governance frameworks, including the NIST AI Risk Management Framework and OMB AI guidance, is advantageous.
• Knowledge of healthcare security and compliance requirements such as HIPAA and HITECH is preferred.
• Experience building conversational or search interfaces, including familiarity with Section 508 accessibility requirements, is a plus.
• Relevant AWS certification, such as AWS Certified Machine Learning Engineer - Associate, AWS Certified AI Practitioner, Generative AI Developer - Professional, Solutions Architect, or an equivalent credential, is desirable.

Benefits

• Opportunity to work on mission-critical generative AI solutions supporting healthcare organizations and access to authoritative program information.
• Hands-on exposure to advanced LLM technologies, retrieval-augmented generation, semantic search, AI evaluation, and responsible AI practices.
• Opportunity to work with AWS cloud services and modern AI engineering tools and frameworks.
• Collaborative environment involving engineers, analysts, project managers, subject matter experts, and client stakeholders.
• Opportunity to contribute to secure and responsible AI solutions operating within federal security and governance requirements.
• Professional growth through exposure to emerging AI technologies, federal AI guidance, and complex healthcare use cases.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.