AI Engineer II

McCarthy Holdings, Inc.; St. Louis (MO); On-site; USD 110,000 - 160,000; Full time

Job summary

McCarthy Holdings, Inc. seeks an AI Engineer II to design, build, and support AI-powered applications and workflows for enterprise value.

You will work closely with the AI Manager and engineers, delivering production-grade AI solutions including generative AI, agentic workflows, and enterprise integrations. The ideal candidate has strong software fundamentals and AI/data-driven experience, with a preference for Palantir Foundry and data products.

Qualifications

• 3–5 years in software or AI engineering or related field.
• Bachelor's degree or equivalent practical experience.
• Experience deploying AI-enabled apps in production.
• Strong Python programming and modern software practices.
• Data pipelines, ETL/ELT, and API integrations.
• SQL and relational data modeling.
• Experience with major cloud platforms (Azure/AWS/GCP).
• Containerized/serverless deployment patterns.
• Palantir Foundry and enterprise AI platforms experience.
• Experience with OpenAI, LangChain, LlamaIndex, Hugging Face.
• Prompt engineering and RAG patterns.
• Palantir Foundry familiarity: AI workflows, data products, governance.

Responsibilities

• Design, develop, test, and maintain AI-powered apps and workflows.
• Build and support generative AI and agentic solutions.
• Develop and maintain data pipelines, integrations, and data products.
• Contribute to data models and ontologies for workflows.
• Develop prompts, retrieval strategies, and agent workflows.
• Use AI tooling to accelerate delivery while ensuring quality and security.
• Participate in MLOps and PromptOps: deployment, monitoring, versioning.
• Collaborate with stakeholders to translate requirements into tech solutions.
• Support production AI solutions via troubleshooting and tuning.
• Create documentation and reusable patterns for the team.
• Follow AI governance and Responsible AI standards.

Skills

Python

SQL

Data pipelines

APIs

Cloud platforms

Testing

Collaboration

Education

Bachelor's in CS/Engineering/DS

Equivalent experience

Tools

Palantir Foundry

Azure / AWS / GCP

Dataiku

OpenAI / LangChain / Hugging Face

Job description

McCarthy is seeking a full-time AI Engineer II who will be part of the Engineering and Intelligence team. In this role, you will design, build, and support AI-powered applications and workflows that help drive business value across the enterprise.

Working closely with the AI Manager, business stakeholders, and fellow engineers, you will contribute to the development of production-grade AI solutions, including generative AI, agentic workflows, advanced analytics, and enterprise integrations. This is a hands‑on engineering role focused on implementation, experimentation, deployment, and continuous improvement of AI capabilities.

The ideal candidate combines strong software engineering fundamentals with experience in AI and data-driven applications. Experience working within Palantir Foundry, including ontology-driven development, data products, operational workflows, and AI-enabled solutions, is strongly preferred.

RESPONSIBILITIES

• Design, develop, test, and maintain AI-powered applications, services, and workflows that support enterprise business processes.
• Build and support generative AI and agentic solutions using modern AI engineering practices and frameworks.
• Develop and maintain data pipelines, integrations, and reusable data products that enable AI and analytics use cases.
• Contribute to the design and evolution of data models and ontologies that support operational and analytical workflows.
• Develop and optimize prompts, retrieval strategies, and agent workflows to improve solution effectiveness, reliability, and user experience.
• Leverage AI-assisted development tools and coding copilots to accelerate delivery while maintaining high standards for code quality, testing, security, and maintainability.
• Participate in MLOps and PromptOps processes, including deployment, monitoring, evaluation, versioning, and continuous improvement of AI systems.
• Collaborate with business and technical stakeholders to translate business requirements into practical technical solutions.
• Support production AI solutions through troubleshooting, performance tuning, monitoring, and ongoing enhancement activities.
• Contribute to documentation, reusable patterns, and engineering best practices that improve team effectiveness and solution consistency.
• Follow established AI governance, security, and Responsible AI standards throughout the solution lifecycle.

QUALIFICATIONS

• 3–5 years of experience in software engineering, AI engineering, machine learning, data engineering, or a related technical discipline.
• Bachelor’s degree in Computer Science, Engineering, Data Science, Information Systems, or a related field (or equivalent practical experience).
• Experience building and deploying AI-enabled applications or machine learning solutions in production environments.
• Strong programming skills in Python and experience with modern software engineering practices.
• Data pipelines, ETL/ELT processes, and API-based integrations
• SQL and relational data modeling
• Cloud platforms such as Azure, AWS, or GCP
• Containerized and serverless application deployment patterns
• Building solutions on enterprise AI and data platforms such as Palantir Foundry, Azure AI, AWS, GCP, or Dataiku.
• Generative AI platforms and frameworks such as OpenAI, Anthropic, LangChain, LlamaIndex, Hugging Face, or similar technologies.
• Prompt engineering, evaluation methodologies, and retrieval-augmented generation (RAG) patterns.
• Experience with Palantir Foundry is strongly preferred, including familiarity with:
  • AIP and AI-enabled workflows
  • Data products and pipeline development
  • Workshop applications and operational workflows
  • Code Repositories and software delivery within Foundry environments
  • Understanding of responsible AI concepts, including transparency, human oversight, security, and governance practices.

CHARACTERISTICS

• Strong problem-solving and analytical skills with the ability to work through ambiguity and deliver practical solutions.
• Effective communication skills and the ability to collaborate with technical and non-technical stakeholders.
• Curiosity and enthusiasm for emerging AI technologies and software engineering practices.
• Strong attention to quality, maintainability, and user experience.
• Ability to learn new technologies quickly and apply them effectively in a business environment.
• High degree of accountability, ownership, and commitment to delivering results.

McCarthy is proud to be an equal opportunity employer, including disability and protected veteran status.

NOTICE TO EXTERNAL SEARCH FIRMS:

McCarthy’s Talent Acquisition Team is the only authorized representative permitted to engage with external search firms, staffing agencies, or other third-party recruiting partners. McCarthy maintains an Approved Agency List for recruiting partners, which is reviewed and updated annually.

McCarthy will only consider submissions from agencies with a signed fee agreement in place for the current year. McCarthy does not accept unsolicited resumes, candidate submissions, or referrals from agencies that do not meet these requirements.

If a candidate is submitted without an active agreement, McCarthy will have no obligation to pay any fees and reserves the right to contact, engage, interview, or hire such candidate(s) without any financial or other responsibility to the submitting agency. Unsolicited resumes, including those sent directly to hiring managers or other employees, will be considered the property of McCarthy.