AI-Driven Project Lead for Cloud & LLMs

ServiceNow

Pacific, Northern (MO, KY)

Hybrid

USD 110,000 - 170,000

Full time

9 days ago

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

ServiceNow is seeking a Project Lead for AI-native software with cloud experience to lead a team of software and AI engineers. You will own end-to-end delivery, including deployment, testing, and evaluation of AI components.

You will mentor engineers, set quarterly goals, and collaborate with product management and cross-functional teams to design scalable AI-driven solutions. Prioritize security and governance in fast-paced development.

Qualifications

3-5 years of practical Java experience.
1-2 years of prompt engineering and prompt/agent scripting.
1-2 years of hands-on experience integrating third-party AI/ML services and platform APIs (e.g., OpenAI, Anthropic, Salesforce and other SaaS).
Proven ability to design and manage domain-specific languages, prompt templates, and agent instruction frameworks.
Develop and optimize microservices that power high-performance data and embedding pipelines, handling up to 10 million rows and feeding vector stores.
Experience with RESTful and streaming APIs, model/inference endpoints, web services, and integration technologies.
Knowledge of cloud computing and managed AI services (e.g., AWS Bedrock/SageMaker, Azure OpenAI, Google Vertex AI).
Create customer-centric AI solutions such as RAG assistants, agentic workflows, and AI-driven customer service.
Create data and knowledge-base migration tools for SaaS applications, including moving embeddings and vector data between cloud instances.
Experience with LLM orchestration and retrieval frameworks (e.g., LangChain, LlamaIndex) and vector databases (e.g., Pinecone, Weaviate, pgvector).
Outstanding collaboration and communication skills.
Strong problem-solving and debugging skills, including working with non-deterministic AI outputs.
Ability to learn quickly, take direction, work independently, and as part of a team.
Ability to develop unit tests and AI evaluation harnesses (accuracy, regression, and hallucination checks) for code components, prompts, and complete applications.
Ability to debug and isolate the root cause of complex issues in probabilistic and distributed systems.
Experience with Agile and Scrum development methodologies.
Experience with Spring Boot or similar frameworks.
Experience working with APIs, REST standards, JSON, SQL, and NoSQL/vector stores.
Bachelor's degree in computer science or a related field; coursework or experience in ML/AI a plus

Responsibilities

Lead a team of software and AI engineers, coaching and mentoring them.
Own code deployment, testing, evaluation, and validation of traditional and AI components.
Perform detailed code reviews, including prompts, agent logic, and evaluation results.
Set and track quarterly goals for all team members and assist with training and recruitment.
Provide status updates and reports to senior leadership and stakeholders.
Collaborate with cross-functional teams to define requirements and scalable AI-driven solutions.
Stay current with AI advancements and apply them to products and services.
Develop intuitive AI-native software and technical specifications including model selection and data architecture.
Ensure secure coding practices and AI safeguards (prompt-injection defense, data privacy).
Maintain software and monitor model performance and drift in production.
Experience with managed AI/ML services across major cloud providers.
Familiarity with Kubernetes and containerization; deployment of inference workloads is a plus.
Drive evaluation harnesses for AI features and ensure release readiness.