AI Engineer

NTT America, Inc.; City of Rome (NY); Hybrid; USD 50,000 - 84,000; Full time

Benefits offered by this job

Private Health Insurance

Sponsored certifications and trainings

Coaching and mentoring programs

Company events and family-friendly mix

Job summary

NTT DATA Romania is seeking an experienced AI/ML Engineer to design and deploy agentic systems using Google ADK or LangGraph. You will work on multi-agent orchestration, RAG pipelines, and tool integration in production environments.

The role requires strong Python, LLM expertise, and hands-on experience with cloud deployment and observability. Remote or hybrid work options are available, with collaboration across product teams.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 3+ years as Software/ML/AI engineer with 1–2 years LLM exposure in real apps.
• Strong Python, async, packaging, testing skills.
• Experience building REST/gRPC APIs and integrating tools/services.
• Deep knowledge of large language models and prompt engineering.
• Hands-on with ADK or LangGraph or both; production experience preferred.

Responsibilities

• Design and build agentic systems with multiple interacting agents.
• Implement robust orchestration logic, state machines, retries, and fallbacks.
• Develop RAG pipelines, tool calling, and advanced prompts for reliability.
• Apply ML concepts to improve agent performance and safety.
• Lead development with Google ADK and/or LangGraph and ensure observability.
• Integrate with LangChain, vector stores, queues, and monitoring tools.
• Define success metrics, run evaluations, and drive improvements.
• Deploy AI services with CI/CD, logging, and tracing; troubleshoot end‑to‑end.

Skills

Python proficiency

LLM experience

REST/gRPC APIs

Prompt engineering

Multi-agent orchestration

ADK/LangGraph knowledge

Vector databases

Cloud deployment

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

Google ADK

LangGraph

LangChain

LlamaIndex

Pinecone

Weaviate

pgvector

Chroma

SQL

AWS/GCP/Azure

Job description

Who We Are

Based in The Romania Excellence Centre, Bucharest - our client is seeking for experienced professionals who value teamwork, pioneering technology, and innovation. People who want to take their careers to the next level of success. You will be part of a global and diverse team, contribute to all stages of software development lifecycle and lead the implementation, deployment and test of multi-agent systems.

Also, this role will give you the chance to:

Use frameworks like Google Agent Development Kit (Google ADK) and LangGraph to build robust, controllable, and observable agentic architectures

Assist in the design of LLM-powered agents and multi-agent workflows (planning, tool use, orchestration, memory, and human-in-the-loop)

So if you are an experienced AI Engineer please join our team to create the next big thing in digital banking.

What You’ll Be Doing

• Design and build complex agentic systems with multiple interacting agents

• Implement robust orchestration logic (state machines / graphs, retries, fallbacks, escalation to humans)

• Implement RAG pipelines, tool calling, and sophisticated system prompts for optimal reliability, latency, and cost control

• Apply core ML concepts to evaluate and improve agent performance, including dataset curation and bias/safety checks

• Lead the development of agents using Google ADK and/or LangGraph, leveraging advanced features for orchestration, memory, evaluation, and observability

• Integrate with supporting libraries and infrastructure (e.g., LangChain/LlamaIndex, vector databases, message queues, monitoring tools) with minimal supervision

• Define success metrics, build evaluation suites for agents (automatic + human evaluation), and drive continuous improvement

• Curate and maintain comprehensive prompt/test datasets; run regression tests for new model versions and prompt changes

• Deploy and operate AI services in production, establishing CI/CD pipelines, observability, logging, and tracing

• Debug complex failures end-to-end, identifying and document root causes across models, prompts, APIs, tools, and data

• Work closely with product managers and stakeholders to shape requirements, translate them into agent capabilities, and manage expectations

• Document comprehensive designs, decisions, and runbooks for complex systems

What We’re Looking For

• Bachelor’s degree in Computer Science, Engineering, or related field

• At least 3 years of experience as Software Engineer / ML Engineer / AI Engineer, with at least 1-2 years working directly with LLMs in real applications

• Strong proficiency in Python (core language features, packaging, testing, async, type hints)

• Very strong software engineering practices: version control (Git), unit/integration testing, code reviews, CI/CD

• Experience building and consuming REST/gRPC APIs and integrating external tools/services

• Understanding of core ML concepts: supervised/unsupervised learning, train/validation/test splits, overfitting, regularization, and common metrics (precision, recall, F1, ROC-AUC, etc.)

• Good understanding of deep learning basics (neural networks, embeddings) and at least one ML/DL framework (e.g., PyTorch, TensorFlow, JAX, scikit-learn)

• Deep practical knowledge of large language models

• Tokenization, context windows, temperature, top-p, system vs user prompts

• Prompt engineering patterns (ReAct, chain-of-thought, tool-calling/tool-use)

• Fine-tuning / adapters / instruction-tuning, or experience with RAG as an alternative

• Experience building LLM-powered applications end-to-end: from idea → prototype → production

• Familiarity with safety and reliability considerations: hallucinations, guardrails, content filtering, privacy

• Conceptual understanding of modern agentic frameworks and patterns (stateful graphs, multi-agent coordination, human-in-the-loop, memory, and evaluation).

• Hands-on experience with at least one of: Google Agent Development Kit (ADK) – building multi-agent workflows, using its orchestration, tools, and evaluation features or LangGraph – designing graph-based, stateful agent workflows with cycles, branches, and durable execution

• Candidates must be able to read, reason about, and extend ADK/LangGraph-based codebases

• Direct production experience with both ADK and LangGraph is a strong plus

• Experience working with vector databases (e.g., Pinecone, Weaviate, pgvector, Chroma) for retrieval-augmented generation

• Comfortable with SQL and basic data modeling

• Experience deploying on at least one major cloud platform (GCP, AWS, Azure) and using managed services (e.g., serverless runtimes, container orchestration, secrets management)

Nice-to-Have experience with:

• Vertex AI / Gemini or other hosted LLM ecosystems

• Related frameworks and tools: LangChain, LlamaIndex, semantic search, evaluation frameworks (e.g., RAGAS, custom eval harnesses)

• Monitoring and observability stacks (OpenTelemetry, Prometheus/Grafana/NewRelic, Datadog, etc.)

What’s in it for you

• New beginnings can be a challenge. We promise a smooth integration and a supportive mentor

• Pick your working style: choose from Remote, Hybrid or Office work opportunities

• Early bird or night owl? Our projects have different working hours to suit your needs

• Nobody is born an expert. Sharpen your tech skills with our sponsored certifications, trainings and top e-learning platforms

• We want you to stay healthy! Enjoy our Private Health Insurance - it’s custom-made for you

• A clear mind is a healthy mind. Attend individual coaching sessions or go one step further by joining our accredited Coaching School

• Make the most of our epic parties or themed events - they're lovingly designed for our people and their families

Make this the place you grow

Your unique talent is what matters. NTT DATA Romania is an equal opportunity employer and considers all applicants regardless to race, color, religion, citizenship, national origin, ethnicity, age, gender, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic.

NTT DATA Romania is an equal opportunity employer and considers all applicants regardless to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic protected by law. We are committed to creating a diverse and inclusive environment for all employees.

Not the job for you? Perhaps you have a friend who would be a perfect fit. Send them this link!