Senior AI Backend Engineer — LLM & Cloud-Native

Moody's Corporation; New York (NY); On-site; USD 133,000 - 192,000; Full time

Job summary

Moody's Corporation is seeking a senior software engineer to design, build, and operate backend services behind Moody's intelligent data products. You will own features end to end, from design to production, with a focus on scalable AI workloads and robust data pipelines.

Join a team that advances AI across Moody's platforms, collaborating with data scientists, ML engineers, and product managers to deliver reliable software with strong security and performance.

Qualifications

• 5+ years of software engineering experience in backend services and cloud-native apps.
• Proficiency in TypeScript, Python, or C# and building scalable APIs and microservices.
• Experience building enterprise AI apps with LLMs, retrieval augmented generation, and orchestration.
• Ability to own services end-to-end from design to production with minimal supervision.
• Experience with cloud-native tech, event-driven architectures, data pipelines, and databases.
• Strong knowledge of algorithms, data structures, and security best practices.
• Mentoring engineers via code reviews, pairing, and testing for excellence.
• Hands-on AI experience with AI tools to improve workflows and responsible AI practices.

Responsibilities

• Designs, builds, and operates backend services, data pipelines, and inference pipelines that support AI workloads.
• Own the delivery of assigned features end to end, from technical design through deployment and monitoring.
• Build and enhance large language model features using retrieval augmented generation, orchestration frameworks, and tool integration.
• Contribute to technical designs, participate in design reviews, and identify risks and trade-offs.
• Maintain engineering excellence through automated testing, code reviews, observability, and on-call support.
• Apply MLOps practices including prompt versioning, automated eval, deployment pipelines, and monitoring.
• Partner with PMs, data scientists, ML engineers, and engineers to translate requirements into reliable software solutions.
• Mentor engineers and promote responsible AI practices across delivered features.

Skills

Backend development

TypeScript

Python

C#

Microservices

Distributed systems

AI/ML integration

Cloud-native

Data pipelines

Code reviews

Education

Bachelor's degree in Computer Science/Engineering or related

Tools

AWS

Azure

PostgreSQL

NoSQL

Vector databases

Observability tooling

CI/CD pipelines

Job description

Moody's Corporation is seeking a senior software engineer to design, build, and operate backend services behind Moody's intelligent data products. You will own features end to end, from design to production, with a focus on scalable AI workloads and robust data pipelines.

Join a team that advances AI across Moody's platforms, collaborating with data scientists, ML engineers, and product managers to deliver reliable software with strong security and performance.