Senior AI Software Engineer: Backend & LLM Systems

PassFort; New York (NY); On-site; USD 133,000 - 192,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Parental leave

Paid time off

401(k) plan with employer contribution

Life insurance

Disability insurance

Accident insurance

Employee stock purchase plan

Tuition reimbursement

Job summary

Moody's is seeking a Senior Software Engineer-AI in New York, NY to design, build, and operate backend services and AI-powered features behind Moody's intelligent data products. You will own features end to end, from design to deployment, including real-time and batch AI workloads using LLMs, retrieval augmented generation, orchestration, and tool integration.

The role requires 5+ years of software engineering, strong skills across TS/Python/C#, cloud-native and serverless experience, and a

Qualifications

• 5+ years of software engineering experience designing, coding, testing, and operating production-grade backend services and cloud-native applications.
• Strong coding proficiency in TypeScript, Python, C#, or similar, with experience building scalable APIs, microservices, and distributed systems.
• Practical experience building enterprise AI applications using large language models, including agents, RAG, orchestration frameworks, and model optimization.
• Own services and features end to end from design to production deployment and operation with limited supervision.
• Hands-on with cloud-native tech, serverless, event-driven architectures, data pipelines, databases, observability, and automated deployment pipelines.
• Strong understanding of algorithms, data structures, performance, security, and engineering trade-offs.
• Mentor engineers through code reviews, debugging, documentation, and testing for engineering excellence.
• Proven ability to implement AI-powered solutions and responsible AI practices; awareness of AI risk management.

Responsibilities

• Design, code, test, and operate backend services, APIs, data pipelines, and inference pipelines for real-time and batch AI workloads.
• Own delivery of features end to end from design through deployment, monitoring, and production support.
• Build and enhance large language model features using retrieval augmented generation, orchestration, evaluation, and tool integration.
• Contribute to technical designs, reviews, and identify risks, constraints, and trade-offs.
• Maintain engineering excellence through automated testing, code reviews, observability, monitoring, and on-call readiness.
• Apply machine learning operations practices including prompt versioning, evaluation, deployment pipelines, and monitoring.
• Collaborate with product managers, data scientists, ML engineers, and fellow engineers to translate requirements into reliable software.
• Mentor engineers, contribute to shared tooling, document designs, and promote responsible AI across features.

Skills

Backend services ownership

LLM AI applications

End-to-end ownership

Cloud-native & serverless

Data pipelines & observability

Algorithms & performance

Mentoring engineers

Responsible AI practices

Education

Bachelor's degree in CS/Engineering or related field

Tools

Cloud-native technologies

Serverless architectures

Relational databases

NoSQL databases

Vector databases

Observability tooling

CI/CD pipelines

Job description

Moody's is seeking a Senior Software Engineer-AI in New York, NY to design, build, and operate backend services and AI-powered features behind Moody's intelligent data products. You will own features end to end, from design to deployment, including real-time and batch AI workloads using LLMs, retrieval augmented generation, orchestration, and tool integration.

The role requires 5+ years of software engineering, strong skills across TS/Python/C#, cloud-native and serverless experience, and a