Senior Lead AI Platform Engineer - LLM & Cloud

DataJobs; Jersey City (NJ); On-site; USD 176,000 - 260,000; Full time

Job summary

DataJobs in Jersey City, NJ seeks a Senior Lead Software Engineer to build agentic AI platforms and LLM-enabled cloud services. You will guide cross-functional teams, own critical architecture, and lead production-grade AI applications using AWS/Azure, containers, and serverless designs.

The role requires 5+ years of experience, strong Python and ML frameworks, and a commitment to responsible AI. You will drive AI-assisted engineering practices and ensure secure, scalable systems.

Qualifications

• Formal training or certification in software engineering concepts.
• 5+ years of applied software engineering experience.
• Strong Python engineering skills with PyTorch or TensorFlow.
• Expertise with vector storage systems and memory design for agents.
• Experience deploying LLM-backed services to production (APIs, microservices).
• Deep MLOps experience: CI/CD, monitoring, incident response, model governance.
• Cloud-native AI deployment on AWS or Azure, incl. cost/performance optimization.
• Commitment to responsible AI practices and operational excellence.
• Strong communication across product, risk, legal, and compliance teams.
• Experience leading adoption of agentic AI-enabled development practices with enterprise tools.

Responsibilities

• Provide technical guidance to business and engineering teams and align priorities.
• Develop secure, high-quality production code and lead code reviews.
• Own architecture and design decisions affecting product and operations.
• Act as SME to support technical trade-offs and resolve complex problems.
• Evaluate and introduce advanced technologies with risk/benefit analysis.
• Build and operate production-grade LLM applications with agentic patterns.
• Design and deliver cloud-native services on AWS/Azure using containers/serverless.
• Implement retrieval-augmented generation (RAG) solutions for quality control.
• Build reliable service APIs and secure integrations.
• Drive adoption and governance of AI-assisted engineering practices across teams.
• Establish measurable validation standards across the SDLC/TLM toolchain.

Skills

Python

PyTorch

TensorFlow

Vector storage

LLM services

APIs

Microservices

CI/CD

AWS

Azure

Containers

Serverless

RAG

Embeddings

Semantic search

SDLC

TLM

Model governance

Tools

AWS

Azure

CI/CD

Job description

DataJobs in Jersey City, NJ seeks a Senior Lead Software Engineer to build agentic AI platforms and LLM-enabled cloud services. You will guide cross-functional teams, own critical architecture, and lead production-grade AI applications using AWS/Azure, containers, and serverless designs.

The role requires 5+ years of experience, strong Python and ML frameworks, and a commitment to responsible AI. You will drive AI-assisted engineering practices and ensure secure, scalable systems.