Senior AI Engineer - Generative AI & LLMs (Onsite Randolph)

DataJobs; Randolph Township (NJ); On-site; USD 50,000 - 600,000; Full time

Job summary

Converge Squad 2 in Randolph, NJ is seeking a Senior Software Engineer to design, build, and productionize AI-powered solutions across ML, generative AI, and LLM-based systems. You will design scalable AI applications, integrate GenAI capabilities into production services, and create AI/ML pipelines from data preparation through training, evaluation, deployment, and monitoring.

Collaborate with product managers, software engineers, and data scientists to translate business requirements into

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 5+ years of professional software engineering experience building production systems.
• Strong Python and/or Java skills.
• Experience with Generative AI, LLMs, or ML systems.
• Experience with APIs and integrating AI/ML models into applications.
• Experience with cloud platforms: AWS, Azure, or Google Cloud.
• Strong testing, debugging, CI/CD, version control, and production operations.

Responsibilities

• Design and develop scalable AI-powered applications and services.
• Build and integrate Generative AI and LLM capabilities into production applications.
• Create AI/ML pipelines covering data preparation, model training, evaluation, deployment, and monitoring.
• Work with LLMs, embeddings, vector databases, RAG, prompt engineering, and AI agents.
• Design and implement APIs and backend services that connect AI capabilities to existing products and platforms.
• Compare models and approaches using accuracy, latency, cost, scalability, and reliability criteria.
• Develop strategies for prompt optimization, model evaluation, hallucination reduction, and response quality.
• Deliver production-ready systems with observability, logging, monitoring, security controls, and failure handling.
• Collaborate with product managers, software engineers, data scientists, and other stakeholders to translate business requirements into technical solutions.
• Contribute to architecture and design discussions and help drive technical decisions.
• Conduct code reviews and help set engineering best practices.
• Mentor other engineers and support technical growth within the team.
• Stay current with developments in AI, machine learning, and LLM technologies and identify ways to apply them to products.

Skills

Python

Java

Cloud platforms

CI/CD

Docker

Kubernetes

API design & backend

LangChain / LlamaIndex / SK

ML / Generative AI / LLMs

Collaboration / mentoring

Education

Bachelor’s or Master’s in CS/Engineering

Tools

LangChain

LlamaIndex

Semantic Kernel

PyTorch

TensorFlow

scikit-learn

Pinecone

Weaviate

Milvus

OpenSearch

pgvector

Docker

Kubernetes

Git

CI/CD tools

Job description

Converge Squad 2 in Randolph, NJ is seeking a Senior Software Engineer to design, build, and productionize AI-powered solutions across ML, generative AI, and LLM-based systems. You will design scalable AI applications, integrate GenAI capabilities into production services, and create AI/ML pipelines from data preparation through training, evaluation, deployment, and monitoring.

Collaborate with product managers, software engineers, and data scientists to translate business requirements into