AI Engineer – Senior Software Engineer

DataJobs; Randolph Township (NJ); On-site; USD 50,000 - 600,000; Full time

Job summary

Converge Squad 2 in Randolph, NJ is seeking a Senior Software Engineer to design, build, and productionize AI-powered solutions across ML, generative AI, and LLM-based systems. You will design scalable AI applications, integrate GenAI capabilities into production services, and create AI/ML pipelines from data preparation through training, evaluation, deployment, and monitoring.

Collaborate with product managers, software engineers, and data scientists to translate business requirements into

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 5+ years of professional software engineering experience building production systems.
• Strong Python and/or Java skills.
• Experience with Generative AI, LLMs, or ML systems.
• Experience with APIs and integrating AI/ML models into applications.
• Experience with cloud platforms: AWS, Azure, or Google Cloud.
• Strong testing, debugging, CI/CD, version control, and production operations.

Responsibilities

• Design and develop scalable AI-powered applications and services.
• Build and integrate Generative AI and LLM capabilities into production applications.
• Create AI/ML pipelines covering data preparation, model training, evaluation, deployment, and monitoring.
• Work with LLMs, embeddings, vector databases, RAG, prompt engineering, and AI agents.
• Design and implement APIs and backend services that connect AI capabilities to existing products and platforms.
• Compare models and approaches using accuracy, latency, cost, scalability, and reliability criteria.
• Develop strategies for prompt optimization, model evaluation, hallucination reduction, and response quality.
• Deliver production-ready systems with observability, logging, monitoring, security controls, and failure handling.
• Collaborate with product managers, software engineers, data scientists, and other stakeholders to translate business requirements into technical solutions.
• Contribute to architecture and design discussions and help drive technical decisions.
• Conduct code reviews and help set engineering best practices.
• Mentor other engineers and support technical growth within the team.
• Stay current with developments in AI, machine learning, and LLM technologies and identify ways to apply them to products.

Skills

Python

Java

Cloud platforms

CI/CD

Docker

Kubernetes

API design & backend

LangChain / LlamaIndex / SK

ML / Generative AI / LLMs

Collaboration / mentoring

Education

Bachelor’s or Master’s in CS/Engineering

Tools

LangChain

LlamaIndex

Semantic Kernel

PyTorch

TensorFlow

scikit-learn

Pinecone

Weaviate

Milvus

OpenSearch

pgvector

Docker

Kubernetes

Git

CI/CD tools

Job description

Converge Squad 2 is hiring a Senior Software Engineer to design, build, and productionize AI-powered solutions across ML, generative AI, and LLM-based systems.

Responsibilities

• Design and develop scalable AI-powered applications and services.
• Build and integrate Generative AI and LLM capabilities into production applications.
• Create AI/ML pipelines covering data preparation, model training, evaluation, deployment, and monitoring.
• Work with LLMs, embeddings, vector databases, RAG (Retrieval-Augmented Generation), prompt engineering, and AI agents.
• Design and implement APIs and backend services that connect AI capabilities to existing products and platforms.
• Compare models and approaches using accuracy, latency, cost, scalability, and reliability criteria.
• Develop strategies for prompt optimization, model evaluation, hallucination reduction, and response quality.
• Deliver production-ready systems with observability, logging, monitoring, security controls, and failure handling.
• Collaborate with product managers, software engineers, data scientists, and other stakeholders to translate business requirements into technical solutions.
• Contribute to architecture and design discussions and help drive technical decisions.
• Conduct code reviews and help set engineering best practices.
• Mentor other engineers and support technical growth within the team.
• Stay current with developments in AI, machine learning, and LLM technologies and identify ways to apply them to products.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
• 5+ years of professional software engineering experience building and deploying production systems.
• Strong programming skills in Python and/or Java.
• Strong understanding of software engineering principles, object-oriented design, data structures, algorithms, and system design.
• Hands-on experience with Generative AI, LLMs, or machine learning systems.
• Experience working with APIs and integrating AI/ML models into applications.
• Experience with cloud platforms: AWS, Azure, or Google Cloud.
• Experience with databases and data processing systems.
• Strong testing and debugging skills, plus experience with CI/CD, version control, and production operations.

Technologies

• Python, Java, SQL
• Machine Learning, Generative AI, LLMs, NLP
• Embeddings, RAG, prompt engineering, model evaluation
• LangChain, LlamaIndex, Semantic Kernel
• PyTorch, TensorFlow, scikit-learn
• REST APIs, microservices, distributed systems
• AWS, Azure, Google Cloud
• SQL and NoSQL databases, vector databases
• Git, CI/CD, Docker, Kubernetes
• Monitoring and observability
• OpenAI, Anthropic, Gemini
• Pinecone, Weaviate, Milvus, OpenSearch, pgvector
• scikit-learn, MLOps/LLMOps

Preferred Qualifications

• Experience with OpenAI, Anthropic, Gemini, or other foundation models.
• Experience building RAG-based applications using embeddings and vector databases.
• Experience with vector databases such as Pinecone, Weaviate, Milvus, OpenSearch, or pgvector.
• Experience with frameworks such as LangChain, LlamaIndex, or Semantic Kernel.
• Experience developing AI agents and tool-using LLM applications.
• Experience with ML frameworks such as PyTorch, TensorFlow, or scikit-learn.
• Experience with model evaluation, fine-tuning, or parameter-efficient fine-tuning.
• Familiarity with MLOps/LLMOps practices.
• Experience with Docker, Kubernetes, and cloud-native application development.
• Knowledge of AI security, data privacy, responsible AI, and model safety practices.
• Experience designing highly scalable distributed systems.

Role Details

• Location: Randolph, NJ (onsite)
• Employment type: Full-time
• Department: Engineering / Artificial Intelligence
• Salary: USD 50,000 - 600,000 per yearly
• Experience: 5+ years
• Additional note: All information is kept confidential according to EEO guidelines.