Senior AI Tooling Engineer — Production LLM Interfaces

Top Gen AI Jobs; New York (NY); Hybrid; USD 180,000 - 260,000; Full time

Benefits offered by this job

Bonus

Commission

Equity

Job summary

Top Gen AI Jobs is seeking a senior engineer to scale production AI tooling and agentic workflows for marketing intelligence. You will design retrieval and memory layers, establish data quality and safety best practices, and work across data pipelines to automate complex processes.

The role emphasizes hands-on development, ambiguity navigation, and strong collaboration with data science teams to deploy reliable AI systems at scale.

Qualifications

• Candidates need over 6 years of experience in software or data engineering with a strong proficiency in Python, SQL, and Kubernetes.
• Hands-on experience integrating LLMs into production systems and the ability to navigate ambiguity are required.

Responsibilities

• Build production AI tooling, interfaces, and agentic workflows to automate marketing intelligence processes.
• Design retrieval and memory layers and establish best practices for AI data quality and safety.

Skills

LLM

RAG

Embeddings

Python

SQL

Kubernetes

Container-based infrastructure

Agent orchestration

Distributed systems

Data engineering

Vector stores

AI observability

Memory layers

AI data quality

Software engineering

Technical strategy

Tools

Python

SQL

Kubernetes

Job description

Top Gen AI Jobs is seeking a senior engineer to scale production AI tooling and agentic workflows for marketing intelligence. You will design retrieval and memory layers, establish data quality and safety best practices, and work across data pipelines to automate complex processes.

The role emphasizes hands-on development, ambiguity navigation, and strong collaboration with data science teams to deploy reliable AI systems at scale.