Sr. Software Engineer II - AI Tooling and Interfaces - Rockerbox

Top Gen AI Jobs; New York (NY); Hybrid; USD 180,000 - 260,000; Full time

Benefits offered by this job

Bonus

Commission

Equity

Job summary

Top Gen AI Jobs is seeking a senior engineer to scale production AI tooling and agentic workflows for marketing intelligence. You will design retrieval and memory layers, establish data quality and safety best practices, and work across data pipelines to automate complex processes.

The role emphasizes hands-on development, ambiguity navigation, and strong collaboration with data science teams to deploy reliable AI systems at scale.

Qualifications

• Candidates need over 6 years of experience in software or data engineering with a strong proficiency in Python, SQL, and Kubernetes.
• Hands-on experience integrating LLMs into production systems and the ability to navigate ambiguity are required.

Responsibilities

• Build production AI tooling, interfaces, and agentic workflows to automate marketing intelligence processes.
• Design retrieval and memory layers and establish best practices for AI data quality and safety.

Skills

LLM

RAG

Embeddings

Python

SQL

Kubernetes

Container-based infrastructure

Agent orchestration

Distributed systems

Data engineering

Vector stores

AI observability

Memory layers

AI data quality

Software engineering

Technical strategy

Tools

Python

SQL

Kubernetes

Job description

The role focuses on building production AI tooling, interfaces, and agentic workflows to automate complex marketing intelligence processes. Responsibilities include designing retrieval and memory layers and establishing best practices for AI data quality and safety.

Requirements

Candidates need over 6 years of experience in software or data engineering with a strong proficiency in Python, SQL, and Kubernetes. Hands-on experience integrating LLMs into production systems and the ability to navigate ambiguity are required.

Key Skills

• LLM
• RAG
• Embeddings
• Python
• SQL
• Kubernetes
• Container-based infrastructure
• Agent orchestration
• Distributed systems
• Data engineering
• Vector stores
• AI observability
• Memory layers
• AI data quality
• Software engineering
• Technical strategy

Benefits

• Bonus
• Commission
• Equity