Senior AI Engineer

Nashoba Valley Chamber of Commerce; Raleigh (NC); On-site; USD 125,000 - 156,000; Full time

Benefits offered by this job

Equity

401k + match

Paid time off

RSUs

Job summary

ZenBusiness is seeking a remote ML/AI engineering professional to design, build, and maintain the AI Platform that powers our customer-facing AI tools.

You will collaborate with engineers to enable prompt management, model evaluation, and knowledge-base maintenance, while integrating AI models into production and ensuring platform reliability and performance.

Qualifications

• 4+ years of experience in ML/AI engineering, with experience contributing to generative AI products.
• Experience with LLM design patterns, including Retrieval-Augmented Generation (RAG), as well as familiarity with broader search and retrieval systems such as vector search, semantic search, and document indexing.
• Strong knowledge of large language model (LLM) concepts including prompt engineering, AI feature evaluation, and working with vector databases.
• Experience working with Vertex AI or similar managed AI platforms.
• Hands-on experience with LLM evaluation frameworks, including dataset management, recall testing, and LLM-as-judge patterns.
• Familiarity with experiment tracking tools such as Weights & Biases.
• Working knowledge of MLOps practices: deployment, model monitoring, and CI/CD workflows.
• Strong problem-solving, system design, and technology decision-making skills.
• Some exposure to application development, such as contributing to or building simple software applications.
• Experience with Node.js and/or TypeScript, particularly in building or maintaining API services.
• Experience designing and versioning REST APIs.
• Working knowledge of PostgreSQL, including schema design, migrations, and JSONB usage.

Responsibilities

• Build and maintain APIs that integrate generative AI models into production systems, focusing on scalability and low latency.
• Collaborate with cross-functional teams to identify use cases for generative AI, define requirements, and contribute to impactful solutions.
• Implement and optimize workflows for model inference using large-scale pre-trained models.
• Contribute to generative AI model pipelines, supporting monitoring and ongoing performance.
• Conduct experiments to evaluate generative AI models against real-world performance metrics such as fluency, coherence, and factual accuracy.
• Stay current with advancements in generative AI research and help integrate new techniques into the organization’s capabilities.
• Support the reliability, scalability, and security of generative AI systems in deployment.
• Document processes, architectures, and technical decisions to facilitate collaboration and future improvements.

Skills

ML/AI engineering

LLM design patterns

Vector search

Semantic search

Document indexing

LLM evaluation

Weights & Biases

MLOps

Node.js/TypeScript

REST APIs

PostgreSQL

Tools

Vertex AI

Weights & Biases

CI/CD

Job description

Who We Are

We started our company to help others launch and run their own businesses, at any stage. The way we help is by keeping it simple and supporting entrepreneurs one step at a time. Put simply: our mission is to enable anyone to start, run, and grow their business while avoiding the common pitfalls that derail hopeful entrepreneurs. No more having to wade through forms, taxes, or ongoing state compliance.

Remote

The Role

In this role, you will work alongside engineers on the AI Platform team to design, build, and maintain the platform that powers our customer-facing AI tools. You will contribute to systems for prompt management, model evaluation, and knowledge base maintenance, while also helping integrate AI models into production systems and supporting the reliability and performance of the platform.

This position will report to the Engineering Manager of the AI Platform team, which sits within the broader AI Products division of the Engineering org. The AI Platform team is responsible for building and maintaining the internal platform used to manage prompts, run evaluations, and maintain knowledge bases that power our customer-facing AI tools. This is a remote role.

Responsibilities

• Build and maintain APIs that integrate generative AI models into production systems, with a focus on scalability and low latency.
• Collaborate with cross-functional teams to identify use cases for generative AI, define requirements, and contribute to impactful solutions.
• Implement and optimize workflows for model inference using large-scale pre-trained models.
• Contribute to generative AI model pipelines, supporting monitoring and ongoing performance.
• Conduct experiments to evaluate generative AI models against real-world performance metrics such as fluency, coherence, and factual accuracy.
• Stay current with advancements in generative AI research and help integrate new techniques into the organization’s capabilities.
• Support the reliability, scalability, and security of generative AI systems in deployment
• Document processes, architectures, and technical decisions to facilitate collaboration and future improvements.

Qualifications

• 4+ years of experience in ML/AI engineering, with experience contributing to generative AI products.
• Experience with LLM design patterns, including Retrieval-Augmented Generation (RAG), as well as familiarity with broader search and retrieval systems such as vector search, semantic search, and document indexing.
• Strong knowledge of large language model (LLM) concepts including prompt engineering, AI feature evaluation, and working with vector databases.
• Experience working with Vertex AI or similar managed AI platforms.
• Hands‑on experience with LLM evaluation frameworks, including dataset management, recall testing, and LLM‑as‑judge patterns.
• Familiarity with experiment tracking tools such as Weights & Biases.
• Working knowledge of MLOps practices: deployment, model monitoring, and CI/CD workflows.
• Strong problem‑solving, system design, and technology decision‑making skills.
• Some exposure to application development, such as contributing to or building simple software applications.
• Experience with Node.js and/or TypeScript, particularly in building or maintaining API services.
• Experience designing and versioning REST APIs.
• Working knowledge of PostgreSQL, including schema design, migrations, and JSONB usage.

Bonus Qualifications

• Familiarity with the GCP ecosystem.

Compensation

Compensation Range: $125,000 – $156,000 annually

We believe in transparent and equitable compensation practices. The range listed above reflects the typical range for this role based on experience, skills, and market. Individual compensation decisions are made thoughtfully and may vary based on qualifications and business needs.

Our total rewards package includes competitive benefits, paid time off, equity, and additional programs designed to support employee well‑being and growth.

Remote Culture.

A great company culture leads to happy employees, and happy employees lead to happy customers. We provide our employees with good salaries, benefits, equity, and interesting challenges that have a positive impact.

Let’s stay connected!

We believe in staying connected, and we have a weekly “All Hands” meeting every week. We also have a social committee that hosts frequent events. We’ve held a virtual talent show, costume competitions, monthly lunch and learn series, Hackathons and more!

Benefits.

The company offers various benefits to employees and their dependents, including medical, vision, dental, disability, and life insurance, as well as parental and military leave. Other benefits include an employee assistance program, 401k + match, annual bonus, pet insurance, and RSUs. Paid parking and 10 paid holidays are also provided.

Diversity, Equity and Inclusion.

We believe in diversity, equity & inclusion. At ZenBusiness, every voice counts no matter your race, ethnicity, gender, sexual orientation, age, location, or background. We celebrate the diversity of our teams, knowing that our products, services, and customers thrive best when we lean into and celebrate our differences.

Please check out our careers' page to learn more about our culture, benefits, and open opportunities.

• applicable to in-office employees