AI Platform Support Engineer

UtiliSave LLC; New York (NY); On-site; USD 65,000 - 80,000; Full time

Benefits offered by this job

Health insurance

Dental Insurance

Vision Insurance

401(k) with company match

Paid time off

Job summary

UtiliSave LLC is seeking an AI Platform Support Engineer to join our growing AI and cloud technology program. You will work hands-on with the AI Assistant Platform, build and maintain RAG pipelines, and help scale our production AI services for auditors and operations.

The role is fully remote in the US, with a 9-6 EST schedule. You will collaborate with auditors, developers, and leadership, configure LLM agents, optimize data workflows, and evaluate new tools while growing toward senior

Qualifications

• 2–4 years in a technical role involving AI/ML tools, cloud platforms, data engineering, or software development support.
• Strong working knowledge of prompt engineering, retrieval-augmented generation (RAG), embeddings, vector databases, and agent-based architectures.
• Demonstrated experience building or operating RAG or embedding-based systems (from prototype to production).
• Hands-on experience with at least one major cloud platform (AWS, Azure, or GCP). Experience with AWS AI services (Bedrock, Q Business, Textract, S3) is a strong plus, but equivalent experience on other clouds is welcome.
• Proficiency in Python (preferred) or JavaScript for scripting, data processing, and automation.
• Experience with SQL databases for querying, loading data, and basic schema design.
• Familiarity with AI-assisted development tools such as Cursor IDE, Claude Code, or GitHub Copilot.
• Familiarity with work-tracking tools such as JIRA, Azure DevOps, or similar.
• Strong communication skills, with the ability to document technical processes and communicate status to both technical and non-technical stakeholders.
• Self-starter mentality, strong curiosity about AI advancements, and a willingness to learn quickly.
• High attention to detail when working with data pipelines, configurations, and testing workflows.
• Exposure to document extraction/OCR tools is a plus.
• Bachelor's degree preferred but not required; equivalent hands-on experience accepted.

Responsibilities

• Support the day-to-day operation and maintenance of the AI Assistant Platform, including monitoring system health, triaging issues, and coordinating fixes with the development team.
• Build and maintain RAG pipelines-chunking, embedding generation, vector indexing, retrieval tuning, and evaluation-to keep the knowledge base accurate and relevant.
• Configure and refine LLM agent behavior, including instruction tuning, tool/Action Group testing, and prompt engineering to improve answer quality for auditor queries.
• Assist with data pipeline tasks including metadata extraction, JSON generation, SQL loading, and semantic indexing.
• Coordinate and execute testing cycles for AI features, collect structured feedback from auditors, and track resolution in JIRA.
• Support document extraction workflows for utility bill processing, validating accuracy and expanding template coverage to new formats.
• Evaluate, pilot, and recommend emerging AI tools and capabilities (e.g., Claude Code, Claude for Excel, Cursor IDE, Amazon Bedrock Agent Core) for adoption across the organization.
• Maintain technical documentation for AI platform components, data flows, agent configurations, and operational runbooks.
• Assist with cloud storage organization, data source management, and cost optimization across AI services.
• Support future integration between the AI platform and CRM by helping define data exchange interfaces and testing data flows.
• Collaborate cross-functionally with auditors, developers, and leadership to translate business needs into AI platform improvements.

Skills

AI/ML concepts

RAG pipelines

Python

SQL databases

AWS/Azure/GCP

JIRA

Documentation

Education

Bachelor's degree preferred

Tools

Cursor IDE

Claude Code

GitHub Copilot

Amazon Bedrock

Amazon Q Business

Textract

S3

Job description

About UtiliSave

Join a team that has delivered over $700 million in refunds and savings to clients-and help us reach $1 billion. For over three decades, UtiliSave has been a leader in utility bill auditing and cost recovery. As our company rapidly expands its investment in AI and cloud technology, we're seeking an AI Platform Support Engineer to help build, maintain, and grow our production AI platform.

About the Role

This is a ground-floor opportunity to grow alongside a company in the middle of a major AI and technology transformation. Reporting directly to the AI Lead, you will work hands-on with our AI Assistant Platform, which leverages large language models, retrieval-augmented generation (RAG), and embedding-based search to serve auditor and operational workflows. Our current production stack runs on AWS (Amazon Bedrock, Amazon Q Business, AWS Textract, and S3), but we value strong fundamentals in AI engineering over exclusive expertise in any single cloud.

This is a full-time position with exciting growth potential. The ideal candidate is an energetic and curious team player, comfortable learning new technologies quickly, and brings initiative to a fast-moving environment. This role offers a clear path to grow into senior AI engineering or platform architect responsibilities as we scale..

Key Responsibilities

• Support the day-to-day operation and maintenance of the AI Assistant Platform, including monitoring system health, triaging issues, and coordinating fixes with the development team.
• Build and maintain RAG pipelines-chunking, embedding generation, vector indexing, retrieval tuning, and evaluation-to keep the knowledge base accurate and relevant.
• Configure and refine LLM agent behavior, including instruction tuning, tool/Action Group testing, and prompt engineering to improve answer quality for auditor queries.
• Assist with data pipeline tasks including metadata extraction, JSON generation, SQL loading, and semantic indexing.
• Coordinate and execute testing cycles for AI features, collect structured feedback from auditors, and track resolution in JIRA.
• Support document extraction workflows for utility bill processing, validating accuracy and expanding template coverage to new formats.
• Evaluate, pilot, and recommend emerging AI tools and capabilities (e.g., Claude Code, Claude for Excel, Cursor IDE, Amazon Bedrock Agent Core) for adoption across the organization.
• Maintain technical documentation for AI platform components, data flows, agent configurations, and operational runbooks.
• Assist with cloud storage organization, data source management, and cost optimization across AI services.
• Support future integration between the AI platform and CRM by helping define data exchange interfaces and testing data flows.
• Collaborate cross-functionally with auditors, developers, and leadership to translate business needs into AI platform improvements.

Qualifications

• 2–4 years of experience in a technical role involving AI/ML tools, cloud platforms, data engineering, or software development support.
• Solid working knowledge of modern AI and LLM concepts, including prompt engineering, retrieval-augmented generation (RAG), embeddings, vector databases, and agent-based architectures.
• Demonstrated experience building or operating RAG or embedding-based systems (from prototype to production).
• Hands-on experience with at least one major cloud platform (AWS, Azure, or GCP). Experience with AWS AI services (Bedrock, Q Business, Textract, S3) is a strong plus, but equivalent experience on other clouds is welcome.
• Proficiency in Python (preferred) or JavaScript for scripting, data processing, and automation.
• Experience with SQL databases for querying, loading data, and basic schema design.
• Familiarity with AI-assisted development tools such as Cursor IDE, Claude Code, or GitHub Copilot.
• Familiarity with work-tracking tools such as JIRA, Azure DevOps, or similar.
• Strong communication skills, with the ability to document technical processes and communicate status to both technical and non-technical stakeholders.
• Self-starter mentality, strong curiosity about AI advancements, and a willingness to learn quickly.
• High attention to detail when working with data pipelines, configurations, and testing workflows.
• Exposure to document extraction/OCR tools is a plus.
• Bachelor's degree preferred but not required; equivalent hands-on experience accepted.

Compensation and Benefits

• Competitive base salary (starting target range: $65,000–$80,000) plus performance-based bonus.
• Comprehensive benefits, including health, dental, and vision insurance, 401(k) with company match.
• Generous PTO plus 11 paid holidays.
• Job Type: Fully remote role. Work Hours 9–6 PM EST, must be based in US in a state with no more than 1 hour time difference from EST. Must be authorized to permanently work in US, with no need for visa support.