AI Operations Specialist: 26-03264

Akraya; San Francisco (CA); Remote; USD 83,000 - 90,000; Full time

Job summary

Akraya is seeking a role focused on integrating AI and machine learning into operational workflows to improve efficiency and accuracy. You will understand current processes, develop AI-driven alternatives, and rigorously test them to ensure optimal performance.

This position requires hands-on work to build, deploy, and maintain AI-powered solutions, collaborating with stakeholders across functions to define success criteria and measurable outcomes.

Qualifications

• Experience in solving operational problems and delivering measurable results.
• Strong quantitative analysis and understanding of core metrics.
• Excellent communication for cross-functional collaboration.

Responsibilities

• Identify high-impact AI projects to improve business processes.
• Analyze workflows and design AI-powered replacements.
• Develop and maintain AI pipelines, including prompts and quality monitoring.
• Create and manage datasets for model evaluation and calibration.
• Collaborate with stakeholders to define launch criteria and evidence for AI features.

Skills

Prompt Engineering

Data Annotation

SQL

Workflow Automation

Quality Assurance

Operational problem-solving

Quantitative analysis

Cross-functional communication

Job description

Primary Skills: Prompt Engineering [intermediate], Data Annotation [intermediate], SQL [intermediate], Workflow Automation [intermediate], Quality Assurance [intermediate] Contract Type: W2 Duration: 12+Months Location: # LI-Remote Pay Range: $60-65/hr-W2 #LP

Job Summary: This role focuses on integrating AI and Machine Learning solutions into operational workflows to enhance efficiency and accuracy. You will be responsible for understanding current processes, developing AI-driven alternatives, and rigorously testing them to ensure optimal performance. The position requires hands-on work to build, deploy, and maintain these AI-powered solutions.

Key Responsibilities:

• Identify high-impact projects that leverage AI for business improvement.
• Analyze existing workflows and design AI-powered replacements.
• Develop and maintain AI pipelines, including prompt writing and quality monitoring.
• Create and manage datasets for model evaluation and calibration.
• Collaborate with stakeholders to define launch criteria and evidence for AI features.

Must-Have Skills:

• Experience in operational problem-solving and driving measurable results.
• Comfort with quantitative analysis and understanding of core metrics.
• Strong communication skills for cross-functional collaboration.

Industry Experience:

Experience in operations, program management, or analytics within a marketplace or operations-intensive business is preferred.

ABOUT AKRAYA

Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment. Most recently, we were recognized Stevie Employer of the Year 2025, SIA Best Staffing Firm to work for 2025, Inc 5000 Best Workspaces in US (2025 & 2024) and Glassdoor's Best Places to Work (2023 & 2022)! Industry Leaders in Tech Staffing As Talent solutions provider for Fortune 100 Organizations, Akraya's industry recognitions solidify our leadership position in the IT staffing space. We don't just connect you with great jobs, we connect you with a workplace that inspires!