We are seeking experienced AI Agent Power Users to contribute to an enterprise AI training project focused on evaluating and improving AI assistants in real-world business workflows.
You’ll use your professional experience and hands‑on knowledge of AI tools to test complex scenarios, evaluate outputs, and provide actionable feedback. No formal AI background is required.
AI Agent Power User
Role Type: Contractor
Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand
Scope of Work
- Run complex, multi‑step business workflows using AI assistants such as ChatGPT and Claude.
- Document workflows and identify where AI performance meets or falls short of real business requirements.
- Evaluate AI‑generated outputs using defined rubrics and quality criteria.
- Provide clear, actionable feedback to AI research and product teams.
- Identify recurring AI strengths, weaknesses, and opportunities for process improvement.
- Connect AI tools with workplace platforms such as Google Drive, Gmail, Slack, and Notion.
- Maintain detailed documentation to ensure findings are clear, consistent, and reproducible.
Preferred Qualifications
- 5+ years of professional experience in any business function involving technology and operational problem‑solving.
- Bachelor’s degree or higher in any discipline.
- Daily, hands‑on experience using ChatGPT and/or Claude for real professional work.
- Experience creating or applying evaluation rubrics, QA scorecards, content review guidelines, or similar frameworks.
- Comfortable working with AI tools and common workplace productivity platforms.
- Excellent written English and strong documentation skills.
- Authorized for contract work and located in the US, Canada, UK, Ireland, Australia, or New Zealand.
AgileEngine is an Inc. 5000 company that creates award‑winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas such as application development and AI/ML, and our people‑first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you’re looking for a place to grow, make an impact, and work with people who care, we’d love to meet you!
ABOUT THE ROLE
We are looking for an Agentic AI Engineer to build generative AI workflows that automate cloud configuration baselines and remediation.
The mandatory requirements are 4+ years of software engineering experience on public cloud infrastructure, 2+ years with cloud deployment pipelines and Infrastructure as Code, 2+ years developing agentic models using RAG and vector databases, and the ability to partner with globally distributed engineering teams.
MUST HAVES
- 4+ years of software engineering experience developing applications and services hosted on public cloud infrastructure.
- 2+ years of experience with cloud infrastructure deployment pipelines and infrastructure as code (IaC).
- 2+ years of experience developing Agentic models (e.g., OpenAI, Anthropic) using Retrieval‑Augmented Generation (RAG) and Vector databases.
- Proven capability to partner with globally distributed inter‑disciplinary engineering teams.
NICE TO HAVES
- Hands‑on experience with modern AI orchestration frameworks (LangChain, LangGraph).
- Hands‑on experience writing Rego policies (Open Policy Agent) or Regula test cases.
- Hands‑on experience with Terraform.
- Familiarity with cloud‑native security services in Amazon Web Services, Azure, and Google Cloud Platform.
- Familiarity with PagerDuty, Atlassian Suite, and ServiceNow.
What You Will Do
- AI Acceleration: implement generative AI workflows utilizing RAG, vector databases, and LLM APIs to automate the creation of cloud configuration baselines.
- Cloud Security Automation: develop AI‑enabled drift detection, continuous discovery, and gap analysis capabilities to accelerate response and remediation activities.
- Policy & Infrastructure as Code (IaC): generate and validate compliant Terraform modules, Rego policies (for Wiz Custom Configuration Rules), and Regula test cases for CI/CD pipelines.
PERKS AND BENEFITS
- Professional growth: Mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation: USD‑based pay with education, fitness, and team activity budgets.
- Exciting projects: Modern solutions with Fortune 500 and top product companies.
- Flextime: Flexible schedule with remote and office options.