Remote Lead AI Automation & Integration Engineer

OP Recruiting; Chicago (IL); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Flexible remote work

Professional development

Medical coverage

EEO commitment

Job summary

OP Recruiting seeks a Lead AI Automation & Integration Engineer to design scalable data pipelines and deploy generative AI agents in a fast-paced analytics environment.

You will build robust integration layers, connect databases and SaaS apps, and ensure high uptime while coordinating with an advanced data team. Remote-friendly with competitive compensation and growth opportunities.

Qualifications

• 5+ years of experience in API development, web data extraction, and complex systems integration.
• Advanced Python proficiency with web scraping frameworks and custom API development.
• Experience building automation across Zapier or n8n.
• Hands-on with generative AI models (OpenAI, Claude) and visual agent orchestration builders.

Responsibilities

• Design and deploy scalable data extraction pipelines using Python scripts and modern web scraping frameworks.
• Build and optimize multi-system automated workflows connecting databases, SaaS apps, and internal tools.
• Develop and integrate intelligent generative AI agents to automate analytical tasks and content workflows.
• Engineer custom Python webhooks, scripts, and RESTful APIs to extend automation capabilities.
• Manage relational database systems and craft SQL queries to maintain data integrity.
• Monitor, troubleshoot, and fine-tune automated processes and scraping systems for uptime.

Skills

API development

Web data extraction

Complex systems integration

Python programming

Workflow automation

SQL

REST APIs

OAuth2

Tools

Scrapy

Playwright

BeautifulSoup

Zapier

n8n

OpenAI

Claude

Snowflake

PostgreSQL

OAuth2

AWS Lambda

AWS EC2

AWS S3

REST APIs

Job description

Job Title Lead AI Automation & Integration Engineer

Location Remote (US / Anywhere)

About the Opportunity Drive the creation of next-generation automation workflows and intelligent data pipelines for an expanding market intelligence and data analytics platform. This hands-on role invites an experienced integrator to design scalable data extraction systems and deploy custom generative AI agents in a fast-paced environment. If you excel at transforming complex raw datasets into streamlined operational solutions, this opportunity offers high-impact visibility alongside an advanced data team.

Responsibilities

• Design and deploy scalable data extraction pipelines leveraging custom Python scripts and modern web scraping frameworks.
• Build and optimize multi-system automated workflows utilizing low-code/no-code platforms to connect databases, SaaS applications, and internal tools.
• Develop and integrate intelligent generative AI agents to automate analytical tasks, customer interactions, and content workflows.
• Engineer custom Python webhooks, scripts, and RESTful APIs to extend automation capabilities and integrate proprietary backends.
• Manage relational database systems and construct SQL queries to safeguard data integrity across connected systems.
• Monitor, troubleshoot, and fine-tune automated processes and scraping systems to ensure maximum operational uptime.
  
  

Requirements

• 5+ years of dedicated experience in API development, web data extraction, and complex systems integration.
• Advanced Python proficiency with proven application in web scraping frameworks (such as Scrapy, Playwright, or BeautifulSoup) and custom API development.
• Demonstrated experience building and maintaining complex, multi-step automations using platforms like Zapier or n8n.
• Hands-on experience implementing generative AI models (OpenAI, Claude) and visual agent orchestration builders, along with chat observability platforms.
• Solid SQL skills and working familiarity with relational databases and enterprise data warehouses (e.g., Snowflake, PostgreSQL).
• Deep comprehension of system integration essentials, including REST APIs, JSON, webhooks, and standard authentication protocols (OAuth2).
• Working knowledge of AWS cloud infrastructure, specifically Lambda, EC2, and S3.
  
  

Preferred Qualifications

• Practical background building complete end-to-end conversational AI workflows and production chat applications.
• Familiarity with enterprise web scraping platforms (e.g., Apify) or custom browser extension engineering.
• Experience integrating enterprise CRM platforms, such as Salesforce.
• Familiarity with modern data stack tooling including DBT, Prefect, Docker, and Terraform.
  
  

Compensation & Benefits

• Competitive base salary and performance-driven bonuses.
• Comprehensive medical and dental coverage.
• Flexible remote work arrangements and professional development support.
• Standard Equal Employment Opportunity (EEO) commitment.
  
  

Accepting Candidates