Automation & Data Integration Engineer

Hoodie Analytics; Chicago (IL); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health insurance

Competitive salary

Professional growth opportunities

Job summary

Hoodie Analytics is seeking a hands-on Full-Stack AI Automation and Integration Engineer to design robust data pipelines and scalable web scraping solutions. You will implement complex multi-step automations using Python, Flowise, and LCNC platforms like Zapier and n8n, while ensuring data quality and reliable delivery across internal systems and external stakeholders.

We value practical AI automation expertise, strong problem solving, and the ability to translate raw data into actionable

Qualifications

• Minimum of 5 years of experience in web data integration and systems integration.
• Advanced-level knowledge of Python for scripting, web scraping, and API development.
• Hands-on experience designing, building, and maintaining complex automations using Zapier or n8n.

Responsibilities

• Architect and implement robust data pipelines using Python and web scraping libraries to extract data from diverse sources.
• Orchestrate complex workflows with LCNC tools to automate processes across SaaS apps, databases, and internal systems.
• Build and deploy generative AI agents and applications within automation workflows.
• Develop custom integrations with Python to create and manage webhooks, APIs, and scripts.
• Manage databases and data flow with moderate SQL skills ensuring data integrity.
• Troubleshoot and optimize automated workflows, scraping agents, and integrations with monitoring and error handling.

Skills

Data integration

Python proficiency

LCNC tooling

Gen AI stack

SQL

REST APIs

AWS

Tools

Beautiful Soup

Scrapy

Playwright

Apify

Flowise

OpenAI

Claude

Job description

Hoodie Analytics is a high growth company supporting cannabis brands, consumers, and retailers with a comprehensive suite of analytics, apps, and data-enabled services that provide marketplace intelligence on sales, distribution, price, and promotion.

About the Role

Are you a hands-on data integration engineer who enjoys working with complex data systems? Do you excel at optimizing workflows, improving data quality, and ensuring efficient data delivery?

At Hoodie Analytics, we have a dynamic data environment and have a never-ending amount of integrations needs. We are seeking a highly resourceful and technically proficient Full-Stack AI Automation and Integration Engineer. You must have a minimum of 5 years of experience in API, web data and systems integration. The ideal candidate is an expert systems integrator, capable of building robust data pipelines, orchestrating complex workflows, and deploying solutions for both internal and external stakeholders. You will combine deep expertise in web scraping, advanced Python skills and with proficiency in low-code/no-code (LCNC) platforms like Zapier, n8n and even Flowise if you are working on AI projects. Most importantly you must be recently experienced in AI automation and seriously passionate about this field.

At Hoodie, you’ll be learning from and working alongside some of the best data engineers in the industry, tackling real-world data challenges that impact our business every day.

We’re looking for someone who is tactical, and hands-on, ready to dive deep into data challenges and deliver impactful solutions. If you’re passionate about transforming raw data into actionable insights, we’d love to hear from you!

Key Responsibilities

• Architect and implement robust data pipelines: Design, build, and maintain scalable web scraping solutions using advanced Python scripting and libraries (e.g., Beautiful Soup, Scrapy, Playwright) to extract complex data from various sources. Use tools like Apify to perform data extraction at scale.
• Orchestrate complex workflows: Leverage LCNC tools like Zapier or n8n to integrate and automate processes between multiple SaaS applications, databases, and internal systems.
• Build generative AI agents and applications: Utilize platforms like Flowise to build and deploy intelligent agents for tasks such as data analysis, content generation, and customer interaction, integrating them into broader automation workflows.
• Develop custom integrations: Write custom code in Python to create and manage webhooks, APIs, and scripts that extend the capabilities of LCNC tools and build integrations for proprietary systems.
• Manage databases and data flow: Use moderate SQL skills to manage and optimize data flow, ensuring data integrity and quality across integrated systems.
• Troubleshoot and optimize: Identify, diagnose, and resolve issues in automated workflows, scraping agents, and integrations. Implement monitoring, error handling, and performance optimization to ensure maximum reliability and efficiency.

Required Skills and Qualifications

• Strong communication, analytical, and problem-solving skills.
• Experience: Minimum of 5 years of experience in web data integration and systems integration.
• Python Proficiency: Advanced-level knowledge of Python for scripting, web scraping (e.g., BeautifulSoup, Scrapy, Playwright), and API development.
• LCNC Expertise: Proven, hands-on experience designing, building, and maintaining complex multi-step automations using integration systems like Zapier or n8n.
• Gen AI Tech Stack: Practical experience with tools like, Open AI, Claude. Tools like Flowise for visual AI agent creation visual AI agent creation, including understanding orchestration, data ingestion, and integration capabilities.. Chat Observability Tools for feedback and improvement.
• Moderate SQL Skills: Experience with relational databases and moderate SQL skills for data querying, manipulation, and optimization.
• System Integration: Strong understanding of REST APIs, webhooks, JSON, and authentication protocols (e.g., OAuth2).
• Problem-Solving: Excellent analytical and problem-solving skills with a meticulous attention to detail.
• Solid understanding of AWS-based data infrastructure (S3, Lambda, EC2).

Our technical environment

• Data: DBT
• Databases: Snowflake, Posgres, ElasticSearch
• Languages: Python & SQL mainly, but also a bit of bash
• Cloud: AWS (EC2s, S3, Lambda functions)
• IaC: Terraform, Docker
• Code management: Github
• Project tracking: Jira

Preferred Qualifications (Bonus Points)

• Gen AI: Experience in Building soup to nuts chat flows and successful implementations.
• CRM Systems: Familiarity with CRM systems and their integration, such as Salesforce.
• Scraping Systems: Familiarity with Apify or other professional web scraping systems.
• Database Experience: Familiarity with specific databases (e.g., PostgreSQL, Snowflake).

Pay range and compensation package

• Competitive salary and performance-based bonuses.
• Comprehensive benefits package including health and dental insurance.
• A collaborative, innovative work environment that values professional growth.
• Opportunities to work on cutting-edge technologies and products that make a difference.