Freelance AI & Web Scraping Developer

MENA Alliances; United States; Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Flexible working hours

Remote-friendly environment

Job summary

MENA Alliances is seeking a Web Crawling & AI Lead Qualification Engineer to build a smart tool that identifies and evaluates potential business leads across client websites. The role involves creating a web crawler, extracting relevant content, and using AI to determine if companies are strong targets for specific industry sectors.

You will design a scoring system, produce structured outputs, and deliver a standalone, handover-ready application that the client can operate and expand.

Qualifications

• Proficient in extracting meaningful data from web pages.
• Experience with text analysis to derive insights from content.
• Ability to design and implement scalable, maintainable software products.
• Familiarity with modern development stacks and best practices.

Responsibilities

• Develop a web crawling and scraping system to collect relevant data from a list of websites.
• Extract and process meaningful content from crawled pages.
• Integrate AI/LLM capabilities to analyze website content and evaluate whether the company fits a target industry vertical.
• Design a scoring or ranking mechanism that qualifies and prioritizes leads.
• Produce a structured output containing qualified leads with clear reasoning or scoring.
• Deliver a standalone, well-structured application ready for handover to the client.

Skills

Content extraction

Text analysis

AI/LLM integration

Software design

Tools

BeautifulSoup

Scrapy

Playwright

Puppeteer

Job description

This is a remote position. MENA Alliances is hiring a Web Crawling & AI Lead Qualification Engineer to develop a smart tool that identifies and evaluates potential business leads. In this role, you will build a web crawling and AI-powered lead qualification application that takes a list of company websites, extracts relevant content, and uses AI to determine whether those companies are strong marketing targets for specific industry sectors (such as utilities or telecom). The final deliverable should be a clean, maintainable, and handover-ready product that the end client can easily operate and expand.

Key Responsibilities

• Develop a web crawling and scraping system to collect relevant data from a list of websites.
• Extract and process meaningful content from crawled pages.
• Integrate AI/LLM capabilities to analyze website content and evaluate whether the company fits a target industry vertical.
• Design a scoring or ranking mechanism that qualifies and prioritizes leads.
• Produce a structured output containing qualified leads with clear reasoning or scoring.
• Deliver a standalone, well-structured application ready for handover to the client.

Requirements Technical Requirements

• Experience with web scraping and crawling tools such as BeautifulSoup, Scrapy, Playwright, Puppeteer, or similar frameworks.
• Strong knowledge of content extraction and text analysis.
• Hands-on experience integrating AI / LLM APIs (e.g., OpenAI, Anthropic, or open-source models).
• Ability to design and build clean, maintainable software products, not just quick prototypes.
• Familiarity with modern development stacks and best practices.

Nice to Have

• Experience in lead generation, marketing technology, or sales intelligence tools.
• Knowledge of prompt engineering, particularly for multilingual or non-English content.
• Experience building end-to-end AI-powered tools or automation solutions.
• German language skills are a plus but not required (language support will be provided by the client).

Benefits

• Flexible working hours to support a healthy work-life balance.
• Remote-friendly work environment.
• Collaborative and supportive team culture.