Senior Automation Engineer (Python)

KWAN; Porto; Hybrid; EUR 60,000 - 90,000; Full time

Benefits offered by this job

Remote-first

Hubs in Lisbon and Porto

Job summary

KWAN is seeking a data automation specialist to design and build large-scale Python-based automation and web scraping solutions. You will integrate diverse data sources, including those with anti-bot measures, and develop robust data pipelines using REST APIs, OAuth, and webhooks.

The role involves handling unstructured data and applying advanced extraction techniques, with a focus on reliability and data quality.

Qualifications

• 5+ years Python experience
• 5+ years automation and data engineering
• Experience scaling web scraping with Playwright or Selenium
• Session management, anti-bot handling, captchas, proxies, rate limiting
• REST API integration, OAuth and webhooks, pagination
• Unstructured data extraction (PDF parsing, entity extraction, normalization)
• Git, code review, CI/CD, automated testing
• Portuguese language at C2 level

Responsibilities

• Design and build code-based automation and web scraping solutions in Python at industrial scale
• Integrate new data sources quickly, including sites with anti-bot measures, captchas, proxies and rate limiting
• Build and maintain integrations via REST APIs, OAuth and webhooks, including paginated data sources
• Extract and normalize information from unstructured sources such as PDFs, reports and news articles
• Implement orchestration, scheduling, retries, idempotency, monitoring and alerting for data pipelines
• Validate data quality at the source and detect silent or incomplete collection failures
• Apply LLMs and agent-based approaches for document/page extraction, news classification and summarization, and self-healing scrapers

Skills

Python

Automation

Data engineering

Web scraping at scale

REST API integration

OAuth / webhooks

Entity extraction

Git / CI/CD / testing

Portuguese (C2)

Tools

Playwright

Selenium

Git

CI/CD

Airflow

Job description

iGaming affiliate marketing company operating across multiple continents. The role sits within a data collection team currently gathering data across a large number of affiliate platforms. The team is evolving from a data collection function into a broader automation and data acquisition team, covering affiliate platform monitoring, web intelligence (news, competitor reports, market data), and automation of manual operational processes.

What you will do

• Design and build code-based automation and web scraping solutions in Python at industrial scale
• Integrate new data sources quickly, including sites with anti-bot measures, captchas, proxies and rate limiting
• Build and maintain integrations via REST APIs, OAuth and webhooks, including paginated data sources
• Extract and normalize information from unstructured sources such as PDFs, reports and news articles
• Implement orchestration, scheduling, retries, idempotency, monitoring and alerting for data pipelines
• Validate data quality at the source and detect silent or incomplete collection failures
• Apply LLMs and agent-based approaches for document/page extraction, news classification and summarization, and self-healing scrapers

Location and work model

• Hybrid (3 days/week in the office, Porto)

What are we looking for?

• Python — 5+ years
• Automation and data engineering — 5+ years
• Web scraping at scale (Playwright or Selenium)
• Session management, anti-bot handling, captchas, proxies, rate limiting
• REST API integration, OAuth, webhooks, pagination
• Unstructured data extraction (PDF parsing, entity extraction, normalization, deduplication)
• Git, code review, CI/CD, automated testing
• Portuguese C2

Nice to have

• Experience with public statistical data sources
• LLM/agentic AI applied to data extraction and classification
• Airflow or similar orchestration tools
• Ambition to grow into a technical leadership role within the team

About KWAN

At KWAN, your career is bigger than one project. You join a real team, on a long-term project, at a company where technology is the business. And when you are ready for something new — a new stack, a new industry, a bigger role — we find that next step with you, without you having to start over somewhere else.

From day one you have a dedicated People Experience Partner: one person accountable for your growth, not your allocation. They know where you want to go, and they help you get there.

You keep learning as technology moves (AI included). Your impact is seen and recognised. Pay and expectations are talked about openly. And you work remote-first, with hubs in Lisbon and Porto for when you want people around.

Grow with clarity. Be treated with respect. Build things that matter.