Senior AI Web Data Engineer – Agentic Search

Nebius

Reims

On-site

EUR 70,000 - 110,000

Full time

14 days+

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Competitive compensation

Career growth

Flexibility

Collaborative culture

Impactful AI projects

International environment

Job summary

Nebius is seeking a Software Engineer - Scraping Specialist to design and run large-scale web acquisition pipelines for real-time AI data. You will build distributed systems to capture and structure the live web, navigating evolving web protections and automation challenges.

The role blends browser, network, and automation expertise, delivering production-grade components with resilience, speed, and trustworthy data. Join a fast-moving, impact-driven team creating AI-ready cloud infrastructure.

Qualifications

3–5 years of experience as a backend or systems engineer.
Strong programming skills in Python or Node.js; Go or C++ is a plus.
Proven experience building and maintaining browser automation systems (Playwright, Puppeteer, or CDP).
Solid understanding of browser internals, network protocols, and web interaction.

Responsibilities

Build distributed data acquisition systems capturing the live web.
Analyze browser internals, fingerprinting, and anti-automation systems.
Prototype and deploy intelligent automation frameworks using Playwright, Puppeteer, and CDP.
Collaborate with AI and infra teams to integrate web data into pipelines.