Remote Python Backend Engineer — Data & Web Scraping

thinkbridge; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Renewable contract

Remote-first

USA hours (PST)

Leave protection

Job summary

think bridge is seeking a skilled Python backend engineer for a fully remote role based in the United States. You will build and maintain large-scale data collection and customer-facing services, using Flask and FastAPI, with emphasis on reliability and performance.

You will design scalable web scraping pipelines, integrate with third-party APIs, and ensure data quality while collaborating with cross-functional teams. The role rewards thinking ahead, learning time, and a long-term career path.

Qualifications

• 3+ years of Python backend development experience.
• Strong web scraping experience with Scrapy/Playwright/Beautiful Soup.
• Experience with large-scale data processing and big datasets.
• Proficiency with SQL and NoSQL databases (PostgreSQL, MongoDB, Redis).
• Knowledge of asynchronous programming and multiprocessing in Python.
• Experience with cloud services (AWS, GCP, or Azure).
• Experience with data pipelines (Airflow, Prefect, or Luigi) is a plus.
• Fluent English communication skills.

Responsibilities

• Develop and maintain Python-based backend services for large-scale data collection + customer facing Web services developed in Flask and FastAPI.
• Build efficient, scalable, and maintainable web scraping solutions using tools like Playwright, Crawl4AI or other open source LLM backed scraping.
• Model large datasets provided by our data partners and collected by our systems and model them efficiently to be served to customers facing applications in sub second latency.
• Ingest data from third-party APIs into our datastore.
• Ensure data integrity and quality through validation, deduplication, and error-handling mechanisms.
• Implement and optimize database queries (SQL and NoSQL) for fast data retrieval.
• Collaborate with cross-functional teams to integrate collected data into internal systems.
• Maintain security and compliance best practices in data scraping and storage.
• Write clean, well-documented, and testable code.
• Accountability– Finish what you started.
• Communication– Context-aware, pro‑active and clean communication.
• Outcome– High throughput.
• Quality– High‑quality work and consistency.
• Ownership – Go beyond.

Skills

Python development

Web scraping

Asyncio / multiprocessing

SQL / NoSQL

Cloud services

Airflow / Prefect

Flask / FastAPI

English communication

Tools

Playwright

Scrapy

Beautiful Soup

Selenium

Docker

Kubernetes

Job description

think bridge is seeking a skilled Python backend engineer for a fully remote role based in the United States. You will build and maintain large-scale data collection and customer-facing services, using Flask and FastAPI, with emphasis on reliability and performance.

You will design scalable web scraping pipelines, integrate with third-party APIs, and ensure data quality while collaborating with cross-functional teams. The role rewards thinking ahead, learning time, and a long-term career path.