Senior Data & Python Engineer — Scalable Web Scraping

Ceartas; Town of Poland (NY); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

25 paid days off

Culture of innovation

Diversity and equal opportunity

Access to latest technology

Employee recognition program

Growth opportunities

Job summary

Ceartas is seeking a Data & Python Software engineer to design and scale web data extraction pipelines and crawling technologies. You will collaborate with our CTO and Head of Engineering to lead the Data Engineering Team in developing data-first solutions for digital security and brand protection.

You will build high-performance scraping systems, ensure data quality and governance, and optimize for performance, reliability, and cost while delivering production-grade backend services and data

Qualifications

• Experience with web scraping.
• Strong SQL skills.
• Strong Python experience.
• Experience with PostgreSQL or similar relational databases.
• Experience designing and building scalable APIs and backend services (e.g. FastAPI, Django, or similar).
• Experience designing efficient, scalable data models and database schemas.
• Hands-on experience deploying and operating systems in the cloud (AWS, GCP, or Azure).
• Experience working with Docker and containerized environments.

Responsibilities

• Design, build, and maintain high-performance web scraping systems and backend data pipelines.
• Implement and maintain scraping-focused APIs and data services for internal products and external integrations.
• Build reliable ingestion, processing, and storage workflows for large-scale web data.
• Ensure data quality, validation, and governance across ingestion, storage, and serving layers.
• Optimize scraping systems for performance, scalability, reliability, and cost efficiency.
• Monitor, debug, and improve scraping system reliability using observability tools.

Skills

Web scraping

SQL

Python

APIs

Backend services

Relational databases

Data modeling

Cloud platforms

Education

Bachelor's degree in CS/Engineering

Master's degree preferred

Tools

Docker

AWS

GCP

Azure

Airflow

Job description

Ceartas is seeking a Data & Python Software engineer to design and scale web data extraction pipelines and crawling technologies. You will collaborate with our CTO and Head of Engineering to lead the Data Engineering Team in developing data-first solutions for digital security and brand protection.

You will build high-performance scraping systems, ensure data quality and governance, and optimize for performance, reliability, and cost while delivering production-grade backend services and data