Senior Data Infrastructure Engineer - Remote Web Crawling ETL

ZoomInfo Technologies LLC; Bethesda, Vancouver, Waltham (MD, WA, MA); Remote; USD 140,000 - 220,000; Full time

Job summary

ZoomInfo is seeking a Senior Software Engineer to join the Web Data team and help build the next generation of web crawling and data extraction infrastructure. You will work on large-scale crawling systems processing billions of pages and ship features that directly impact data quality across the platform.

You'll collaborate with a people manager, product manager, and senior manager to ensure engineering execution and career growth, focusing on scalable, observable, and reliable systems in a

Qualifications

• 5+ years of professional software engineering experience building production systems
• Strong CS fundamentals: algorithms, data structures, concurrency, distributed systems
• Proficiency in Java and/or Python
• Track record of owning features end-to-end from design through deployment and operation
• Comfortable making sound architectural decisions at the component level
• Hands-on experience with cloud data warehouses and ETL/ELT pipelines
• Experience with orchestration tools and streaming/event-driven systems

Responsibilities

• Design and implement components of scalable, fault-tolerant web crawling and extraction pipelines
• Write clean, production-grade code in Java and Python
• Build and operate ETL/ELT pipelines for large-scale data extraction and transformation
• Work with cloud infrastructure on GCP and AWS, primarily on GKE
• Improve observability, reliability, and operational excellence across the systems you contribute to
• Partner with product and data science teams to deliver impactful solutions
• Contribute to code reviews, documentation, and knowledge sharing across the team
• Stay current with evolving web technologies, anti-crawling mechanisms, and AI-powered extraction approaches

Skills

5+ years software engineering

CS fundamentals

Java

Python

Distributed systems

Problem solving

Tools

BigQuery

Snowflake

Airflow

Kubernetes

Terraform

Scrapy

Job description

ZoomInfo is seeking a Senior Software Engineer to join the Web Data team and help build the next generation of web crawling and data extraction infrastructure. You will work on large-scale crawling systems processing billions of pages and ship features that directly impact data quality across the platform.

You'll collaborate with a people manager, product manager, and senior manager to ensure engineering execution and career growth, focusing on scalable, observable, and reliable systems in a