Remote Data Engineer - Web Scraping (3-Month Contract)

CXG

United States

Remote

USD 83,000 - 124,000

Full time

10 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CXG is seeking a Data Engineer specialized in web scraping to work remotely on a 3-month contract. You will maintain scraping configurations in Python, ensure reliability, and transform data for ingestion into the Datalake.

Collaboration with data scientists and analysts is part of the role, with a focus on scalable architecture and secure data handling. The ideal candidate has strong Python skills, experience with ETL, Airflow, DBT, SQL/NoSQL, and familiarity with Azure.

Qualifications

  • Proven experience in data engineering with expertise in designing and implementing scalable data architectures.
  • Strong experience with ETL processes, data modeling, and data warehousing (Airflow & DBT preferred).
  • Expertise in database technologies, both relational (SQL) and NoSQL.
  • Knowledge of cloud platforms, particularly Azure.
  • Solid understanding of data security measures and compliance standards.
  • Excellent Python experience for data engineering and automation.
  • Strong collaboration skills to work closely with data scientists and analysts.
  • Ability to optimize data pipelines for performance and efficiency.
  • Ability to build, test, and maintain tasks and projects.
  • Experience with version control systems, such as Git.
  • Hands-on experience with Airflow and/or DBT.
  • Experience with Terraform for infrastructure management.
  • Minimum 2 years of experience in a similar role.
  • Strong academic background in a relevant field.
  • Fluent in English (French is a plus).

Responsibilities

  • Maintain and manage website scraping configurations using Python.
  • Monitor scraping configurations for errors and potential crashes.
  • Oversee retrieved data to detect potential issues and blockages.
  • Coordinate with stakeholders to understand scraping task requirements and report issues.
  • Prepare and share periodic reports on scraping activities with stakeholders.
  • Develop necessary pipelines to ingest data into the Datalake and perform required transformations.

Skills

Data engineering
ETL processes
Python
Airflow
DBT
SQL
NoSQL
Azure
Terraform
Git
Data warehousing
Data modeling
Security & compliance

Education

Bachelor's degree

Tools

Airflow
DBT
Azure
Terraform
Git

Job description

CXG is seeking a Data Engineer specialized in web scraping to work remotely on a 3-month contract. You will maintain scraping configurations in Python, ensure reliability, and transform data for ingestion into the Datalake.

Collaboration with data scientists and analysts is part of the role, with a focus on scalable architecture and secure data handling. The ideal candidate has strong Python skills, experience with ETL, Airflow, DBT, SQL/NoSQL, and familiarity with Azure.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - Web Scraping (3 months contract)
Data Engineer - Web Scraping (3 months contract)

CXG Holdings Inc • United States

Remote
USD 83,000 - 124,000
Remote Data Engineer: Web Scraping & Data Pipelines
Remote Data Engineer: Web Scraping & Data Pipelines

Alternative Path Private Limited • United States

Remote
USD 90,000 - 130,000
Data Engineer - Web Scraping
Data Engineer - Web Scraping

Alternative Path Private Limited • United States

Remote
USD 90,000 - 130,000
Remote Web Scraping Engineer | Scalable Data Pipelines
Remote Web Scraping Engineer | Scalable Data Pipelines

Wynd Labs • United States

Remote
USD 110,000 - 170,000
Opportunity
Culture
Compensation
Senior Data Engineer
Senior Data Engineer

Advancing Analytics • United States

Remote
USD 134,000 - 171,000
Senior ETL & Web Data Extraction Engineer
Senior ETL & Web Data Extraction Engineer

WebDataGuru • Indiana

On-site
USD 120,000 - 170,000
ETL/DB/Data Extraction Engineer
ETL/DB/Data Extraction Engineer

WebDataGuru • Indiana

On-site
USD 120,000 - 170,000
Remote Data Infrastructure Engineer (Scraping & Scale)
Remote Data Infrastructure Engineer (Scraping & Scale)

Jobgether • United States

Remote
USD 65,000 - 98,000
Fully remote work arrangement
Full-time employment
Part-time Remote Python Data Scraping Engineer
Part-time Remote Python Data Scraping Engineer

Mindrift • United States

Remote
GBP 25,663 - 37,981
Work fully remote with flexible schedule
Hands-on experience in hybrid AI and human collaboration
Performance-based bonus programs
Python Web Scraping Engineer - Data Extraction Specialist
Python Web Scraping Engineer - Data Extraction Specialist

Artingdigital • United States

Remote
USD 90,000 - 130,000