Senior Python Backend Engineer – Remote Data Crawling

Jobgether; Germany (OH); On-site; USD 81,995 - 105,423; Full time

Benefits offered by this job

Competitive salary

Fully remote flexibility

Comprehensive health coverage

Paid time off

Retirement savings plan

Home office setup support

Continuous learning support

Job summary

Jobgether is seeking a Senior Software Engineer (Python) for a fully remote position. The role focuses on building large-scale, distributed systems for data extraction, processing, and search, requiring expertise in Python and data pipelines. You will design systems that collect data from various sources and collaborate with ML/NLP teams to ensure efficient data flow.

We offer a competitive salary, comprehensive health coverage, and a supportive work culture that emphasizes professional development and inclusion.

Qualifications

• 5+ years of experience in Python development for web scraping.
• Experience with data formats like PDFs and OCR tools.
• Strong problem-solving skills in scaling and complexity.

Responsibilities

• Design and build distributed web crawling systems.
• Develop robust data pipelines from diverse sources.
• Build systems for unifying heterogeneous data.
• Implement preprocessing for ML/NLP models.
• Develop APIs exposing structured data.
• Collaborate with ML and data science teams.
• Automate workflows using tools like Apache Airflow.
• Optimize data processing using Spark.

Skills

Python development

Web scraping

REST APIs

ElasticSearch/OpenSearch

Data pipeline systems

Apache Airflow

Spark (EMR)

AWS

Kubernetes

Machine Learning/NLP

Job description

Jobgether is seeking a Senior Software Engineer (Python) for a fully remote position. The role focuses on building large-scale, distributed systems for data extraction, processing, and search, requiring expertise in Python and data pipelines. You will design systems that collect data from various sources and collaborate with ML/NLP teams to ensure efficient data flow.

We offer a competitive salary, comprehensive health coverage, and a supportive work culture that emphasizes professional development and inclusion.