[Hiring] Senior Data Engineer @Predoc

Predoc; Deutschland; Remote; EUR 85.000 - 120.000; Vollzeit

Zusammenfassung

A leading tech organization is hiring a remote Senior Data Engineer to develop and maintain data pipelines and manage database migrations. The ideal candidate will have over 5 years of experience in data engineering, strong Python and SQL skills, and experience with data documentation and analysis. This role also involves collaboration with various teams to define and implement data solutions.

Qualifikationen

• 5+ years of proven experience in Data Engineering or a similar role.
• Demonstrable experience using data-focused libraries such as Pandas and DuckDB.
• Strong SQL experience, including table design and advanced query building.

Aufgaben

• Develop, test, and maintain data pipelines using Python.
• Design and optimize database tables and write efficient SQL queries.
• Collaborate with product teams and data scientists to implement data solutions.

Kenntnisse

Python

SQL (Postgres RDBMS)

Data Documentation

Event-Based Data Processing

Data Modeling

Tools

Airflow

Kestra

Git

AWS (S3, Step Functions, Batch, Athena, Glue)

Jobbeschreibung

Overview

Sep 23, 2025 - Predoc is hiring a remote Senior Data Engineer. Location: USA.

Responsibilities

• Design and Development: Develop, test, and maintain data pipelines using Python and orchestration tools such as Airflow or Kestra.
• Code Quality: Write clean, maintainable, and efficient code, following best practices for coding standards, security, testing, and deployment.
• Database Management: Design and optimize database tables, write efficient SQL queries, and manage database migration scripts.
• Documentation: Develop and maintain documentation around data sources and their composition requirements and resulting transformations from ingestion to final data structures. Also, ensure accurate tracking through the data lifecycle.
• Collaboration: Work with the product team, data scientists, and other stakeholders to define and implement data solutions using new and existing data sources and technologies.
• Continuous Improvement: Participate in code reviews, contribute to team learning, and stay updated with industry trends and technologies.

Requirements

Technical Qualifications

• Python
  • Demonstrable experience in data-focused libraries (Pandas, DuckDB, etc.)
  • Experience working with DAGs or equivalent structures
  • Experience in process automation in Python
  • Experience Integrating with third-party APIs
• Proven Experience in a Data Engineering or Similar Role (ideally 5+ yrs)
  • Understanding Data Lineage and Strategies
  • ETL Pipeline Design/Development
  • Data Modeling Experience
  • Experience Building Scalable Data Lakes/Warehouses
  • Experience analyzing and organizing large data sets
• Experience in Event-Based Data Processing
• Strong Data Documentation Experience
• Strong SQL (Postgres RDBMS) Experience
  • Table design and optimization
  • Advanced Query Building and Optimization
  • Advanced Data Aggregation Strategies
• Experience with ETL/Workflow Automation & Tools (Kestra, Airflow, or similar)
• Git SCM (Gitlab)
• Experience in Regulated Industries (Healthcare, Banking, etc.)

Bonus

• AWS (S3, Step Functions, Batch, Athena, Glue)
• Experience in Data Analysis
• Experience working with Data Science/ML teams
• Experience with Typescript