Mid-level Data Engineer

Jobtailor; Maringá; Presencial; BRL 120 000 - 190 000; Tempo integral

Resumo da oferta

Jobtailor in Brazil is seeking a data engineer to develop and maintain data pipelines in Python, implement extraction and incremental load strategies for high-volume relational databases, and build dbt models.

You'll write tests, document pipelines, optimize SQL queries, work with Docker and Linux, and participate in PR-driven code reviews using Git.

Qualificações

• Solid Python skills for building data pipelines (2+ years).
• Advanced SQL: reading, refactoring, and optimizing complex queries.
• dbt: hands-on experience building models, tests, and documentation.
• Experience with high-volume relational databases and extraction/incremental load strategies.
• Docker and comfort with Linux environments.
• Git and PR workflow with code reviews.
• Plus: ingestion tools like dlt or building custom extractors.
• Orchestrators such as Dagster or Airflow.
• ClickHouse or other analytical databases.
• Data catalog and governance tools (OpenMetadata).
• Experience with BI environment migrations and commercial ERP systems.

Responsabilidades

• Develop and maintain data pipelines in Python.
• Implement extraction and incremental load strategies for high-volume relational databases.
• Build and evolve models in dbt.
• Write quality tests and keep documentation up to date.
• Read, refactor, and optimize complex SQL queries to improve performance.
• Work with Docker and Linux environments.
• Follow a Git workflow with Pull Requests and code reviews with the team.
• Develop custom extractors or use ingestion tools like dlt and load data into analytical databases.

Conhecimentos

Python

SQL

dbt

Relational DBs

Git

Incremental loads

Ferramentas

Docker

Linux

Dagster

Airflow

dlt

OpenMetadata

ClickHouse

Descrição da oferta de emprego

Responsibilities

• Develop and maintain data pipelines in Python
• Implement extraction and incremental load strategies for high-volume relational databases
• Build and evolve models in dbt
• Write quality tests and keep documentation up to date
• Read, refactor, and optimize complex SQL queries to improve performance
• Work with Docker and Linux environments
• Follow a Git workflow with Pull Requests and ongoing code reviews with the team
• Develop custom extractors or use ingestion tools such as dlt, orchestrate pipelines with Dagster or Airflow, and load data into analytical databases like ClickHouse.

Requirements

• Solid Python skills for data pipelines (2+ years)
• Advanced SQL — reading, refactoring, and optimizing complex queries
• dbt — hands‑on experience building models, tests, and documentation
• Experience with high-volume relational databases and extraction/incremental load strategies
• Docker and comfort with Linux environments
• Git and workflow with PRs and code review
• Plus: ingestion tools like dlt or building custom extractors
• Orchestrators (Dagster, Airflow)
• ClickHouse or other analytical databases
• Data catalog and governance tools (e.g., OpenMetadata)
• Experience with BI environment migrations
• Experience with commercial ERP systems