Python Data Engineer Leader

Bebeedataengineer; Salvador; Presencial; BRL 120.000 - 160.000; Tempo integral

Resumo da oferta

A data engineering company based in Brazil is seeking a Senior Data Engineer to develop high-performance data processing pipelines and RESTful APIs. The ideal candidate has strong proficiency in Python, experience with Pandas and FastAPI, and a solid understanding of data modelling. This role offers opportunities for growth, collaboration, and innovation within a team-driven environment.

Qualificações

• Strong expertise in Python for data processing.
• Experience in building RESTful APIs using FastAPI.
• Understanding of star schema design principles.

Responsabilidades

• Design high-performance data processing pipelines.
• Develop RESTful APIs ensuring integration with upstream sources.
• Generate dynamic Excel reports from normalized Parquet files.

Conhecimentos

Python proficiency

Data processing with Pandas

Backend development using FastAPI

Data modelling principles

Ferramentas

GitHub Copilot

Claude

Descrição da oferta de emprego

Senior Data Engineer

About the Role

• Data Engineering Expertise: Possess a deep understanding of designing high-performance data processing pipelines using Pandas and Polars.
• API Architecture: Develop RESTful APIs using FastAPI or similar frameworks, ensuring seamless integration with upstream sources.
• Data Analytics: Consume and process normalized Parquet files to generate dynamic Excel reports, driving business insights and decision-making.
• Collaborative Development: Contribute to a spec-driven development workflow, leveraging tools like GitHub Copilot and Claude.

Required Skills and Qualifications

• Programming Expertise: Strong proficiency in Python for data processing, including experience with Pandas and Polars.
• Backend Development: Proven experience in building backend services or APIs using FastAPI.
• Data Modelling: Solid understanding of data modelling principles, including star schema design and handling normalized datasets.
• Messaging Patterns: Familiarity with enterprise messaging patterns and data integration from various sources.

Benefits of this Role

This role offers opportunities for growth, collaboration, and innovation.

If you are passionate about working with data and developing cutting‑edge solutions, we encourage you to apply.