Senior Data Engineer

Breakthrough Talent; Serra; Presencial; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading data consulting firm in Brazil is seeking a Senior Data Engineer to support building and scaling their new data platform. The ideal candidate will have over six years of experience in Data Engineering, strong skills in AWS, Python, SQL, and a disciplined approach to coding. Responsibilities include designing cloud infrastructure, building data pipelines, and collaborating with teams. This position requires teamwork in an agile environment and strong problem-solving skills.

Qualificações

• 6+ years experience in Data Engineering or Data Infrastructure role.
• Strong experience building data architectures in AWS.
• Solid coding skills in Python and SQL.
• Strong knowledge of Cloud Formation.
• Experience with relational databases like Postgres or Redshift.
• Good coding discipline including documentation and unit testing.
• Experience with Git and CI CD tools.
• Worked in Agile teams.

Responsabilidades

• Design, build, and maintain core infrastructure for data processing.
• Build and maintain cloud-based infrastructure using Cloud Formation.
• Design and implement data processing environments using AWS services.
• Build data processing pipelines using Python and SQL.
• Monitor performance, cost, and security of the data platform.
• Collaborate with multiple teams for the data platform strategy.

Conhecimentos

Data Architecture in AWS

Coding in Python

Coding in SQL

Golang

Cloud Formation

Git

Agile Methodologies

Problem Solving

Communication

Ferramentas

AWS Services

Cloud Formation

Postgres

Redshift

GitLab

Apache Airflow

Snowflake

Jira

Descrição da oferta de emprego

Senior Data Engineers Breakthrough Talent is currently supporting a leading data business build a brand new data platform to support a modern data mesh organisation. They work with national and global clients across data, software and digital consulting, and they are now looking for a Data Infrastructure Engineer to help build and scale their next generation platform.

This role suits someone who enjoys owning infrastructure, building reusable solutions, and supporting data teams with analytics and AI ready environments.

The Role

As a Data Engineer you will design, build and maintain the core infrastructure that enables data processing, analytics, data science and data management across the business.

You will work in a multi account and multi region AWS environment that follows zero trust and least privilege principles. Infrastructure as Code and CI CD will be central to how you operate, alongside continuous improvement and strong governance.

What You Will Do

• Build and maintain cloud based infrastructure using Cloud Formation and SAM
• Design and implement data processing environments using AWS services such as Glue, EMR, Sagemaker, Redshift, Aurora and Snowflake
• Build data processing pipelines using Python, SQL, PySpark, Spark, Lambda, Step Functions and Apache Airflow
• Monitor performance, cost and security of the data platform
• Apply strong data governance and access control for sensitive data
• Collaborate with multiple teams to support the wider data platform strategy

What You Need

• Six years or more experience in a Data Engineering or Data Infrastructure role
• Strong experience building data architectures in AWS
• Solid coding skills in Python and SQL, Golang
• Strong Cloud Formation knowledge
• Experience working with relational databases such as Postgres or Redshift
• Good coding discipline including documentation, unit testing and version control
• Experience with Git and CI CD tools such as GitLab
• Worked in Agile teams and ceremonies
• Strong problem solving skills and excellent communication

Nice to Have

• Experience with Jira or similar project management tools
• Experience with Snowflake
• Spatial data processing experience

If you would like to learn more about the role, please reach out to Jake Denman at Breakthrough Talent.