Senior Data Engineer Em Alemanha (se)

RE Partners; Sergipe; Presencial; BRL 167 400 - 279 000; Tempo integral

Resumo da oferta

A RE Partners está buscando um Engenheiro de Dados Sênior para projetar e construir pipelines de dados ETL na plataforma de dados AWS. O candidato ideal terá forte experiência em engenharia de dados com habilidades em Spark e boas práticas para garantir a qualidade dos dados.

O trabalho envolve colaboração com várias equipes e otimização da infraestrutura de dados, oferecendo um ambiente de trabalho dinâmico e desafiador. O salário é a combinar e os benefícios não estão informados.

Qualificações

• Experiência profissional em ambientes de data warehousing e engenharia de dados.
• Proficiente em pelo menos uma linguagem de programação de alto nível.
• Bom entendimento de bancos de dados.

Responsabilidades

• Desenhar e construir pipelines de dados ETL no AWS.
• Colaborar com equipes multifuncionais para entender dados necessários.
• Otimizar a infraestrutura de dados.

Conhecimentos

Experiência em engenharia de dados

Programação em Scala, Java ou Python

Conhecimento em Hadoop e Spark

Conhecimento de qualidade e governança de dados

Entendimento de design de sistemas

Ferramentas

AWS (EMR, S3, Lambda, Redshift)

Spark

Hadoop

Descrição da oferta de emprego

Cargo:

Senior data engineer em alemanha (SE) – alemanha

Requisitos

Who We Are: We are a fast growing business and technology consultant company co-founded in 2019. We offer a custom-tailored, white-glove engineering service fit for our clients, because a digital transformation is more than just technology. With a successful track record of being a preferred vendor for Fortune 500 companies and as a trusted partner for some of the industry’s leading companies, our global talent has helped many clients achieve their goals.

The 3 G’s of RE

• “Get Shit Done.”
• “Get Over Shit.”
• “Give a Shit.”

What You’ll Do

• Design and build Spark data ETL pipelines on AWS data platform.
• Collaborate with cross functional teams such as data scientists, fraud, marketing and other business stakeholders to understand their data needs and deliver reliable solutions.
• Optimize data infrastructure - Design and maintain robust data infrastructure by using modern data platform architecture.
• Ensure data quality and reliability.
• Innovate and follow best practices.
• Ensure operational excellence of the data platform, including monitoring, incident response, performance optimization, and continuous improvement.

Who We’re Looking For

• Professional experience working in data warehousing, data architecture, and/or data engineering environments, especially using spark, hadoop, hive etc with solid understanding of streaming pipelines.
• Proficiency in at least one high-level programming language (Scala, Java, Python or equivalent).
• Good understanding of databases.
• You have built large-scale data products and understand the tradeoffs made when building these features.
• You have a deep understanding of system design, data structures, and algorithms.
• You have an excellent knowledge of distributed computing frameworks such as Hadoop Map Reduce, Spark.
• You have a strong knowledge of following AWS infrastructure - EMR, S3, Lambda, Redshift etc.
• You have strong understanding of data quality, governance.
• You are a team player, self-driven, highly motivated individual who loves to learn new things.

Equal Opportunity Employer

We are an equal opportunity employer and welcome applications from all qualified individuals regardless of race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, or veteran status.

Salário

A Combinar

Benefícios

Não informado