Senior Data Engineer Em Lavras (ma)

RE Partners; Maranhão; Presencial; BRL 167 400 - 279 000; Tempo integral

Resumo da oferta

A RE Partners, uma empresa de consultoria empresarial e tecnológica, busca um engenheiro de dados sênior para desenhar e construir pipelines de ETL de dados utilizando Spark na plataforma AWS. O candidato deve ter experiência em ambientes de engenharia de dados e ser proficiente em pelo menos uma linguagem de programação. A posição oferece um ambiente dinâmico e a oportunidade de moldar o futuro da consultoria em tecnologia. Benefícios e salário a combinar.

Qualificações

• Profissional com experiência em ambientes de dados, especialmente com Spark e Hadoop.
• Proficiência em pelo menos uma linguagem de programação de alto nível.
• Boa compreensão de bancos de dados e produtos de dados em grande escala.
• Forte entendimento de sistemas, estruturas de dados e algoritmos.
• Bom conhecimento de frameworks de computação distribuída.

Responsabilidades

• Projetar e construir pipelines ETL de dados com Spark na AWS.
• Colaborar com equipes multifuncionais para entender suas necessidades de dados.
• Otimizar a infraestrutura de dados e garantir a qualidade e confiabilidade dos dados.
• Inovar e seguir as melhores práticas na abordagem.

Conhecimentos

Experiência em data warehousing

Data architecture

Data engineering

Spark

Hadoop

Hive

Scala

Java

Python

AWS (EMR, S3, Lambda, Redshift)

Estruturas de dados

Algoritmos

Qualidade e governança de dados

Descrição da oferta de emprego

Cargo:

Senior data engineer em lavras (MA) – lavras

Requisitos:

We are a fast growing business and technology consultant company co‑founded in 2019. We offer a custom‑tailored, white‑glove engineering service fit for our clients, because a digital transformation is more than just technology. With a successful track record of being a preferred vendor for Fortune 500 companies and as a trusted partner for some of the industry’s leading companies, our global talent has helped many clients achieve their goals.

Our culture is guided by the 3 G’s:

• Get Shit Done.
• Get Over Shit.
• Give a Shit.

What You’ll Do:

• Design and build Spark data ETL pipelines on AWS data platform.
• Collaborate with cross‑functional teams such as data scientists, fraud, marketing and other business stakeholders to understand their data needs and deliver reliable solutions.
• Optimize data infrastructure—design and maintain robust data infrastructure by using modern data platform architecture.
• Ensure data quality and reliability.
• Innovate and follow best practices.
• Ensure operational excellence of the data platform, including monitoring, incident response, performance optimization, and continuous improvement.

Who We’re Looking For:

• Professional experience working in data warehousing, data architecture, and/or data engineering environments, especially using Spark, Hadoop, Hive, etc. with a solid understanding of streaming pipelines.
• Proficiency in at least one high‑level programming language (Scala, Java, Python or equivalent).
• Good understanding of databases.
• Experience building large‑scale data products and understanding the trade‑offs made when building these features.
• Strong understanding of system design, data structures, and algorithms.
• Excellent knowledge of distributed computing frameworks such as Hadoop MapReduce, Spark.
• Strong knowledge of AWS infrastructure—EMR, S3, Lambda, Redshift, etc.
• Solid understanding of data quality and governance.
• Team player, self‑driven, highly motivated individual who loves to learn new things.

Join Our Global Team: We invite you to apply for the position at RE Partners. Join us in shaping the future of business technology consulting and transforming the way organizations thrive in a digital world. As a diverse, woman‑owned global business, we pride ourselves on keeping talent happy—our 7% attrition rate speaks volumes. Bring your talented friends along and earn a referral bonus.

Equal Opportunity Employer: We are an equal opportunity employer and welcome applications from all qualified individuals regardless of race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, or veteran status.

Salário:

A Combinar

Benefícios:

Não informado