Sr. Data Engineer (Experience in Databricks, Azure, Data Lakes)

DHL Germany; São Paulo; Híbrido; BRL 120.000 - 150.000; Tempo integral

Resumo da oferta

A leading logistics company seeks a Senior Data Engineer to enhance their Data & Analytics Services. You will design and implement data strategies, optimize data pipelines, and collaborate with cross-functional teams. This role offers professional growth in a dynamic environment, focusing on innovative data solutions and agile methodologies.

Serviços

Professional development opportunities

Collaborative workplace culture

Competitive compensation

Qualificações

• 5-7 years of experience in IT; 3-5 years in a Data Engineer role.
• Expert programming skills in Python/PySpark; experience in Java/Scala is beneficial.

Responsabilidades

• Build scalable, performant, supportable, and reliable data pipelines.
• Define and implement a DevOps framework using CI/CD.
• Coach a small team of junior data engineers.

Conhecimentos

SQL

Python

Data Analysis

Collaboration

Formação académica

University Degree in Computer Science

Ferramentas

MS Azure

Databricks SQL

Parquet

Delta

Descrição da oferta de emprego

Job Type:Permanent (Full-Time)

Work Model:hybrid (mix of work from and onsite)

About DHL and Procurement: DHL Supply Chain is a global leader in logistics and supply chain management, committed to providing high-quality services and innovative solutions. Our Procurement team plays a crucial role in optimizing our supply chain processes and driving efficiency.

Job Purpose: As a Senior Data Engineer in the Data & Analytics Services Team, you will work on Data Lake and Data Warehousing projects, analyzing business and system requirements to define optimal data strategies. You will design and implement data acquisition strategies, owning and extending the business's data pipeline through the collection, storage, processing, and transformation of large datasets.

Key Responsibilities:

• Build scalable, performant, supportable, and reliable data pipelines, optimizing data systems from the ground up.
• Set up and monitor new metrics, analyze data, and collaborate with other Data & Analytics team members to implement system and process improvements.
• Support the collection of metadata into our data catalogue system, ensuring accurate maintenance and cataloging of data.
• Define and implement a DevOps framework using CI/CD.
• Collaborate closely with big data architects, data analysts, data warehouse engineers, and data scientists.
• Support and promote an Agile way of working using the SCRUM framework.
• Coach a small team of junior data engineers (2 people).

Essential Qualifications:

• University Degree in Computer Science, Information Systems, Statistics, or a related field.
• Minimum 5-7 years of experience in IT; 3-5 years in a Data Engineer role.
• Expert SQL knowledge and experience with relational and no-SQL database systems.
• Expert programming skills in Python/PySpark; experience in Java/Scala is beneficial.
• Experience with Data Warehousing for large complex datasets, including defining, building, and optimizing data models.
• Expertise in implementing Data Lake/Big Data projects in Cloud MS Azure and/or On-premise platforms.
• Experience with designing and building lakehouse architectures in Parquet/Delta and Synapse Serverless or Databricks SQL.
• Working experience with DevOps frameworks and a strong understanding of Software Development Lifecycle.
• Experience in performing root cause analysis on data and processes to identify opportunities for improvement.
• Ability to collaborate across different teams/geographies/stakeholders/levels of seniority.
• Fluent in English; fluent in Spanish or Portuguese is a plus.

Benefits of Joining the Procurement Team:

• Opportunity to work in a dynamic and innovative environment.
• Professional development and career growth opportunities.
• Collaborative and inclusive workplace culture.
• Competitive compensation and benefits package.

DHL Offers: We are committed to providing equality of opportunity for all employees and ensuring that our workplaces are free from discrimination. We aim to treat all employees and potential future employees fairly, with dignity and respect.

Does this opportunity spark your interest? We eagerly look forward to receiving your application.

#SCOUT