Brazil - Remote: Data Engineer - Platform & Pipelines

Halliburton; Teletrabalho; BRL 120.000 - 160.000; Tempo integral

Resumo da oferta

A leading global energy services provider is looking for a Data Engineer to build and maintain ELT pipelines, ensuring data quality and availability for Data Scientists. Ideal candidates should have a Bachelor's degree in Computer Science and over 3 years of experience in Data Engineering, with strong skills in SQL, Python, Apache Airflow, and Databricks. This is a fully remote position offering competitive compensation.

Qualificações

• 3+ years of experience in Data Engineering.
• Strong proficiency in Apache Airflow and Databricks.
• Experience implementing Medallion/Delta Lake architectures.

Responsabilidades

• Build and maintain ELT pipelines for data processing.
• Ensure data quality and availability for Data Scientists.
• Work with Delta Lake, Databricks, and Airflow.

Conhecimentos

Apache Airflow

SQL

Python

Data Engineering experience

Advanced English communication

Formação académica

Bachelor's degree in Computer Science or related

Ferramentas

Databricks

Polars

Descrição da oferta de emprego

Overview

We are looking for the right people — people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world’s largest providers of products and services to the global energy industry.

What You’ll Do

We are implementing a strict Medallion Architecture to organize petabytes of industrial data. This role is for a Data Engineer who excels at transforming raw chaos into structured, queryable assets.

You will build and maintain the ELT pipelines that move data from "Bronze" (Raw) to "Silver" (Cleaned) and "Gold" (Aggregated). You will work with Delta Lake (On-prem/Databricks), Polars and Airflow to ensure data quality and availability for Data Scientists and the Knowledge Graph.

The Technology Stack

• Orchestration: Apache Airflow.
• Data Processing: Polars (primary for ETL), PySpark/SQL (for massive scale)
• Compute: Single-node workers (Polars), Databricks/Spark clusters (when scale requires)
• Storage: Delta Lake, Parquet, S3/Blob Storage, MinIO
• Language: Python 3.12+ (w/ Polars), SQL.

Qualifications

Must Haves:

• Complete Bachelor's degree in Computer Science, Engineering, or related.
• 3+ years of experience in Data Engineering.
• Strong proficiency in Apache Airflow and Databricks.
• Experience implementing Medallion/Delta Lake architectures.
• Strong SQL and Python skills.
• Advanced English communication skills.

Good to Have:

• Experience with Unity Catalog or other governance tools.
• Familiarity with dbt (data build tool).
• Background in processing telemetry or sensor data.

Knowledge, Skills, and Abilities

• The Structured Thinker: You love organizing data. You understand the importance of schemas, data typing, and normalization.
• Quality Obsessive: You don\'t just move data; you test it. You implement checks to ensure no bad data reaches the Gold layer.
• Pipeline Builder: You view data engineering as software engineering. You write modular, reusable code for your transformations.

EEO

Halliburton is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.

Location

Fully Remote position.

Job Details

Requisition Number: 205556
Experience Level: Entry-Level
Job Family: Engineering/Science/Technology
Product Service Line: Landmark Software & Services
Full Time / Part Time: Full Time
Employee Group: Temporary

Compensation

Compensation Information: Compensation is competitive and commensurate with experience.