Senior Data Engineer

Halliburton Energy Services; Rio de Janeiro; Presencial; BRL 20.000 - 40.000; Tempo integral

Resumo da oferta

A leading company in the energy sector seeks an experienced Senior Data Engineer to join their team. The role involves designing and optimizing data pipelines using Azure technologies and Python. Ideal candidates will possess strong skills in data engineering principles and experience with web application development tools. This position offers the chance to contribute to innovative projects in a dynamic environment and is suited for professionals looking to advance their careers in a competitive field.

Qualificações

• Advanced proficiency with Azure Databricks, Pyspark, Python, and SQL.
• Proven experience with data pipelines and handling large datasets.
• Strong skills in Pandas, NumPy, and Matplotlib.

Responsabilidades

• Design, debug, and optimize data pipelines using Azure Databricks.
• Collaborate with data scientists to improve data pipelines.
• Propose and implement architectural enhancements.

Conhecimentos

Azure Databricks

Pyspark

Python

SQL

Data Engineering Principles

Data Science

Power BI

Flask

Dash

Git

Azure DevOps

Formação académica

Bachelor's or Master’s degree in Computer Science, IT, or related field

Ferramentas

Azure Functions

Delta Lakes

Azure Synapse

Git

Azure DevOps

Matplotlib

Pandas

NumPy

Descrição da oferta de emprego

Select how often (in days) to receive an alert:

We are looking for the right people — people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world’s largest providers of products and services to the global energy industry.

Job Duties

Job Summary:
We are seeking a Senior Data Engineer to design, implement, and optimize data pipelines and web applications. The ideal candidate brings strong expertise in Azure Databricks, Pyspark, Python, and SQL, with experience leading projects and improving architectures.

Key Responsibilities:

Design, debug, and optimize pipelines using Azure Databricks with Pyspark and Python for SQL Server, Delta Lakes, and Azure Synapse (serverless/dedicated).

Apply strong knowledge of SQL, Python, and core Data Engineering principles, with familiarity in Data Science.

Develop web apps and dashboards using Power BI, Flask, Dash, and Plotly.

Collaborate with data scientists to improve pipelines and resolve issues in Azure Databricks.

Propose and implement architectural enhancements to data pipelines.

Monitor cluster resources and optimize performance in Azure Databricks.

Utilize Git and Azure DevOps for versioning and deployment.

Use Matplotlib, Pandas, and NumPy for data analysis and visualization.

Contribute to a globally distributed team in dynamic and sometimes ambiguous environments.

Experience with Azure services like Power Apps and Azure Functions is a plus.

Qualifications

Required Qualifications:

Bachelor's or Master’s degree in Computer Science, IT, or related field.

Proven experience with data pipelines and handling large datasets.

Advanced proficiency with Azure Databricks, Pyspark, Python, and SQL.

Experience building web apps using Flask, Dash, and Plotly.

Strong skills in Pandas, NumPy, and Matplotlib.

Familiarity with Delta Lakes and Azure Synapse.

Proficiency with Git and Azure DevOps (or similar).

Strong analytical and troubleshooting abilities.

Fluent English, both written and verbal.

Comfortable working across time zones and diverse environments.

Preferred Qualifications:

Experience improving data architectures and workflows.

Familiarity with data science tools and frameworks.

Exposure to cloud platforms beyond Azure.

Halliburton is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.

Location

Requisition Number:199537
Experience Level:Experienced Hire
Job Family:Engineering/Science/Technology
Product Service Line:Production Enhancement
Full Time / Part Time:Full Time

Additional Locations for this position:

Compensation Information
Compensation is competitive and commensurate with experience.