Senior Data Engineer

Halliburton; Rio de Janeiro; Presencial; BRL 30.000 - 50.000; Tempo integral

Resumo da oferta

A leading company in the energy sector seeks a Senior Data Engineer in Rio de Janeiro. This role involves designing data pipelines, developing applications, and collaborating with data scientists. Ideal candidates are proficient in Azure Databricks, Pyspark, and Python, and possess strong analytical skills.

Qualificações

• Experience with data pipelines and handling large datasets.
• Fluent in English, both written and verbal.
• Comfortable working across time zones and diverse environments.

Responsabilidades

• Design, debug, and optimize data pipelines using Azure Databricks.
• Develop web apps and dashboards using Power BI, Flask, Dash, and Plotly.
• Collaborate with data scientists on pipeline improvements.

Conhecimentos

Azure Databricks

Pyspark

Python

SQL

Flask

Dash

Plotly

Pandas

NumPy

Git

Formação académica

Bachelor's or Master’s degree in Computer Science, IT, or related field

Ferramentas

Azure DevOps

Descrição da oferta de emprego

We are looking for the right people — people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world’s largest providers of products and services to the global energy industry.

Job Duties

Job Summary:
We are seeking a Senior Data Engineer to design, implement, and optimize data pipelines and web applications. The ideal candidate brings strong expertise in Azure Databricks, Pyspark, Python, and SQL, with experience leading projects and improving architectures.

Key Responsibilities:

• Design, debug, and optimize pipelines using Azure Databricks with Pyspark and Python for SQL Server, Delta Lakes, and Azure Synapse (serverless/dedicated).

• Apply strong knowledge of SQL, Python, and core Data Engineering principles, with familiarity in Data Science.

• Develop web apps and dashboards using Power BI, Flask, Dash, and Plotly.

• Collaborate with data scientists to improve pipelines and resolve issues in Azure Databricks.

• Propose and implement architectural enhancements to data pipelines.

• Monitor cluster resources and optimize performance in Azure Databricks.

• Utilize Git and Azure DevOps for versioning and deployment.

• Use Matplotlib, Pandas, and NumPy for data analysis and visualization.

• Contribute to a globally distributed team in dynamic and sometimes ambiguous environments.

• Experience with Azure services like Power Apps and Azure Functions is a plus.

Qualifications

Required Qualifications:

• Bachelor's or Master’s degree in Computer Science, IT, or related field.

• Proven experience with data pipelines and handling large datasets.

• Advanced proficiency with Azure Databricks, Pyspark, Python, and SQL.

• Experience building web apps using Flask, Dash, and Plotly.

• Strong skills in Pandas, NumPy, and Matplotlib.

• Familiarity with Delta Lakes and Azure Synapse.

• Proficiency with Git and Azure DevOps (or similar).

• Strong analytical and troubleshooting abilities.

• Fluent English, both written and verbal.

• Comfortable working across time zones and diverse environments.

Preferred Qualifications:

• Experience improving data architectures and workflows.

• Familiarity with data science tools and frameworks.

• Exposure to cloud platforms beyond Azure.

Halliburton is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.

Location

Rua Paulo Emidio Barbosa 485 Q,Rio de Janeiro,Rio de Janeiro,291941, Brazil

Job Details

Requisition Number:199537
Experience Level:Experienced Hire
Job Family:Engineering/Science/Technology
Product Service Line:Production Enhancement
Full Time / Part Time:Full-time

Additional Locations for this position:

Compensation Information
Compensation is competitive and commensurate with experience.