Senior Data Engineer

-; Rio de Janeiro; Presencial; BRL 20.000 - 30.000; Tempo integral

Resumo da oferta

A leading global energy company seeks a Senior Data Engineer to optimize data pipelines and web applications. The role requires expertise in Azure Databricks, Pyspark, Python, and SQL, offering challenges and opportunities to innovate in a dynamic environment.

Qualificações

• Proven experience with data pipelines and handling large datasets.
• Advanced proficiency with Azure Databricks, Pyspark, Python, and SQL.
• Strives for strong analytical and troubleshooting abilities.

Responsabilidades

• Design, debug, and optimize pipelines using Azure Databricks with Pyspark.
• Develop web apps and dashboards using Power BI, Flask, Dash, and Plotly.
• Collaborate with data scientists to improve pipelines.

Conhecimentos

Azure Databricks

Pyspark

Python

SQL

Data Engineering

Data Science

Formação académica

Bachelor's or Master's degree in Computer Science, IT, or related field

Ferramentas

Power BI

Flask

Dash

Plotly

Git

Azure DevOps

Matplotlib

Pandas

NumPy

Descrição da oferta de emprego

We are looking for the right people - people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world's largest providers of products and services to the global energy industry.

Job Duties

Job Summary:
We are seeking a Senior Data Engineer to design, implement, and optimize data pipelines and web applications. The ideal candidate brings strong expertise in Azure Databricks, Pyspark, Python, and SQL, with experience leading projects and improving architectures.

Key Responsibilities:

• Design, debug, and optimize pipelines using Azure Databricks with Pyspark and Python for SQL Server, Delta Lakes, and Azure Synapse (serverless/dedicated).
  
• Apply strong knowledge of SQL, Python, and core Data Engineering principles, with familiarity in Data Science.
  
• Develop web apps and dashboards using Power BI, Flask, Dash, and Plotly.
  
• Collaborate with data scientists to improve pipelines and resolve issues in Azure Databricks.
  
• Propose and implement architectural enhancements to data pipelines.
  
• Monitor cluster resources and optimize performance in Azure Databricks.
  
• Utilize Git and Azure DevOps for versioning and deployment.
  
• Use Matplotlib, Pandas, and NumPy for data analysis and visualization.
  
• Contribute to a globally distributed team in dynamic and sometimes ambiguous environments.
  
• Experience with Azure services like Power Apps and Azure Functions is a plus.
  

Qualifications

Required Qualifications:

• Bachelor's or Master's degree in Computer Science, IT, or related field.
  
• Proven experience with data pipelines and handling large datasets.
  
• Advanced proficiency with Azure Databricks, Pyspark, Python, and SQL.
  
• Experience building web apps using Flask, Dash, and Plotly.
  
• Strong skills in Pandas, NumPy, and Matplotlib.
  
• Familiarity with Delta Lakes and Azure Synapse.
  
• Proficiency with Git and Azure DevOps (or similar).
  
• Strong analytical and troubleshooting abilities.
  
• Fluent English, both written and verbal.
  
• Comfortable working across time zones and diverse environments.
  

Preferred Qualifications:

• Experience improving data architectures and workflows.
  
• Familiarity with data science tools and frameworks.
  
• Exposure to cloud platforms beyond Azure.
  

Halliburton is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.

Location

Rua Paulo Emidio Barbosa 485 Q,Rio de Janeiro,Rio de Janeiro,291941, Brazil

Job Details

Requisition Number:199537
Experience Level:Experienced Hire
Job Family:Engineering/Science/Technology
Product Service Line:Production Enhancement
Full Time / Part Time:Full Time

Additional Locations for this position:

Compensation Information
Compensation is competitive and commensurate with experience.

Job Segment: Computer Science, Database, SQL, Data Analyst, Technology, Data