Datasphere Data Engineer | Senior

Compass.uol; Brasil; Teletrabalho; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading company is seeking a Data Engineer to develop and optimize data pipelines for ETL processes in distributed and real-time environments. The role involves creating systems for data collection, collaborating with business units, and providing analytical reports and visualizations. This position encourages continuous development and offers remote work options.

Qualificações

• Experience with data modeling.
• Advanced knowledge in Python and SQL programming.

Responsabilidades

• Develop and optimize data pipelines for ETL processes.
• Create systems for data collection and storage.
• Collaborate with business areas to deliver reports and dashboards.

Conhecimentos

Python

SQL

Data Modeling

ETL Operations

Formação académica

Degree in Information Technology

Ferramentas

Datasphere

Databricks

Azure Data Factory

DevOps

Descrição da oferta de emprego

Job description

We are seeking a Data Engineer to develop and optimize data pipelines for ingestion, transformation, and loading (ETL) in distributed and real-time environments. The role involves creating systems for data collection and storage, collaborating with business units to understand their needs, and providing reports, dashboards, and visualizations to support strategic decision-making. Additionally, the candidate will build data aggregation and transformation processes for analytical purposes.

Main responsibilities

1. Develop and optimize data pipelines for ETL processes in distributed and real-time environments.
2. Create systems for data collection and storage.
3. Collaborate with business areas to understand their needs and deliver reports, dashboards, and visualizations.
4. Build data aggregation and transformation processes for analytics.

Requirements and skills

• Experience with Datasphere.
• Degree and/or specialization in Information Technology (Computer Science, Systems Analysis and Development, or related fields).
• Experience with data modeling.
• Advanced knowledge in Python and SQL programming.
• Knowledge of Databricks.
• Familiarity with ETL operations and related processes.
• Ability to consume and integrate data via RESTful and/or SOAP APIs.
• Desirable: Knowledge in Azure Data Factory and DevOps.

Don't meet all the requirements? That's okay! At Compass UOL, we encourage continuous development of new talent and turn challenges into opportunities.

Additional information

#remote

"remote"