Data Engineer – Mid-level

Jobtailor; São Paulo; Presencial; BRL 120 000 - 240 000; Tempo integral

Resumo da oferta

Jobtailor is seeking a Data Engineer in São Paulo to develop, maintain and optimize ETL/ELT processes across SQL Server, Spark and NoSQL platforms, and to migrate routines from SQL Server to Spark using PySpark.

You will model and structure data for governance and performance, work with architects and analysts to ensure data quality, and contribute to cloud modernization initiatives in GCP while leveraging Python and BI tools like Qlik.

Qualificações

• Proficiency in ANSI SQL.
• Data modeling and relational database design.
• Experience with SQL Server and Spark (PySpark).
• Knowledge of Python and NoSQL.
• Understanding of ETL/ELT concepts and data engineering best practices.
• Experience with GCP.
• Strong verbal and written communication skills and analytical problem-solving ability.
• Experience with BI tools, especially Qlik (QlikView, Qlik Sense or Qlik Cloud).

Responsabilidades

• Develop, maintain and optimize ETL/ELT processes across SQL Server, Spark, NoSQL.
• Migrate routines and data loads from SQL Server to Spark (PySpark).
• Develop scripts and automations in Python.
• Model and structure data according to governance and performance best practices.
• Work together with architects, analysts and testers to ensure data quality and integrity.
• Support data migration and modernization initiatives in cloud environments (GCP).

Conhecimentos

ANSI SQL

Data modeling

Relational database design

ETL/ELT concepts

Data governance

Communication skills

Analytical problem-solving

Ferramentas

SQL Server

Spark/PySpark

Python

NoSQL

GCP

Qlik

Descrição da oferta de emprego

Responsibilities

• Develop, maintain and optimize ETL/ELT processes across different platforms (SQL Server, Spark, NoSQL)
• Migrate routines and data loads from SQL Server to Spark (PySpark)
• Develop scripts and automations in Python
• Model and structure data according to governance and performance best practices
• Work together with architects, analysts and testers to ensure data quality and integrity
• Support data migration and modernization initiatives in cloud environments (GCP)

Requirements

• Proficiency in ANSI SQL
• Data modeling and relational database design
• Experience with SQL Server and Spark (PySpark)
• Knowledge of Python and NoSQL
• Understanding of ETL/ELT concepts and data engineering best practices
• Experience with GCP
• Strong verbal and written communication skills and analytical problem-solving ability
• Experience with BI tools, especially Qlik (QlikView, Qlik Sense or Qlik Cloud)