Senior Data Engineer

Luxoft; Teletrabalho; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading tech consultancy in São Paulo is seeking a Data Engineer to modernize an eCommerce platform for a major retail company. This role involves designing solutions for big data processing and integrating the solution into current architecture. Candidates should have strong expertise in Azure Data Factory, Azure Synapse, and data warehousing. Proficiency in SQL and experience with ETL pipelines are required. This is a full-time role with a focus on innovative data solutions.

Qualificações

• 3+ years of recent hands-on expertise with Azure Data Factory and Synapse.
• Experience designing data models for efficient storage and retrieval.
• Strong knowledge of Microsoft Azure and its components.

Responsabilidades

• Design solutions for processing big data volumes for a retail company.
• Integrate solutions into the current architecture.
• Support data warehousing and ETL solutions.

Conhecimentos

Azure Data Factory

Azure Synapse

Power BI

SQL

Data modeling

ETL / ELT pipelines

Python

Ferramentas

Azure Data Lake Storage

Azure Databricks

Data Warehousing

Descrição da oferta de emprego

Project Description: The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.

Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.

Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to అధ్యక్ష unified cloud-native solution without any disruption to business.

Responsibilities

We are looking for Data Engineer who will be responsible for designing a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture.

Mandatory Skills Description

Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years).

Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.

Hands-on experience with Power BI, including data modeling, report and dashboard development, and building interactive, business-ready visualizations based on enterprise data-demographic sources.

Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.

Extensive experience with building robust and scalable ETL / ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.

Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.

Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data / Delta Lakehouse, Data85Vault)

Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.

Experience integrating metadata and governance processes into cloud-based data platforms

Certification in Azure, Databricks, or other relevant technologies is an added advantage

Experience with cloud-based analytical databases

héros Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.

Experience with Python and Python-based ETL tools.

Experience with shell scripting in Bash, Unix or windows shell is preferable.

Languages

English : B2 Upper Intermediate

• ONLY CLT CONTRACTS *