Data Engineer

Insight Global; São Paulo; Teletrabalho; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A staffing firm is seeking an Azure Data Engineer for a fully remote position working with a US client. The role involves creating and optimizing data pipelines, writing SQL queries, and collaborating with various teams to develop a comprehensive data warehouse. Ideal candidates will have extensive experience in Data Engineering and proficiency in Python or SQL. The position offers a competitive salary range of 15k-20k BRL/month.

Qualificações

• 2-5+ years of experience in Data Engineering.
• Use Python or SQL for engineering tasks.
• Create and enhance data pipeline processes.

Responsabilidades

• Assist in creating a data warehouse backbone.
• Develop data pipelines and queries.
• Work with multiple teams to streamline processes.

Conhecimentos

Experience in Data Engineering

Proficient in Python or SQL

Knowledge of relational databases

Ability to create E2E pipelines

Experience with NoSQL databases

Building and optimizing complex queries

Familiarity with ADLS or Azure Databricks

Ferramentas

Azure SQL

AWS

ETL tools

Descrição da oferta de emprego

This is a fully remote position working for a US client, CLT model and salary range of 15k-20k BRL / mo.

Required Skills & Experience

• 2-5+ Year of experience in Data Engineering
• Use Python or SQL for engineering and scientific calculations
• Proven technology champion in working with relational, Data warehouses databases, query authoring (SQL) as well as working familiarity with a variety of databases
• Experience / Knowledge in working with NoSQL databases and can create E2E pipelines.
• Experienced in building and optimizing complex queries
• Proven Experience in working with any one of the data engineering technologies like ADLS, Azure Databricks ADF, Azure SQL, Synapse, AWS

Nice to Have Skills & Experience

• Previously created or enhanced CI / CD build and releases pipelines
• Experience in working with scripting languages such as YAML, PowerShell, Terraform
• Certification in Azure

Job Description

A US client of Insight Global is looking for an Azure Data Engineer to join their team. This person will be assisting the team to create a data warehouse back bone from end-to-end and working with the architect to streamline all processes. Duties will involve creating data pipelines and queries, writing SQL queries from scratch, comparing data, writing analysis, extracting data from existing databases, utilizing Azure Databricks, and working with ETL tools. Both verbal and written communication is a must as this person will be required to work with multiple teams throughout the organization.