Data Engineer

Insight Global; Teletrabalho; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A US-based technology firm is seeking an Azure Data Engineer for a fully remote position. The role involves creating a data warehouse backbone, developing data pipelines, and writing complex SQL queries. Ideal candidates will have 2-5+ years of Data Engineering experience and knowledge of Azure data technologies like Azure Databricks. Strong communication skills are essential as collaboration with multiple teams will be required in this dynamic environment.

Qualificações

• 2-5+ years of experience in Data Engineering.
• Proven technology champion with relational and data warehouse databases.
• Experience in creating E2E pipelines.

Responsabilidades

• Create data pipelines and queries.
• Write SQL queries from scratch.
• Extract and compare data from existing databases.

Conhecimentos

Data Engineering

Python

SQL

NoSQL databases

Data pipelines

Ferramentas

Azure Databricks

ADLS

Azure SQL

Terraform

Descrição da oferta de emprego

This is a fully remote position working for a US client, CLT model and salary range of 16k-20k BRL / mo.

Required Skills & Experience

• 2-5+ Years of experience in Data Engineering
• Use Python or SQL for engineering and scientific calculations
• Proven technology champion in working with relational, data warehouses databases, query authoring (SQL) as well as working familiarity with a variety of databases
• Experience / Knowledge in working with NoSQL databases and can create E2E pipelines.
• Experienced in building and optimizing complex queries
• Proven Experience in working with any one of the data engineering technologies like ADLS, Azure Databricks, ADF, Azure SQL, Synapse

Nice to Have Skills & Experience

• Previously created or enhanced CI / CD build and releases pipelines
• Experience in working with scripting languages such as YAML, PowerShell, Terraform
• Certification in Azure

Job Description

A US client of Insight Global is looking for an Azure Data Engineer to join their team. This person will be assisting the team to create a data warehouse back bone from end-to-end and working with the architect to streamline all processes. Duties will involve creating data pipelines and queries, writing SQL queries from scratch, comparing data, writing analysis, extracting data from existing databases, utilizing Azure Databricks, and working with ETL tools. Both verbal and written communication is a must as this person will be required to work with multiple teams throughout the organization.