Data Engineer

Insight Global; Teletrabalho; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A tech consulting firm is looking for a Data Engineer to support a large-scale ERP implementation. This remote position requires at least 3 years of experience in Data Engineering, proficiency in Microsoft Fabric or Azure services, and strong skills in SQL, Pandas, and PySpark. The role involves designing scalable data pipelines and collaborating with teams to ensure data integrity. Ideal candidates are adaptable and ready to handle various data-related challenges in a dynamic environment.

Qualificações

• 3+ years of experience in Data Engineering.
• Hands-on data engineering experience with Microsoft Fabric, Azure Synapse, or Databricks.
• Proficient in SQL, Pandas, and PySpark for advanced data manipulation.

Responsabilidades

• Design and implement scalable data pipelines for ERP integration.
• Develop and maintain data models aligned with ERP requirements.
• Optimize data storage and retrieval using Azure services.
• Collaborate with ERP teams to ensure accurate data migration.

Conhecimentos

Data Engineering

SQL

Pandas

PySpark

Azure Data Lake Storage

Azure Data Factory

Azure SQL Databases

Ferramentas

Microsoft Fabric

Azure Synapse

Databricks

Python

Scikit-learn

XGBoost

MLFlow

Descrição da oferta de emprego

Position :

Data Engineer

Location :

Remote in Brazil

Duration :

3 year+ PJ Contract

Monthly Salary Range :

3-5k USD / Month

Requirements :

• 3+ years of experience in Data Engineering
• Hands on data engineering experience with Microsoft Fabric (highly preferred) or Azure Synapse / Databricks are also acceptable
• Advanced Data Manipulation experience using SQL, Pandas, and PySpark
• Proficiency in Azure Data Services such as : Azure Data Lake Storage, Azure Data Factory, or Azure SQL Databases

Nice to Have :

• Exposure to Azure AI Services (AI Foundry, AI Search, Document Intelligence).
• Experience in Data Science & Machine Learning :
• Python, Scikit-learn, XGBoost, MLFlow, EDA.
• Familiarity with LLMs and related frameworks :
• OpenAI, Prompt Engineering, LangChain.

Day to day –

We are seeking 2 experienced Data Engineers to support a large-scale ERP implementation for one of our hardware manufacturing clients. The ideal candidate will design, build, and optimize data pipelines and architectures to ensure seamless integration and transformation of enterprise data. This role requires strong technical expertise in modern data platforms, Azure services, and data modeling principles.

Key Duties and Responsibilities –

• Design and implement scalable data pipelines for ERP integration.
• Develop and maintain data models aligned with ERP requirements.
• Optimize data storage and retrieval using Azure services.
• Collaborate with ERP functional teams to ensure accurate data migration and transformation.
• Implement best practices for Data Architecture, Data Warehouse design, and Master Data Management.
• Support Azure infrastructure and troubleshoot data-related issues.
• Ensure compliance with data governance and security standards.