Senior Data Engineer

Encora Inc.; Betim; Teletrabalho; BRL 120.000 - 160.000; Tempo integral

Resumo da oferta

A leading technology company is seeking a Senior Data Engineer to build and optimize data pipelines and cloud-based data platforms. The ideal candidate will design scalable data ecosystems and collaborate with data scientists. Requires expertise in Azure services and strong programming skills in Python or Java. This full-time position offers the flexibility of work from home located in Betim, Brazil.

Qualificações

• Experience in building, optimizing, and managing data pipelines.
• Strong knowledge of ETL / ELT processes for structured and unstructured data.
• Experience with big data frameworks like Apache Spark and Databricks.

Responsabilidades

• Design and optimize data pipelines for data lakes and warehouses.
• Ensure data quality and security compliance.
• Collaborate with data scientists on AI/ML initiatives.

Conhecimentos

Data engineering, architecture, or ETL development

Programming in Python, Java, or Scala

Advanced SQL expertise

Hands-on experience with Apache Spark, Hadoop

Knowledge of Azure data services

Experience with workflow orchestration tools

Familiarity with NoSQL databases

Data modeling, partitioning, and query optimization

Strong communication skills in English

Formação académica

Certifications in cloud platforms or data engineering

Ferramentas

PostgreSQL

MySQL

Oracle

SQL Server

Airflow

Lucid

Prefect

Kafka

Flink

Spark Streaming

Descrição da oferta de emprego

Important Information Location : Brazil

Job Mode : Full-time

Work Mode : Work from home

Job Summary

We are looking for a Senior Data Engineer with deep expertise in building, optimizing, and managing data pipelines and modern cloud-based data platforms. This role involves designing scalable, secure, and high-performance data ecosystems for global clients while collaborating closely with data scientists, BI teams, and architects. The ideal candidate has experience in big data processing, ETL / ELT pipelines, and cloud-native services, particularly on Azure OpenAI.

Responsibilities and Duties

• Design, build, and optimize ETL / ELT processes and data pipelines for structured and unstructured data;
• Develop and maintain data lakes, warehouses, and analytics platforms in the cloud;
• Ensure data quality, governance, and security compliance across environments;
• Translate business and technical requirements into scalable data solutions;
• Implement best practices for data storage, partitioning, and performance tuning;
• Work with Azure cloud-native services (Data Factory, Synapse, Databricks) for ingestion, transformation, and orchestration;
• Build real-time and batch data processing solutions using big data frameworks;
• Partner with analysts and data scientists to support AI / ML and reporting initiatives;
• Monitor and troubleshoot data pipelines, workflows, and infrastructure issues;

Contribute to automation, CI / CD pipelines, and Infrastructure-as-Code practices for data platforms.

Essential Skills

• Experience in data engineering, architecture, or ETL development;
• Strong programming skills in Python, Java, or Scala for data processing;
• Advanced SQL expertise and proficiency in relational databases (PostgreSQL, MySQL, Oracle, SQL Server);
• Hands-on experience with big data frameworks (Apache Spark, Hadoop, Databricks);
• Strong knowledge of Azure data services (Data Factory, Synapse, Databricks);
• Experience with workflow orchestration tools (Airflow, Luigi, Prefect);
• Familiarity with NoSQL databases (MongoDB, Cassandra, DynamoDB);
• Solid understanding of data modeling, partitioning, and query optimization;

Strong communication skills in English (written and verbal).

Highly Desirable Skills

• Experience with streaming platforms (Kafka, Flink, Spark Streaming);
• Familiarity with MLOps / AI pipelines to support data science workflows;
• Knowledge of data governance and regulatory compliance (GDPR, HIPAA);
• Experience in Agile / Scrum delivery models;
• Prior work in a nearshore delivery environment supporting US / European clients;

Certifications in cloud platforms or data engineering (AWS Big Data Specialty, Azure Data Engineer Associate, GCP Data Engineer).

About Encora

Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.

At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.