Senior Data Engineer

Encora; Brasil; Teletrabalho; USD 30.000 - 60.000; Tempo integral

Resumo da oferta

A leading technology company is seeking a Data Engineer with expertise in building data pipelines and scalable cloud infrastructure. The role involves working with Kotlin, Azure, and Kubernetes to develop robust solutions for data movement and access, ensuring efficient processing across services.

Qualificações

• Experience building ELT or streaming data pipelines.
• Strong development skills in Kotlin and Python or JVM languages.
• Deep understanding of distributed systems and real-time data processing.

Responsabilidades

• Design, build, and maintain ELT pipelines in Kotlin and Python.
• Develop high-performance APIs for real-time data access.
• Collaborate to ensure reliable access to up-to-date data.

Conhecimentos

Kotlin

Python

Data Engineering

Real-time data processing

Microservices

Kubernetes

Cloud deployment

Typescript

Descrição da oferta de emprego

Important Information

Location: Brazil
Job Mode: Full-time
Work Mode: Work from home

Job Summary

We are looking for a Data Engineer who has experience with data pipelines, real-time APIs, and scalable cloud infrastructure. In this role, you will work with technologies like Kotlin, Kafka/Pulsar, Azure, and Kubernetes to build reliable, high-throughput systems for data movement and access.

Responsibilities and Duties

• Design, build, and maintain ELT pipelines in Kotlin and Python that ingest and transform data from real-time sources like Kafka and Pulsar;
• Develop and maintain high-performance APIs to serve real-time data from databases, services, and caches;
• Collaborate with internal users and microservice consumers to ensure reliable access to up-to-date data;
• Architect and implement scalable solutions to handle growing traffic and data volume across services;
• Work with Azure cloud services, including Databricks, for data processing and analytics;
• Manage containerized workloads using Kubernetes, with a focus on high availability and auto-scaling;
• Participate in CI/CD, observability, and performance tuning across the platform.

Essential Skills

• Experience building ELT or streaming data pipelines;
• Strong Kotlin, Python development skills (or experience with JVM languages and willingness to learn Kotlin);
• Deep understanding of distributed systems and real-time data processing;
• Proven experience with microservices architecture and API development;
• Solid understanding of Kubernetes concepts: pods, services, autoscaling, Helm charts, etc;
• Cloud deployment experience, ideally on Azure with exposure to Databricks or similar platforms;
• Experience with Typescript is a plus.

About Encora
Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.
At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.