Technical Lead For Data Engineering

Bebeetechnicallead; São Paulo; Presencial; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading technology company in São Paulo is seeking a skilled Technical Lead for Data Engineering to drive the development of backend and data engineering workflows. You will leverage your expertise in Python and AWS services to ensure the scalability and reliability of applications. Ideal candidates will have strong system design skills and experience with AI/LLM integration. Join us to lead a talented team, deploying innovative data solutions in a dynamic environment.

Qualificações

• Strong Python development experience.
• Expertise in SQL and NoSQL databases.
• Proficiency in AWS services including Glue, Step Functions, and SQS.
• Knowledge of AI/LLM frameworks and integration.
• Familiarity with real-time communication protocols such as MQTT/WebSockets.

Responsabilidades

• Lead the development of backend and data pipelines.
• Collaborate to deploy scalable data workflows on AWS.
• Integrate AI/LLM frameworks into production systems.
• Ensure applications' reliability and scalability on Kubernetes.

Conhecimentos

Python development

SQL expertise

NoSQL databases

AWS services

AI/LLM frameworks

Microservices architecture

Event-driven architecture

Kubernetes

CI/CD

System design

Descrição da oferta de emprego

Job Overview

We are seeking a skilled Technical Lead for Data Engineering to lead our team focused on backend and data engineering for headend applications.

Key Responsibilities

• Leverage technical leadership skills to drive development of backend and data pipelines using Python.
• Collaborate with teams to develop and deploy scalable data workflows on AWS services such as Glue, Step Functions, and SQS.
• Integrate AI/LLM frameworks (Bedrock, RAG, Agents) into production systems.
• Ensure reliability and scalability of Kubernetes‑hosted applications.

Mandatory Skills

• Strong Python development experience.
• Expertise in SQL and NoSQL databases (key‑value datastores and document storage).
• Expertise in AWS services (Glue, Step Functions, SQS, Lambda, S3).
• Knowledge of AI/LLM frameworks and integration patterns.
• Familiarity with MQTT / WebSockets for real‑time communication.
• Proficiency in microservices and event‑driven architecture.
• Kubernetes and CI/CD expertise.
• Strong system design skills for distributed environments.

Nice‑to‑Have Skills

• Java / Golang experience.