Python/ Data Engineer

Luxoft; Barueri; Presencial; BRL 90.000 - 130.000; Tempo integral

Resumo da oferta

A leading video content provider in Brazil seeks a backend and data engineer to design and develop data pipelines using Python and AWS. The ideal candidate will have strong experience with SQL, NoSQL, and AI frameworks, ensuring the scalability of Kubernetes-hosted applications. Proficiency in CI/CD practices and collaboration within Agile teams is essential for success in this role.

Qualificações

• Strong experience in Python development.
• Expertise in SQL and NoSQL databases.
• Proficient with AWS services such as Glue and SQS.
• Knowledge of AI / LLM frameworks.
• Familiar with real-time communication protocols.
• Experience with microservices architectures.
• Expert in CI / CD processes.
• Solid system design background for distributed applications.

Responsabilidades

• Design and develop backend and data pipelines using Python.
• Develop data workflows using AWS services.
• Integrate AI / LLM frameworks into production systems.
• Ensure reliability of Kubernetes-hosted applications.
• Collaborate with teams and maintain CI / CD pipelines.

Conhecimentos

Python development

SQL and NoSQL databases

AWS services expertise

AI / LLM frameworks knowledge

MQTT / WebSockets familiarity

Microservices and event-driven architecture

Kubernetes expertise

CI / CD knowledge

System design skills

Descrição da oferta de emprego

Join a team focused on backend and data engineering for headend applications at a leading video content provider. This role emphasizes Python-based services, AWS data workflows, and integration with AI / LLM frameworks to enable advanced media processing capabilities.

Responsibilities:

• Design and develop backend and data pipelines using Python.
• Development base on AWS services such as Glue, Step Functions, and SQS for data workflows + Serverless.
• Integrate AI / LLM frameworks (Bedrock, RAG, Agents) into production systems.
• Ensure scalability and reliability of Kubernetes-hosted applications.
• Collaborate with Agile teams and maintain CI / CD pipelines.

Mandatory Skills:

• Strong Python development experience.
• Expertise in SQL and NoSQL databases (key-value datastores, and document storage).
• Expertise in AWS services (Glue, Step Functions, SQS, Lambda, S3).
• Knowledge of AI / LLM frameworks and integration patterns.
• Familiarity with MQTT / WebSockets for real-time communication.
• Proficiency in microservices and event-driven architecture.
• Kubernetes and CI / CD expertise.
• Strong system design skills for distributed environments.

Nice-to-Have Skills:

• Java / Golang experience.

Languages:

English : C1 Advanced