Senior Data Engineer, Data Platform Brazil

Tbwa Chiat/Day Inc; Brasil; Teletrabalho; BRL 80.000 - 150.000; Tempo integral

Resumo da oferta

An established industry player is seeking a Senior Data Engineer to revolutionize data infrastructure. In this pivotal role, you will design and maintain robust data solutions that empower data-driven decision-making across various teams. Your expertise in modern data architectures, ETL optimization, and cloud platforms will be crucial in enhancing the performance and security of the data platform. Join a forward-thinking company that values innovation and collaboration, and make a significant impact on strategic initiatives while enjoying a flexible work environment and comprehensive benefits.

Serviços

Annual profit-sharing program

Health, dental, and life insurance

Flexible meal allowance

Extended parental leaves

Flexible work schedule

Financial assistance for home setup

Wellness program

Free shipping on VTEX stores

Qualificações

• Extensive experience in designing modern data architectures.
• Proficient in building and optimizing ETL pipelines.

Responsabilidades

• Lead the design and maintenance of data infrastructure for AI and ML initiatives.
• Ensure reliability, performance, and security of the data platform.

Conhecimentos

Data Architecture Design

ETL Pipeline Optimization

Data Modeling

Cloud Platforms (AWS, GCP, Azure)

Object-Oriented Programming (Python)

Large Dataset Handling

Communication Skills

Ferramentas

Airflow

Dagster

Kafka

AWS Kinesis

Flink

Terraform

Docker

Kubernetes

Descrição da oferta de emprego

The Senior Data Engineer is a highly experienced professional responsible for designing, building, and maintaining robust and scalable data infrastructure that empowers data-driven decision-making. They are a hands-on engineer, capable of leading the development and implementation of modern data solutions from end-to-end. This role requires a deep understanding of data engineering best practices, a passion for data quality, and the ability to collaborate effectively with different types of stakeholders.

ABOUT THE TEAM

As part of the Data Platform team, you will lead efforts to design, build, and maintain the data infrastructure that supports VTEX’s Artificial Intelligence, Machine Learning, Data Science and Analytics initiatives. You will be instrumental in ensuring the reliability, performance, and security of our data platform, enabling the next level of VTEX products and seizing strategic opportunities for our customers and business.

WHO YOU ARE

• You have extensive experience designing and implementing modern data architectures, including data warehouses, data lakes and data lakehouses.
• You are proficient in building and optimizing ETL pipelines using tools like Airflow, Dagster, or similar.
• You have a deep understanding of data modeling concepts and experience with both relational and NoSQL databases.
• You have experience with cloud-based data platforms (e.g., AWS, GCP, Azure).
• You are proficient in object-oriented programming, including strong experience with Python and its data processing libraries.
• You understand the challenges of handling large datasets and optimizing performance.
• You have strong communication skills, enabling you to effectively collaborate with other data engineers, data scientists, leadership and external stakeholders.

Plus:

• Experience with real-time data processing technologies (e.g., Kafka, AWS Kinesis, Flink).
• Experience with data governance and security best practices.
• Experience with MLOps tools and platforms.
• Experience with infrastructure-as-code (e.g., Terraform, CDK, CloudFormation).
• Experience with containerization and orchestration technologies (e.g., Docker, Kubernetes).
• Experience with building and deploying data APIs.

ABOUT VTEX

VTEX (NYSE: VTEX) is the composable and complete commerce platform that delivers more efficiency and less maintenance to organizations seeking to make smarter IT investments and modernize their tech stack. Through our pragmatic composability approach, we empower brands, distributors, and retailers with unparalleled flexibility and comprehensive solutions, enabling them to invest solely in what provides a clear business advantage and boosts profitability. VTEX is trusted by 2,600 global B2C and B2B clients, including Carrefour, Colgate, Motorola, Sony, Stanley Black & Decker, and Whirlpool, having 3,500 active online stores across 43 countries (as of FY ended on December 31, 2023). For more information, visit www.vtex.com.

BENEFITS

• Annual profit-sharing program and equity eligibility
• Health, dental, and life insurance with national coverage provided by VTEX
• Flexible meal allowance
• Extended parental leaves
• Flexible work schedule and remote-first culture
• Financial assistance to build your work-from-home setup
• Wellness program
• Free shipping on 1000+ VTEX stores