Senior Data Engineer

Lean Tech, a Lean Solutions Group Division; São Paulo; Presencial; BRL 180 000 - 280 000; Tempo integral

Resumo da oferta

Lean Tech, a Lean Solutions Group Division, is seeking a Data Engineer to join our Data Services / Data Products team. This role centers on deep SQL expertise, database internals, and real-time data processing using DBT, Materialize, and Snowflake to build high-performance data models powering dashboards and data products.

You will work with streaming architectures, CDC and Kafka, supporting end-to-end workflows with Data Platform and BI teams in a modern streaming-enabled environment.

Qualificações

• Expert-level SQL proficiency with query optimization and indexing.
• Experience with streaming-enabled databases or near real-time SQL processing.
• Familiarity with Kafka, JSON patterns, and real-time systems.
• Hands-on DBT for modeling and transformation.
• Strong understanding of relational database concepts and query plans.

Responsabilidades

• Design and maintain advanced data models and transformations using DBT across Materialize and Snowflake.
• Develop and optimize complex SQL queries, views, and procedures with focus on cost, memory, and indexing.
• Translate BI requirements into scalable semantic models and curated tables for real-time reporting.
• Monitor and tune Materialize clusters for optimal performance.
• Collaborate with Data Platform engineers on CDC, pipelines, and data flows.
• Contribute to schema design, data quality, and governance best practices.
• Define models to support analytical and reporting needs with BI teams.
• Support streaming architectures, integrating CDC, Kafka, and Materialize with Snowflake.
• Review IaC deployments and containerized flows; contribute to infrastructure tasks.
• Drive reliability, performance, cost optimization, and documentation improvements.

Conhecimentos

SQL proficiency

Streaming data processing

Kafka

DBT modeling

Relational databases

Ferramentas

DBT

Materialize

Snowflake

PostgreSQL

Docker

Descrição da oferta de emprego

Company Overview

Lean Tech is a forward-thinking technology consultancy built on a foundation of excellence, innovation, and impact. We partner with organizations worldwide to deliver transformative engineering solutions that drive measurable business outcomes. Our strength lies in providing highly skilled nearshore talent who embody ownership, technical mastery, and a collaborative mindset. At Lean Tech, we cultivate a culture of continuous improvement, autonomy, and professional growth, empowering our teams to thrive in dynamic environments. We specialize in designing and implementing scalable data platforms, resilient pipelines, and advanced analytics ecosystems that unlock the full potential of organizational data. By joining Lean Tech, you become part of a diverse, global engineering community that embraces creativity, problem-solving, and modern technologies to tackle complex challenges. Together, we are shaping the future of data-driven innovation and redefining how businesses leverage technology to achieve success.

Position Overview

We are seeking a Data Engineer to join our Data Services / Data Products team. This role is central to bridging advanced data modeling, expert-level SQL engineering, and BI enablement. Unlike traditional BI or pipeline-focused positions, this opportunity demands deep SQL expertise, a strong grasp of database internals, and familiarity with cloud infrastructure concepts to optimize query performance, with an increasing emphasis on real-time, event-driven data processing within streaming architectures. You will transform raw application data into curated, high-performance models using DBT, Materialize, and Snowflake. These models will serve as the backbone for BI engineers and stakeholders, powering dashboards, reports, and mission-critical data products. Operating within a modern, streaming-aware ecosystem, you will support and reason about real-time data flows from CDC and Kafka, understanding how data changes propagate across systems and impact downstream consumers, while collaborating closely with Data Platform and BI Engineering teams to deliver end-to-end workflows that are reliable, scalable, and efficient.

Key Responsibilities

• Design, build, and maintain advanced data models and transformations using DBT across Materialize and Snowflake.
• Develop and optimize complex SQL queries, views, and stored procedures with a focus on compute cost, memory usage, and indexing strategies.
• Translate BI and business requirements into scalable semantic models and curated tables for real-time reporting.
• Monitor and tune Materialize clusters, ensuring optimal resource usage and performance.
• Troubleshoot upstream data issues in collaboration with Data Platform engineers, addressing CDC connectors, pipelines, and message flows.
• Participate in schema design, data quality assessments, and governance best practices.
• Collaborate with BI engineers to define models that support analytical and reporting needs.
• Support streaming-enabled architectures, integrating CDC, Kafka, and Materialize with Snowflake.
• Contribute to infrastructure tasks, reviewing IaC deployments, containerized flows, and system logs.
• Drive continuous improvement in pipeline reliability, performance, cost optimization, and documentation.

Required Skills & Experience

• Expert-level SQL proficiency, including query optimization, indexing, and database engine behavior.
• Experience with streaming-enabled databases (e.g., Materialize or similar technologies), or strong hands-on experience with streaming data processing and incremental SQL in near real-time systems.
• Familiarity with Kafka, JSON message patterns, and real-time systems.
• Hands-on experience with DBT for modeling and transformation.
• Strong understanding of relational database concepts and query plans.
• Experience with modern data warehouses such as Snowflake.
• Proficiency in SQL-based stored procedures/functions (PostgreSQL preferred; Oracle/SQL Server valuable).
• General software engineering skills, including log analysis and deployment reasoning.
• Ability to manage schema evolution challenges effectively.

Nice to Have

• Experience in cloud environments (AWS, GCP, Azure, Oracle).
• Python scripting for validation, automation, or pipeline support.
• Familiarity with Docker, Kubernetes, and IaC tools (Terraform, CloudFormation).
• Exposure to CDC technologies (FiveTran, HVR) and ability to debug pipeline issues related to CDC and ingestion workflows.
• Basic dashboarding experience with Power BI or similar tools.
• Knowledge of observability practices in cloud environments.

Soft Skills

• Strong analytical mindset with attention to performance trade-offs.
• Excellent communication skills for cross-functional collaboration.
• Curiosity and adaptability to learn new tools quickly.
• Ownership-driven problem-solving with attention to detail.
• Team-oriented mindset to support upstream and downstream partners.

Why You Will Love Working with Us

At Lean Tech, you will join a powerful tech workforce committed to changing the world through innovation. We offer professional development opportunities with international clients, a collaborative environment, and mentorship programs designed to accelerate your career growth. Your contributions will directly shape the data landscape of a dynamic, growing organization. We celebrate diversity, foster inclusion, and believe in empowering every employee to reach their full potential.