Senior Data Tech Lead - Databricks on Azure

Openkrill; United States; A distancia; USD 160.000 - 230.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Health and dental insurance

Meal and food allowance

Childcare assistance

Extended paternity leave

Wellhub fitness partnerships

Profit Sharing

Life insurance

CI&T University

Discount club

Wellbeing platform

Pregnancy and parenting course

Online learning partnerships

Language learning platform

Descripción de la vacante

CI&T is seeking a senior Data Tech Lead to drive the technical leadership of our data engineering initiatives on Databricks in Azure. You will partner with the Data Architect to define standards, remove roadblocks, and enable the team to deliver scalable, reliable pipelines within the Medallion architecture.

In this hands-on role, you will mentor engineers, codify best practices for the Lakehouse, oversee PySpark/Spark SQL pipelines, and ensure security and governance.

Formación

• Senior data engineering leader with hands-on Databricks experience.
• Strong Python/SQL skills and Delta Lake mastery.
• Experience with Azure data services and security governance.
• Proven ability to mentor and lead technical teams.

Responsabilidades

• Provide technical leadership to Data Engineering squads.
• Define technical vision and standards for the Lakehouse.
• Design and oversee pipelines in Databricks across Bronze/Silver/Gold.
• Implement DataOps: Git, CI/CD, testing and documentation.
• Optimize jobs for performance, cost, and reliability.
• Ensure security and governance in Azure/Databricks.
• Collaborate with stakeholders to deliver scalable solutions.
• Mentor engineers and create templates to accelerate delivery.

Conocimientos

Databricks PySpark

Medallion architecture

Azure Databricks

Delta Lake

Python

SQL

DataOps

Code reviews

English communication

Herramientas

Git

CI/CD

dbt

Airflow

Great Expectations

Descripción del empleo

CI&T is seeking a senior Data Tech Lead to drive the technical leadership of our data engineering initiatives on Databricks in Azure. You will partner with the Data Architect to define standards, remove roadblocks, and enable the team to deliver scalable, reliable pipelines within the Medallion architecture.

In this hands-on role, you will mentor engineers, codify best practices for the Lakehouse, oversee PySpark/Spark SQL pipelines, and ensure security and governance.