[Job-24880 ]Data Tech Lead - Databricks Architect, Brazil

CI&T; Brasil; Presencial; BRL 160.000 - 200.000; Tempo integral

Resumo da oferta

A leading tech transformation company in Brazil seeks a Databricks Data Architect to design a scalable data platform for a retail client. This role involves implementing DataOps practices and enabling advanced analytics for data-driven decision-making. Ideal candidates should have expertise in Databricks and cloud platforms. The position offers comprehensive benefits including health insurance and a continuous learning platform.

Serviços

Health and dental insurance

Meal and food allowance

Childcare assistance

Extended paternity leave

Profit Sharing

Continuous learning platform

Partnerships with online learning platforms

Life insurance

Qualificações

• Expertise in Databricks (Delta Lake, Spark, Databricks SQL).
• Strong background in data architecture and design of large-scale systems.
• Proven experience building data workflows with streaming technologies.
• Solid understanding of DataOps practices including CI/CD.
• Hands-on experience with cloud platforms including storage and security.

Responsabilidades

• Architect a hub-and-spoke data platform using Databricks.
• Enable advanced analytics and real-time use cases.
• Implement DataOps best practices and CI/CD.
• Define data contracts for schema consistency.
• Optimize data processing using Delta Lake and Spark.

Conhecimentos

Expertise in Databricks

Data architecture design

Building data pipelines

DataOps practices

Proficiency in SQL

Proficiency in Python (PySpark)

Cloud platforms (AWS/Azure/GCP)

Data governance knowledge

Advanced English

Formação académica

Bachelor's or Master's degree in Computer Science, Data Engineering

Ferramentas

Databricks

Delta Lake

Spark

SQL

Python (PySpark)

Cloud platforms (AWS/Azure/GCP)

Descrição da oferta de emprego

Overview

We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.

With over 7.400 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.

We are looking for a highly skilled Databricks Data Architect to lead the design, development, and implementation of a modern hub-and-spoke data platform for a leading retail company. This platform will serve as the foundation for advanced analytics and real-time personalization, enabling data-driven decision-making and customer engagement.

The role involves working closely with business stakeholders, data engineers, and product teams to design scalable, secure, and efficient data solutions on Databricks and the modern data stack. The architect will also drive the adoption of DataOps practices such as CI/CD pipelines, data contracts, quality checks, and observability.

Responsibilities

• Architect and Design a hub-and-spoke data platform on Databricks to integrate structured, semi-structured, and unstructured data from multiple sources.
• Enable Advanced Analytics & Real-Time Use Cases such as personalization, customer 360, recommendation systems, and marketing attribution.
• Implement DataOps Best Practices, including CI/CD pipelines, version-controlled workflows, automated testing, data quality monitoring, and observability.
• Define and Enforce Data Contracts to ensure schema consistency and reliable data exchange between producers and consumers.
• Optimize Data Processing using Databricks Delta Lake, Spark, and streaming technologies for both batch and real-time pipelines.
• Integrate with Cloud-Native Ecosystems (AWS/Azure/GCP) for scalable storage, compute, security, and orchestration.
• Collaborate Across Teams including business stakeholders, analytics, ML, and engineering teams to align data architecture with business goals.
• Ensure Security and Compliance with industry standards (e.g., GDPR, CCPA) for sensitive retail and customer data.

Qualifications

• Must-have Skills:
• Expertise in Databricks (Delta Lake, Spark, Databricks SQL, Unity Catalog, MLflow).
• Strong background in data architecture and design of large-scale, distributed systems.
• Proven experience building data pipelines (batch and streaming) with technologies like Delta Live Tables, Spark Structured Streaming, Kafka, Event Hubs, or Kinesis.
• Solid understanding of DataOps practices: CI/CD for data workflows, testing frameworks, monitoring, and observability tools.
• Proficiency in SQL and Python (PySpark).
• Hands-on experience with cloud platforms (AWS, Azure, or GCP) including storage, networking, IAM, and security best practices.
• Knowledge of data governance, lineage, and cataloging solutions (e.g., Unity Catalog, Collibra, Alation).
• Ability to integrate APIs, third-party systems, and retail platforms into the data ecosystem.
• Advanced English is essential.
• Understanding of the entire business side.
• Desired Qualifications:
• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
• Retail industry experience with customer data, personalization, and omnichannel analytics use cases.
• Experience implementing real-time decisioning systems or personalization engines.
• Familiarity with modern orchestration tools (Airflow, dbt, Dagster, Prefect).
• Experience with data quality frameworks (Great Expectations, Deequ, Soda).
• Exposure to machine learning pipelines and MLOps best practices.
• Excellent communication and stakeholder management skills.
• Certifications in Databricks, Azure Data Engineer, AWS Big Data, or GCP Data Engineering.

Benefits

• Health and dental insurance
• Meal and food allowance
• Childcare assistance
• Extended paternity leave
• Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;
• Profit Sharing and Results Participation (PLR);
• Life insurance
• Continuous learning platform (CI&T University);
• Discount club
• Free online platform dedicated to physical, mental, and overall well-being
• Pregnancy and responsible parenting course
• Partnerships with online learning platforms
• Language learning platform
• And many more!

More details about our benefits can be discussed during the interview process.

At CI&T, inclusion starts at the first contact. If you are a person with a disability, it is important to present your assessment during the selection process. This way, we can ensure the support and accommodations that you deserve. If you do not yet have the assessment, don’t worry: we can support you in obtaining it.

We have a dedicated Health and Well-being team, inclusion specialists, and affinity groups who will be with you at every stage. Count on us to make this journey side by side.