Senior Data Engineer Brazil

Ciandt; Campinas; On-site; BRL 180,000 - 260,000; Full time

Benefits offered by this job

Plano de saúde

Vale alimentação

Auxílio-creche

PLR

Seguro de Vida

CI&T University

Job summary

CI&T está buscando um Senior Data Engineer para atuar em Campinas, liderando pipelines de dados financeiros, integração de novas fontes e melhoria contínua de qualidade de dados. A posição envolve colaboração com equipes globais para suportar fechamentos financeiros, reconciliação de dados e modelos de IA em workloads de dados.

O profissional será hands-on, analítico e poderá otimizar performances, com ênfase em Delta Lake, Lakehouse e Azure Data Lake Storage, contribuindo para soluções

Qualifications

• Experiência com Databricks, notebooks, jobs e clusters.
• Proficiente em PySpark, Python e SQL para transformação de dados.
• Conhecimento de Delta Lake e arquitetura Lakehouse.

Responsibilities

• Desenvolver, manter e melhorar data pipelines para dados financeiros.
• Integrar novas fontes de dados ao ecossistema existente.
• Suportar reconciliação financeira, P&L e fechamento global.
• Otimizar processamento, usar Delta Lake e boas práticas de Lakehouse.
• Monitorar, identificar problemas e manter pipelines estáveis diariamente.

Skills

Databricks

PySpark

Python

SQL

Delta Lake

Lakehouse

Azure Data Lake Storage

Data pipelines

Tools

Databricks

Delta Lake

Azure Data Lake Storage

Databricks Workflows

Job description

Senior Data Engineer Brazil

Na CI&T , ajudamos grandes empresas a transformar o potencial da AI em impacto real nos negócios com AI Deployment, execução AI-native e tech-integrated business solutions.

Com 30 anos de experiência em transformação tecnológica, aceleramos inovação com expertise em agentic SDLC, application modernization, Data & AI, martech e business strategy.

Somos 8.000 CI&Ters em mais de 25 países, colaborando para construir soluções com impacto real. AI já faz parte da forma como trabalhamos, evoluímos e inovamos todos os dias.

Importante: se você reside na Região Metropolitana de Campinas, sua presença nos escritórios da cidade será obrigatória, conforme a política de frequencia vigente.

We are seeking a talented and experienced Senior Data Engineer to join our team and support a strategic partner in the evolution, maintenance, and continuous improvement of global financial closing processes.

This role will focus on supporting financial data reconciliation, P&L routines, existing data pipelines, and the integration of new data sources. The professional will also contribute to building new pipelines, improving data quality and support initiatives involving AI models and advanced data capabilities.

We are looking for someone hands-on, collaborative, and analytical, who enjoys solving complex data challenges and building reliable, scalable solutions that create real business impact.

Responsibilities

• Data Pipeline Development: Develop, maintain, and improve data pipelines using Databricks, PySpark, Python, and SQL to transform raw financial data into reliable curated datasets.


• Data Integration: Integrate new data sources into the existing data ecosystem, helping expand the platform's capabilities and improve business visibility.


• Financial Data Reconciliation: Support financial reconciliation activities, P&L routines, and global closing processes by ensuring data consistency, accuracy, and traceability across different sources.


• Data Processing and Optimization: Process large volumes of structured and semi-structured data, optimizing transformations, storage formats, and query performance using Delta Lake and Lakehouse best practices.


• Pipeline Maintenance and Support: Monitor, troubleshoot, and support existing pipelines, identifying issues, investigating discrepancies, and ensuring reliable daily and monthly processing.


• Continuous Improvement: Propose and implement better technical approaches to improve performance, scalability, maintainability, and data quality across the financial data ecosystem.


• Collaboration with Cross-functional Teams: Work closely with existing data engineers, business stakeholders, finance teams, and technology teams to understand needs and deliver high-quality data solutions.


• Governance and Data Quality: Support data governance, validation rules, auditability, documentation, and controls to ensure trustworthy and well-managed financial data.


• AI Integration: Support initiatives involving AI models and advanced data capabilities, helping integrate AI-driven insights and automation into data workflows.

Requirements

• Strong experience with Databricks, including notebooks, jobs, workflows, clusters, and best practices for building scalable data solutions.


• Proficiency in data processing using PySpark, Python, and SQL, with hands-on experience transforming raw data into curated and reliable datasets.


• Experience with Delta Lake and Lakehouse architecture, including Delta tables, incremental processing, data optimization, and structured data layers.


• Knowledge of Azure data ecosystem, especially Azure Data Lake Storage, data integration patterns, and cloud-based data processing.


• Experience supporting financial data pipelines, preferably involving reconciliation, P&L, financial closing, or other critical business processes.


• Hands-on experience maintaining and improving existing pipelines, including troubleshooting, performance tuning, documentation, and production support.


• Ability to work with structured and semi-structured data, ensuring data quality, traceability, and readiness for analytical and business consumption.


• Problem-solving mindset, with the ability to investigate complex data, understand root causes, and propose practical solutions in challenging data environments.


• Interest or experience with AI models and advanced data capabilities, supporting the integration of AI-driven solutions into data workflows.


• English proficiency for interaction with global teams, technical discussions, and documentation.

Nice to Have:

• Familiarity with AI frameworks and methodologies.


• Experience with advanced capabilities, such as Delta Lake optimization, Databricks Workflows and Databricks Apps or Streamlit.


• Experience with data quality and observability practices, including validation rules, reconciliation checks, monitoring, logs, alerts, and pipeline execution metrics.

Nossos benefícios

• - Plano de saúde e odontológico


• - Vale alimentação e refeição


• - Auxílio-creche


• - Licença parental estendida


• - Parceria com academias e profissionais de saúde e bem-estar via Wellhub (Gympass) TotalPass


• - Participação nos Lucros e Resultados (PLR)


• - Seguro de Vida


• - Plataforma de aprendizagem contínua (CI&T University)


• - Clube de descontos


• - Plataforma online gratuita dedicada à promoção da saúde física, mental e bem-estar


• - Curso gestante e parentalidade responsável


• - Parceria com plataformas de cursos online


• - Plataforma para aprendizagem de idiomas


• - E muitos outros Mais detalhes sobre os nossos benefícios aqui: https://ciandt.com/br/pt-br/carreiras

Na CI&T, a inclusão começa no primeiro contato. Se você é pessoa com deficiência, é importante apresentar o seu laudo durante o processo seletivo.

Consulte quais dados são necessários conter no laudo clicando aqui.

Se ainda não tem o laudo caracterizador, não se preocupe: podemos te apoiar para obtê-lo.

Temos um time dedicado de Saúde e Bem-estar, especialistas em inclusão e grupos de afinidade que estarão com você em todas as etapas. Conte com a gente para fazer essa jornada lado a lado.