[Job - 29706] Senior Data Developer (Azure and Databricks), Brazil

Ciandt; Brasil; Presencial; BRL 100 000 - 130 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health and dental insurance

Meal and food allowance

Childcare assistance

Extended paternity leave

Partnership with gyms

Profit Sharing and Results Participation

Life insurance

Continuous learning platform

Discount club

Language learning platform

Resumo da oferta

Ciandt is seeking a Senior Data Engineer to enhance financial data processes and integrate AI solutions. This role involves developing and optimizing data pipelines while ensuring accuracy and reliability in financial reporting.

The ideal candidate should have strong experience in Databricks, PySpark, Python, and SQL, as well as a collaborative mindset to work with cross-functional teams to deliver high-quality data solutions.

Qualificações

• Strong experience with Databricks including notebooks and jobs.
• Proficiency in PySpark, Python, and SQL for data processing.
• Experience with Delta Lake and Lakehouse architecture.
• Knowledge of Azure data ecosystem and data integration patterns.
• Hands-on experience supporting financial data pipelines.

Responsabilidades

• Develop and maintain data pipelines using Databricks and SQL.
• Integrate new data sources into the existing ecosystem.
• Support financial reconciliation activities and P&L routines.
• Optimize processing of structured and semi-structured data.
• Monitor and troubleshoot existing pipelines.

Conhecimentos

Databricks

PySpark

Python

SQL

Delta Lake

Azure Data Lake Storage

Data Quality

AI Integration

Descrição da oferta de emprego

At CI&T, we help large enterprises transform the potential of AI into real business impact with AI Deployment, AI-native execution, and tech-integrated business solutions.

With 30 years of experience in technological transformation, we accelerate innovation with expertise in Agentic SDLC, Application modernization, Data & AI, Martech and Business strategy.

We are 8,000 CI&Ters across more than 25 countries, collaborating to build solutions with real impact. AI is already part of how we work, evolve, and innovate every day.

We are seeking a talented and experienced Senior Data Engineer to join our team and support a strategic partner in the evolution, maintenance, and continuous improvement of global financial closing processes. This role will focus on supporting financial data reconciliation, P&L routines, existing data pipelines, and the integration of new data sources. The professional will also contribute to building new pipelines, improving data quality and support initiatives involving AI models and advanced data capabilities. We are looking for someone hands‑on, collaborative, and analytical, who enjoys solving complex data challenges and building reliable, scalable solutions that create real business impact.

Responsibilities

• Data Pipeline Development: Develop, maintain, and improve data pipelines using Databricks, PySpark, Python, and SQL to transform raw financial data into reliable curated datasets.
• Data Integration: Integrate new data sources into the existing data ecosystem, helping expand the platform’s capabilities and improve business visibility.
• Financial Data Reconciliation: Support financial reconciliation activities, P&L routines, and global closing processes by ensuring data consistency, accuracy, and traceability across different sources.
• Data Processing and Optimization: Process large volumes of structured and semi‑structured data, optimizing transformations, storage formats, and query performance using Delta Lake and Lakehouse best practices.
• Pipeline Maintenance and Support: Monitor, troubleshoot, and support existing pipelines, identifying issues, investigating discrepancies, and ensuring reliable daily and monthly processing.
• Continuous Improvement: Propose and implement better technical approaches to improve performance, scalability, maintainability, and data quality across the financial data ecosystem.
• Collaboration with Cross‑functional Teams: Work closely with existing data engineers, business stakeholders, finance teams, and technology teams to understand needs and deliver high‑quality data solutions.
• Governance and Data Quality: Support data governance, validation rules, auditability, documentation, and controls to ensure trustworthy and well‑managed financial data.
• AI Integration: Support initiatives involving AI models and advanced data capabilities, helping integrate AI‑driven insights and automation into data workflows.

Requirements for this challenge

• Strong experience with Databricks, including notebooks, jobs, workflows, clusters, and best practices for building scalable data solutions.
• Proficiency in data processing using PySpark, Python, and SQL, with hands‑on experience transforming raw data into curated and reliable datasets.
• Experience with Delta Lake and Lakehouse architecture, including Delta tables, incremental processing, data optimization, and structured data layers.
• Knowledge of Azure data ecosystem, especially Azure Data Lake Storage, data integration patterns, and cloud‑based data processing.
• Experience supporting financial data pipelines, preferably involving reconciliation, P&L, financial closing, or other critical business processes.
• Hands‑on experience maintaining and improving existing pipelines, including troubleshooting, performance tuning, documentation, and production support.
• Ability to work with structured and semi‑structured data, ensuring data quality, traceability, and readiness for analytical and business consumption.
• Problem‑solving mindset, with the ability to investigate complex data, understand root causes, and propose practical solutions in challenging data environments.
• Interest or experience with AI models and advanced data capabilities, supporting the integration of AI‑driven solutions into data workflows.
• English proficiency for interaction with global teams, technical discussions, and documentation.

Nice to have

• Familiarity with AI frameworks and methodologies.
• Experience with advanced capabilities, such as Delta Lake optimization, Databricks Workflows and Databricks Apps or Streamlit.
• Experience with data quality and observability practices, including validation rules, reconciliation checks, monitoring, logs, alerts, and pipeline execution metrics.

Our benefits

• Health and dental insurance
• Meal and food allowance
• Childcare assistance
• Extended paternity leave
• Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass
• Profit Sharing and Results Participation (PLR)
• Life insurance
• Continuous learning platform (CI&T University)
• Discount club
• Free online platform dedicated to physical, mental, and overall well‑being
• Pregnancy and responsible parenting course
• Partnerships with online learning platforms
• Language learning platform
• And many more!

More details about our benefits here: https://ciandt.com/br/pt-br/carreiras

At CI&T, inclusion starts at the first contact. If you are a person with a disability, it is important to present your assessment during the selection process. See which data needs to be included in the report by clicking here. This way, we can ensure the support and accommodations that you deserve. If you do not yet have the assessment, don't worry: we can support you in obtaining it.

We have a dedicated Health and Well‑being team, inclusion specialists, and affinity groups who will be with you at every stage. Count on us to make this journey side by side.