Senior Data Engineer: Financial Pipelines & AI Enablement

CI&T; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health insurance

Meal allowance

Childcare assistance

Paternity leave

Wellbeing programs

PLR program

Life insurance

CI&T University

Language learning

Job summary

CI&T is seeking a Senior Data Engineer to join our team and drive the evolution, maintenance, and improvement of global financial closing processes. You will build and optimize data pipelines using Databricks, PySpark, Python, and SQL, integrate new data sources, and ensure data quality across the financial data ecosystem.

Collaborate with cross-functional teams, support AI-enabled data initiatives, and contribute to governance, observability, and scalable solutions that empower business

Qualifications

• Strong experience with Databricks notebooks, jobs, and clusters.
• Proficiency in PySpark, Python, and SQL for data transformation.
• Experience with Delta Lake and Lakehouse architecture.
• Knowledge of Azure Data Lake Storage and cloud data processing.
• Experience supporting financial data pipelines and reconciliation processes.
• Hands-on pipeline maintenance, troubleshooting, and production support.
• Ability to work with structured and semi-structured data and ensure data quality.
• Interest in applying AI models within data workflows.
• English proficiency for global collaboration.

Responsibilities

• Data Pipeline Development: Develop, maintain, and improve data pipelines using Databricks, PySpark, Python, and SQL to transform raw financial data into reliable curated datasets.
• Data Integration: Integrate new data sources into the existing data ecosystem, helping expand the platform’s capabilities and improve business visibility.
• Financial Data Reconciliation: Support financial reconciliation activities, P&L routines, and global closing processes by ensuring data consistency, accuracy, and traceability across different sources.
• Data Processing and Optimization: Process large volumes of structured and semi-structured data, optimizing transformations, storage formats, and query performance using Delta Lake and Lakehouse best practices.
• Pipeline Maintenance and Support: Monitor, troubleshoot, and support existing pipelines, identifying issues, investigating discrepancies, and ensuring reliable daily and monthly processing.
• Continuous Improvement: Propose and implement better technical approaches to improve performance, scalability, maintainability, and data quality across the financial data ecosystem.
• Collaboration with Cross-functional Teams: Work closely with existing data engineers, business stakeholders, finance teams, and technology teams to understand needs and deliver high-quality data solutions.
• Governance and Data Quality: Support data governance, validation rules, auditability, documentation, and controls to ensure trustworthy and well-managed financial data.
• AI Integration: Support initiatives involving AI models and advanced data capabilities, helping integrate AI-driven insights and automation into data workflows.

Skills

Databricks

PySpark

Python

SQL

Delta Lake

Lakehouse

Azure Data Lake

Data governance

Data quality

English

Tools

Databricks

Azure Data Lake Storage

Delta Lake

Databricks Workflows

Job description

CI&T is seeking a Senior Data Engineer to join our team and drive the evolution, maintenance, and improvement of global financial closing processes. You will build and optimize data pipelines using Databricks, PySpark, Python, and SQL, integrate new data sources, and ensure data quality across the financial data ecosystem.

Collaborate with cross-functional teams, support AI-enabled data initiatives, and contribute to governance, observability, and scalable solutions that empower business