Data Engineer - FX and Cloud Platforms

Casado; São Paulo; On-site; BRL 240,000 - 360,000; Full time

Job summary

Casado in São Paulo, Brazil invites a Senior Data Engineer to design, build, and operate scalable data platforms for FX trading and financial markets. You will craft robust data pipelines, enable processing of large datasets, and collaborate with software engineers, data specialists, and product teams to deliver cloud-native data solutions.

You will engineer high-performance pipelines with Python/Java, leverage Spark, and contribute to observability and production reliability, while applying

Qualifications

• Minimum 6 years of professional experience in Data Engineering, Software Engineering, or related disciplines.
• Proven track record delivering scalable data platforms in production environments.
• Strong ability to design and operate ETL/ELT pipelines and analytical data storage.
• Experience with Python and Java development, cloud-native architectures, and data quality practices.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines.
• Build data ingestion, transformation, validation, orchestration, and monitoring solutions.
• Develop production-grade applications using Python and Java.
• Manage and optimize large-scale data processing workflows.
• Implement data quality controls and monitoring frameworks.
• Design analytical data models and storage solutions for reporting and analytics.
• Build cloud-native solutions on AWS and containerized applications with Docker.
• Support real-time and near-real-time data processing requirements.
• Collaborate with engineering, product, and business teams for end-to-end ownership.

Skills

Python

Java

AWS

Apache Spark

ETL/ELT pipelines

Docker

Kubernetes

Airflow

SQL / Data modelling

Big data

Tools

Docker

Kubernetes

ClickHouse

Kafka

Terraform

Apache Airflow

Job description

Senior Data Engineer

Location: São Paulo, Brazil

About the Role

We are looking for a Senior Data Engineer to join a growing technology team focused on delivering scalable, high-performance data platforms within the Financial Markets space. This role is ideal for an experienced engineer who enjoys working at the intersection of cloud technologies, big data, data engineering, and FX trading systems. You will be responsible for designing, building, and operating robust data pipelines, enabling the processing of large-scale datasets while supporting critical business and trading functions. You'll collaborate closely with software engineers, data specialists, product teams, and business stakeholders to deliver reliable, cloud-native data solutions that drive decision-making and support real-time market operations.

What You'll Be Doing

Data Engineering & Platform Development

• Design, develop, and maintain scalable ETL/ELT pipelines.
• Build solutions for data ingestion, transformation, validation, orchestration, and monitoring.
• Develop high-quality, production-ready applications using Python and Java.
• Manage and optimize large-scale data processing workflows.
• Implement data quality controls and monitoring frameworks.
• Design analytical data models and storage solutions to support reporting and advanced analytics.

Cloud & Infrastructure

• Build and maintain cloud-native solutions leveraging AWS services.
• Develop and deploy containerized applications using Docker.
• Support scalable and resilient production environments.
• Contribute to infrastructure automation and platform reliability initiatives.

Big Data & Real-Time Processing

• Develop distributed data processing solutions using Spark and related technologies.
• Optimize data pipelines for performance, scalability, and efficiency.
• Support real-time and near-real-time data processing requirements.
• Work with large and complex datasets in demanding business environments.

Collaboration & Innovation

• Partner with engineering, product, and business teams to understand requirements and deliver solutions.
• Contribute to architecture discussions and technical decision-making.
• Apply software engineering best practices, including testing, debugging, observability, and operational excellence.
• Leverage modern AI-assisted and agentic development workflows to improve productivity and code quality.

Required Skills & Experience

Technical Skills

• Strong experience with Python and Java development.
• Hands-on experience with AWS services and cloud-native architectures.
• Proven experience with Big Data frameworks, particularly Apache Spark.
• Strong background in designing and operating ETL/ELT pipelines.
• Excellent understanding of analytical data storage concepts and architectures.
• Experience with Docker and containerized application development.
• Solid understanding of software engineering principles, system design, debugging, testing, and production support.
• Experience working with modern AI-powered development tools and agentic coding workflows.

Financial Markets Experience

Experience working within FX (Foreign Exchange) environments.

Understanding of trading data, market data flows, financial systems, or electronic trading platforms is highly desirable.

Professional Experience

• Minimum 6 years of professional experience in Data Engineering, Software Engineering, or related disciplines.
• Proven track record of delivering scalable and reliable data platforms in production environments.
• Strong communication, collaboration, and problem-solving skills.

Nice to Have

Experience with any of the following technologies will be considered a strong advantage:

• ClickHouse
• QuestDB
• KX/kdb+
• Kubernetes
• Apache Kafka or other distributed messaging platforms
• Terraform or other Infrastructure-as-Code tools
• Apache Airflow or similar workflow orchestration platforms
• Real-time analytics and time-series data platforms
• Capital Markets or Electronic Trading environments

What We're Looking For

We're seeking a proactive and technically strong engineer who thrives in a fast-paced environment and enjoys solving complex data challenges. The ideal candidate combines deep data engineering expertise with a strong software engineering mindset and an interest in financial markets technology. You should be comfortable owning solutions end-to-end, collaborating across teams, and contributing to the evolution of modern cloud-based data platforms.