Senior Data Engineer (AWS) – DataOps & Lakehouse Architect

Coderio; Cordoba; À distance; COP 346 162 000 - 534 978 000; Plein temps

Avantages offerts par ce poste

100% remote

Long-term commitment with autonomy

Strategic, high-visibility role

Collaborative international team

Career development within Coderio

Résumé du poste

Coderio is seeking a Senior Data Engineer to design, build, and optimize scalable data platforms that support global financial and transactional data. You will work with Python, SQL, Spark, and AWS to deliver high-performance solutions in a fast-paced environment.

Collaborate with data scientists, software engineers, and product managers to translate business needs into reliable data systems, enforce data quality, and implement DataOps practices.

Qualifications

• 5+ years of experience in Data Engineering or related Software Engineering roles.
• 2
• Strong proficiency in Python and SQL; Scala/Java a plus.
• Hands-on with Spark/PySpark, Delta Lake, and lakehouse architectures incl. Data Mesh.
• Strong expertise in AWS data services (S3, Glue, Athena, EventBridge, Firehose, Lambda).
• Experience with Airflow or similar DAG-based tools and platforms such as Snowflake, Redshift, or BigQuery.
• Experience designing real-time streaming architectures using Kafka or Kinesis; familiarity with dbt.
• Strong knowledge of DevOps/DataOps incl. Git, Docker, CI/CD, IaC; cloud platforms such as AWS or GCP.
• Advanced English proficiency.

Responsabilités

• Design, build, and maintain high-throughput batch and streaming data pipelines to ingest and process financial transactions from diverse global sources.
• Design, scale, and optimize cloud data warehouse and lakehouse architectures capable of handling massive volumes of structured and unstructured data.
• Collaborate with Data Scientists, Software Engineers, and Product Managers to translate business needs into scalable data solutions.
• Implement and enforce data quality frameworks, automated testing, monitoring, and alerting for data integrity and SLAs.
• Drive DataOps adoption, including CI/CD, workflow automation, and Infrastructure as Code for data systems.
• Champion data governance, privacy, and security, including GDPR/LGPD compliance.
• Mentor junior and mid-level Data Engineers; promote engineering excellence.

Connaissances

Python

SQL

Apache Spark

AWS

Data modeling

DataOps

CI/CD

Airflow

Kafka/Kinesis

dbt

Outils

Snowflake

AWS Redshift

Google BigQuery

Delta Lake

Databricks

Airflow

Terraform

Description du poste

Coderio is seeking a Senior Data Engineer to design, build, and optimize scalable data platforms that support global financial and transactional data. You will work with Python, SQL, Spark, and AWS to deliver high-performance solutions in a fast-paced environment.

Collaborate with data scientists, software engineers, and product managers to translate business needs into reliable data systems, enforce data quality, and implement DataOps practices.