Remote Senior Data Engineer - Scale Real Estate Data

8020REI; Bogotá ciudad; Hybrid; COP 226,559,000 - 388,387,000; Full time

Benefits offered by this job

Remote work

Flex PTO

Home Office upgrade bonus

Performance share bonus

HMO bonus

Job summary

8020REI is seeking a Senior Data Engineer to own the AWS-based data platform, including PySpark ETL/ELT, lakehouse management, and data API delivery. You will lead architecture decisions, manage cloud budgets, and ensure data quality in production.

This role requires deep AWS, Spark, and SQL expertise and collaboration with DS teams to operationalize ML models. You will drive cost optimization and build robust CI/CD pipelines, with a focus on nationwide data processing and scalable data services

Qualifications

• 4+ years of hands-on data engineering with large-scale distributed data systems and ownership of production pipelines.
• Advanced PySpark with performance tuning and cost-aware clustering on real workloads.
• Strong Python with production-grade code and CI tooling.

Responsibilities

• Own end-to-end big data pipelines on EMR and AWS Glue.
• Operate and evolve a medallion-style lakehouse on S3 with Hudi or comparable formats.
• Build reliable orchestration with Step Functions, EventBridge, and Lambda.
• Enforce data quality through contracts, audits, and drift monitoring.
• Manage production databases (Aurora PostgreSQL, DynamoDB) and data-serving APIs.
• Own cloud cost and optimize EMR, Glue, S3 usage and related services.
• Define IaC using Terraform and/or CloudFormation in CI/CD workflows.
• Collaborate with Data Science to productionize ML models and serving paths.
• Document architecture and data dictionaries for operability.

Skills

PySpark

Python

SQL

AWS

Data modeling

Airflow/Orchestration

Terraform/CloudFormation

Data quality

ETL/ELT

Scala/Spark

Education

Bachelor’s degree in Computer Science, Engineering, or equivalent

Tools

Amazon EMR

AWS Glue

S3

Athena

Aurora PostgreSQL

DynamoDB

Terraform

CloudFormation

Job description

8020REI is seeking a Senior Data Engineer to own the AWS-based data platform, including PySpark ETL/ELT, lakehouse management, and data API delivery. You will lead architecture decisions, manage cloud budgets, and ensure data quality in production.

This role requires deep AWS, Spark, and SQL expertise and collaboration with DS teams to operationalize ML models. You will drive cost optimization and build robust CI/CD pipelines, with a focus on nationwide data processing and scalable data services