Senior Data Engineer - Remote, Flexible & Lakehouse

Parser; Colombia; À distance; COP 90 000 000 - 140 000 000; Plein temps

Avantages offerts par ce poste

Remote-friendly

Flexible schedule

Résumé du poste

Parser in Colombia is seeking a senior data engineer to design, develop, and optimize data pipelines using Databricks and Apache Spark, building scalable ETL/ELT processes from banking systems.

You will implement Delta Lake data lakehouse architecture, collaborate with data scientists and stakeholders, and mentor junior engineers while upholding security and regulatory requirements such as PCI-DSS, SOX, and GDPR.

Qualifications

• 5+ years of experience in data engineering or related roles.
• 3+ years hands-on experience with Databricks platform.
• Strong proficiency in Apache Spark (PySpark/Scala).
• Expert-level SQL skills and experience with large-scale data processing.
• Experience with Delta Lake and data lakehouse architectures.
• Solid understanding of cloud platforms (AWS, Azure, or GCP).
• Experience with banking or financial services data and regulatory requirements.
• Knowledge of data modeling, data warehousing concepts, and dimensional modeling.
• Strong problem-solving skills and attention to detail.
• Advance level english

Responsabilités

• Design, develop, and optimize data pipelines using Databricks and Apache Spark
• Build scalable ETL/ELT processes to ingest, transform, and deliver data from various banking systems
• Implement data lakehouse architecture using Delta Lake for reliable data storage and processing
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements
• Optimize Databricks cluster configurations and query performance for cost efficiency
• Develop and maintain data quality frameworks and monitoring solutions
• Implement security best practices and ensure compliance with banking regulations (PCI-DSS, SOX, GDPR)
• Create and maintain technical documentation for data workflows and processes
• Mentor junior engineers and promote best practices in data engineering
• Participate in code reviews and contribute to continuous improvement initiatives

Connaissances

Advanced English

Problem solving

Mentoring

Collaboration

Data quality

Outils

Databricks

Apache Spark

Delta Lake

Terraform

CloudFormation

Pandas

NumPy

Description du poste

Parser in Colombia is seeking a senior data engineer to design, develop, and optimize data pipelines using Databricks and Apache Spark, building scalable ETL/ELT processes from banking systems.

You will implement Delta Lake data lakehouse architecture, collaborate with data scientists and stakeholders, and mentor junior engineers while upholding security and regulatory requirements such as PCI-DSS, SOX, and GDPR.