Data Engineer

PartnerOne; Colombia; Presencial; COP 60.000.000 - 100.000.000; Jornada completa

Descripción de la vacante

PartnerOne is seeking a Data Engineer to design, build, and maintain robust data pipelines powering analytics, compliance, and reporting across the Mortgage Cadence Platform. The role emphasizes execution with growing end-to-end ownership of data workflows as familiarity with the platform grows.

Key requirements include Advanced SQL, experience with Microsoft Fabric Dataflow Gen2 and related ETL tools, and strong data modeling skills.

Formación

• Advanced SQL with optimization, window functions, performance tuning.
• Experience with Microsoft Fabric Dataflow Gen2, Notebooks, Lakehouse or equivalent ETL tools.
• Strong relational database design and dimensional modeling knowledge.
• Power Query / M data shaping and transformation.
• Python or similar scripting for data manipulation and automation.
• Git/version control basics for collaboration.
• Data quality frameworks including unit tests, assertions and validation rules.
• Ability to interpret business requirements and design efficient data solutions.
• Mortgage/lending domain familiarity preferred; willingness to learn domain.

Responsabilidades

• Design and build ETL pipelines using Microsoft Fabric (Dataflow Gen2, Notebooks, or equivalent tools).
• Write optimized SQL queries and transformations for data ingestion from source systems.
• Apply data quality checks and validation at each pipeline stage.
• Implement incremental loads and manage refresh schedules for performance.
• Escalate architectural questions to Lead for complex transformations.

Conocimientos

Advanced SQL

Relational database design

Dimensional modeling

Data quality

Business requirements interpretation

Data governance mindset

Data pipelines

Herramientas

Microsoft Fabric Dataflow Gen2

Notebooks

Lakehouse

Python

dbt

Talend

Informatica

Power Query / M

Git

Descripción del empleo

About The Company

We are looking for a new Data Engineer to be part of the Mortgage Cadence team.

Role Overview

The Data Engineer operates designing, building and maintaining robust data pipelines and transformation logic that powers analytics, compliance and operational reporting across the Mortgage Cadence Platform. The role is execution-focused with increasing ownership of end-to-end data workflows as familiarity with the platform grows. Strong SQL, ETL, and data quality skills are required; the ability to build reports and leverage semantic models is secondary to data engineering excellence.

Responsibilities

Data Pipeline Development

• Design and build ETL pipelines using Microsoft Fabric (Dataflow Gen2, Notebooks, or equivalent tools)
• Write optimized SQL queries and transformations for data ingestion from designated source systems
• Apply data quality rules and validation logic at each pipeline stage
• Implement incremental loads and manage refresh schedules for performance
• Escalate to Lead for architectural decisions or complex transformation patterns

Data Quality & Validation

• Define and implement data quality checks at ingestion, transformation, and output stages
• Perform ongoing data validation to ensure pipeline outputs align with business logic and source system expectations
• Identify, document, and elevate data quality issues with root cause analysis
• Maintain data quality dashboards and SLA monitoring
• Support UAT for new data sources or transformation logic

Transformation & Modeling

• Build and maintain data transformations using Power Query, SQL, or Python as appropriate
• Develop dimensional models and define aggregation logic aligned with analytics requirements
• Optimize data structures for performance and maintainability
• Document transformation logic, lineage, and assumptions per team standards
• Collaborate with Lead to define semantic

Operational Support

• Troubleshoot pipeline failures and performance issues; coordinate resolution with IT/Engineering
• Respond to data discrepancy reports from business users and analysts
• Maintain documentation of data sources, data dictionaries, and transformation specifications
• Support capacity planning and optimization of Fabric environments and pipelines models and calculated metrics

Requirements

Technical

• Advanced SQL – query optimization, window functions, performance tuning, debugging complex transformations
• Proficient with Microsoft Fabric – Dataflow Gen2, Notebooks, Lakehouse – or equivalent ETL tools (Python, dbt, Talend, Informatica)
• Strong understanding of relational database design and dimensional modeling
• Power Query / M – complex data shaping, merging, error handling, and transformation logic
• Python or similar scripting language – data manipulation, pipeline automation
• Git/version control basics – able to collaborate on code and track changes
• Data quality and testing frameworks – unit tests, assertions, validation rules

Non-Technical

• Ability to interpret business requirements and design efficient data solutions
• Data governance mindset – understands data lineage, documentation, and quality standards
• Proactive about identifying edge cases and potential data issues
• Mortgage/lending domain familiarity preferred; willingness to learn domain required
• Works effectively within defined standards and escalates architectural questions to Lead
• Able to balance speed with quality; advocates for technical excellence