Senior Data Engineering

Publicis Groupe; Bogotá ciudad; On-site; COP 120,000,000 - 200,000,000; Full time

Benefits offered by this job

Competitive compensation and benefits

Health benefits

Flexible work arrangements

Paid leave

Wellness program

Job summary

Publicis Sapient seeks a Senior Data Engineer to own data pipeline health and reliability for ENDUR-fed systems and Power BI reporting layers.

You will maintain Airflow pipelines, optimize Spark jobs, and build Power BI models while mentoring juniors. Training for ETRM will be provided pre-deployment, with focus on on-prem/hybrid lakehouse environments and CI/CD practices.

Qualifications

• 6+ years of hands-on data engineering in production environments.
• Airflow-based pipelines in production (DAGs, operators, retries, SLAs).
• Python with OOP and unit testing.
• Advanced SQL tuning, views and validations.
• Apache Spark processing and optimization.
• Power BI end-to-end data modeling and DAX/RLS.
• Experience with on-prem/hybrid lakehouse (MinIO, Iceberg, Trino).
• Familiarity with CI/CD and test automation for pipelines and reports.
• ETRM experience preferred but training provided pre-deployment.

Responsibilities

• Maintain and evolve Airflow pipelines pulling from ENDUR batches.
• Detect and resolve pipeline failures with minimal downtime.
• Build Power BI data models and reporting solutions.
• Author pipeline transformations and optimize Spark jobs.
• Drive root cause analysis across data flows and reporting layers.
• Mentor junior engineers and contribute to monitoring frameworks.

Skills

6+ years experience

Airflow

Python (OOP)

Advanced SQL

Apache Spark

Power BI

CI/CD

ETRM domain training

Tools

Airflow

Python

SQL

Spark

Power BI

MinIO

Iceberg

Trino

Kubernetes

CI/CD tooling

Job description

Company description

Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting, and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting, and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value.

Overview

Publicis Sapient is looking for a Senior Data Engineer to take ownership of data pipeline health, evolution, and reliability for systems feeding off ENDUR and the reporting layer built on Power BI. While prior knowledge of energy trading and ETRM concepts is a significant advantage, Endur-specific skills are not mandatory — selected candidates will attend focused ETRM domain training as part of onboarding.

Your Impact

• Maintain and evolve Airflow-based pipelines pulling from ENDUR batches, including DAG execution, monitoring, and config changes.


• Detect and resolve pipeline failures and data mismatches with minimal downtime and business disruption.


• Build Power BI data models and complete reporting solutions aligning with stakeholder needs.


• Author new pipeline transformations, optimize Spark jobs, and refine advanced SQL queries.


• Drive root cause analysis and implement preventive solutions across data flows and reporting layers.


• Mentor junior engineers, enforce standards, and contribute to proactive monitoring frameworks.

Qualifications

Skills & Experience

• 6+ years of hands-on data engineering experience in production environments.


• Strong proficiency with:
  
  
  
  • Apache Airflow (DAG authoring, custom operators, retry logic, SLAs)
  
  
  • Python with OOP and unit testing
  
  
  • Advanced SQL (tuning, views, validations)
  
  
  • Apache Spark
  
  
  • Power BI end-to-end (data modeling, DAX, RLS)
  
  


• Experience working with on-prem/hybrid lakehouse environments (MinIO, Apache Iceberg, Trino).


• Familiarity with CI/CD and test automation for pipelines and reports.


• ETRM experience preferred but not required; mandatory training will be provided pre-deployment.

Set Yourself Apart With

• Previous work in energy trading or BFSI risk/trading data platforms.


• Experience implementing monitoring, alerting, and preventive reconciliation frameworks.


• Background in containerized workloads, Kubernetes, or related orchestration platforms.


• Evidence of handling high-pressure incident response and on-call rotations effectively.

Additional information

• An inclusive workplace that promotes diversity and collaboration.


• Access to ongoing learning and development opportunities.


• Competitive compensation and benefits package.


• Flexibility to support work-life balance.


• Comprehensive health benefits for you and your family.


• Generous paid leave and holidays.


• Wellness program and employee assistance.

As part of our dedication to an inclusive and diverse workforce, Publicis Sapient is committed to Equal Employment Opportunity without regard for race, color, national origin, ethnicity, gender, protected veteran status, disability, sexual orientation, gender identity, or religion. We are also committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at [e-mail]