Data Engineer

Lean Tech, a Lean Solutions Group Division; Medellín; Presencial; COP 100.000.000 - 160.000.000; Jornada completa

Descripción de la vacante

Lean Tech, a Lean Solutions Group Division, is seeking a Senior Data Engineer to own the data ecosystem powering analytics and data science initiatives. You will design and optimize scalable data pipelines, craft governance-aware data warehouses, and lead cloud infrastructure architecture.

You will collaborate with data scientists and product teams to deliver impactful insights. You will mentor teammates, participate in on-call rotations, and drive best practices in AI tooling adoption as data

Formación

• 5+ years of experience in data engineering.
• Bachelor's degree in Computer Science, Engineering, or related field (or equivalent).
• Expert SQL and strong Python programming.
• Experience building data pipelines with dbt and Airflow.
• Experience with cloud data warehouses (Snowflake, BigQuery, Redshift).
• Knowledge of event-driven and streaming systems (Kafka, SQS, Kinesis, Pub/Sub).
• RBAC, data security, and data governance familiarity.

Responsabilidades

• Design, build, and optimize robust, scalable data pipelines from diverse sources.
• Develop and maintain data warehousing solutions with governance models.
• Architect and manage cloud-based data infrastructure.
• Orchestrate batch ML pipelines with data scientists to align product requirements.
• Promote AI tooling adoption and best practices across the team.
• Improve performance, efficiency, and cost of data systems.
• Collaborate with data scientists, analysts, and product managers to deliver actionable solutions.
• Work with internal software teams to define architectures for data ingestion and production metrics.
• Lead incident management in on-call rotations and maintain documentation.

Conocimientos

SQL

Python

dbt

Airflow

event-driven architecture

real-time streaming

RBAC

Azure Event hubs

Kafka

SQS

Kinesis

Pub/Sub

Snowflake

Databricks

BigQuery

Redshift

CI/CD

microservice architecture

DDD

data contracts

Educación

Bachelor's degree in Computer Science or related field

Herramientas

dbt

Airflow

Snowflake

Databricks

BigQuery

Redshift

Kafka

Azure Event Hubs

SQS

Kinesis

Pub/Sub

PowerBI

Descripción del empleo

As a Senior Data Engineer, you will build and own the data ecosystem that powers our analytics, business intelligence, and data science initiatives. This position is for an experienced professional who provides technical leadership to the team and directly influences how the organization leverages data.

Design, build, and optimize robust, scalable, and reliable data pipelines to ingest and process data from a wide variety of sources.

Develop and maintain data warehousing solutions (e.g., Snowflake), including advanced RBAC models to ensure data governance.

Architect and manage cloud-based data infrastructure.

Orchestrate batch machine learning pipelines, working closely with data scientists to align optimizations with product requirements.

Leverage and drive team adoption of AI coding agents, ensuring best practices are kept up to date as AI tooling advances.

Improve performance, efficiency, and optimize the cost of existing data systems and processes.

Collaborate with stakeholders, including data scientists, analysts, and product managers to deliver actionable solutions.

Work with internal software engineering teams to define architectures for data ingestion and making metrics available to production applications.

Proactively address gaps in team standards, SLAs, operating principles, and documentation.

Be a leader, mentor, and subject matter expert for the team and peers.

Take part in an on-call rotation and lead incident management with clear communication.

Required Skills & Experience

• -5+ years of experience in data engineering.


• -Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent professional experience).


• -Expert proficiency in SQL and strong programming skills in Python.


• -Proven experience building and orchestrating data pipelines using dbt and Airflow.


• -Solid understanding of event-driven architecture and messaging systems, real-time streaming data, like website clicks or object tracking, where data is constantly flowing into their platform.


• -Strong experience with Azure Event hubs, or similar messaging streaming technologies like Kafka, Amazon SQS, Kinesis, Google Pub/Sub, etc.


• -Experience with modern cloud data warehouses such as Snowflake, Databricks, BigQuery, or Redshift.


• -Familiarity with CI/CD, microservice architecture, domain-driven design (DDD), and data contracts.


• -Solid understanding of best practices around data security/privacy and role-based access control (RBAC).


• -Experience with machine learning concepts, frameworks, and infrastructure.

Nice to Have Skills

• Hands-on experience developing data solutions in Microsoft Azure (Strong Preference).


• Solid understanding of BI-tooling integrations, specifically PowerBI (Strong Preference).


• Experience in interacting with vendors to craft the adoption of new technology and infrastructure.

Soft Skills

• Excellent written and oral communication and presentation skills.


• Strong leadership and mentoring capabilities for stakeholders and peers.


• Ability to foster a collaborative environment that drives solutions forward at a large scope.


• Proven ability to weigh tradeoffs in "build vs buy" decisions and technical initiatives versus product roadmaps.