Lead Data Engineer - Cloud Data Pipelines (GCP)
BairesDev
Convierte este puesto en una entrevista — un currículum y una carta de presentación creados pensando en lo que quiere el empleador.
Ventajas ofrecidas por este puesto de trabajo
Descripción de la vacante
BairesDev is seeking a Lead Data Engineer (Snowflake) to design, build, and optimize robust data pipelines for enterprise analytics. You will work with Python on GCP, leveraging BigQuery, Dataflow, and Pub/Sub to enable scalable streaming and batch processing in a modern cloud environment.
You will collaborate with product and engineering teams, ensure data quality, and drive improvements in ETL/ELT workflows, data modeling, and pipeline performance.
Formación
- 5+ years in Data Engineering or Software Engineering.
- Hands-on Python and GCP (BigQuery, Dataflow, Pub/Sub).
- Experience designing streaming pipelines and robust ETL/ELT workflows.
- Solid knowledge of workflow orchestration (Airflow/Cloud Composer) and data modeling for analytics.
- Advanced proficiency in English.
Responsabilidades
- Design, implement, and maintain highly scalable batch and streaming data pipelines.
- Architect and optimize robust ETL/ELT workflows using cloud-native services and orchestrators.
- Develop and optimize high-performance data models for downstream analytics.
- Collaborate with product and engineering teams to integrate diverse datasets and ensure data quality.
- Monitor, troubleshoot, and continuously improve pipeline performance.
Conocimientos
Herramientas
Descripción del empleo
BairesDev is seeking a Lead Data Engineer (Snowflake) to design, build, and optimize robust data pipelines for enterprise analytics. You will work with Python on GCP, leveraging BigQuery, Dataflow, and Pub/Sub to enable scalable streaming and batch processing in a modern cloud environment.
You will collaborate with product and engineering teams, ensure data quality, and drive improvements in ETL/ELT workflows, data modeling, and pipeline performance.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
