Lead Data Engineer: Databricks, Python & Cloud Pipelines
gsbsolutions1
Recibe más respuestas de empleadores
Envía un currículum específico para el puesto de trabajo en cuestión de minutos.
Ventajas ofrecidas por este puesto de trabajo
Descripción de la vacante
gsbsolutions1 is seeking a Lead Data Engineer to design and implement scalable data analytics solutions across on-premises and cloud data platforms in Guadalajara, Mexico. You will lead production-grade data pipelines and mentor a team of data engineers.
The role requires deep hands-on experience with Python, Spark, SQL, Hadoop and Databricks, plus strong leadership and architectural input. On-site in Guadalajara with excellent benefits and growth opportunities.
Formación
- Strong hands-on experience building production-grade data engineering solutions.
- Advanced proficiency in Python, PySpark/Spark, and SQL.
- Experience with Databricks; Snowflake is a plus.
- Hands-on experience with the Hadoop ecosystem (Hive/Impala).
- Experience with Airflow, NiFi, or Talend for ETL/ELT data pipelines.
- Experience with distributed data processing and CI/CD practices.
Responsabilidades
- Design and build scalable, cloud-native data platforms and pipelines.
- Develop robust ETL/ELT pipelines integrating data from multiple sources.
- Build production-grade data solutions using Python, Spark, SQL, and Databricks.
- Design modular, maintainable data processing components.
- Participate in architecture and technical design decisions.
- Lead code reviews and promote best practices.
Conocimientos
Herramientas
Descripción del empleo
gsbsolutions1 is seeking a Lead Data Engineer to design and implement scalable data analytics solutions across on-premises and cloud data platforms in Guadalajara, Mexico. You will lead production-grade data pipelines and mentor a team of data engineers.
The role requires deep hands-on experience with Python, Spark, SQL, Hadoop and Databricks, plus strong leadership and architectural input. On-site in Guadalajara with excellent benefits and growth opportunities.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
