Senior Data Engineer — Remote, Spark & Databricks Expert

Grupo Giga; A distancia; MXN 1,457,000 - 2,005,000; Jornada completa

Descripción de la vacante

A dynamic technology company in Veracruz is seeking a Senior Data Engineer to work with modern technologies for data ingestion, storage, and transformation. You'll develop software, utilize tools like Kafka and Databricks, and support data governance. The role promises opportunities for professional growth in a community-oriented environment. Ideal candidates will demonstrate strong skills in SQL and Python, alongside distributed data processing experiences. Remote work is available.

Servicios

Opportunities for professional development

Flexible work hours

15 business days PTO

Referral Program

Friendly working culture

Responsabilidades

• Software development focused on data ingestion, storage, transformation, and orchestration.
• Utilize Autoloader and Kafka for data ingestion.
• Perform data transformation using PySpark and Structured Streaming.

Conocimientos

SQL Server knowledge

Python knowledge

GitHub knowledge

Distributed data processing with Spark

Structured Streaming experience

Databricks Live Tables

Kafka / Azure EventHub experience

Proficiency in Python

Strong knowledge of SQL

English proficiency

Descripción del empleo

A dynamic technology company in Veracruz is seeking a Senior Data Engineer to work with modern technologies for data ingestion, storage, and transformation. You'll develop software, utilize tools like Kafka and Databricks, and support data governance. The role promises opportunities for professional growth in a community-oriented environment. Ideal candidates will demonstrate strong skills in SQL and Python, alongside distributed data processing experiences. Remote work is available.