Senior Data Engineer — Databricks Lakehouse Migration
Sigma Software
Recebe mais respostas dos empregadores
Envia um currículo específico para a oferta em poucos minutos.
Resumo da oferta
Sigma Software is seeking a Senior Data Engineer to join its Data Engineering Center of Excellence. You will help migrate a large-scale analytics platform from BigQuery to Databricks, design Lakehouse architectures, and optimize Spark-based data pipelines for retail analytics.
The role requires extensive experience with Databricks, PySpark, Delta Lake, and cloud data platforms. You will collaborate with international teams, contribute to architectural decisions, and uphold data governance
Qualificações
- 5+ years of experience as a Data Engineer.
- Strong Python and SQL skills.
- Hands-on Databricks experience.
- Strong knowledge of Apache Spark (PySpark).
- Experience designing modern cloud-based data platforms.
- Experience ETL/ELT pipelines and large-scale processing.
- Hands-on Delta Lake experience.
- Experience with Spark Declarative Pipelines.
- Cluster monitoring and performance optimization.
- Knowledge of data warehousing concepts and dimensional modeling.
Responsabilidades
- Migrate large-scale analytics platform from BigQuery to Databricks.
- Design scalable Lakehouse architectures with Databricks and Delta Lake.
- Analyze ETL/ELT workloads and plan migration approaches.
- Build and optimize data pipelines for retail analytics data.
- Implement incremental processing and scalable transformations.
- Develop Spark-based data solutions using PySpark.
Conhecimentos
Ferramentas
Descrição da oferta de emprego
Sigma Software is seeking a Senior Data Engineer to join its Data Engineering Center of Excellence. You will help migrate a large-scale analytics platform from BigQuery to Databricks, design Lakehouse architectures, and optimize Spark-based data pipelines for retail analytics.
The role requires extensive experience with Databricks, PySpark, Delta Lake, and cloud data platforms. You will collaborate with international teams, contribute to architectural decisions, and uphold data governance
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
