Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
SP Software is seeking a Senior Big Data Engineer to design and implement scalable data pipelines using PySpark, Scala and Spark, with strong AWS cloud services experience. The role focuses on ETL/ELT development, data processing, and pipeline orchestration, ensuring performance, reliability and data quality across complex systems.
You will collaborate with cross-functional teams, leverage Databricks and Snowflake for data analytics, and apply best practices in monitoring and optimization.
PySpark, Scala, Apache Spark, AWS, Amazon EMR, AWS Glue, AWS Step Functions, AWS Lambda, ETL Development and Big Data Pipeline Development.
We are looking for an experienced Senior Big Data Engineer with strong expertise in PySpark, Scala, Apache Spark and AWS cloud services. The candidate will be responsible for designing, developing, implementing and optimizing scalable big data pipelines and ETL solutions. The role requires hands-on experience with AWS services such as Amazon EMR, AWS Glue, AWS Step Functions and AWS Lambda, along with expertise in data processing, pipeline orchestration, monitoring and performance optimization.
Databricks, Snowflake, AI Knowledge, AWS Services, Data Pipeline Monitoring and Performance Optimization.