A technology firm is seeking a Data Engineer to architect and operate large-scale distributed data platforms using Databricks and Spark. The ideal candidate will have at least 6 years of experience in data or cloud engineering, with proven skills in optimizing Spark workloads and implementing Infrastructure as Code. Responsibilities include leading incident responses and driving performance standards. This is an opportunity to work in a dynamic environment with modern technologies.
Qualifications
6+ years of data or cloud engineering experience.
2+ years operating Databricks in production.
2+ years working with Spark.
2+ years implementing Infrastructure as Code.
Responsibilities
Optimize Spark and Delta Lake workloads.
Implement Infrastructure as Code.
Lead incident response.
Drive performance standards.
Skills
Data engineering
Cloud engineering
Spark
Databricks
Job description
Architect and operate large-scale distributed data platforms using Databricks and Spark.