A technology solutions company is seeking an experienced Data Engineer to architect and operate large-scale distributed data platforms using Databricks and Spark. The role requires expertise in optimizing Spark and Delta Lake workloads, implementing Infrastructure as Code, and leading incident response. With a need for 6+ years of experience in data or cloud engineering, this position presents an exciting opportunity for skilled professionals. Come and drive performance standards within a dynamic team based in Hyderabad, India.
Qualifications
6+ years of data or cloud engineering experience.
2+ years of experience operating Databricks in production.
2+ years of experience working with Spark.
2+ years of experience implementing Infrastructure as Code.
Responsibilities
Architect and operate large-scale distributed data platforms using Databricks and Spark.
Optimize Spark and Delta Lake workloads.
Implement Infrastructure as Code.
Lead incident response.
Drive performance standards.
Skills
Data engineering experience
Databricks operations
Spark expertise
Infrastructure as Code
Job description
Architect and operate large-scale distributed data platforms using Databricks and Spark.