Senior Data Platform Engineer (Big Data, Spark)

Dropbox; New York (NY); On-site; Full time

Job summary

A leading file storage and collaboration platform is seeking a Data Architect to help build large-scale data platforms. The ideal candidate will have over 5 years of experience in Python, Java, SQL, and schema design. This role involves defining data assets, optimizing data systems, and collaborating with business units to create scalable architectures. Candidates with a BS in Computer Science or equivalent and a passion for data technology will excel. Located in New York, this position offers an opportunity to leverage big data technologies.

Qualifications

• 5+ years of development experience in Python, Java, C++, or Scala.
• 5+ years of SQL experience, No-SQL is a plus.
• 5+ years of experience with schema design and dimensional data modeling.
• Strong ownership mentality and excellent strategic thinking skills.
• Experience designing and maintaining data processing systems.

Responsibilities

• Define company data assets and develop Spark, SparkSQL, and HiveSQL jobs.
• Design data integrations and data quality frameworks.
• Collaborate to develop efficient and scalable Data Platform architecture.
• Own data architecture for large-scale projects.
• Work with teams to understand data needs and represent insights.
• Design and build sophisticated data models and visualizations.
• Optimize pipelines, dashboards, frameworks, and systems.

Skills

Python

Java

C++

Scala

SQL

No-SQL

Education

BS degree in Computer Science or related field

Job description

A leading file storage and collaboration platform is seeking a Data Architect to help build large-scale data platforms. The ideal candidate will have over 5 years of experience in Python, Java, SQL, and schema design. This role involves defining data assets, optimizing data systems, and collaborating with business units to create scalable architectures. Candidates with a BS in Computer Science or equivalent and a passion for data technology will excel. Located in New York, this position offers an opportunity to leverage big data technologies.