Cloud Data Architect: Databricks, Azure & Governance

REGED INC; Florida; Remote; USD 100,000 - 200,000; Full time

Benefits offered by this job

Competitive pay and bonus

Remote work option

Medical, dental and vision plans

Generous paid time off

Life insurance

Job summary

RegEd is seeking a Data Architect to own the design and evolution of a cloud-native data platform serving 200+ clients in a multi-tenant SaaS environment. You will lead the architecture of a metadata-driven data integration platform built on Databricks, Azure Data Lake Gen2, and Unity Catalog, enabling flexible ingestion through configurable mappings and transformations.

You will collaborate with data engineering, platform engineering, and product teams to deliver new features, translate

Qualifications

• Review client-provided documents to ensure they meet minimum requirements for development.
• Develop and maintain data governance policies and procedures
• Stay up-to-date with emerging trends and technologies in a data science and development
• 10+ years of experience in data science and development
• Strong knowledge of data modeling, data warehousing, and data integrations techniques
• Experience with programming languages such as Phyton, R, and SQL
• Experience with big data technologies such as Hadoop and Spark
• Experience with cloud-based data solutions such as AWS and Azure

Responsibilities

• Own design and evolution of a cloud-native data platform serving 200+ clients in a multi-tenant SaaS environment.
• Lead architecture of a metadata-driven data integration platform using Databricks, Azure Data Lake Gen2, and Unity Catalog.
• Enable ingestion of diverse file formats via configurable mappings and transformations.
• Collaborate with data engineering, platform engineering and product teams to design and deliver features.
• Own Azure Data Factory and Databricks pipeline architecture and drive the data governance model including Unity Catalog and Purview.
• Support a 30TB+ cloud data estate through scalable architecture.

Skills

Data architecture

Data modeling

Data warehousing

Data integration

Python

R

SQL

Hadoop

Spark

AWS

Azure

Education

Bachelor's degree in Computer Science, Data Science or related field

Tools

Databricks

Azure Data Factory

Azure Data Lake Storage Gen2

Unity Catalog

Microsoft Purview

Job description

RegEd is seeking a Data Architect to own the design and evolution of a cloud-native data platform serving 200+ clients in a multi-tenant SaaS environment. You will lead the architecture of a metadata-driven data integration platform built on Databricks, Azure Data Lake Gen2, and Unity Catalog, enabling flexible ingestion through configurable mappings and transformations.

You will collaborate with data engineering, platform engineering, and product teams to deliver new features, translate