Databricks Data Architect Lead — Lakehouse & Cloud

MatrixEdge Inc; Kansas City (MO); In loco; USD 150.000 - 190.000; Tempo pieno

Descrizione del lavoro

MatrixEdge Inc. seeks a Senior Data Architect with deep expertise in Databricks to lead design, development, and modernization of enterprise data platforms in a cloud environment.

This role requires hands-on implementation from initial design through production deployment and ongoing optimization. You will define data architecture strategies, implement scalable data solutions, and collaborate with stakeholders to translate business needs into technical data solutions.

Competenze

• 8+ years of experience in data architecture, data engineering, data warehousing, or related disciplines.
• 3+ years of hands-on experience with Databricks, including designing and implementing enterprise solutions.
• Led at least one end-to-end Databricks implementation from architecture through production deployment.
• Strong understanding of Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and Apache Spark.
• Advanced proficiency in Python, PySpark, and SQL.
• Experience designing scalable ETL/ELT pipelines and data integration solutions.
• Experience with at least one major cloud platform: Azure, AWS, or Google Cloud Platform.
• Experience migrating or modernizing legacy data platforms into cloud-based architectures.
• Ability to develop architecture diagrams, technical documentation, and implementation roadmaps.
• Strong communication skills with the ability to collaborate with technical teams and business stakeholders.

Mansioni

• Lead end-to-end Databricks implementations, including architecture design and production deployment.
• Design and implement scalable, secure enterprise data architectures leveraging Databricks.
• Establish data ingestion, transformation, orchestration, and integration patterns.
• Implement medallion (Bronze/Silver/Gold) data modeling approaches.
• Configure and optimize Databricks workflows, compute resources, and performance.
• Support migration of legacy data warehouses and ETL processes into Databricks.
• Develop architectural documentation and technical standards.
• Collaborate with data engineers, developers, and cross-functional teams.
• Partner with stakeholders to translate business requirements into technical solutions.
• Ensure solutions meet security, compliance, and governance requirements.

Conoscenze

Databricks

Data Architecture

Python

PySpark

SQL

Delta Lake

Unity Catalog

Apache Spark

Data Governance

CI/CD

Strumenti

Terraform

dbt

Airflow

Power BI

Tableau

Azure Data Factory

AWS Glue

S3

Descrizione del lavoro

MatrixEdge Inc. seeks a Senior Data Architect with deep expertise in Databricks to lead design, development, and modernization of enterprise data platforms in a cloud environment.

This role requires hands-on implementation from initial design through production deployment and ongoing optimization. You will define data architecture strategies, implement scalable data solutions, and collaborate with stakeholders to translate business needs into technical data solutions.