Data Architect

VBeyond Corporation; Seattle (WA); Hybrid; USD 180,000 - 240,000; Full time

Job summary

VBeyond Corporation is seeking a senior Data Engineering Leader in Seattle for hybrid work. You will drive end-to-end data platform delivery, architect scalable data pipelines, and guide cross-functional teams including product management and customers.

You will apply deep expertise in Databricks, Azure, Unity Catalog, and Delta Lake to optimize data governance, ingestion, and quality. Strong leadership and project management are essential.

Qualifications

• 15+ years of relevant experience.
• 5+ years leading highly complex engineering teams.
• Strong hands-on Databricks expertise.
• Experience managing distributed teams preferred.
• Expertise in large distributed data systems and data warehousing at scale.
• Knowledge of Unity Catalog architecture and data governance.
• Proficiency in PySpark and Python; APIs, containerization and orchestration a plus.

Responsibilities

• Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders.
• Follow the Agile development methodology; think strategically and execute methodically.
• Develop and manage capacity and growth projection forecasts of the environment within budgets.
• Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements.
• Drive optimization, testing and tooling to improve quality of solutions.
• Manage teams that build and operate high volume distributed systems in a SaaS environment.
• Great at devising efficient processes that increase velocity and quality.

Skills

Databricks

Azure

Data Factory

Data Lake

Unity Catalog

Delta Live Tables

PySpark

Python

APIs

Containerization

Orchestration

Cloud architecture

Leadership

Project management

Job description

Location – Seattle , WA (Hybrid) & {hoenix AZ

Mode – Full Time

Mandate : Databricks , Azure , Data Factory , Data Lake , Unity Catalog , Delta Live Tables , Pyspark

Experience : 15+

Responsibilities

• Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders.
• Follow the Agile development methodology; think strategically and execute methodically.
• Develop and manage capacity and growth projection forecasts of the environment within budgets.
• Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements.
• Drive optimization, testing and tooling to improve quality of solutions.
• Manage teams that build and operate high volume distributed systems in a SaaS environment.
• Great at devising efficient processes that increase velocity and quality.

Desired Experience/ Skills:

• 15+ years of relevant experience
• At least 5 years of experience building and leading highly complex technical engineering teams.
• Strong hands-on experience in Databricks
• Experience managing distributed teams preferred.
• Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills: financial/budget management, scheduling and resource management experience with medium and large-scale projects
• Comfortable working with ambiguity and multiple stakeholders.
• Experience in medallion architecture, optimization, Ingestion, Quality.
• Should have worked on Unity Catalog and understands its architecture and how to leverage its Data Governance and Observability capabilities.
• Comfortable working cross functionality with product management and directly with customers; ability to deeply understand product and customer personas.
• Architecture Design Experience for Cloud and Non-cloud platforms
• Expertise on Azure Cloud platform
• Knowledge on orchestrating workloads on cloud
• Ability to set and lead the technical vision while balancing business drivers
• Strong experience with PySpark, Python programming
• Proficiency with APIs, containerization and orchestration is a plus