Databricks Solution Architect - Data Platform & AI Leader

Guidehouse; Arlington (VA); On-site; USD 162,000 - 270,000; Full time

Benefits offered by this job

Medical Insurance

Paid Holidays

Discretionary Incentive Bonus

Tuition Reimbursement

Mobility Stipend

Parental Leave

Job summary

Guidehouse is seeking a Databricks Solution Architect to join our AI and Data team to support client projects in the utility industry involving Databricks solution design, platform administration, data governance, and secure Databricks solution implementation.

This role focuses on architecting and administering enterprise Databricks environments across workspaces, Unity Catalog, compute, security, automation, and operational standards.

Qualifications

• Bachelor's degree from an accredited college/university.
• 7+ years of relevant experience in data architecture, cloud data platforms, data engineering, platform engineering, or technical solution delivery.
• 3+ years Databricks hands-on experience designing, implementing, or administering Databricks environments (architecting), including workspaces, jobs, clusters, SQL warehouses, notebooks, repos, and platform configurations.
• Ability to quickly develop fluency in utility business processes, data models, source systems, regulatory requirements, and operational terminology, and translate that context into practical platform and solution architecture.
• Strong experience with SQL, Python, and Spark-based development for data engineering, automation, and platform operations.
• Strong experience with Unity Catalog, including access controls, catalogs, schemas, external locations, storage credentials, lineage, and governed data organization.
• Experience with cloud platforms such as Azure, AWS, or GCP, including identity, networking, storage, security, and deployment considerations for cloud-native data platforms.
• Experience developing architecture artifacts, technical designs, platform standards, implementation roadmaps, and operational documentation for technical and non-technical audiences.
• Ability to lead technical discussions with clients, evaluate tradeoffs, communicate architecture decisions, and work effectively in consulting or project-based delivery environments.
• Familiarity with data governance, DevOps, CI/CD, infrastructure automation, monitoring, cost management, and secure software delivery practices.
• Travel: onsite in NY at least one day every other week.

Responsibilities

• Partner with utility business, IT, data, and regulatory stakeholders to design governed data architectures that integrate customer, account, premise, service-address, meter, property, and energy-usage data across systems.
• Lead the design and implementation of Databricks solution architectures that support data engineering, analytics, AI/ML, and governed data product delivery.
• Administer Databricks workspaces, account-level settings, workspace configurations, users, groups, service principals, permissions, secrets, jobs, and platform objects.
• Design and manage Unity Catalog structures, including metastores, catalogs, schemas, external locations, storage credentials, access controls, lineage, and metadata standards.
• Define compute, cluster policy, SQL warehouse, job orchestration, runtime, and workload management patterns balancing performance, cost, security, and delivery needs.
• Translate business, technical, security, and governance requirements into Databricks-native architecture patterns, implementation plans, technical architecture and design documentation, and platform standards.
• Partner with cloud, cybersecurity, identity management, networking, and DevOps teams to support secure platform integration across Azure, AWS, or GCP environments.
• Develop reusable architecture guidance, reference implementations, deployment patterns, and operational playbooks for Databricks platform teams and delivery teams.
• Troubleshoot platform issues related to permissions, compute-performance, job execution, storage access, networking, workspace configuration, and production operations.
• Advise clients on platform governance, cost management, auditability, release management, environment strategy, separation of duties, regulatory traceability, and data-quality controls.
• Support delivery teams through technical leadership, architecture reviews, code and configuration reviews, documentation, and stakeholder communication.

Skills

SQL

Python

Spark

Databricks

Unity Catalog

Cloud platforms (Azure, AWS, GCP)

Data architecture

Governance

Stakeholder collaboration

Education

Bachelor's degree

Job description

Guidehouse is seeking a Databricks Solution Architect to join our AI and Data team to support client projects in the utility industry involving Databricks solution design, platform administration, data governance, and secure Databricks solution implementation.

This role focuses on architecting and administering enterprise Databricks environments across workspaces, Unity Catalog, compute, security, automation, and operational standards.