DataBricks Solution Architect

Veriipro

Charlotte (NC)

On-site

USD 120,000 - 160,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Veriipro is seeking a Databricks Solutions Architect to assess and optimize enterprise data pipelines. You will review the current Databricks architecture and how applications consume data, identifying bottlenecks and opportunities to improve performance, cost, security, and governance.

You will deliver an optimization roadmap, perform deep code reviews of PySpark, Spark SQL, notebooks, SQL queries, and Delta Lake implementations, and help shape scalable data solutions across streaming and batch

Qualifications

  • Experience reviewing Databricks architecture.
  • Ability to optimize performance, cost, and governance.
  • Proven experience with data consumption patterns.
  • Able to deliver an optimization roadmap.

Responsibilities

  • Architecture assessment: review Databricks architecture and data flows.
  • Understand how applications consume Databricks data.
  • Identify bottlenecks and unnecessary complexity.
  • Code review: PySpark, Spark SQL, notebooks and SQL queries.
  • Evaluate Delta Lake implementation and streaming code.

Skills

Data consumption
Architecture review
Performance optimization
Security governance
Roadmap delivery
Databricks architect

Tools

Databricks
Spark SQL
Delta Lake

Job description

Required Skills:
  • Understanding how application consume data
  • Need someone who can come in look at the architecture and code and offer optimization solution
  • Focus on performance, cost, security and governance
  • Deliver an optimization roadmap
  • DataBricks Solutions architect on the application side.
  • Someone who has experience with consumption of data
Responsibilities:
1. Architecture assessment
  • Review the existing Databricks architecture
  • Understand how applications consume Databricks data
  • Review data flows, integrations, APIs, SQL Warehouses, clusters, Delta tables, etc.
  • Identify architectural bottlenecks and unnecessary complexity
2. Code review

This is critical. They should be comfortable getting into the actual:

  • PySpark code
  • Spark SQL
  • Databricks notebooks
  • SQL queries
  • ETL/ELT pipelines
  • Delta Lake implementation
  • Streaming code,
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Solution Architect
Databricks Solution Architect

Centraprise • San Francisco (CA)

On-site
USD 180,000 - 260,000
Databricks Architect
Databricks Architect

Satwic Inc • Houston (TX)

On-site
USD 120,000 - 170,000
Solution Data Architect
Solution Data Architect

Celebal Technologies • Houston (TX)

On-site
USD 140,000 - 180,000
Senior Resident Solution Architect
Senior Resident Solution Architect

Unison Group • San Francisco (CA)

On-site
USD 180,000 - 240,000
Databricks Solutions Architect
Databricks Solutions Architect

Compunnel Inc. • Florida

On-site
USD 120,000 - 160,000
Enterprise Architect - Data
Enterprise Architect - Data

TechDigital Group • Minneapolis (MN)

On-site
USD 120,000 - 150,000
Databricks Data Architect/Lead
Databricks Data Architect/Lead

Celebal Technologies • United States

On-site
USD 180,000 - 240,000
Databricks Solution Architect
Databricks Solution Architect

Tata Consultancy Services Limited • Irving (TX)

On-site
USD 125,000 - 140,000
Databricks Data Architect
Databricks Data Architect

Winfo Solutions • Atlanta (GA)

On-site
USD 140,000 - 210,000
Databricks Architect
Databricks Architect

TechDoQuest • Edison (NJ)

Remote
USD 130,000 - 180,000