Principal - Databricks Solution Architect

Affine; Wilmington (DE); On-site; USD 145,000 - 165,000; Full time

Job summary

An established industry player is seeking a Principal Databricks Solution Architect to lead the design and implementation of innovative data solutions. This role involves developing scalable architectures on the Databricks platform while optimizing costs through Azure services. The ideal candidate will possess deep expertise in data engineering, particularly with Azure technologies, and will mentor others in best practices. Join a dynamic team that values collaboration and innovation, and contribute to impactful projects in a cloud-based environment.

Qualifications

• Deep expertise in the Databricks ecosystem and data processing frameworks.
• Experience with Azure technologies and cost optimization projects.

Responsibilities

• Lead design and implementation of data solutions using Azure services.
• Mentor team members on data engineering best practices.

Skills

Pyspark

Azure

ADF

Azure Synapse Analytics

Databricks

Solution Architecture

Project management

ETL

SQL

Job description

Join to apply for the Principal - Databricks Solution Architect role at Affine

1 month ago Be among the first 25 applicants

Join to apply for the Principal - Databricks Solution Architect role at Affine

Get AI-powered advice on this job and more exclusive features.

We are seeking an experienced Databricks Architect to design, implement, and optimize big data and cloud-based solutions using the Databricks platform. As a Databricks Architect, you will be responsible for creating scalable, efficient, and secure data architectures and workflows in a cloud-based environment, while ensuring best practices in data engineering, governance, and security.

The ideal candidate should have deep expertise in the Databricks ecosystem, strong experience with data processing frameworks (such as Apache Spark), and a solid understanding of cloud infrastructure. You will collaborate with cross-functional teams to design solutions that support large-scale data processing and machine learning workloads.

Key Responsibilities

• Lead the design and implementation of data solutions using Azure services, including Azure Synapse Analytics and Azure Databricks, specifically for cost optimization.
• Define the overall data strategy and architecture for cost optimization projects.
• Mentor and guide team members on data engineering best practices and cost optimization techniques.
• Collaborate with cross-functional teams to identify and prioritize cost-saving opportunities through data analysis.
• Evaluate and implement new data technologies to enhance performance and reduce costs.
• Ensure compliance with data governance standards and best practices across cost optimization projects.
• Extensive experience in data engineering, with a focus on Azure technologies and cost optimization projects.
• Proven leadership skills with a track record of successful project delivery focused on cost savings.
• Strong expertise in data modelling, ETL processes, and data governance.
• Excellent communication skills and the ability to collaborate with stakeholders at all levels.
  
  

Must Have Skills

• Pyspark
• Azure
• ADF
• Azure Synapse Analytics
• Databricks
• Solution Architecture
• Project management
• ETL
• SQL

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Business Consulting and Services

Referrals increase your chances of interviewing at Affine by 2x

Sign in to set job alerts for “Principal Solutions Architect” roles.

Sr. Manager, Delivery Solutions Architects - Retail

Newark, DE $145,000.00-$165,000.00 2 weeks ago

Newark, DE $140,000.00-$150,000.00 2 weeks ago

Enterprise Architect-Wilmington DE, Coral Springs FL, or Omaha NE

Technology Strategy, Solutions Architect Manager

Philadelphia, PA $100,000.00-$232,000.00 1 week ago

Healthcare Product Solutions Architect, Industry Products

Malvern, PA $138,200.00-$239,000.00 2 days ago

Philadelphia, PA $159,000.00-$185,000.00 1 week ago

Senior Solution Architect, Salesforce, Enterprise Solutions & Services, Wharton Computing

Philadelphia, PA $145,000.00-$155,000.00 5 days ago

Philadelphia, PA $155,000.00-$200,000.00 2 weeks ago

Director, ANAPLAN Solutions Architect (*remote consideration)

Solutions Architect, Media & Entertainment - Virtual

Philadelphia, PA $92,800.00-$141,800.00 2 weeks ago

Consulting Field Solutions Architect - Unstructured Data

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.