Senior Databricks Architect — AWS Data Lake & Pipelines

Delta System & Software, Inc.; Minneapolis (MN); On-site; USD 130,000 - 185,000; Full time

Job summary

Delta System & Software, Inc. is seeking a senior Data Architect/Engineer to provide guidance and hands-on leadership for developing scalable data pipelines on Databricks within an AWS data lake environment.

You will collaborate with business and IT stakeholders to shape the future-state architecture and drive data-driven decisions. The role requires 10+ years of Databricks experience, strong AWS skills, and a Databricks certification.

Qualifications

• 10+ years of experience with Databricks on AWS
• Databricks certification is required
• Experience leading data architecture and pipelines
• Strong collaboration with business and IT partners to set data strategy

Responsibilities

• Provide guidance and support to teams and analysts.
• Lead architecture, design, and implementation of scalable data pipelines on Databricks.
• Collaborate with data engineering, platform, and analytics teams to integrate Databricks with AWS services (S3, Redshift).
• Architect solutions for batch and real-time data using Delta Lake, Spark, and MLflow.
• Ensure data quality, governance, and security best practices are followed.

Skills

Databricks

AWS

Data strategy

Data governance

Data quality

Education

Databricks certification

Tools

Delta Lake

Spark

MLflow

Snowflake

S3 / AWS data lake

Redshift

Talend

SAP BW/HANA

Oracle

Job description

Delta System & Software, Inc. is seeking a senior Data Architect/Engineer to provide guidance and hands-on leadership for developing scalable data pipelines on Databricks within an AWS data lake environment.

You will collaborate with business and IT stakeholders to shape the future-state architecture and drive data-driven decisions. The role requires 10+ years of Databricks experience, strong AWS skills, and a Databricks certification.