Databricks Architect

Net2Source (N2S); Dallas (TX); On-site; USD 140,000 - 200,000; Full time

Job summary

Net2Source (N2S) seeks a Sr. Data Bricks Engineer to lead design and implementation of enterprise-grade data platforms on Databricks. You will shape architectures across AWS/Azure/GCP, drive scalable ETL/ELT pipelines, and guide teams through governance and optimization.

The role emphasizes collaboration with stakeholders, pre-sales input, and a focus on data lineage, security, and modern data stack advancements.

Qualifications

• Strong hands-on experience with Databricks clusters, notebooks, Delta Lake, MLflow, Unity Catalog.
• Experience with at least one cloud provider (AWS, Azure, GCP).
• Strong proficiency in Spark, Python, SQL, and distributed data processing.
• Experience with streaming technologies (Structured Streaming, Kafka, Kinesis, EventHub).

Responsibilities

• Design end-to-end data architectures using Databricks Lakehouse Platform.
• Architect scalable ETL/ELT pipelines, real-time streaming solutions, and advanced analytics platforms.
• Define data models, storage strategies, and integration patterns aligned with business and enterprise architecture standards.
• Provide guidance on cluster configuration, performance optimization, cost management, and workspace governance.

Skills

Databricks

Spark

Python

SQL

Cloud platforms

Streaming technologies

CI/CD

Tools

Delta Lake

MLflow

Unity Catalog

Azure DevOps

GitHub Actions

Jenkins

Kafka

Kinesis

EventHub

Job description

Mandatory Skills: Sr. Data Bricks Engineer, AWS, SQL

State: TX

Role Description

Role Summary

We are looking for a highly skilled Databricks Solution Architect to lead the design and implementation of scalable, enterprise-grade data platforms using Databricks. The ideal candidate will combine strong technical expertise in data engineering and cloud platforms (AWS/Azure/GCP) with architectural leadership, solution design capability, and strong stakeholder engagement skills.

Key Responsibilities

• Design end-to-end data architectures using Databricks Lakehouse Platform.
• Architect scalable ETL/ELT pipelines, real-time streaming solutions, and advanced analytics platforms.
• Define data models, storage strategies, and integration patterns aligned with business and enterprise architecture standards.
• Provide guidance on cluster configuration, performance optimization, cost management, and workspace governance.

2. Technical Leadership

• Lead technical discussions and design workshops with engineering teams and business stakeholders.
• Perform code reviews and provide technical mentoring to data engineers and developers.

3. Stakeholder & Project Engagement

• Collaborate with product owners, business leaders, and analytics teams to translate business requirements into scalable technical solutions.
• Create and present solution proposals, architectural diagrams, and implementation strategies.
• Support pre-sales or discovery phases with technical input when needed.

4. Data Governance, Security & Compliance

• Define and implement governance standards across Databricks workspaces (data lineage, cataloging, access control, etc.).
• Ensure compliance with regulatory and organizational security frameworks.
• Implement best practices for monitoring, auditing, and data quality management.
• Stay updated on Databricks features, roadmap, and industry trends.
• Recommend improvements, optimizations, and modernization opportunities across the data ecosystem.
• Evaluate integration of complementary technologies (Delta Live Tables, MLflow, Unity Catalog, streaming frameworks, etc.)

Required Skills & Experience:

Technical Skills

• Strong hands-on experience with Databricks (clusters, notebooks, Delta Lake, MLflow, Unity Catalog).
• Experience with at least one cloud provider (AWS, Azure, GCP).
• Strong proficiency in Spark, Python, SQL, and distributed data processing.
• Experience with streaming technologies (Structured Streaming, Kafka, Kinesis, EventHub).
• CI/CD practices for data pipelines (Azure DevOps, GitHub Actions, Jenkins, etc.).

Soft Skills

• Strong communication skills with ability to engage technical and business teams.
• Experience working in Agile environments.
• Ability to simplify complex technical concepts for non-technical audiences.
• Strong analytical, problem-solving, and decision-making abilities.

Preferred Qualifications

• Databricks Certified Data Engineer Professional / Architect certification.
• AWS/Azure/GCP cloud architect certifications.
• Experience with BI tools (Tableau, Power BI, Looker).
• Experience in machine learning workflows and ML operations.
• Background in large-scale data modernization or cloud migration projects.