Databricks Architect

OpenTalent; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

Onebridge, a Marlabs Company, seeks a Databricks Architect to design, implement, and govern scalable data platforms supporting enterprise reporting and analytics. You will shape data architecture, set standards, and guide solution design with data engineers, analysts, and stakeholders.

Leading cloud deployments across AWS, Azure, or GCP, you will optimize performance and costs, mentor engineers, and drive CI/CD and governance practices to mature the organization’s data capabilities.

Qualifications

• 10+ years of experience in data engineering, data architecture, or enterprise analytics platforms.
• Hands-on experience designing and implementing solutions on Databricks.
• Strong proficiency in Apache Spark, SQL, and Delta Lake for large-scale data processing.
• Experience building and optimizing both batch and real-time data pipelines.
• Proven experience with at least one major cloud platform (AWS, Azure, or GCP).
• Solid understanding of data governance concepts including security, lineage, access control, and compliance.
• Experience with data modeling techniques for analytical and reporting workloads.
• Familiarity with CI/CD practices in data projects.

Responsibilities

• Design and architect end-to-end data platforms using Databricks Lakehouse architecture.
• Define and implement scalable batch and streaming data pipelines.
• Collaborate with engineering, analytics, and business teams to translate requirements into designs.
• Establish data modeling, performance optimization, and cost-management best practices within Databricks.
• Lead cloud-based implementations across AWS, Azure, or GCP, including security and access controls.
• Provide technical leadership through architecture reviews and design sessions.
• Support production environments by troubleshooting data quality, performance, and reliability issues.

Skills

Databricks

Spark

SQL

Delta Lake

Data pipelines

Cloud platforms

Data governance

Data modeling

CI/CD

Job description

Onebridge , a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly skilled Databricks Architect to join our innovative and dynamic team.

Databricks Architect | About You

As a Databricks Architect, you are responsible for designing, implementing, and governing scalable data and analytics platforms that support enterprise reporting, advanced analytics, and data-driven decision making. You play a hands-on role in shaping data architecture, setting technical standards, and ensuring Databricks solutions are built for performance, reliability, and long-term scalability. You work closely with data engineers, analysts, and business stakeholders to guide solution design, review implementations, and ensure alignment with business objectives. You are actively involved in platform optimization, cost management, and the adoption of best practices across data ingestion, transformation, and analytics. As a technical leader, you mentor team members, influence architectural decisions, and help mature the organization’s overall data capabilities.

Databricks Architect | Day-to-Day

• Design and architect end-to-end data platforms using the Databricks Lakehouse architecture.
• Define and implement scalable batch and streaming data pipelines using Apache Spark and Delta Lake.
• Partner with engineering, analytics, and business teams to translate functional requirements into technical designs.
• Establish and enforce data modeling, performance optimization, and cost-management best practices within Databricks.
• Lead cloud-based implementations across AWS, Azure, or GCP, including networking, security, and access controls.
• Provide technical leadership through architecture reviews, code reviews, and design sessions.
• Support production environments by troubleshooting data quality, performance, and reliability issues.

Databricks Architect | Skills & Experience

• 10+ years of overall experience in data engineering, data architecture, or enterprise analytics platforms.
• Hands-on experience designing and implementing solutions on Databricks.
• Strong proficiency in Apache Spark, SQL, and Delta Lake for large-scale data processing.
• Experience building and optimizing both batch and real-time data pipelines.
• Proven experience working within at least one major cloud platform, including AWS, Azure, or GCP.
• Solid understanding of data governance concepts including security, lineage, access control, and compliance.
• Experience with data modeling techniques for analytical and reporting workloads.
• Familiarity with CI/CD