Azure Databricks Architect

Onebridge; Indiana (PA); Hybrid; USD 81,000 - 205,000; Full time

Job summary

An innovative consulting firm is seeking a skilled Azure Databricks Architect to join their dynamic team. This role involves establishing strategic technology directions and scalable data solutions using Azure Databricks, while collaborating with cross-functional teams in an Agile environment. The ideal candidate will have extensive experience in enterprise Data Architecture, advanced analytics, and a passion for driving technology transformations. Join a company recognized as one of the best places to work and contribute to exciting projects that shape the future of data solutions.

Benefits

Medical Insurance

Vision Insurance

401(k) Plan

Qualifications

• 12+ years of experience in enterprise Data Architecture with Azure Databricks.
• Expertise in designing and building data platforms and solutions.
• Strong experience in data governance and data management.

Responsibilities

• Establish strategic technology direction and architecture for data solutions.
• Collaborate with stakeholders to develop technology roadmaps.
• Lead efforts in code reviews and knowledge-sharing sessions.

Skills

Azure Databricks

Data Architecture

ETL Processes

Data Governance

Data Modeling

Machine Learning

Agile Methodologies

Data Lakes

Data Warehouses

AWS Technologies

Education

Bachelor's Degree in Computer Science

Master's Degree in Data Science

Tools

AWS

Informatica

Job description

6 days ago Be among the first 25 applicants

Onebridge is a Consulting firm with an HQ in Indianapolis, and clients dispersed throughout the United States and beyond. We have an exciting opportunity for a highly skilled Azure Databricks Architect to join an innovative and dynamic group of professionals at a company rated among the top “Best Places to Work” in Indianapolis since 2015.

Employment Type: Full Time or Contract

Location: Indianapolis, IN - Hybrid

As an Azure Databricks Architect, you are responsible for establishing a strategic technology direction, architecture, and a scalable data solution using Azure Databricks. You have a proven track record of influencing senior leadership and a strong grasp of value creation and business capability models. You will collaborate with cross-functional teams in an Agile environment and lead efforts to understand business requirements, optimize data workflows, and ensure the efficient processing of large datasets. You are highly experienced with and passionate about using Azure Databricks in large-scale technology transformations and platforms. You have exposure to and understanding of advanced analytics techniques using ML and AI.

• Collaborate with key stakeholders in an Agile environment to understand advanced data requirements and develop technology target states and roadmaps that align with short and long-term business goals.
• Create data models, complex ETL processes, data integrations, and CI/CD pipelines with AWS technologies.
• Define and implement best practices for data quality, data governance, and data security within Azure Databricks architecture.
• Provide knowledge on advanced concepts such as medallion architecture, DLT, unity catalog within Azure Databricks, and core AWS services/architecture best practices.
• Lead and participate in code reviews, documentation, and knowledge-sharing sessions related to Azure Databricks and AWS.
• 12+ years of proven enterprise Data Architecture experience with expertise in designing and building data platforms and solutions in Azure Databricks.
• Extensive hands-on experience in Azure Databricks fundamentals/architecture, including setting up and optimizing Azure Databricks clusters and modules (Data Engineering, ML, and SQL warehouse).
• Experience building solutions for migrations, batches, and real-time ingestions.
• Strong experience architecting big data solutions using Data Lakes, Data Warehouses, and Data Products.
• Experience with data streaming technologies and ingestion with various versions of Informatica.
• Experience with Data Modeling, Governance, Data Management, DevOps, and MLOps.

A Best Place to Work in Indiana since 2015

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology

Industries

• IT Services and IT Consulting

Referrals increase your chances of interviewing at Onebridge by 2x

Inferred from the description for this job

Medical insurance

Vision insurance

401(k)

Get notified about new Cloud Architect jobs in Indiana, United States.

Washington, IN $118,200.00-$204,300.00 2 weeks ago

Cloud Architect - Indianapolis, IN (must be a local to IN)

Indianapolis, IN $81.21-$81.21 5 hours ago

Carmel, IN $134,000.00-$254,000.00 2 weeks ago

IT - Senior Technology Architect | Cloud Platform | Amazon Webservices Architecture Senior Technology Architect | Cloud Platform | Amazon Webservices Architecture

Indiana, United States $150,000.00-$210,000.00 10 hours ago

Delivery Solutions Architect - Data & AI

Indiana, United States $150,000.00-$210,000.00 10 hours ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.