Databricks Platform Architecture

AT&T; Plano (TX); On-site; USD 155,000 - 261,000; Full time

Benefits offered by this job

Medical/Dental/Vision coverage

401(k) plan

Tuition reimbursement program

Paid Time Off and Holidays

Parental Leave

Caregiver Leave

Adoption Reimbursement

Disability Benefits

Life and Accidental Death Insurance

Employee discounts on AT&T plans

Job summary

AT&T is seeking a Principal Solution Architect to lead enterprise Databricks architecture across Azure and AWS from Plano. The role focuses on building secure, scalable platform capabilities for data engineering, analytics, and AI/ML workloads, with governance and cost optimization at the core.

The successful candidate will design and administer Databricks accounts, workspaces, and compute, while guiding Genie and Lakebase adoption and coordinating with security and cloud teams to deliver

Qualifications

• Master’s degree in Computer Science or related field preferred.
• 7+ years of hands‑on experience architecting and administering production Databricks environments.
• Databricks and Azure/AWS certifications preferred, depending on role requirements.
• Experience with Unity Catalog, Azure Data Lake Storage, and secure platform connectivity.
• Hands‑on experience with serverless Databricks capabilities, performance tuning, and cost optimization.
• Experience with Genie and Lakebase, plus Databricks data engineering, SQL analytics, and AI/ML capabilities.
• Proven ability to establish architectural standards and lead engineering teams via IaC and CI/CD.

Responsibilities

• Define enterprise Databricks architecture, standards, and roadmap for Azure and AWS.
• Administer Databricks accounts, workspaces, compute, SQL warehouses, and security controls.
• Establish governance with Unity Catalog and manage data access and lineage.
• Architect and administer Azure Data Lake Storage and integration with Databricks.
• Evaluate and support Databricks products including Genie and Lakebase.
• Guide secure adoption of Genie and Lakebase with proper configurations and use cases.
• Lead troubleshooting, performance tuning, and cost optimization for serverless and other compute.
• Develop repeatable platform provisioning via infrastructure as code, APIs, automation, and CI/CD.
• Collaborate with Enterprise Architects and security teams to establish patterns and guide production deployments.

Skills

Enterprise architecture

Technical leadership

Security governance

Cloud collaboration

Cost optimization

Education

Master’s degree in Computer Science

Tools

Databricks

Azure

AWS

Genie

Lakebase

Delta Lake

Databricks SQL

CI/CD

Python/SQL

Job description

This is a full-time onsite role based in the location(s) posted and is performed from the designated work location five days per week. No relocation is offered.

Join AT&T and reimagine the communications and technologies that connect the world. The Data Science team at AT&T leads transformation through data-driven decisions that enhance the customer experience and businesses worldwide. Leveraging one of the largest data sets available, we develop meaningful insights that drive continuous innovation. We utilize the latest technology to develop generative AI solutions with real business impacts. When you step into a career with AT&T, you won’t just imagine the future-you’ll create it.

You will provide hands‑on architecture and technical leadership for the enterprise Databricks platform across Azure and AWS. Design, implement, administer, and optimize secure, scalable, reliable, and cost‑effective platform capabilities supporting data engineering, analytics, and AI/ML workloads.

A typical day includes making platform design decisions, configuring and troubleshooting platform services, establishing governance and security controls, optimizing performance and cost, and partnering with engineering and business teams to adopt Databricks capabilities, including Genie, Lakebase, and serverless services.

Key Roles and Responsibilities

• Define the enterprise Databricks architecture, platform standards, and technical roadmap across Azure and AWS, aligning business needs with security, reliability, scalability, and performance requirements.
• Design and administer Databricks accounts, workspaces, compute, SQL warehouses, and serverless capabilities, including identity integration, access controls, networking, monitoring, and workload isolation.
• Establish governance using Unity Catalog, including permissions, data access patterns, lineage, and integration with enterprise security requirements.
• Architect and administer Azure Data Lake Storage and associated storage containers, including access controls, connectivity, lifecycle management, and integration with Databricks.
• Evaluate, implement, and support Databricks products and capabilities, including Delta Lake, data ingestion and transformation, workflow orchestration, Databricks SQL, AI/ML, Genie, and Lakebase.
• Guide the secure adoption of Genie and Lakebase, including access configuration, integration patterns, operational readiness, and appropriate business use cases.
• Lead hands‑on troubleshooting and performance tuning; establish compute policies, usage monitoring, and cost‑optimization practices for both serverless and other compute configurations.
• Develop repeatable platform provisioning and configuration through infrastructure as code, APIs, automation, and CI/CD.
• Collaborate with Enterprise Architects, security teams, cloud infrastructure teams, and engineers to establish reusable patterns, resolve technical trade‑offs, and guide production implementations.

Qualifications

• Master’s degree in Computer Science or a related field desired.
• 7+ of related experience, including substantial hands‑on experience architecting and administering production Databricks environments.
• Relevant Databricks and Azure/AWS certifications preferred, subject to applicable role requirements.
• Enterprise Databricks platform architecture and administration: Deep hands‑on production experience across Azure and AWS, including account/workspace architecture, networking, identity, compute, and operational support.
• Security, governance, and cloud storage administration: Strong Unity Catalog expertise and practical experience administering Azure Data Lake Storage, storage containers, permissions, and secure platform connectivity.
• Serverless, performance, and cost optimization: Hands‑on experience implementing and operating Databricks serverless capabilities, tuning workloads, troubleshooting issues, and managing consumption and cost.
• Databricks product expertise, including Genie and Lakebase: Practical implementation experience with Genie and Lakebase, supported by broad working knowledge of Databricks data engineering, SQL analytics, and AI/ML capabilities.
• Platform automation and technical leadership: Experience with infrastructure as code, CI/CD, Databricks APIs, and Python/SQL, combined with the ability to establish architectural standards and guide engineering teams.

"AT&T will not hire any applicants for this position who require employer sponsorship now or in the future."

Our Principal Solution Architecture jobs earn between $155,400.00 – $261,100.00 USD Annual. Not to mention all the other amazing rewards that working at AT&T offers. Individual starting salary within this range may depend on geography, experience, expertise, and education/training.

Joining our team comes with amazing perks and benefits:

• Medical/Dental/Vision coverage
• 401(k) plan
• Tuition reimbursement program
• Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company‑designated holidays)
• Paid Parental Leave
• Paid Caregiver Leave
• Additional sick leave beyond what state and local law require may be available but is unprotected
• Adoption Reimbursement
• Disability Benefits (short term and long term)
• Life and Accidental Death Insurance
• Supplemental benefit programs: critical illness/accident hospital indemnity/group legal
• Employee Assistance Programs (EAP)
• Extensive employee wellness programs
• Employee discounts up to 50% off on eligible AT&T mobility plans and accessories, AT&T internet (and fiber where available) and AT&T phone

Weekly Hours:

40

Time Type:

Regular

Location:

USA:GA:Alpharetta / 300 North Point Pkwy - Dat (owned):300 North Point Pkwy, USA:TX:Plano / W Plano Pkwy - Adm & Dat:2900 W Plano Pkwy

Salary Range:

$155,400.00 - $261,100.00

AT&T and its subsidiaries are committed to equal employment opportunity. All hiring, promotion, and other employment decisions remain merit-based and free from discrimination on the basis of race, color, religion, religious creed, national origin, ancestry, age, sex, sexual orientation, gender, gender identity, gender expression, physical disability, mental disability, pregnancy, medical condition, genetic information, marital status, citizenship status, military status, veteran status, or any other characteristic protected by federal, state, or local laws. In addition, AT&T will provide reasonable accommodations to qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made. Click here to learn more or request an application accommodation here.