Principal Databricks Engineer

Alaska Airlines, Inc.

SeaTac (WA)

On-site

USD 141,000 - 212,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Free stand-by travel privileges on our
Well-being programs including medical,
401k match
Annual bonus plans
Paid time off

Job summary

Alaska Airlines is seeking a Principal Data Engineer to own and advance the Enterprise Data Platform built on Databricks. As the sole SME, you will define long-term strategy, mentor teams, and partner on technical implementations to ensure scalability, security, and alignment with business goals.

You will lead design of high-performance data pipelines, collaborate with data scientists and engineers, enforce governance, optimize costs, and continuously improve system reliability.

Qualifications

  • 7 years of experience in data engineering, big data platforms, and analytics.
  • Bachelor’s degree or an additional two years of relevant training/experience in lieu of this degree.
  • Expert-level proficiency in Databricks and Apache Spark.
  • Deep understanding of Databricks configurations and real-time streaming with Structured Streaming and Delta Live Tables.
  • Strong coding skills with Python, SQL and PySpark.
  • Experience with Infrastructure as Code (ARM, Terraform) and CI/CD pipelines (Azure DevOps and/or GitHub).
  • Experience with Kafka.
  • Familiarity with Unity Catalog and Lakehouse Federation.

Responsibilities

  • Design and implement high-performance data pipelines on Databricks (batch and real-time).
  • Collaborate with data scientists, analysts, and engineering teams to deliver production-grade solutions.
  • Define best practices for workspace governance, orchestration, and CI/CD integration.
  • Optimize cluster configurations and job execution for cost and speed.
  • Lead development and mentor engineers in streaming, Spark internals, and Delta optimization.
  • Implement and manage Unity Catalog for data governance and access control.
  • Monitor costs and drive optimization opportunities across the Databricks environment.
  • Collaborate with Enterprise Architecture and Security on platform architecture and security.

Skills

Databricks
Apache Spark
Python
SQL
PySpark
Kafka
CI/CD tooling

Education

Bachelor’s degree or equivalent

Tools

Terraform
ARM
Azure DevOps
GitHub
Unity Catalog
Delta Live Tables

Job description

Company

Alaska Airlines

The Team

Guided by our purpose, core values, and leadership principles, we are creating an airline people love. Our corporate teams set the strategies and operational plans to ensure the success of our company. Whether we use our expertise in accounting, human resources, finance, planning, legal, marketing, or any of our operational divisions, our shared passion for travel and our guests is what motivates us to achieve excellence each day. If you share our passion for creating an airline people love, we want to hear from you.

Role Summary

The Principal Data Engineer is the sole subject matter expert in designing, optimizing, implementing and advancing Alaska Air Group’s Enterprise Data platform using Databricks. As an individual contributor, this role defines long-term strategy for driving innovation, mentoring teams, partnering on the best technical implementation of Databricks, and ensuring the platform is scalable, secure, and aligned with Business and ITS goals.

Key Duties
  • Act as lead subject matter expert in designing and implementing high-performance batch or real-time data pipelines using Apache Spark, Delta Live Tables, and Structured Streaming on Databricks.
  • Collaborate with data scientists, analysts, and engineering teams to deliver robust, production grade solutions.
  • Define and enforce best practices for workspace governance, job orchestration, and CI/CD integration.
  • Optimize cluster configurations, spark parameters, and job execution plans for cost efficiency and speed.
  • Evaluate and implement new Databricks features to enhance platform capabilities. Champion the usage and raise awareness of these new features across the teams.
  • Exercise considerable latitude and initiative to troubleshoot and resolve performance bottlenecks, memory issues, and streaming latency challenges.
  • Lead development and mentor engineers on real-time streaming solutions, spark internals, delta table optimization strategies, and advanced debugging techniques.
  • Implement and manage Unity Catalog for centralized governance, data lineage, and fine-grained access control.
  • Monitor Databricks costs, identify, evaluate and drive implementation for cost reduction opportunities.
  • Lead efforts to standardize tagging and metadata practices across the AAG Databricks environment to improve cost attribution, accountability, and reporting.
  • Focus on continuous improvement in system reliability through automation and monitoring, including implementation of automated unit testing. Document and create best practices for the development of future teams.
  • Collaborate directly with Enterprise Architecture and Security to develop and plan the platforms architecture and security strategies.
  • Act as a forward thinker to help ensure that new capabilities are evaluated, implemented, and operationalized.
Job-Specific Experience, Education & Skills
Required
  • 7 years of experience in data engineering, big data platforms, and analytics, including independent work on large-scale data architectures or a related area.
  • Bachelor’s degree, or an additional two years of relevant training/experience in lieu of this degree.
  • Expert-level proficiency in Databricks, Apache Spark.
  • Deep understanding of Databricks configurations and hands‑off experience with real-time streaming using Structured Streaming and Delta Live tables.
  • Strong coding skills with Python, SQL and PySpark.
  • Expert knowledge and experience in Infrastructure as Code (ARM, Terraform) and CI/CD pipeline (Azure DevOps and/or GitHub preferred).
  • Proven ability to optimize data pipelines for performance, reliability, and cost.
  • Familiarity with Unity Catalog, Lakehouse Federation.
  • Ability to work collaboratively with cross functional teams to understand objectives, gather automation requirements, write technical specifications, and perform in a lead role.
  • Experience with Kafka.
  • Excellent communication skills and a proven ability to collaborate or contribute to technical debate and design choices with a variety of team members.
  • High school diploma or equivalent.
  • Minimum age of 18.
  • Must be authorized to work in the U.S.
Preferred
  • Familiarity with Azure, MLflow.
  • Certifications such as Databricks Certified Data Engineer Professional or Azure Solutions Architect Expert.
  • Experience in Agile (Scrum) or Kanban development methodologies.
  • Experience estimating effort and establishing timelines for projects.
  • Experience conveying knowledge to diverse groups of people, such as classes, brown bag meetings, or seminars to ensure a consistent application of standards is established.
Job-Specific Leadership Expectations

Embody our values to own safety, do the right thing, be caring and kind, and deliver performance.

Salary Range

$141,250-$211,900 / year

Salary Details

Pay will be based on multiple factors, including and not limited to location, relevant experience/level and skillset while balancing internal equity relative to other Alaska/Hawaiian/Horizon employees. Alaska/Hawaiian/Horizon is committed to fair, unbiased compensation along with competitive benefits in all locations in which we operate.

Note: We don’t typically hire at the top of the range.

Total Rewards

Alaska Airlines, Hawaiian Airlines and Horizon Air pay and benefits can vary by company, location, number of regularly scheduled hours worked, length of employment, and employment status.

  • Free stand‑by travel privileges on Alaska Airlines, Hawaiian Airlines & Horizon Air
  • Comprehensive well‑being programs including medical, dental and vision benefits
  • Generous 401k match program
  • Annual bonus plans
  • Generous holiday and paid time off

For more information about Alaska/Hawaiian/Horizon Total Rewards please visit our career site and view benefits.

Regulatory Information

Equal Employment Opportunity Policy Statement It is the policy of Alaska Airlines, Hawaiian Airlines and Horizon Air to comply with all applicable federal, state and local laws governing nondiscrimination in employment and to ensure equal opportunity in all terms, conditions, and benefits of employment or potential employment.

We also prohibit discrimination and harassment against any employee or applicant for employment because of race, color, religion, sex, national origin, age, disability, veteran status, genetic information and other legally protected categories.

We have established an EEO Compliance Program under Section 503 of the Rehabilitation Act of 1973 (“Section 503”) and the Vietnam Era Veteran’s Readjustment Assistance Act of 1974 (“VEVRAA”). All applicants and employees are treated without regard to their race, color, religion, sex, national origin, disability or protected veteran status. In addition, we have established an audit and reporting system to allow for effective measurement of its equal employment opportunity activities.

To implement this policy, we will:

(1) Recruit, hire, train and promote qualified persons in all job titles, without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information and any other legally protected categories;

(2) Ensure that employment decisions are based only on valid job requirements; and

(3) Ensure that all personnel actions and employment activities such as compensation, benefits, promotions, layoffs, return from layoff, Alaska Airlines, Hawaiian Airlines and Horizon Air sponsored programs, and tuition assistance will be administered without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information and other legally protected categories.

Employees and applicants for employment will not be subjected to harassment, intimidation, threats, coercion or discrimination because they have engaged or may engage in (1) filing a complaint, (2) opposing any act or practice made unlawful by, or exercising any other right protected by, any Federal, State or local law requiring equal opportunity, including Section 503 and the equal opportunity provisions of VEVRAA, or (3) assisting or participating in any investigation, compliance evaluation, hearing, or any other activity related to the administration of any Federal, State or local law requiring equal opportunity, including Section 503 and the equal opportunity provisions of

VEVRAA.

Government Contractor & Department of Transportation (DOT) RegulationsAlaska Airlines, Hawaiian Airlines & Horizon Air are regulated by the Department of Transportation (DOT – regulations, 49 CFR part 40) and all applicants are advised that post-offer and/or pre-employment drug testing will be conducted to determine the presence of marijuana, cocaine, opioids, phencyclidine (PCP) and amphetamines or a metabolite of these drugs prior to any offer or employment or transfer into a safety-sensitive position. Failure to submit to testing or positive indications of drug use will render the applicant ineligible for employment with Alaska Airlines/Hawaiian Airlines/Horizon Air and any employment offer will be withdrawn.

FLSA Status

Exempt

Employment Type

Full-Time

Regular/Temporary

Regular

Requisition Type

Management

Location

Seattle - Hub

L:

#LI-B

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Databricks Engineer
Principal Databricks Engineer

Alaska Air Group • SeaTac (WA)

On-site
USD 141,000 - 212,000
Free stand-by travel privileges
Comprehensive well-being programs
Generous 401k match
+2
Principal Artificial Intelligence Software Engineer
Principal Artificial Intelligence Software Engineer

Alaska Airlines • SeaTac (WA)

On-site
USD 141,000 - 212,000
Free stand-by travel privileges
Comprehensive well-being programs
Generous 401k match program
+2
Principal Artificial Intelligence Software Engineer
Principal Artificial Intelligence Software Engineer

Alaska Air Group • SeaTac (WA)

On-site
USD 141,000 - 212,000
AI Manager
AI Manager

Alaska Airlines • SeaTac (WA)

On-site
USD 150,000 - 224,000
Free stand-by travel privileges
Comprehensive well-being programs
Generous 401k match
Senior Artificial Intelligence Software Engineer
Senior Artificial Intelligence Software Engineer

Alaska Airlines, Inc. • SeaTac (WA)

On-site
USD 118,000 - 177,000
Stand-by travel privileges
Well-being programs
401k match
+2
Principal Software Engineer
Principal Software Engineer

Alaska Airlines, Inc. • SeaTac (WA)

On-site
USD 141,000 - 212,000
Free stand-by travel privileges
Comprehensive well-being programs
Generous 401k match
+2
Principal Artificial Intelligence Software Engineer
Principal Artificial Intelligence Software Engineer

Alaska Airlines • SeaTac (WA)

On-site
USD 141,000 - 212,000
Travel perks
Well-being benefits
401k match
+2
Director Corporate Sales
Director Corporate Sales

Alaska Airlines, Inc. • Burlingame (CA)

On-site
USD 188,000 - 292,000
Free stand-by travel privileges
Travel credits provided annually
Medical, dental and vision benefits
+3
AI Manager
AI Manager

Alaska Air Group • SeaTac (WA)

On-site
USD 150,000 - 224,000
Free standby travel privileges
Comprehensive well-being programs
Generous 401k match
+2
Director Corporate Sales
Director Corporate Sales

Alaska Airlines • SeaTac (WA)

On-site
USD 173,000 - 267,000
Free stand-by travel privileges
Travel credits
Comprehensive well-being programs
+3