Lead Data Engineer- Databricks

Phaxis; Beaverton (OR); On-site; USD 120,000 - 180,000; Full time

Job summary

Phaxis in Beaverton, Oregon is seeking an experienced Data Engineer to design and scale enterprise data pipelines. You will work with Databricks (PySpark, Spark SQL, Delta Lake), Python, and SQL to deliver robust data solutions for the business.

The role requires strong collaboration with cross‑functional teams, data modeling and warehousing expertise, and a focus on performance optimization, CI/CD, and DevOps practices in cloud environments (Azure/AWS/GCP).

Qualifications

• 14+ years IT experience with 10+ years in Data Engineering.
• Hands-on Databricks experience (PySpark, Spark SQL, Delta Lake).
• Strong programming in Python and SQL.
• Experience building scalable ETL/ELT pipelines and data solutions.
• Hands-on with Azure/AWS/GCP, preferably Azure, and orchestration tools (ADF/Airflow).
• Strong data modeling, warehousing and performance optimization skills.
• Experience with Git, CI/CD and DevOps practices.
• Knowledge of Delta Live Tables, Unity Catalog and Structured Streaming is preferred.
• Ability to collaborate with business and cross-functional teams to deliver enterprise data solutions.
• Excellent analytical, problem-solving, and communication skills.

Skills

Databricks

Python

SQL

ETL/ELT pipelines

Cloud platforms

Data modeling

Data warehousing

Performance optimization

Git CI/CD

DevOps

Tools

Azure

AWS

GCP

Airflow/ADF

Delta Live Tables

Unity Catalog

Structured Streaming

Job description

• 14+ yearsof IT experience with10+ yearsin Data Engineering.
• Mandatory hands-on experience in Databricks(PySpark, Spark SQL, Delta Lake).
• Strong programming skills inPythonandSQL.
• Experience building scalableETL/ELT pipelinesand data engineering solutions.
• Hands-on experience withAzure/AWS/GCP, preferably Azure, and orchestration tools (ADF/Airflow).
• Strong understanding ofdata modeling, data warehousing, and performance optimization.
• Experience withGit, CI/CD, and DevOps best practices.
• Knowledge ofDelta Live Tables, Unity Catalog, and Structured Streamingis preferred.
• Ability to collaborate with business and cross-functional teams to deliver enterprise data solutions.
• Excellent analytical, problem-solving, and communication skills.