SUMMARY
The Data Engineer owns the end‑to‑end data platform, building high‑scale pipelines, optimizing cloud resources, and ensuring that analysts and executives have trusted, timely data. The role drives architecture decisions, mentors junior engineers, and champions Python and PySpark best practices across the organization.
ESSENTIAL DUTIES AND RESPONSIBILITIES
- Design, build, and maintain scalable data pipelines in Databricks (Spark SQL, PySpark, Delta Lake).
- Stand up and manage Azure resources (Data Lake Storage, Azure Key Vault, ADF/Synapse, Databricks workspaces).
- Partner with business and technical leaders to capture analytic requirements and translate them into robust ETL workflows and scalable data infrastructure.
- Use Databricks Workflows or similar orchestration tools to schedule jobs, manage dependencies, and implement data quality checks.
- Optimize data models for analytics, reporting, and machine‑learning workloads.
- Implement CI/CD workflows (Git, Azure DevOps) and automated testing for code deployments.
- Monitor pipeline performance, cost, and data quality; drive continuous improvement.
- Document technical designs and mentor analytic team members on SQL, Python, and Spark best practices.
- Experience with implementing automated data delivery solutions using Databricks and Azure.
- Help define access controls, sensitive data handling, and governance standards using Unity Catalog and Databricks best practices.
EDUCATION, EXPERIENCE, AND SKILLS REQUIRED
- 4+ years in data engineering or related roles.
- Expert‑level Python and advanced SQL (PostgreSQL/Spark‑SQL).
- Production experience with Databricks, Spark (batch & streaming), and Delta Lake.
- Proven success configuring and securing Azure data services (Storage, Networking).
- Hands‑on experience with REST/Graph APIs and real‑time data ingestion pipelines.
- Strong communication skills and a track record of owning mission‑critical data systems.
PREFERRED SKILLS AND ABILITIES
- Bachelor’s or Master’s in Computer Science, Data Engineering, or related field.
- Azure certifications (DP‑203, AZ‑305) or Databricks Data Engineer Professional.
- Experience with BI tools (Tableau or Power BI) and Excel.
- Familiarity with Azure VMs and SSRS.
COMPENSATION
The compensation range for this role is $125,000 - $140,000 depending on experience. Pay may vary by location, and actual compensation depends on factors such as qualifications, experience, skills, and business needs. Sono Bello may adjust this range in the future.
BENEFITS
- Medical, Dental, Vision, Life Insurance
- 401(k) with match, EAP, PTO, paid holidays, equity, and parental leave
LOCATION
Greater Seattle Area. This position is based on‑site.