Databricks Data Engineer | PySpark, Delta Lake, Azure

BuzzClan LLC; Beaverton (OR); On-site; USD 120,000 - 170,000; Full time

Job summary

BuzzClan LLC seeks a Data Engineer with strong Databricks expertise to design, build, and maintain scalable enterprise data pipelines and data engineering solutions. The role demands hands-on work with Databricks, PySpark, Spark SQL, Delta Lake, Python, and SQL, plus cloud experience across Azure, AWS, or GCP, with Azure preferred.

The candidate will implement data modeling, data warehousing, and performance optimization while collaborating with business stakeholders and cross-functional teams.

Qualifications

• 6+ years of overall IT experience.
• 5+ years of Data Engineering experience.
• Strong hands-on with Databricks.
• Proficient in PySpark, Spark SQL, and Delta Lake.
• Strong programming in Python and SQL.
• Experience with cloud platforms (Azure/AWS/GCP), preferably Azure.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines and enterprise data solutions.
• Develop and optimize data processing using Databricks, PySpark, Spark SQL, and Delta Lake.
• Build reliable data pipelines using Python and SQL with performance in mind.
• Implement data integration and transformation across various enterprise sources.
• Work with cloud platforms (Azure, AWS, GCP), with Azure preferred.
• Develop and manage data workflows using orchestration tools like Azure Data Factory and/or Airflow.
• Apply data modeling and warehousing best practices; optimize performance.
• Implement data quality, scalability, reliability, and performance improvements across platforms.
• Collaborate with stakeholders, data architects, and developers to deliver enterprise data solutions.

Job description

BuzzClan LLC seeks a Data Engineer with strong Databricks expertise to design, build, and maintain scalable enterprise data pipelines and data engineering solutions. The role demands hands-on work with Databricks, PySpark, Spark SQL, Delta Lake, Python, and SQL, plus cloud experience across Azure, AWS, or GCP, with Azure preferred.

The candidate will implement data modeling, data warehousing, and performance optimization while collaborating with business stakeholders and cross-functional teams.