Principal Data Engineer: Databricks & Lakehouse Expert

Pyramid Technology Solutions Inc.; Alhambra (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

Pyramid Technology Solutions Inc. is seeking a Principal Data Engineer to design, implement, and manage our data infrastructure, ensuring reliability, scalability, and robust analytical capabilities.

The role emphasizes Databricks, data governance, and cross-functional collaboration to deliver high-quality data solutions. The ideal candidate will mentor junior engineers, drive data pipeline development with Python, and lead architectural efforts around Lakehouse patterns while leveraging Azure

Qualifications

• 5+ years of Databricks-focused data engineering experience.
• 5 years developing data pipelines with Python.
• 3+ years designing Databricks medallion Lakehouse architecture with data governance and quality best practices.
• 1 year developing data models.
• 1 year managing Azure resources.
• 1 year automating Azure data resources with DataOps.

Responsibilities

• Design and implement data infrastructure and platforms.
• Provide governance and quality best practices across data workflows.
• Mentor junior data engineers and database administrators.
• Collaborate with stakeholders to deliver analytical solutions.

Skills

Communication skills

Analytical thinking

Business acumen

Time management

Independent work

Mentoring

Tools

Databricks

Python

Azure

Lakehouse architecture

Data governance

Data quality

Data integration

Data warehousing

DataOps

Job description

Pyramid Technology Solutions Inc. is seeking a Principal Data Engineer to design, implement, and manage our data infrastructure, ensuring reliability, scalability, and robust analytical capabilities.

The role emphasizes Databricks, data governance, and cross-functional collaboration to deliver high-quality data solutions. The ideal candidate will mentor junior engineers, drive data pipeline development with Python, and lead architectural efforts around Lakehouse patterns while leveraging Azure