Senior Data Engineer

Pyramid Technology Solutions Inc.; Alhambra (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

Pyramid Technology Solutions Inc. is seeking a Principal Data Engineer to design, implement, and manage our data infrastructure, ensuring reliability, scalability, and robust analytical capabilities.

The role emphasizes Databricks, data governance, and cross-functional collaboration to deliver high-quality data solutions. The ideal candidate will mentor junior engineers, drive data pipeline development with Python, and lead architectural efforts around Lakehouse patterns while leveraging Azure

Qualifications

• 5+ years of Databricks-focused data engineering experience.
• 5 years developing data pipelines with Python.
• 3+ years designing Databricks medallion Lakehouse architecture with data governance and quality best practices.
• 1 year developing data models.
• 1 year managing Azure resources.
• 1 year automating Azure data resources with DataOps.

Responsibilities

• Design and implement data infrastructure and platforms.
• Provide governance and quality best practices across data workflows.
• Mentor junior data engineers and database administrators.
• Collaborate with stakeholders to deliver analytical solutions.

Skills

Communication skills

Analytical thinking

Business acumen

Time management

Independent work

Mentoring

Tools

Databricks

Python

Azure

Lakehouse architecture

Data governance

Data quality

Data integration

Data warehousing

DataOps

Job description

A Principal Data Engineer is responsible for designing, implementing, and managing the data infrastructure of an organization. The position provides specialized technical expertise in data integration, data quality, data operations, data platform architecture, and data governance to ensure a reliable, scalable, and well-managed analytical environment. Skills: Excellent verbal and written communication skills; customer service orientation; strong analytical & business acumen; Excellent time management and organization abilities; with a proven capacity to handle multiple tasks simultaneously; Highly collaborative, yet capable of working independently with focus and self-direction on projects; Meticulous and dedicated to delivering high-quality work; and effective mentor, providing guidance and support to junior data engineers and database administrators.

Additional Experience Required:

• Five (5) + years of professional work experience specializing in Databricks with significant expertise in data engineering, data integration, data warehousing, and cloud computing.
• Five (5) years of experience in developing data pipelines using Python
• Three (3) + years of experience in designing and developing Databricks medallion Lakehouse architecture, applying data governance, and data quality best practices
• One (1) year of experience in developing data models
• One (1) year of experience in Managing Azure Resources
• One (1) year of experience in automating Azure Data Resources using DataOps