Data Engineer - Real-Time Pipelines on Microsoft Fabric

Vagaro; Pleasanton (CA); On-site; USD 135,000 - 150,000; Full time

Benefits offered by this job

Health & Wellness plans

Onsite gym

TicketsAtWork discounts

401k with 4% match

Job summary

Vagaro in Pleasanton, CA is seeking a Data Engineer to design and maintain enterprise data architectures on the Microsoft Fabric platform. You will lead ETL/ELT pipelines and data governance to enable real-time analytics and ML model training.

This onsite role collaborates with Data Science, BI, and engineering teams to deliver scalable data solutions and ensure data quality across sources. A strong background in Azure-based data platforms is required.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related technical field.
• 3-5 years of experience as a Data Engineer or similar role.
• Hands-on experience with Microsoft Fabric, including data migration projects.
• Strong experience with relational and NoSQL databases.
• Experience building modern cloud-based data platforms in Azure (AWS or GCP experience is also beneficial).
• Experience with DevOps practices, CI/CD pipelines, and Infrastructure as Code.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines from diverse data sources.
• Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
• Monitor and resolve data pipeline issues.
• Develop reusable Python libraries and frameworks.
• Build and maintain CI/CD pipelines for deployment, testing, and release.
• Integrate with REST APIs to ingest and process external data.
• Design and maintain Fabric warehouses, lakehouses, semantic models, and data pipelines.
• Define Fabric architecture, workspace strategy, security, and governance.
• Collaborate with Data Scientists, BI teams, and stakeholders to deliver data solutions.
• Participate in architecture reviews, code reviews, and mentoring.

Skills

SQL

Python

PySpark

Pandas

Spark

Data Modeling

Azure

REST APIs

NoSQL

CI/CD

Education

Bachelor's or Master's in Computer Science, Information Systems, Engineering

Tools

Microsoft Fabric

Docker

Kubernetes

Azure Data Lake Storage

Delta Lake

Parquet

SQL Server

MongoDB

Elasticsearch

Azure DevOps

GitHub Actions

Job description

Vagaro in Pleasanton, CA is seeking a Data Engineer to design and maintain enterprise data architectures on the Microsoft Fabric platform. You will lead ETL/ELT pipelines and data governance to enable real-time analytics and ML model training.

This onsite role collaborates with Data Science, BI, and engineering teams to deliver scalable data solutions and ensure data quality across sources. A strong background in Azure-based data platforms is required.