Data Engineer - Real-Time Analytics on Microsoft Fabric

Vagaro; Pleasanton (CA); On-site; USD 135,000 - 150,000; Full time

Benefits offered by this job

Health insurance

15 days PTO

Discounted tickets via TicketsAtWork

Onsite gym

Job summary

Vagaro is hiring a Data Engineer to design and maintain scalable data architectures on the Microsoft Fabric platform. You will lead ETL/ELT pipelines, establish data governance, and enable real-time analytics across ML and BI initiatives.

Based onsite in Pleasanton, CA, you will collaborate with Data Science, BI, and software teams to deliver enterprise-grade data solutions. Ideal candidates have 3–5 years of data engineering experience, strong SQL and Python skills, and hands-on Azure Fabric

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related technical field.
• 3-5 years of experience as a Data Engineer or similar role.
• Experience designing and maintaining enterprise-scale ETL/ELT solutions.
• Hands-on experience with Microsoft Fabric, including data migration projects.
• Strong experience with relational and NoSQL databases.
• Experience building modern cloud-based data platforms in Azure.
• Experience with DevOps practices, CI/CD pipelines, and Infrastructure as Code.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and store data from various sources.
• Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
• Monitor, troubleshoot, and resolve data pipeline failures and performance issues.
• Develop reusable Python libraries and frameworks to standardize data engineering solutions.
• Build and maintain CI/CD pipelines to automate deployment, testing, and release processes.
• Collaborate with Data Scientists, BI teams, and engineers to deliver reliable data infrastructure.

Skills

SQL

Python

Data modeling

Dimensional modeling

REST APIs

NoSQL

Azure data lake

Delta Lake

Parquet

Pandas

Spark

CI/CD

RESTful data integration

GitHub Actions

Docker

Kubernetes

Education

Bachelor's or Master's in CS/IS/Engineering

Tools

Microsoft Fabric

Azure

Azure DevOps

GitHub Actions

PySpark

Job description

Vagaro is hiring a Data Engineer to design and maintain scalable data architectures on the Microsoft Fabric platform. You will lead ETL/ELT pipelines, establish data governance, and enable real-time analytics across ML and BI initiatives.

Based onsite in Pleasanton, CA, you will collaborate with Data Science, BI, and software teams to deliver enterprise-grade data solutions. Ideal candidates have 3–5 years of data engineering experience, strong SQL and Python skills, and hands-on Azure Fabric