Azure Cloud Data Engineer: Build Scalable Data Pipelines

Kavaliro; Napa (CA); On-site; USD 115,000 - 152,000; Full time

Job summary

Kavaliro is seeking a Cloud Data Engineer for a direct-hire opportunity in California. The role focuses on designing, implementing, and managing data solutions on Microsoft Azure and other cloud platforms, building scalable pipelines, storage, and data processing to enable data-driven decisions.

You will collaborate with analysts and stakeholders, ensure data quality and security, mentor IT staff, and support continuous learning in cybersecurity, while managing relationships with the System

Qualifications

• Bachelor’s degree in computer science or a closely related field.
• Minimum five+ years of Azure migration experience.
• Proven experience with Python and SQL for data processing.
• Experience with Azure components like Data Factory, Databricks, Data Lake Storage, SQL DW and PySpark.
• ETL in a data warehouse environment and big data pipeline optimization.
• Ability to multitask in a fast-paced setting and collaborate with vendors.

Responsibilities

• Design and implement scalable data processing pipelines and storage environments in cloud services.
• Collaborate with analysts and stakeholders to understand data requirements and deliver solutions.
• Ensure data is cleansed, transformed, and optimized for storage and analysis.
• Build data pipelines and workflows for data ingestion, processing, and distribution.
• Load transformed data into data warehouses and analytics applications.
• Monitor and troubleshoot the data environment for high availability and performance.
• Provide on-call support for critical production systems.
• Implement data security measures including encryption, access controls, and auditing.
• Use analytics services to provide actionable insights for decision-making.
• Maintain documentation on data procedures, systems, and architectures.
• Mentor IT staff on security best practices and emerging technologies.
• Collaborate on technology plans to enhance security posture and SI relationships.
• Review Statements of Work, deliverables, and invoices; measure SI performance against KPIs/SLAs.

Skills

Python

SQL

Azure Data Factory

Databricks

Data Lake Storage

SQL DW

Analysis Services

PySpark

ETL

Big data pipelines

JIRA

Education

Bachelor's degree in Computer Science or related field

Tools

JIRA

Job description

Kavaliro is seeking a Cloud Data Engineer for a direct-hire opportunity in California. The role focuses on designing, implementing, and managing data solutions on Microsoft Azure and other cloud platforms, building scalable pipelines, storage, and data processing to enable data-driven decisions.

You will collaborate with analysts and stakeholders, ensure data quality and security, mentor IT staff, and support continuous learning in cybersecurity, while managing relationships with the System