Data Engineer

Ventures Unlimited Inc; Saint Paul (MN); On-site; USD 140,000 - 170,000; Full time

Job summary

Ventures Unlimited Inc. seeks a senior data architect to design and implement scalable Azure Data Lake/Data Lakehouse architectures in a W2, 10+ month engagement in St. Paul, MN. You will build Azure SQL databases, manage data migrations, and lead security and governance practices.

You will mentor engineers, develop robust pipelines with CI/CD, and collaborate with analytics teams to optimize data access and performance.

Qualifications

• Extensive experience designing and implementing Azure Data Lakes/Databases.
• Expertise in Azure Databricks, Data Factory and data migration.
• Proficient in building scalable data models and data warehouse concepts.
• Strong security with RBAC, encryption, and network controls.
• Experience with CI/CD pipelines and cloud automation.
• Knowledge of Azure Monitor, SQL Analytics and performance insights.
• Experience with backup/DR and high availability.

Responsibilities

• Design, develop, and implement Azure Data Lakes and Data Lakehouse architectures.
• Build relational and non-relational databases in Azure environments.
• Develop scalable data models and optimize data access patterns.
• Create secure, high-performance, and reliable database solutions.
• Develop data transformation and cloud integration solutions.
• Establish backup, DR, and HA strategies.
• Work with Azure Data Factory, Databricks, Monitor, SQL Analytics, and ARM.
• Develop and support CI/CD pipelines for data platforms.
• Ensure data security through RBAC, encryption, and network controls.
• Create documentation and provide knowledge transfer; mentor team members.

Skills

Azure Data Lakes

Azure SQL Database

Azure Databricks

Azure Data Factory

CI/CD pipelines

RBAC & encryption

Azure Monitor

PowerShell

Data modeling

Data warehouse concepts

Tools

Azure Data Factory

Databricks

Azure Monitor

SQL Analytics

ARM Templates

PowerShell

Job description

• Location: St. Paul, MN
• Duration: 10+ Months
• Employment Type: W2
• Visa: USC / Green Card

Key Responsibilities:

• Design, develop, and implement Azure Data Lakes and Data Lakehouse architecture.
• Build and maintain relational and non-relational databases in Azure.
• Develop scalable data models and optimize data access patterns.
• Design secure, high-performance, and reliable database solutions.
• Develop data transformation and cloud integration solutions.
• Implement backup, disaster recovery, and high-availability strategies.
• Work with Azure Data Factory, Databricks, Azure Monitor, SQL Analytics, and Azure Resource Manager.
• Develop and support CI/CD pipelines.
• Ensure data security using RBAC, encryption, and network security best practices.
• Create technical documentation and provide knowledge transfer.
• Mentor architects and database engineers on Azure technologies.

Required Skills:

• Extensive experience with Azure Data Lakes and Azure SQL Database architecture.
• Strong expertise with Azure Databricks.
• Experience with Azure Data Factory and data migration solutions.
• Experience loading and transforming data using Azure utilities and scripting.
• Experience with CI/CD pipelines.
• Strong knowledge of cloud computing concepts.
• Experience with Azure Monitor, SQL Analytics, Query Performance Insight, Azure CLI, ARM Templates, and PowerShell.
• Experience implementing backup and disaster recovery solutions.
• Strong understanding of RBAC, encryption, and Azure security.
• Knowledge of data modeling, schema design, indexing strategies, Azure SQL Managed Instances, Elastic Pools, and Data Warehouse concepts.
• Experience with Teradata Data Warehouse is a plus.
• 10+ years of experience in Data Architecture or Data Management preferred.