Data Engineer

Ledelsea; Minnesota; On-site; USD 120,000 - 160,000; Full time

Job summary

Ledelsea seeks a senior data engineer to design, build, and optimize data lakes and databases in Azure. You will craft scalable data pipelines, and ensure efficient access patterns while maintaining thorough documentation.

You will mentor teammates, coordinate with security-focused teams, and help integrate cloud tooling and CI/CD practices. Oracle and Databricks experience is valued.

Qualifications

• Design, develop, and implement data lakes and databases in Azure.
• Experience with Databricks and Oracle databases is preferred.
• Strong ability to develop data transformations and integrate cloud infrastructure.
• Proficient in loading data via Azure data load utilities and scripting.

Responsibilities

• Develop and implement relational and non-relational databases in Azure.
• Develop and implement data transformations and optimize access patterns.
• Maintain documentation and ensure security standards across teams.
• Mentor colleagues and provide knowledge transfer on technologies.

Skills

Data lake design

Azure cloud concepts

Data transformation development

Mentoring others

Security & compliance awareness

Time management

Tools

Azure Databricks

Azure Data Factory

Azure Monitor

Azure CLI/PowerShell

Azure SQL/Managed Instances

Teradata Data Warehouse

Job description

• Develop and implement relational and non-relational databases in Azure.
• Develop and implement data transformations.
• Ensure data access patterns are optimized.
• Maintain necessary documentation.
• Coordinate with necessary teams to meet security standards.
• Provide knowledge transfer.

Qualifications

• Experience with designing, developing, and implementing data lakes and relational and non-relational databases in Azure.
• Experience with Databricks.
• Experience with Oracle databases.
• Strong experience developing and implementing data transformation solutions and cloud infrastructure integration.
• Strong experience coding and testing programs and scripts to load data using Azure data load utilities.
• Strong experience with CI/CD pipelines.
• Experience with cloud computing concepts.
• Experience with tools such as Azure Monitor, Azure Data Factory, SQL Analytics, Query Performance Insight, Azure Resource Manager, and Azure CLI/PowerShell for infrastructure management.
• Experience in mentoring others in the needed technologies.
• Experience developing and implementing backup and recovery strategies using tools such as Azure Backup or Geo-replication.
• Experience with role-based access control, encryption, and network security.
• Strong organizational and time management skills.
• Desired 15 years’ experience designing, developing, and implementing data lakes and relational and non-relational databases in Azure.
• Knowledge of data concepts, data modeling, schema design, and indexing strategies.
• Knowledge of Azure SQL instances, managed instances, and elastic pools.
• Knowledge of Data Warehouse Administration and Teradata Data Warehouse.