Senior Azure Data Engineer: Cloud Data Lake & Pipelines

Native American Talent; Madison (WI); Remote; USD 103,000 - 117,000; Part time

Job summary

Native American Talent seeks a Senior Azure Data Engineer to modernize an enterprise data platform by migrating on-premises data warehouses to an Azure cloud data lake. You will design and build scalable data pipelines with Databricks and Data Factory, shaping data architecture and driving best practices across the team.

The role emphasizes hands-on development combined with guidance on solution design, data quality, and performance optimization in a remote, contract-to-hire setting.

Qualifications

• Strong hands-on data engineering experience in enterprise environments.
• Demonstrated experience with Azure Databricks and Azure Data Factory.
• Proficient in SQL and Python or PySpark.
• Experience designing and developing batch data pipelines and ETL/ELT workflows.
• Experience implementing data-quality, data-validation, and reconciliation processes.
• Knowledge of medallion/lakehouse architecture (Bronze/Silver/Gold).
• Experience with relational databases and large datasets.
• Understanding of data modeling, schema design, partitioning, and performance optimization.
• Experience with Git and CI/CD practices.

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Migrate data and ETL workloads from on-premises Oracle and DataStage to Azure cloud data lake.
• Develop scalable ingestion, transformation, and data-processing solutions.
• Implement medallion architecture across Bronze, Silver, Gold layers.
• Incorporate data-quality checks and validation into pipelines and workflows.
• Automate validation and testing to improve data product reliability.
• Guide architectural discussions and engineering standards.
• Troubleshoot pipeline failures and data-quality issues.
• Collaborate with engineers, analysts, architects, and stakeholders to translate requirements into data solutions.
• Participate in code reviews, documentation, testing, deployment, and continuous-improvement.

Skills

SQL

Python/PySpark

Data engineering

ETL/ELT

CI/CD

Git

Azure architecture

Analytical thinking

Tools

Azure Databricks

Azure Data Factory

Job description

Native American Talent seeks a Senior Azure Data Engineer to modernize an enterprise data platform by migrating on-premises data warehouses to an Azure cloud data lake. You will design and build scalable data pipelines with Databricks and Data Factory, shaping data architecture and driving best practices across the team.

The role emphasizes hands-on development combined with guidance on solution design, data quality, and performance optimization in a remote, contract-to-hire setting.