Senior Azure Data Engineer - Data Lake Pipelines (Remote)

Creative Chaos; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Paid Time Off

Work From Home

Health Insurance

OPDTraining and Development

Job summary

Creative Chaos is seeking a skilled Data Engineer with extensive Azure Data Lake experience to architect, develop, and optimize data pipelines for large datasets. You will design robust pipeline solutions, integrate diverse data sources, and ensure data quality and governance.

Ideal candidates have 5+ years in data engineering, strong Python and SQL skills, and hands-on experience with Azure Data Lake Storage, Data Factory, and Synapse Analytics.

Qualifications

• Bachelor's degree in Computer Science, IT, or related field.
• Minimum 5 years of experience as a Data Engineer with Azure Data Lake.
• Proficiency in Azure Data Services: Data Lake Storage, Data Factory, Synapse.
• Strong Python and SQL skills; familiarity with Java or C#.
• Excellent problem-solving and stakeholder communication.

Responsibilities

• Design and implement robust data pipeline solutions within Azure Data Lake.
• Integrate and transform data from various sources to enable analytics and reporting.
• Ensure data quality and integrity with governance practices.
• Collaborate with cross-functional teams to understand data requirements and develop scalable solutions.
• Monitor and optimize data processing workflows for performance and reliability.
• Document processes and architecture to ensure maintainability and scalability.
• Stay abreast of new Azure technologies and best practices for data engineering.

Skills

Python

SQL

Data modeling

ETL processes

Communication

Education

Bachelor's degree in Computer Science, IT, or related field

Tools

Azure Data Lake Storage

Azure Data Factory

Azure Synapse Analytics

Java

C#

Job description

Creative Chaos is seeking a skilled Data Engineer with extensive Azure Data Lake experience to architect, develop, and optimize data pipelines for large datasets. You will design robust pipeline solutions, integrate diverse data sources, and ensure data quality and governance.

Ideal candidates have 5+ years in data engineering, strong Python and SQL skills, and hands-on experience with Azure Data Lake Storage, Data Factory, and Synapse Analytics.