Data Engineer

Creative Chaos; Pakistan; Remote; PKR 1,800,000 - 3,000,000; Full time

Benefits offered by this job

Paid Time Off

Work From Home

Health Insurance

OPD

Training and Development

Job summary

Creative Chaos is seeking a highly skilled Data Engineer with extensive experience in Azure Data Lake to architect, develop, and optimize data pipelines for large datasets. You will design robust pipelines and ensure data quality while collaborating with cross-functional teams to deliver scalable analytics solutions.

The ideal candidate has 5+ years of Data Engineering experience, strong Python/SQL skills, and hands-on experience with Azure Data Factory, Synapse, and Data Lake Storage.

Qualifications

• Bachelor's degree in CS, IT, or related field.
• 5+ years of experience as a Data Engineer focusing on Azure Data Lake.
• Strong skills in Python, SQL, and data warehousing concepts.

Responsibilities

• Design, develop, and optimize data pipelines within Azure Data Lake.
• Integrate and transform data from multiple sources for analytics.
• Ensure data quality, governance, and reliable data processing workflows.
• Collaborate with cross-functional teams to meet data requirements.
• Document architecture and monitor performance of data workflows.

Skills

Azure Data Lake

Python

SQL

Data modeling

ETL processes

Communication

Education

Bachelor's degree in Computer Science or IT

Tools

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake Storage

Job description

We are seeking a highly skilled Data Engineer with extensive experience in Azure Data Lake to contribute to our dynamic team at Creative Chaos. The ideal candidate will be responsible for architecting, developing, and optimizing data pipelines that will facilitate the efficient processing of large datasets.

Responsibilities:

• Designing and implementing robust data pipeline solutions within Azure Data Lake.
• Integrating and transforming data from various sources to enable comprehensive analytics and reporting.
• Ensuring data quality and integrity, implementing data governance practices.
• Collaborating with cross-functional teams to understand data requirements and develop scalable solutions.
• Monitoring and optimizing data processing workflows for performance and reliability.
• Documenting processes and architecture to ensure maintainability and scalability.
• Staying abreast of new Azure technologies and best practices for data engineering.

Requirements

The successful candidate will possess the following qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• A minimum of 5 years of experience working as a Data Engineer, with a strong emphasis on Azure Data Lake.
• Proficiency in Azure Data Services, particularly Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics.
• Demonstrated experience with data modeling, ETL processes, and data warehousing solutions.
• Strong programming skills in Python, SQL, and familiar with Java or C#.
• Excellent problem-solving skills and a detail-oriented approach to work.
• Ability to communicate technical concepts clearly to non-technical stakeholders.
• Strong organizational skills with the ability to manage multiple priorities and meet deadlines.

Benefits

Perks & benefits

• Paid Time Off
• Work From Home
• Health Insurance
• OPD
• Training and Development