Data Engineer I (Remote)

Quik Hire Staffing; United Kingdom; Remote; GBP 60,000 - 90,000; Full time

Job summary

Quik Hire Staffing is seeking a Data Engineer for a full-time remote role focusing on building and optimizing data pipelines to ensure efficient data flow between systems. You will design, construct, load, and optimize data structures and databases to support analytics and business intelligence initiatives.

You'll design scalable pipelines, enable real-time and batch processing, collaborate with cross-functional teams, and implement data quality checks while troubleshooting issues to minimize

Qualifications

• Proficiency in Python and SQL with Airflow or similar.
• Experience with cloud platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, or Redshift).
• Strong ETL and data modeling knowledge.
• Familiarity with Kafka or Spark Streaming is a plus.
• Ability to work independently in a remote environment.

Responsibilities

• Design, develop, and maintain scalable data pipelines to ingest, process, and transform large datasets.
• Build and optimize data infrastructure to support real-time and batch processing workflows.
• Collaborate with cross-functional teams to identify data requirements and ensure alignment with business goals.
• Implement data quality checks and monitoring to maintain accuracy and reliability of data assets.
• Troubleshoot and resolve issues in data pipelines, ensuring minimal downtime and maximum efficiency.

Skills

Python

SQL

Airflow

ETL

Data modeling

Kafka

Spark Streaming

Remote work

Tools

Apache Airflow

Snowflake

BigQuery

Redshift

Kafka

Spark Streaming

AWS

GCP

Azure

Job description

We are hiring for one of our clients, seeking a Data Engineer to work on a Full-Time basis. The role focuses on building and optimizing data pipelines to ensure efficient data flow between systems. You will design, construct, load, and optimize data structures and databases. Responsibilities include integrating data from various sources to support analytics and business intelligence initiatives.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines to ingest, process, and transform large datasets.
• Build and optimize data infrastructure to support real-time and batch processing workflows.
• Collaborate with cross-functional teams to identify data requirements and ensure alignment with business goals.
• Implement data quality checks and monitoring to maintain accuracy and reliability of data assets.
• Troubleshoot and resolve issues in data pipelines, ensuring minimal downtime and maximum efficiency.

Required Skills & Qualifications:

• Proficiency in Python, SQL, and experience with data pipeline frameworks such as Apache Airflow or similar.
• Experience with cloud platforms (AWS, GCP, or Azure) and data warehousing solutions (Snowflake, BigQuery, or Redshift).
• Strong understanding of ETL processes and data modeling techniques.
• Familiarity with stream processing technologies (Kafka, Spark Streaming) is a plus.
• Ability to work independently in a remote environment with strong problem-solving skills.

More About the Opportunity:

This role offers a unique opportunity to work with a global leader in the Software Development industry, contributing to the scalability and performance of data systems that drive business decisions. The project involves building robust infrastructure to support high-volume data processing and analytics.

Equal Opportunity Employer:

We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.