Senior Data Engineer

Blue.cloud; Remote; USD 60,000 - 80,000; Full time

Job summary

A leading cloud solutions provider in the United States is seeking a Senior Data Engineer. The ideal candidate must have strong experience with Apache Airflow and AWS EMR. Knowledge of Snowflake is preferable. The role includes responsibilities for installing, configuring, and developing data workflows using Airflow. This is a great opportunity for engineers looking to advance their career in a dynamic environment.

Qualifications

• Experience as a Senior Data Engineer with a focus on Apache Airflow.
• Strong background in AWS EMR and Snowflake is a plus.

Responsibilities

• Install and configure all components of Airflow.
• Develop necessary DAGs and manage deployment of Airflow components.
• Handle scheduling and monitoring of data workflows using Airflow.

Skills

Airflow experience

AWS knowledge

Snowflake knowledge

Job description

Overview

Nearshore (onshore and offshore can be backup if needed) EMR airflow support (scheduling). Senior Data Engineer with Apache Airflow and AWS EMR experience; Snowflake preferable.

Responsibilities

• Senior Data Engineer with Airflow experience (this is must). Should have knowledge of AWS EMR.
• The data engineer should have knowledge in creating EMR job flows, start EMR notebook execution etc.
• AWS knowledge is must.
• Airflow will be used for scheduling.
• Senior Data Engineer will be responsible for installing and configuring all components of Airflow.
• Develop necessary DAGs and handle the deployment of all Airflow components.
• Managing dependencies, scheduling, and monitoring of data workflows.
• Snowflake knowledge is preferable.