Senior Data Engineer - Basis Tech

Blue.cloud Inc; United States; Remote; USD 110,000 - 160,000; Full time

Job summary

A leading company in data solutions is seeking a Senior Data Engineer with expertise in Apache Airflow and AWS EMR. You will be responsible for developing and managing data workflows, ensuring efficiency in scheduling and deployment. This role offers an exciting opportunity to work with advanced tools in a dynamic environment.

Qualifications

• Must have experience in Apache Airflow.
• Knowledge of AWS EMR is essential.
• Snowflake experience is preferable.

Responsibilities

• Install and configure all components of Airflow.
• Develop necessary DAGs and handle deployment.
• Manage dependencies and monitoring of workflows.

Skills

Airflow

AWS

Data Workflow Management

Job description

Nearshore (onshore and offshore can be backup if needed)

EMR airflow support (scheduling) (Senior Data Engineer with Apache Airflow and AWS EMR experience, Snowflake preferable)

• Senior Data Engineer with Airflow experience (this is must). Should have knowledge of AWS EMR.
• The data engineer should have knowledge in creating EMR job flows, start EMR notebook execution etc.
• AWS knowledge is must.
• Airflow will be used for scheduling.
• Senior Data Engineer will be responsible for installing and configuring all components of Airflow.
• Develop necessary DAGs and handle the deployment of all Airflow components.
• Managing dependencies, scheduling, and monitoring of data workflows.
• Snowflake knowledge is preferable.