Remote Data Engineer - AWS Athena & Airflow Pipelines

Talentify; Cupertino (CA); Remote; USD 85,000 - 120,000; Full time

Job summary

INSPYR Solutions is seeking a Junior Data Engineer to support a confidential health sector project. This remote (California) role focuses on modernizing data pipelines, optimizing metric computation, and enabling scalable analytics through cloud-based solutions.

You will overhaul Airflow pipelines, optimize metrics with AI scanning, and implement automated metrics extraction. Strong SQL/Python skills and experience with AWS services are essential for success.

Qualifications

• 3+ years experience as a Data Engineer supporting complex environments.
• Hands on experience with AWS services, specifically Athena and Airflow for Python, plus familiarity with Github and Apache Spark.
• Strong programming skills in SQL, Python and Pandas for writing code.
• AI Agentic Coding experience to support day to day productivity for production at scale; preferably creating and integrating MCPs with Claude Code, Gemini, Copilot.

Responsibilities

• Airflow pipeline overhaul including Athena integration and source-controlled SQL.
• Metric job optimization using AI-driven code scans and Spark evaluation.
• Automated metrics extraction using AI-based code sweeps and v1 metrics catalog generation.

Skills

Data engineer experience

AWS Athena

Airflow

Github

Apache Spark

SQL

Python

Pandas

AI coding tools

Tools

Airflow

Athena

Github

Apache Spark

Claude Code

Gemini

Copilot

Concourse CI

AWS Glue

Job description

INSPYR Solutions is seeking a Junior Data Engineer to support a confidential health sector project. This remote (California) role focuses on modernizing data pipelines, optimizing metric computation, and enabling scalable analytics through cloud-based solutions.

You will overhaul Airflow pipelines, optimize metrics with AI scanning, and implement automated metrics extraction. Strong SQL/Python skills and experience with AWS services are essential for success.