Data Engineer

Talentify; Cupertino (CA); Remote; USD 85,000 - 120,000; Full time

Job summary

INSPYR Solutions is seeking a Junior Data Engineer to support a confidential health sector project. This remote (California) role focuses on modernizing data pipelines, optimizing metric computation, and enabling scalable analytics through cloud-based solutions.

You will overhaul Airflow pipelines, optimize metrics with AI scanning, and implement automated metrics extraction. Strong SQL/Python skills and experience with AWS services are essential for success.

Qualifications

• 3+ years experience as a Data Engineer supporting complex environments.
• Hands on experience with AWS services, specifically Athena and Airflow for Python, plus familiarity with Github and Apache Spark.
• Strong programming skills in SQL, Python and Pandas for writing code.
• AI Agentic Coding experience to support day to day productivity for production at scale; preferably creating and integrating MCPs with Claude Code, Gemini, Copilot.

Responsibilities

• Airflow pipeline overhaul including Athena integration and source-controlled SQL.
• Metric job optimization using AI-driven code scans and Spark evaluation.
• Automated metrics extraction using AI-based code sweeps and v1 metrics catalog generation.

Skills

Data engineer experience

AWS Athena

Airflow

Github

Apache Spark

SQL

Python

Pandas

AI coding tools

Tools

Airflow

Athena

Github

Apache Spark

Claude Code

Gemini

Copilot

Concourse CI

AWS Glue

Job description

Data Engineer
Location: Remote (California)

ABOUT THIS FEATURED OPPORTUNITY

We are seeking a Junior Data Engineer to support a confidential project within the Health sector. This role will focus on modernizing data pipelines, optimizing metric computation, and enabling scalable analytics through cloud-based solutions.

THE OPPORTUNITY FOR YOU

Airflow pipeline overhaul

• Build out of Athena Operator support for Airflow jobs
• Custom SQL hidden in QuickSight moved under source control
• Compute moved to AWS Athena where possible
• Correct operators used for Python jobs
• Rebuild of Airflow testing process to remove need for separate Airflow testing for query-only updates

Metric job optimization

• AI-driven scan of code to look for improvement opportunities
• Investigation of whether and when to use Spark

Automated metrics extraction

• AI-based sweep of code to build text-based metrics descriptors
• Generation of v1 metrics catalog pulling from metric descriptors

KEY SUCCESS FACTORS (Top Must-Have Skills)

1. 3+ years experience as a Data Engineer supporting complex enviroments
2. Hands on experience with AWS services, specifically Athena and managed Airlfow for using Python, plus familiarity with Github, and Apache Spark
3. Strong programming skills in SQL, Python and Pandas for writing code
4. AI Agentic Coding experience, to support day to day productivity for production at scale, day to day use not something you use on the side for fun. Preferably skill creating and integrating custom MCPs. Claude Code, Gemini, Copilot, or any similar tool will suffice.

NICE TO HAVES

1. Experience with CI/CD tools such as Concourse CI or similar pipelines
2. Familiarity with AWS Glue
3. Experience with medical care delivery data

About INSPYR Solutions

Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.

INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, or any other protected status. INSPYR Solutions complies with all applicable laws governing nondiscrimination in employment in every location in which the company has facilities.

Applicants requiring reasonable accommodation during the application or interview process should contact [e-mail] for assistance.

Information collected and processed through your application with INSPYR Solutions (including any job applications you choose to submit) is subject to INSPYR Solutions' Privacy Policy and INSPYR Solutions' AI and Automated Employment Decision Tool Policy: https://www.inspyrsolutions.com/policies/. By submitting an application, you are consenting to being contacted by INSPYR Solutions through phone, email, or text.