Senior Data Engineer — AI/ML Data Platform (Hybrid, AWS)

NBME; Philadelphia (Philadelphia County); Hybrid; USD 127,000 - 160,000; Full time

Benefits offered by this job

Remote friendly workplace

Healthcare benefits

Dental plan

Vision plans

401(k) with matching

Tuition reimbursement

Commuter benefits

Job summary

NBME is seeking a data engineer to join a skilled team building and expanding a data platform on AWS for medical professionals. The role focuses on data lakes, ETL pipelines, and scalable data solutions supporting analytics, AI/ML, and business decisions.

You will work with data scientists and engineers to deliver high-quality data products, improve data quality, and implement data engineering best practices in a hybrid environment centered in Philadelphia.

Qualifications

• Bachelor's Degree in a relevant field.
• 7+ years of experience in application development (internship not counted).
• 4+ years of experience with big data technologies and 4+ years with AWS.
• 4+ years of experience with Python, SQL, Scala, or Java in distributed data environments.
• 4+ years of experience with distributed data tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL).
• 4+ years of experience with real-time data and streaming applications.

Responsibilities

• Code, test, deploy, orchestrate, monitor, document, and troubleshoot cloud-based data engineering processes and data stores.
• Collaborate with data scientists and architects to prepare data for AI/ML model training and feature extraction.
• Lead evaluation and experimentation with batch/streaming data technologies and MLOps tools.
• Act as a technical lead to showcase capabilities of AI and data technologies across the organization.
• Contribute to refining data engineering processes and best practices.

Skills

Python

SQL

Scala/Java

UNIX/Linux

Agile engineering practices

Data-driven problem solving

Education

Bachelor's Degree

Tools

AWS

Apache Spark

Kafka

Hadoop

Hive

EMR

AirFlow

KubeFlow

MySQL

Job description

NBME is seeking a data engineer to join a skilled team building and expanding a data platform on AWS for medical professionals. The role focuses on data lakes, ETL pipelines, and scalable data solutions supporting analytics, AI/ML, and business decisions.

You will work with data scientists and engineers to deliver high-quality data products, improve data quality, and implement data engineering best practices in a hybrid environment centered in Philadelphia.