Senior Data Engineer: Build Scalable Pipelines & ML-Ready

Institute for Experiential AI at Northeastern University; Portland (ME); On-site; USD 80,000 - 110,000; Full time

Benefits offered by this job

Medical benefits

Tuition assistance

Paid time off

Retirement benefits

Wellness plans

Job summary

The Institute for Experiential AI at Northeastern University is seeking a skilled IT professional to build and enhance data ingestion and transformation components. This role involves utilizing strong programming skills in Java and Scala along with expertise in Big Data technologies to support various AI projects.

Ideal candidates will have a Bachelor’s degree in Computer Science and 5+ years of relevant experience. This position provides opportunities for collaboration across academia and industry, along with a comprehensive benefits package, including medical, tuition assistance, and paid time off.

Qualifications

• 5 or more years of professional experience in IT.
• Experience in cloud architecture, particularly AWS, is preferred.

Responsibilities

• Build, maintain, and improve data pipelines and infrastructure.
• Support data scientists and end users.
• Support practicum courses and academic programs.

Skills

Java/Scala development

Python programming

ETL pipelines

Big Data pipeline processing

Cloud platforms (AWS, Azure, Google Cloud)

Containerization (Docker, Podman)

Machine learning frameworks (SKLearn, AutoML)

Deep learning frameworks (Pytorch)

Data governance best practices

Version control best practices

Relational and non-relational databases

Education

Bachelor’s degree in Computer Science or Engineering

Job description

The Institute for Experiential AI at Northeastern University is seeking a skilled IT professional to build and enhance data ingestion and transformation components. This role involves utilizing strong programming skills in Java and Scala along with expertise in Big Data technologies to support various AI projects.

Ideal candidates will have a Bachelor’s degree in Computer Science and 5+ years of relevant experience. This position provides opportunities for collaboration across academia and industry, along with a comprehensive benefits package, including medical, tuition assistance, and paid time off.