Senior Big Data Architect & Engineer – Spark, Hadoop, ETL

SmartRecruiters, Inc.; Portland (OR); On-site; USD 120,000 - 180,000; Full time

Job summary

SmartRecruiters, Inc. in Portland, OR seeks a strong Big Data Professional to drive data architecture and analytics initiatives. You will collaborate with customers and internal teams, translating requirements into scalable data pipelines and robust ETL processes.

The role emphasizes hands-on work with Hadoop, Spark, Hive, and cloud-based data platforms, plus experience with Java or Python. Healthcare domain knowledge is highly valued.

Qualifications

• Bachelor’s Degree with 6–9+ years in data architecture/big data.
• Extensive experience in data architecture/ETL environment.
• Experience with ETL tools like Informatica, Talend or ODI.

Responsibilities

• Participate in technical planning and requirements gathering for big data applications.
• Ingest, maintain and troubleshoot data in operational and analytics databases.
• Build and optimize distributed data solutions using Hive, Hadoop, Spark, and related tech.
• Design and implement cloud-based ETL/data ingestion platforms.
• Ensure data warehousing scalability and data quality.
• Work with cloud platforms (AWS or Azure) and SDLC/Agile practices.

Skills

Data architecture

Big Data

ETL

Informatica PowerCenter

Hive

Hadoop

Core Java

Python

Healthcare domain

Java

Spark

Elasticsearch

Storm

Kafka

AWS

Azure

Data warehousing

Data ingestion

JIRA

Git

Bitbucket

JUnit

MDM

RDM

Oozie

Education

Bachelor’s Degree

Tools

Informatica PowerCenter

JIRA

Git

Bitbucket

JUnit

Oozie

Job description

SmartRecruiters, Inc. in Portland, OR seeks a strong Big Data Professional to drive data architecture and analytics initiatives. You will collaborate with customers and internal teams, translating requirements into scalable data pipelines and robust ETL processes.

The role emphasizes hands-on work with Hadoop, Spark, Hive, and cloud-based data platforms, plus experience with Java or Python. Healthcare domain knowledge is highly valued.