Senior Data Engineer — Big Data Pipelines & Cloud

Apex Systems; Beaverton (OR); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Everforth Apex is seeking a Senior Data Engineer for an 8-month contract in Portland, OR (hybrid). You will design and implement data products, contribute to architecture for large-scale data processing, and evaluate new technologies in a fast-paced Agile environment.

The role requires 10+ years in software development and 5+ years in big data, with strong Python/Scala and SQL skills. You will work with data engineers, analysts, and product partners to deliver high-volume processing pipelines,

Qualifications

• Bachelor’s degree in Computer Science or related technical discipline.
• 10+ years of experience in large-scale software development, 5+ years in big data.
• Proficiency in Python or Scala.
• Experience with Hadoop and Spark/Hive ecosystem.
• Experience with messaging/streaming/complex event processing tooling.
• SQL and SQL analytics functions.
• Experience with Airflow for workflow orchestration.
• Experience with GitHub or Bitbucket for source control.
• Strong communication skills, verbal and written.
• Experience with Agile/Scrum development.

Responsibilities

• Contribute to design and implement data products and features with product owners, analysts, and business partners using Agile/Scrum.
• Help shape architecture and patterns for processing and storing large data volumes.
• Evaluate new technologies/tools/frameworks for high-volume data processing.
• Translate backlog items into engineering work units.
• Build distributed data processing pipelines using big data tools.
• Create utilities, UDFs, libraries to improve data flow patterns.
• Collaborate to ensure quality solutions and best practices.
• Develop automated unit tests and participate in integration testing.
• Advance CI/CD frameworks and practices.
• Troubleshoot data issues and perform root cause analysis.
• Collaborate across teams to resolve operational and performance issues.

Skills

Big data

Agile/Scrum

Communication

Problem solving

Python/Scala

Education

Bachelor's degree in CS or related

Tools

Python/Scala

Hadoop

Spark

Hive

Airflow

SQL

Github/Bitbucket

Databricks

Job description

Everforth Apex is seeking a Senior Data Engineer for an 8-month contract in Portland, OR (hybrid). You will design and implement data products, contribute to architecture for large-scale data processing, and evaluate new technologies in a fast-paced Agile environment.

The role requires 10+ years in software development and 5+ years in big data, with strong Python/Scala and SQL skills. You will work with data engineers, analysts, and product partners to deliver high-volume processing pipelines,