Need Sr Big Data Engineer at Beaverton, OR Only W2

USM; Beaverton (OR); On-site; USD 120,000 - 150,000; Full time

Job summary

A leading technology solutions provider is seeking a Senior Big Data Engineer in Beaverton, OR. This role involves working with product teams to automate and integrate diverse data components into a next-gen analytics platform. Candidates should have over 5 years of development experience, primarily in Python, and significant exposure to AWS. You will contribute to the ingestion and organization of data through cloud-native processes, ensuring efficient data access and manipulation across various platforms.

Qualifications

• 5+ years of experience in professional development with Python, Scala, or Java.
• 3+ years experience with HDFS and AWS platforms.
• Familiarity with database and SQL optimization.

Responsibilities

• Work with product teams to automate and integrate data domains.
• Ingest, organize, and prepare data through cloud-native processes.
• Develop within the AWS ecosystem and optimize data access.

Skills

Python

Scala

Java

Data-centric development

HDFS ecosystem tools

AWS platforms

Airflow

Problem-solving

Job description

Need Sr Big Data Engineer at Beaverton, OR Only W2

Contract

Hi,

We have immediate opportunity with our direct client send your resume asap upon your interest. Thank you.

Location: Beaverton, OR.

Duration: Long Term

Skills

Typical Office: This is a typical office job, with no special physical requirements or unusual work environment.

Core responsibilities: Expert data engineers will work with product teams across client to help automate and integrate various of data domains with a wide variety of data profiles (different scale, cadence, and volatility) into client's next-gen data and analytics platform. This is an opportunity to work across multiple subject areas and source platforms to ingest, organize, and prepare data through cloud-native processes.

Required skills/experience:

• 5+ years of professional development experience between either Python (preferred) or Scala/Java; familiarity with both is ideal
• 5+ years of data-centric development with a focus on efficient data access and manipulation at multiple scales
• 3+ years of experience with the HDFS ecosystem of tools (any distro, Spark experience prioritized)
• 3+ years of significant experience developing within the broader AWS ecosystem of platforms and services
• 3+ years of experience optimizing data access and analysis in non-HDFS data platforms (Traditional RDMS's, NoSQL / KV stores, etc)
• Direct task development and/or configuration experience with a remote workflow orchestration tool – Airflow (preferred), Amazon Data Pipeline, Luigi, Oozie, etc.
• Intelligence, strong problem-solving ability, and the ability to effectively communicate to partners with a broad spectrum of experiential backgrounds

Several of the following skills are also desired:

• A demonstrably strong understanding of security and credential management between application / platform components
• A demonstrably strong understanding of core considerations when working with data at scale, in both file-based and database contexts, including SQL optimization
• Direct experience with Netflix Genie is another huge plus
• Prior experience with the operational backbone of a CI/CD environment (pipeline orchestration + configuration management) is useful
• Clean coding practices, passion for development, being a generally good team player, etc, etc (and experience with GitHub) is always nice

Keys to Success:

• Demonstrate accountability and integrity
• Be willing to learn and adapt every day

Regards
Nithya

All your information will be kept confidential according to EEO guidelines. please send the profiles to nithyar(at)usmsystems.com and contact No# 703-794-2380.