Senior Big Data Engineer — Spark, Hadoop on AWS (Hybrid)

Rishi Writes

Rockville (MD)

Hybrid

USD 120,000 - 170,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Rishi Writes in Rockville, MD is seeking a highly skilled Big Data Engineer to design, develop and optimize large-scale data processing systems in a hybrid role.

You will build data pipelines with Hadoop, Spark and AWS services, collaborating with data scientists and analysts to deliver scalable, reliable solutions. This position requires 5+ years of distributed-systems experience and a strong focus on performance tuning at petabyte scale.

Qualifications

  • Requires Big data engineering experience with Hadoop, Hive and Trino at petabyte scale.
  • Proficient in Spark development, performance tuning and troubleshooting.
  • Advanced SQL and data modeling skills are required.

Responsibilities

  • Design, develop and maintain large-scale data processing pipelines using Hadoop, Spark, Python and Scala.
  • Implement data ingestion, storage, transformation and analysis solutions that are scalable and reliable.
  • Optimize existing pipelines for performance, scalability and reliability.
  • Collaborate with cross-functional teams to translate business needs into technical solutions.
  • Run tests to protect data accuracy and pipeline strength.
  • Create and maintain automated tests for data pipelines.
  • Monitor and troubleshoot pipelines in production.
  • Support data scientists and analysts.
  • Stay current with emerging big data technologies.

Skills

Hadoop
Spark
Python
Scala
SQL
AWS
LLM tooling
GitHub Copilot

Education

Bachelor's degree in Computer Science, Information Systems or related field

Tools

Hive
Trino
EMR
Athena

Job description

Rishi Writes in Rockville, MD is seeking a highly skilled Big Data Engineer to design, develop and optimize large-scale data processing systems in a hybrid role.

You will build data pipelines with Hadoop, Spark and AWS services, collaborating with data scientists and analysts to deliver scalable, reliable solutions. This position requires 5+ years of distributed-systems experience and a strong focus on performance tuning at petabyte scale.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Hybrid Senior Big Data Engineer - Spark & AWS
Hybrid Senior Big Data Engineer - Spark & AWS

Unisys • Tysons (VA)

Hybrid
USD 150,000 - 210,000
Senior Big Data Engineer — AWS, Spark & AI Pipelines
Senior Big Data Engineer — AWS, Spark & AI Pipelines

Unisys • McLean (VA)

On-site
USD 120,000 - 180,000
Senior Big Data Architect | Lead Analytics & Spark Security
Senior Big Data Architect | Lead Analytics & Spark Security

Jobsbridge • Rockville (MD)

On-site
USD 140,000 - 190,000
Top Big Data Engineer Job in Rockville, MD | 5+ Years
Top Big Data Engineer Job in Rockville, MD | 5+ Years

Rishi Writes • Rockville (MD)

Hybrid
USD 120,000 - 170,000
Senior/Lead Big Data Engineer
Senior/Lead Big Data Engineer

Unisys • Tysons (VA)

Hybrid
USD 150,000 - 210,000
Senior Big Data Engineer: Spark, Hadoop & AWS
Senior Big Data Engineer: Spark, Hadoop & AWS

Jobsbridge • Somerset (MA)

On-site
USD 90,000 - 130,000
Senior Data Engineer: Spark & Scala Big Data Pipelines
Senior Data Engineer: Spark & Scala Big Data Pipelines

The Briefed • Bethesda (MD)

Hybrid
USD 140,000 - 220,000
Senior Big Data Engineer (Hadoop/AWS) - Remote in 6 months
Senior Big Data Engineer (Hadoop/AWS) - Remote in 6 months

Mapjects.com • San Francisco (CA)

Hybrid
USD 120,000 - 160,000
Senior Big Data Lead - Spark, AWS & Java
Senior Big Data Lead - Spark, AWS & Java

Jobsbridge • Alameda (CA)

On-site
USD 120,000 - 150,000
Senior Big Data Engineer (Hadoop/AWS) | Java
Senior Big Data Engineer (Hadoop/AWS) | Java

Mapjects.com • Atlanta (GA)

Hybrid
USD 110,000 - 170,000