Senior Big Data Engineer | Hadoop, Spark, SQL

Experis; Virginia; On-site; USD 99,000 - 103,000; Full time

Benefits offered by this job

Medical and Prescription Drug Plans

Dental Plan

Vision Plan

Health Savings Account

Health Flexible Spending Account

Dependent Care Flexible Spending Area

401(k), Plus Match

Weekly Pay

Job summary

Experis is hiring a Big Data Engineer to join the Data Engineering team in McLean, VA, onsite. The role focuses on building scalable data pipelines using Hadoop, Spark, Python, and Scala to support analytics initiatives.

You will design, develop, test, and optimize end-to-end data flows, ensure data quality, and collaborate with data scientists and analysts to enable data-driven decisions. Candidates should have 5+ years of experience and a solid software engineering background.

Qualifications

• Bachelor’s degree in CS/IS or related field with at least 5 years of relevant experience.
• Strong experience with enterprise-grade data pipelines and Big Data technologies.
• Proficient in SQL, window functions, joins, and handling NULLs and duplicates.
• Experience with test automation, build automation, and configuration management.
• Experience collaborating with data scientists and analysts.

Responsibilities

• Design, develop, and maintain large-scale data processing pipelines using Hadoop, Spark, Python, and Scala.
• Build scalable, efficient data ingestion, storage, transformation, and analysis solutions.
• Optimize pipelines for performance, scalability, and reliability; troubleshoot production issues.
• Develop automated testing frameworks and implement continuous testing for data quality.
• Collaborate with data scientists and analysts to enable data-driven decisions.

Skills

5+ years experience

Big Data

data pipeline

SQL

Agile

test automation

Education

Bachelor’s degree in CS/IS or related

Tools

Hadoop

Spark

Hive

Trino

Python

Scala

Job description

Experis is hiring a Big Data Engineer to join the Data Engineering team in McLean, VA, onsite. The role focuses on building scalable data pipelines using Hadoop, Spark, Python, and Scala to support analytics initiatives.

You will design, develop, test, and optimize end-to-end data flows, ensure data quality, and collaborate with data scientists and analysts to enable data-driven decisions. Candidates should have 5+ years of experience and a solid software engineering background.