Big Data Engineer: Scalable Pipelines with Spark & Hadoop

African American Talent; McLean, Northern (VA, KY); Hybrid; USD 99,000 - 103,000; Full time

Benefits offered by this job

Medical plan

Dental plan

Vision plan

HSA

Health FSA

Dependent Care FSA

Life Insurance

Disability insurance

Travel insurance

401(k) plan

Weekly pay

Job summary

ManpowerGroup in McLean, VA is seeking a Big Data Engineer to design, build, and maintain large-scale data pipelines using Hadoop, Spark, Python, and Scala. This role requires strong OO and database fundamentals and hands-on experience with Big Data tools.

You will collaborate with data scientists and analysts, implement scalable data solutions, and contribute to automated testing and data quality. Competitive hourly pay and benefits are provided.

Qualifications

• Bachelor's degree in CS/IS or related field with 5+ years of related experience.
• Strong OO and database concepts and experience delivering enterprise-quality solutions.
• Experience with test automation, build automation, and Agile delivery practices.
• Hands-on with Big Data tech such as Hadoop, Spark, Hive, Trino; debugging and mitigation of issues.

Responsibilities

• Design, develop, and maintain large-scale data pipelines using Hadoop, Spark, Python, and Scala.
• Implement data ingestion, storage, transformation, and analysis solutions that are scalable, efficient and reliable.
• Optimize and enhance existing data pipelines for performance and reliability, including production issue troubleshooting.
• Develop automated testing frameworks and implement continuous testing to support data quality assurance.
• Collaborate with cross-functional teams, including data scientists and analysts, to support data-driven decision-making.

Skills

Big Data

OOP concepts

SQL advanced

Agile

Data pipelines

Hadoop

Spark

Hive

Trino

Education

Bachelor's degree

Tools

Hadoop

Spark

Hive

Trino

Job description

ManpowerGroup in McLean, VA is seeking a Big Data Engineer to design, build, and maintain large-scale data pipelines using Hadoop, Spark, Python, and Scala. This role requires strong OO and database fundamentals and hands-on experience with Big Data tools.

You will collaborate with data scientists and analysts, implement scalable data solutions, and contribute to automated testing and data quality. Competitive hourly pay and benefits are provided.