Big Data Engineer: Scalable Pipelines & Cloud

ManpowerGroup; McLean (VA); On-site; USD 120,000 - 150,000; Full time

Job summary

ManpowerGroup is seeking a highly skilled Big Data Engineer to design, develop, and optimize large-scale data processing systems. You will design pipelines, implement data integration, and ensure performance, scalability, and reliability of big data platforms.

You will collaborate with cross-functional teams and stay current with technologies like Hadoop, Spark, and Python/Scala. The ideal candidate has five years of experience and strong OO/database concepts, plus testing/CI/CD experience.

Qualifications

• Bachelor's degree in Computer Science or related field with 5+ years of experience.
• Master's degree and Financial Services experience preferred.
• Strong OO and database concepts; enterprise-grade solutions.
• Experience in Agile development environments.
• Experience with test automation and build/config management.
• Excellent written and verbal technical communication.

Responsibilities

• Design, develop, and maintain large-scale data processing pipelines.
• Ingest, store, transform, and analyze scalable data solutions.
• Collaborate with cross-functional teams to translate requirements.
• Optimize pipelines for performance and reliability.
• Develop automated tests and data quality assurance.
• Troubleshoot production pipelines and resolve issues.
• Work with data scientists and analysts to enable data-driven decisions.

Skills

Distributed systems

Cloud platforms

Hadoop

Spark

Python/Scala

SQL (Window functions)

Spark tuning

Data quality testing

Agile/Scrum

Education

Bachelor's in CS or related

Master's degree (pref.)

Tools

Hadoop

Spark

Hive

Trino

Python

Scala

SQL

Job description

ManpowerGroup is seeking a highly skilled Big Data Engineer to design, develop, and optimize large-scale data processing systems. You will design pipelines, implement data integration, and ensure performance, scalability, and reliability of big data platforms.

You will collaborate with cross-functional teams and stay current with technologies like Hadoop, Spark, and Python/Scala. The ideal candidate has five years of experience and strong OO/database concepts, plus testing/CI/CD experience.