Senior Big Data Engineer: Scalable Pipelines & Analytics

Experis Technology Group; Virginia; On-site; USD 99,000 - 103,000; Full time

Benefits offered by this job

Medical insurance

Dental plan

Vision plan

Health Savings Account

Health Flexible Spending Account

Dependent Care Flexible Spending账户

Supplemental Life Insurance

Short Term Disability Insurance

Long Term Disability Insurance

Business Travel Insurance

401(k) with Match

Weekly Pay

Job summary

ManpowerGroup in McLean, Virginia seeks a Big Data Engineer to join our data engineering team. You will design and maintain large-scale data processing pipelines using Hadoop, Spark, Python, and Scala, enabling analytics and data platform initiatives.

You will implement scalable data ingestion, storage, transformation, and analysis solutions, optimize pipelines for performance, and collaborate with data scientists and analysts to drive data-driven decisions.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, or related discipline with at least five years of related experience.
• Demonstrated technical expertise in object-oriented and database technologies, with enterprise-quality solutions.
• Strong software engineering background with test automation, build automation, and configuration management practices.
• Hands-on experience with Big Data technologies such as Hadoop, Spark, Hive, and Trino, including debugging and mitigation for data skew and resource-related issues.
• Strong SQL skills (window functions, joins, complex queries) and ability to optimize SQL queries.

Responsibilities

• Design, develop, and maintain large-scale data processing pipelines using Hadoop, Spark, Python, and Scala.
• Implement data ingestion, storage, transformation, and analysis solutions that are scalable and reliable.
• Optimize existing pipelines for performance and reliability, including troubleshooting production issues.
• Develop automated testing frameworks and continuous testing for data quality assurance.
• Collaborate with data scientists and analysts to support data-driven decision-making.

Skills

Software engineering

Agile delivery

Test automation

Build automation

Configuration management

SQL proficiency

Education

Bachelor's degree in CS/IS

Tools

Hadoop

Spark

Hive

Trino

Job description

ManpowerGroup in McLean, Virginia seeks a Big Data Engineer to join our data engineering team. You will design and maintain large-scale data processing pipelines using Hadoop, Spark, Python, and Scala, enabling analytics and data platform initiatives.

You will implement scalable data ingestion, storage, transformation, and analysis solutions, optimize pipelines for performance, and collaborate with data scientists and analysts to drive data-driven decisions.