Big Data Engineer (No C2C)

Experis Technology Group; Virginia; On-site; USD 99,000 - 103,000; Full time

Benefits offered by this job

Medical insurance

Dental plan

Vision plan

Health Savings Account

Health Flexible Spending Account

Dependent Care Flexible Spending账户

Supplemental Life Insurance

Short Term Disability Insurance

Long Term Disability Insurance

Business Travel Insurance

401(k) with Match

Weekly Pay

Job summary

ManpowerGroup in McLean, Virginia seeks a Big Data Engineer to join our data engineering team. You will design and maintain large-scale data processing pipelines using Hadoop, Spark, Python, and Scala, enabling analytics and data platform initiatives.

You will implement scalable data ingestion, storage, transformation, and analysis solutions, optimize pipelines for performance, and collaborate with data scientists and analysts to drive data-driven decisions.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, or related discipline with at least five years of related experience.
• Demonstrated technical expertise in object-oriented and database technologies, with enterprise-quality solutions.
• Strong software engineering background with test automation, build automation, and configuration management practices.
• Hands-on experience with Big Data technologies such as Hadoop, Spark, Hive, and Trino, including debugging and mitigation for data skew and resource-related issues.
• Strong SQL skills (window functions, joins, complex queries) and ability to optimize SQL queries.

Responsibilities

• Design, develop, and maintain large-scale data processing pipelines using Hadoop, Spark, Python, and Scala.
• Implement data ingestion, storage, transformation, and analysis solutions that are scalable and reliable.
• Optimize existing pipelines for performance and reliability, including troubleshooting production issues.
• Develop automated testing frameworks and continuous testing for data quality assurance.
• Collaborate with data scientists and analysts to support data-driven decision-making.

Skills

Software engineering

Agile delivery

Test automation

Build automation

Configuration management

SQL proficiency

Education

Bachelor's degree in CS/IS

Tools

Hadoop

Spark

Hive

Trino

Job description

Our client, a data-driven organization, is seeking a Big Data Engineer to join their team. As a Big Data Engineer, you will be part of the Data Engineering team supporting analytics and data platform initiatives. The ideal candidate will have a strong drive to build reliable data pipelines, a collaborative mindset to translate business needs into technical solutions, and the discipline to continuously improve performance, scalability, and data quality.

Job Title:Big Data Engineer

Location:McLean, VA

Pay Range:$72-$75/hr depending on years of experience

What's the Job?

• Design, develop, and maintain large-scale data processing pipelines using Big Data technologies such as Hadoop, Spark, Python, and Scala.
• Implement data ingestion, storage, transformation, and analysis solutions that are scalable, efficient, and reliable.
• Optimize and enhance existing data pipelines for performance, scalability, and reliability, including troubleshooting production issues.
• Develop automated testing frameworks and implement continuous testing to support data quality assurance.
• Collaborate with cross-functional teams, including data scientists and analysts, to support data-driven decision-making.

What's Needed?

• Bachelor's degree in Computer Science, Information Systems, or related discipline with at least five (5) years of related experience, or equivalent training and/or work experience.
• Demonstrated technical expertise in object-oriented and database technologies/concepts, with experience delivering enterprise-quality solutions.
• Strong software engineering background with test automation, build automation, and configuration management practices, including iterative or Agile delivery experience.
• Hands-on experience with Big Data technologies such as Hadoop, Spark, Hive, and Trino, including debugging and mitigation for issues like data skew and resource-related job failures.
• Strong SQL skills (window functions, joins, complex queries) and the ability to write/optimize SQL queries while handling edge cases such as NULLs, duplicates, and ordering.

What's in it for me?

• Opportunity to design and optimize large-scale data processing systems that support enterprise analytics.
• Work in an Agile environment with continuous improvement practices and cross-functional collaboration.
• Build automated testing and data quality assurance into production-grade pipelines.
• Partner with data scientists and analysts to enable reliable, actionable insights.
• Use modern tools and AI development assistants to improve development workflows and productivity.

Upon completion of waiting period consultants are eligible for:

• Medical and Prescription Drug Plans
• Dental Plan
• Vision Plan
• Health Savings Account
• Health Flexible Spending Account
• Dependent Care Flexible Spending Account
• Supplemental Life Insurance
• Short Term and Long Term Disability Insurance
• Business Travel Insurance
• 401(k), Plus Match
• Weekly Pay

About ManpowerGroup, Parent Company of: Manpower, Experis, Talent Solutions, and Jefferson Wells.

ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands – Manpower, Experis, Talent Solutions, and Jefferson Wells –creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2023 ManpowerGroup was named one of the World's Most Ethical Companies for the 14th year - all confirming our position as the brand of choice for in-demand talent.