Data Engineer

Pyramid, Inc; McLean (VA); Hybrid; USD 76,000 - 83,000; Full time

Job summary

Pyramid Consulting, Inc. is seeking a Data Engineer for a 6+ month contract in McLean, VA with hybrid work arrangement. The role focuses on building scalable data pipelines using PySpark and Scala, and designing cloud-based data processing on AWS.

Strong experience in ETL/ELT, data transformation, and collaboration with cross-functional teams is required. The candidate will optimize jobs for performance and reliability, work with AWS data services, and ensure data quality, security, and

Qualifications

• 5+ years of hands-on PySpark experience.
• 5+ years of programming in Scala.
• 5+ years of AWS cloud services and data engineering.

Responsibilities

• Develop and maintain scalable data pipelines using PySpark and Scala.
• Design data processing solutions on AWS cloud.
• Build efficient ETL/ELT pipelines for large-scale data.
• Optimize PySpark/Scala jobs for performance and reliability.
• Work with AWS data services and cloud architectures.
• Transform, cleanse, validate and integrate data.
• Troubleshoot pipeline issues and improve system performance.
• Collaborate with data architects, analysts, developers and stakeholders.

Skills

PySpark

Scala

AWS

Data pipelines

Tools

AWS

ETL/ELT

Job description

Immediate need for a talented Data Engineer. This is a 06+ Months Contract opportunity with long-term potential and is located in Mclean, VA (Hybrid).

Job ID:26-30557. Pay Range: $55 - $60/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).

Key Responsibilities

• Develop and maintain scalable data pipelines using PySpark and Scala.
• Design and implement data processing solutions on AWS.
• Build efficient ETL/ELT pipelines for large-scale structured and unstructured data.
• Optimize PySpark/Scala jobs for performance, scalability, and reliability.
• Work with AWS data services and cloud-based data architectures.
• Perform data transformation, cleansing, validation, and integration.
• Troubleshoot data pipeline issues and improve overall system performance.
• Collaborate with data architects, analysts, developers, and business stakeholders.
• Follow best practices for data quality, security, monitoring, and governance.

Key Requirements and Technology Experience

• 5+ years of strong hands-on experience with PySpark.
• 5+ years of strong programming experience in Scala.
• 5+ years of strong experience with AWS cloud services and data engineering.
• Experience building and supporting production-grade data pipelines.
• Good understanding of distributed data processing and cloud data architecture.

Our client is a leading IT Industry and we are currently interviewing to fill this and other similar contract positions.

Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.