PySpark Engineer – AWS/EMR

Big Resourcing; Massachusetts; Hybrid; USD 90,000 - 150,000; Full time

Job summary

An innovative technology consulting firm is seeking both Junior and Senior PySpark Engineers to join their dynamic team. This coding-heavy role focuses on building distributed data pipelines using Apache Spark on AWS EMR. Candidates should possess strong programming skills in Python and have experience with Databricks. The position offers a unique opportunity to work in a GxP-compliant environment, ensuring data integrity while collaborating with cross-functional teams. If you are passionate about data engineering and thrive in a cloud-native setting, this role is perfect for you!

Qualifications

• 8-10 years of experience in software or data engineering for senior roles.
• 2-4 years of experience in software or data engineering for junior roles.
• Deep hands-on experience with Apache Spark, PySpark, and AWS EMR.

Responsibilities

• Design and develop distributed ETL data pipelines using PySpark on AWS EMR.
• Ensure data integrity and regulatory alignment in a GxP-compliant environment.
• Collaborate with cross-functional teams to deliver end-to-end data solutions.

Skills

Python

PySpark

Apache Spark

AWS EMR

Databricks

GxP compliance

Distributed systems

Data engineering

Job description

Job Title: Senior PySpark Engineer – AWS/EMR and Junior PySpark Engineer – AWS/EMR (Multiple openings)

Location: Remote (EST Time Zone Preferred)- 5 Days a month in the Office

Duration: 6 Months Contract

About BigRio:

BigRio is a remote-based, technology consulting firm with headquarters in Boston, MA. We deliver software solutions ranging from custom development and software implementation to data analytics and machine learning/AI integrations. As a one-stop shop, we attract clients from a variety of industries due to our proven ability to deliver cutting-edge, cost-effective software solutions.

Job Overview:

We are seeking both Junior and Senior PySpark Engineers with strong hands-on experience in building distributed data pipelines using Apache Spark on AWS EMR. The ideal candidate is proficient in Python, has worked with Databricks, and has a solid understanding of GxP-compliant environments. This is a coding-heavy role — not DevOps or AWS administration — where you’ll contribute directly to the architecture and development of robust data solutions in a highly regulated, cloud-native environment.

Key Responsibilities:

• Design, develop, and maintain distributed ETL data pipelines using PySpark on AWS EMR
• Work within a GxP-compliant environment, ensuring data integrity and regulatory alignment
• Write clean, scalable, and efficient PySpark code for large-scale data processing
• Utilize AWS cloud services for pipeline orchestration, compute, and storage
• Collaborate closely with cross-functional teams to deliver end-to-end data solutions
• Participate in code reviews, testing, and deployment of pipeline components
• Ensure performance optimization, fault tolerance, and scalability of data workflows
• 8–10 years of experience in software or data engineering with a focus on distributed systems for senior
• 2-4 years of experience in software or data engineering with a focus on distributed systems for Junior
• Deep hands-on experience with Apache Spark, PySpark, and AWS (especially EMR)
• Experience building pipelines using Databricks is required.
• Strong programming skills in Python
• Solid understanding of cloud-native architectures
• Familiarity with GxP compliance and working in regulated data environments
• Proven ability to independently design and develop data pipelines (not a DevOps/AWS admin role)
• Experience with distributed computing and high-volume ETL pipelines

Equal Opportunity Statement:

BigRio is an equal-opportunity employer. We prohibit discrimination and harassment of any kind based on race, religion, national origin, sex, sexual orientation, gender identity, age, pregnancy, status as a qualified individual with disability, protected veteran status, or other protected characteristic as outlined by federal, state, or local laws. BigRio makes hiring decisions based solely on qualifications, merit, and business needs at the time. All qualified applicants will receive equal consideration for employment.

BigRio is a cutting-edge technology company committed to being your strategic partner in accelerating digital transformation and fostering innovation. With a relentless focus on delivering exceptional solutions, we empower businesses to thrive in the rapidly evolving digital landscape.

• Harvard Square, One Mifflin Place
  Suite 400
  Cambridge, MA 02138