Data Engineer - Python, PySpark & AWS

BCforward; Plano (TX); On-site; USD 90,000 - 96,000; Part time

Job summary

BCforward is seeking a hands-on Senior Data Engineer in Plano, TX to design, build, and operate scalable big-data pipelines and cloud-native data solutions.

The role emphasizes Python and PySpark with production experience on AWS (S3/EMR/Lambda), infrastructure as code (Terraform), and modern data orchestration. You'll implement ETL/ELT pipelines, Kafka or MQ integrations, and work with Cassandra.

Qualifications

• Hands-on experience with Python and PySpark for data engineering.
• Deep experience with Big Data technologies and distributed data processing.
• Production experience with AWS services (S3, EMR, Lambda).
• Experience with infrastructure as code (Terraform).
• Experience with workflow orchestration and scheduling (Airflow, Control-M, native schedulers).
• Experience with Cassandra for high-volume data storage.
• Experience building ETL/ELT pipelines and data integration.
• Knowledge of REST APIs and MQ messaging.
• Java experience is a plus.

Responsibilities

• Design, develop, test, deploy, and optimize large-scale batch and streaming data pipelines.
• Build and maintain ETL/ELT workflows ingesting, transforming, validating, and delivering data.
• Develop and support AWS-based data solutions using S3, EMR, and Lambda.
• Provision, manage, and version cloud infrastructure using Terraform.
• Build event-driven integrations using Kafka, MQ, and REST APIs.
• Develop data services using Java where required.
• Orchestrate production workloads with Airflow, Control-M, and native schedulers.
• Work with Cassandra for high-volume data storage and retrieval.
• Implement data-quality checks, logging, monitoring, and performance tuning.
• Collaborate with data engineers, architects, software engineers, and stakeholders.

Skills

Python

PySpark

Big Data

Data pipelines

Tools

AWS

S3

EMR

Lambda

Terraform

Airflow

Control-M

Kafka

MQ messaging

REST APIs

Java

Cassandra

Job description

Job Title: Data Engineer - Python, PySpark & AWS

Location: Plano, TX

Duration: Contract to Hire - 6 months

RTH

Pay Range: $65 to 70$/hr (W2)

Job ID: 411040

About BCforward

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Role Overview

We are seeking a hands-on Senior Data Engineer to design, build, and operate scalable big-data pipelines and cloud-native data solutions. The ideal candidate combines strong Python and PySpark expertise with production experience across AWS, infrastructure-as-code, and modern data orchestration. Similar enterprise roles emphasize building ETL/ELT pipelines, distributed Spark processing, AWS data services, and workflow automation.

Key Responsibilities

• Design, develop, test, deploy, and optimize large-scale batch and streaming data pipelines using Python and PySpark.
• Build and maintain ETL/ELT workflows that ingest, transform, validate, and deliver data for analytics, reporting, and downstream applications.
• Develop and support AWS-based data solutions using S3, EMR, and Lambda.
• Provision, manage, and version cloud infrastructure using Terraform.
• Build event-driven and messaging-based integrations using Kafka, MQ messaging, and REST APIs.
• Develop and maintain data services and integrations using Java where required.
• Orchestrate production workloads using Airflow, Control-M, and native schedulers, including dependency management, retries, monitoring, and operational support.
• Work with Cassandra for high-volume, low-latency data storage and retrieval.
• Implement data-quality checks, reconciliation, logging, alerting, and performance tuning.
• Collaborate with data engineers, architects, software engineers, and business stakeholders to deliver reliable and maintainable data products.

Required Skills

• Strong hands-on experience with Python and PySpark for data engineering.
• Deep experience with Big Data technologies and distributed data processing.
• Practical production experience with AWS, specifically:
• S3 for data lake and object storage
• EMR for Spark-based processing
• Lambda for event-driven processing and automation
• Working knowledge of Terraform for infrastructure as code.
• Working knowledge of:
• Java
• REST APIs
• MQ messaging
• Apache Kafka
• Cassandra
• Experience with workflow orchestration and scheduling using:
• Apache Airflow
• Control-M
• Native schedulers

About Our Commitment

BCforward is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.