Python Developer | Fourways Consulting | NYC, NY, Fort Mill, SC

Fourways Consulting; New York, Fort Mill (NY, SC); On-site; USD 120,000 - 180,000; Full time

Job summary

Fourways Consulting is seeking an experienced Python Developer for a 12+ month contract across NYC, NY and Fort Mill, SC. You will design, build, and optimize high-throughput distributed data pipelines and serverless cloud integrations on AWS, using Python, PySpark, AWS Glue, and AWS Lambda.

You will collaborate with solution architects and data engineers to translate complex requirements into scalable solutions, implement CI/CD pipelines, enforce automated tests, and optimize memory usage in

Qualifications

• Experience in backend Python development and data pipeline engineering.
• Proficient in PySpark for distributed data processing and DataFrame manipulation.
• Extensive experience deploying serverless functions with AWS Lambda.
• Hands-on expertise building, scheduling, and monitoring AWS Glue ETL pipelines.

Responsibilities

• Design, develop, and maintain high-performance, scalable data processing apps and backend services using Python.
• Build and optimize distributed data transformation workflows with PySpark across large datasets.
• Develop, configure, and orchestrate serverless event-driven workflows with AWS Lambda.
• Architect, catalog, and schedule automated ETL/ELT pipelines using AWS Glue.
• Manage Amazon S3 data lake storage and optimize query access across cloud databases.
• Troubleshoot bottlenecks, optimize memory in PySpark, and reduce cloud costs.
• Implement automated unit tests, integration tests, and data quality checks to ensure pipeline resilience.
• Collaborate with agile teams to participate in sprint ceremonies and code reviews.

Skills

Python

PySpark

AWS Lambda

AWS Glue

SQL

AWS S3

CloudWatch IAM

Tools

Docker

Apache Airflow

Databricks

Redshift

Snowflake

Job description

Position Summary:

Fourways Consulting is urgently seeking an experienced, high-caliber Python Developer for an immediate 12+ month contract engagement spanning NYC, NY, and Fort Mill, SC. In this high-impact engineering role, you will take ownership of designing, building, scaling, and optimizing mission-critical data processing applications and serverless cloud integration pipelines across Amazon Web Services. Leveraging advanced programming expertise in Python, PySpark, AWS Glue, and AWS Lambda, you will transform massive enterprise datasets into high-availability analytical assets and streamline backend data operations. This contract position provides an exceptional opportunity for an ambitious software and data engineering specialist to make an immediate impact within a premier technology consulting organization.

Detailed Job Description:

As a Python Developer at Fourways Consulting supporting enterprise client initiatives across New York City, NY, and Fort Mill, SC, you will hold direct technical accountability for the architecture, implementation, and maintenance of high-throughput distributed data pipelines and cloud-native backend services. Working within an agile engineering environment, you will collaborate closely with solution architects, data platform engineers, database administrators, and cross-functional business stakeholders to translate complex analytical requirements into scalable, fault-tolerant software solutions.

Your core technical mandate encompasses developing distributed batch and micro-batch data transformation jobs utilizing PySpark, orchestrating serverless data workflows with AWS Lambda, and provisioning managed ETL pipelines using AWS Glue. You will integrate diverse data sources across Amazon S3 data lakes and relational or NoSQL database platforms, ensuring stringent data consistency, validation, and sub-second query performance. In addition to core feature engineering, you will optimize memory utilization in distributed computing jobs, enforce automated unit testing, establish CI/CD deployment pipelines, and conduct rigorous code reviews. This fast-paced contract role requires outstanding analytical problem-solving skills, deep cloud engineering acumen, and immediate readiness to hit the ground running.

Key Responsibilities:

• Design, develop, and maintain high-performance, scalable data processing applications and backend services using Python.
• Build and optimize distributed data transformation and aggregation workflows utilizing PySpark across large-scale enterprise datasets.
• Develop, configure, and orchestrate serverless event-driven workflows and micro-batch data loaders using AWS Lambda.
• Architect, catalog, and schedule automated ETL/ELT pipelines and metadata crawlers utilizing AWS Glue.
• Integrate heterogeneous data stores, manage Amazon S3 data lake storage structures, and optimize query access across cloud databases.
• Troubleshoot distributed processing bottlenecks, optimize PySpark memory execution, and minimize cloud infrastructure compute costs.
• Implement automated unit tests, integration test suites, and data quality validation checks to guarantee pipeline resilience.
• Collaborate with agile engineering teams to participate in sprint ceremonies, conduct technical code reviews, and support production releases.

Required Qualifications & Skills:

• Demonstrated professional experience in software engineering, backend Python development, or data pipeline engineering.
• Advanced programming proficiency in Python, including object-oriented design, performance profiling, and standard data libraries.
• Strong hands-on technical proficiency with PySpark for distributed large-scale data processing and DataFrame manipulation.
• Extensive engineering experience developing and deploying serverless functions utilizing AWS Lambda.
• Demonstrated hands‑on expertise building, scheduling, and monitoring enterprise ETL pipelines utilizing AWS Glue.
• Solid technical knowledge of AWS cloud foundational services, specifically Amazon S3, CloudWatch, and IAM security policies.
• Proven proficiency in relational databases, data modeling concepts, and writing optimized SQL queries for high-volume datasets.
• Strong analytical problem‑solving abilities, excellent professional English communication skills, and immediate availability for contract onboarding.

Nice‑to‑Have Skills:

• AWS Certified Developer – Associate, AWS Certified Solutions Architect, or AWS Certified Data Engineer credentials.
• Experience with workflow orchestration platforms such as Apache Airflow or AWS Step Functions.
• Familiarity with cloud data warehousing solutions such as Amazon Redshift, Snowflake, or Databricks.
• Hands‑on experience with containerization technologies including Docker and continuous integration/continuous deployment (CI/CD) pipelines.
• Prior consulting experience delivering client‑facing enterprise software or big data solutions across multi‑location teams.

Application Information:

• Employer / Recruiting Firm: Fourways Consulting
• Recruiter Contact: Saif
• Position Title: Python Developer
• Work Locations: NYC, NY / Fort Mill, SC
• Contract Duration: 12+ Months (Contract)
• Hiring Urgency: Urgent Hiring | Immediate Requirement
• Core Technology Stack: Python, PySpark, AWS Glue, AWS Lambda
• Application Email: [e-mail]

Recruitment Pro Tip:

Because this is an urgent 12+ month contract opening with an immediate start, make sure your resume spotlights your core four technologies—Python, PySpark, AWS Glue, and AWS Lambda—right at the top of your technical summary. Highlight specific metrics demonstrating the volume and performance of data pipelines you have built, and explicitly state your immediate start availability and location flexibility (NYC, NY or Fort Mill, SC) when emailing your resume to [e-mail].