Big Data Developer With Pyspark Experience

WRA; Baltimore (MD); On-site; USD 135,000 - 150,000; Full time

Job summary

An established IT consulting firm in Baltimore is seeking a Big Data Developer with extensive experience in PySpark, AWS, and big data solutions. This full-time role involves leading the development of scalable data solutions and mentoring developers. You'll work collaboratively with various teams to achieve optimal performance and ensure compliance while managing ETL processes.

Qualifications

• 7+ years of experience in AWS Cloud Computing.
• 10+ years of experience in big data and distributed computing.
• Hands-on experience with PySpark, Apache Spark, and SQL/NoSQL.

Responsibilities

• Lead the design, development, and deployment of PySpark-based big data solutions.
• Architect and optimize ETL pipelines for structured and unstructured data.
• Mentor junior developers and review code for best practices and efficiency.

Skills

Big Data

PySpark

Python

AWS

SQL

NoSQL

DevOps

Tools

Docker

Kubernetes

Job description

Big Data Developer With Pyspark Experience

Big Data Developer With Pyspark Experience

1 week ago Be among the first 25 applicants

Leading IT consulting firm in Baltimore MD seeking an experienced developer with hands-on experience in Big Data, Pyspark, Python, AWS, and SQL/NoSQL. This is a six-month consulting position with possibility of extension. Payrate $65/hour.

Note: Visa sponsorship or C2C employment not available for this position.

Position Responsibilities::

• Lead the design, development, and deployment of PySpark-based big data solutions.
• Architect and optimize ETL pipelines for structured and unstructured data.
• Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions.
• Optimize Spark performance through partitioning, caching, and tuning.
• Work with cloud platforms like AWS.
• Ensure data security, governance, and compliance.
• Mentor junior developers and review code for best practices and efficiency.

MUST HAVE:

• 7+ years of experience in Amazon Web Service(AWS) Cloud Computing.
• 10+ years of experience in big data and distributed computing.
• Experience with PySpark, Apache Spark, and Python.
• Experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).
• Hands on experience with AWS cloud-based data platforms.
• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Information Services

Referrals increase your chances of interviewing at WRA by 2x

Get notified about new Big Data Developer jobs in Baltimore, MD.

Baltimore, MD $112,597.33-$152,810.66 1 month ago

Linthicum Heights, MD $57.87-$92.40 1 week ago

Columbia, MD $100,000.00-$160,000.00 2 days ago

Baltimore, MD $112,597.33-$152,810.66 1 month ago

Software Engineer - 2 (Python Developer)

Data Engineer - Multiple Levels (TS/SCI with Poly Required)

Dayton, MD $95,000.00-$155,000.00 1 year ago

Data Engineer (Mid-Senior Level) – Healthcare SaaS Platform

Annapolis, MD $110,000.00-$130,000.00 2 days ago

Baltimore, MD $144,768.00-$209,109.33 1 month ago

Baltimore, MD $144,768.00-$209,109.33 1 month ago

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics

Big Data Engineer (Remote, Top Secret Clearance Required) (Baltimore)

Agile Developer - 5 (Java/Spring Boot/Python)

Annapolis Junction, MD $228,000.00-$293,000.00 1 week ago

Software Engineer I (Merchant Data Platform)

Maryland, United States $90,000.00-$150,000.00 4 months ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.