Remote PySpark Engineer - Data Pipelines & Spark Mastery

Bright Vision Technologies; Edison (NJ); Remote; USD 115,000 - 165,000; Full time

Job summary

Bright Vision Technologies is seeking a PySpark Developer to design, build, validate, and support data solutions that enable trusted information for enterprise operations, analytics, and decision-making.

The role focuses on data integration, modeling, quality, performance, and governance, applying Apache Spark, PySpark/Scala, Spark SQL, distributed processing, and batch/streaming pipelines. You will collaborate with cross-functional teams to deliver reliable, maintainable solutions.

Qualifications

• Strong SQL skills and data-related programming experience.
• Knowledge of data modeling, ETL/ELT, and data integration patterns.
• Experience with data quality, security, and production support.
• Ability to translate business requirements into maintainable data solutions.
• Excellent analytical, documentation, and stakeholder communication skills.

Responsibilities

• Develop and maintain data pipelines, transformations, reports, models, or platform components as required.
• Translate source-to-target and business requirements into validated technical data solutions.
• Implement data quality checks, access controls, monitoring, and failure-recovery procedures.
• Tune SQL, processing jobs, models, dashboards, or platform resources for performance and cost.
• Document data definitions, lineage, operational procedures, and technical decisions.

Skills

SQL proficiency

Data analysis

Documentation & stakeholder

ETL/ELT concepts

Data modeling

Tools

Apache Spark

PySpark/Scala

Spark SQL

Distributed processing

Partitioning & tuning

Batch/streaming pipelines

Job description

Bright Vision Technologies is seeking a PySpark Developer to design, build, validate, and support data solutions that enable trusted information for enterprise operations, analytics, and decision-making.

The role focuses on data integration, modeling, quality, performance, and governance, applying Apache Spark, PySpark/Scala, Spark SQL, distributed processing, and batch/streaming pipelines. You will collaborate with cross-functional teams to deliver reliable, maintainable solutions.