Remote PySpark Data Engineer: Pipelines & Data Quality

Bright Vision Technologies; Edison (CA); Remote; USD 115,000 - 165,000; Full time

Job summary

Bright Vision Technologies is seeking a PySpark Developer to design, build, validate, and support data solutions that enable enterprise operations, analytics, and decision‑making. The work includes data integration, modeling, quality, performance, and governance.

The successful candidate will apply practical expertise in Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines, working with cross‑functional teams to deliver reliable,

Qualifications

• 4+ years of professional data engineering experience.
• Experience with Spark, PySpark/Scala, Spark SQL, and distributed pipelines.
• Strong SQL skills and data modeling knowledge.
• Ability to translate business requirements into maintainable data solutions.
• Experience with data quality, security, and production support.

Responsibilities

• Develop and maintain data pipelines, transformations, and platform components.
• Translate source-to-target and business requirements into validated data solutions.
• Implement data quality checks, access controls, monitoring, and failure recovery.
• Tune SQL and processing jobs for performance and cost.
• Document data definitions, lineage, and technical decisions.

Skills

SQL skills

Analytical abilities

Stakeholder communication

Data quality awareness

Documentation

Tools

Apache Spark

PySpark/Scala

Spark SQL

Batch/Streaming pipelines

Partitioning

Job description

Bright Vision Technologies is seeking a PySpark Developer to design, build, validate, and support data solutions that enable enterprise operations, analytics, and decision‑making. The work includes data integration, modeling, quality, performance, and governance.

The successful candidate will apply practical expertise in Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines, working with cross‑functional teams to deliver reliable,