Remote PySpark Engineer – Data Pipelines & Analytics

Bright Vision Technologies; Oregon; Hybrid; USD 115,000 - 165,000; Full time

Job summary

Bright Vision Technologies is seeking a PySpark Developer to design, build, validate, and support data solutions that enable trusted information for enterprise operations and analytics.

You will work on data integration, modeling, quality, performance, and governance, applying expertise in Spark, PySpark/Scala, Spark SQL, and batch/streaming pipelines while collaborating with cross-functional teams.

Qualifications

• 4+ years in a related data engineering or analytics role.
• Hands-on experience with Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines.
• Strong SQL and data modeling skills; knowledge of ETL/ELT patterns.
• Experience with data quality, data governance, security controls, and production support.

Responsibilities

• Develop and maintain data pipelines, transformations, and platform components as required.
• Translate requirements into validated data solutions and dashboards.
• Implement data quality checks, access controls, monitoring, and fault-tolerance procedures.
• Tune SQL and jobs for performance and cost efficiency.
• Document data definitions, lineage, and operational procedures.

Skills

PySpark

Spark SQL

SQL

Distributed processing

Data modeling

ETL/ELT

Data quality

Documentation

Tools

Apache Spark

Scala

Job description

Bright Vision Technologies is seeking a PySpark Developer to design, build, validate, and support data solutions that enable trusted information for enterprise operations and analytics.

You will work on data integration, modeling, quality, performance, and governance, applying expertise in Spark, PySpark/Scala, Spark SQL, and batch/streaming pipelines while collaborating with cross-functional teams.