Remote Spark Data Engineer — Pipelines & Analytics

Bright Vision Technologies; Edison (NJ); Remote; USD 115,000 - 165,000; Full time

Job summary

Bright Vision Technologies is seeking an Apache Spark Developer to design, build, validate, and support data solutions that make trusted information available for enterprise operations, analytics, and decision-making. The role includes data integration, modeling, quality, performance, and governance.

You will apply expertise in Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines while collaborating with cross-functional teams to

Qualifications

• 4+ years in a related professional data role.
• Hands-on with Apache Spark ecosystem: Spark SQL, PySpark/Scala, distributed processing.
• Experience in data engineering, analytics, or data management.
• Strong SQL skills and experience with the referenced data technologies.
• Understanding of data modeling, ETL/ELT, data validation and integration.
• Experience with data quality, security, access controls, and production support.
• Ability to translate business requirements into maintainable data solutions.
• Strong analytical, documentation, and stakeholder communication skills.

Responsibilities

• Develop and maintain data pipelines, transformations, models, or platform components.
• Translate source-to-target and business requirements into data solutions.
• Implement data quality checks, access controls, monitoring, and failure recovery.
• Tune SQL and processing jobs for performance and cost.
• Document data definitions, lineage, procedures, and technical decisions.

Skills

SQL skills

Analytical

Documentation

Stakeholder communication

Tools

Apache Spark

PySpark/Scala

Spark SQL

Distributed processing

Partitioning

Tuning

Batch/Streaming pipelines

Job description

Bright Vision Technologies is seeking an Apache Spark Developer to design, build, validate, and support data solutions that make trusted information available for enterprise operations, analytics, and decision-making. The role includes data integration, modeling, quality, performance, and governance.

You will apply expertise in Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines while collaborating with cross-functional teams to