PySpark Developer

Bright Vision Technologies; Edison (NJ); Remote; USD 115,000 - 165,000; Full time

Job summary

Bright Vision Technologies is seeking a PySpark Developer to design, build, validate, and support data solutions that enable trusted information for enterprise operations, analytics, and decision-making.

The role focuses on data integration, modeling, quality, performance, and governance, applying Apache Spark, PySpark/Scala, Spark SQL, distributed processing, and batch/streaming pipelines. You will collaborate with cross-functional teams to deliver reliable, maintainable solutions.

Qualifications

• Strong SQL skills and data-related programming experience.
• Knowledge of data modeling, ETL/ELT, and data integration patterns.
• Experience with data quality, security, and production support.
• Ability to translate business requirements into maintainable data solutions.
• Excellent analytical, documentation, and stakeholder communication skills.

Responsibilities

• Develop and maintain data pipelines, transformations, reports, models, or platform components as required.
• Translate source-to-target and business requirements into validated technical data solutions.
• Implement data quality checks, access controls, monitoring, and failure-recovery procedures.
• Tune SQL, processing jobs, models, dashboards, or platform resources for performance and cost.
• Document data definitions, lineage, operational procedures, and technical decisions.

Skills

SQL proficiency

Data analysis

Documentation & stakeholder

ETL/ELT concepts

Data modeling

Tools

Apache Spark

PySpark/Scala

Spark SQL

Distributed processing

Partitioning & tuning

Batch/streaming pipelines

Job description

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is an opportunity to contribute to technology initiatives in a collaborative environment with opportunities for professional growth.

Job Title: PySpark Developer

Location: Remote

Position Type: Full-time, Direct W2 - [Not open to C2C or 1099]

Salary Range: $115,000–$165,000 Annually

Experience Required: 4+ years

Sponsorship

U.S. Citizens, Green Card holders, EAD holders, and H-1B transfer candidates are encouraged to apply. Bright Vision Technologies is unable to sponsor new H-1B visa petitions for this position.

Job Summary

Bright Vision Technologies is seeking a PySpark Developer to design, build, validate, and support data solutions that make trusted information available for enterprise operations, analytics, and decision-making. The work includes data integration, modeling, quality, performance, and governance. The successful candidate will apply practical expertise in Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines, work with cross-functional teams, and contribute to reliable, maintainable solutions through the delivery lifecycle.

Key Responsibilities

• Develop and maintain data pipelines, transformations, reports, models, or platform components as required by the role.
• Translate source-to-target and business requirements into validated technical data solutions.
• Implement data quality checks, access controls, monitoring, and failure-recovery procedures.
• Tune SQL, processing jobs, models, dashboards, or platform resources for performance and cost.
• Document data definitions, lineage, operational procedures, and technical decisions.

Required Qualifications

• Experience Required: typically 4+ years in a related professional role; exact threshold must match the approved requisition.
• Practical experience with the role-specific technology stack: Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines.
• Professional experience in data engineering, analytics, data management, or the platform area relevant to this role.
• Strong SQL skills and practical experience with the data technologies identified for the position.
• Understanding of data modeling, ETL/ELT, data validation, and integration patterns.
• Experience with data quality, security, access controls, and production support.
• Ability to translate business requirements into accurate and maintainable data solutions.
• Strong analytical, documentation, and stakeholder communication skills.

Preferred Qualifications

• Additional hands‑on depth in Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines.
• Experience with cloud services, automation, and modern delivery practices relevant to the project.
• Familiarity with secure development, accessibility, governance, or regulatory requirements where applicable.
• Relevant professional certifications or advanced training in the role’s technology area.

Bright Vision Technologies is an Equal Opportunity Employer.

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.