Apache Spark Developer

Bright Vision Technologies; Edison (NJ); A distancia; USD 115.000 - 165.000; Jornada completa

Descripción de la vacante

Bright Vision Technologies is seeking an Apache Spark Developer to design, build, validate, and support data solutions that make trusted information available for enterprise operations, analytics, and decision-making. The role includes data integration, modeling, quality, performance, and governance.

You will apply expertise in Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines while collaborating with cross-functional teams to

Formación

• 4+ years in a related professional data role.
• Hands-on with Apache Spark ecosystem: Spark SQL, PySpark/Scala, distributed processing.
• Experience in data engineering, analytics, or data management.
• Strong SQL skills and experience with the referenced data technologies.
• Understanding of data modeling, ETL/ELT, data validation and integration.
• Experience with data quality, security, access controls, and production support.
• Ability to translate business requirements into maintainable data solutions.
• Strong analytical, documentation, and stakeholder communication skills.

Responsabilidades

• Develop and maintain data pipelines, transformations, models, or platform components.
• Translate source-to-target and business requirements into data solutions.
• Implement data quality checks, access controls, monitoring, and failure recovery.
• Tune SQL and processing jobs for performance and cost.
• Document data definitions, lineage, procedures, and technical decisions.

Conocimientos

SQL skills

Analytical

Documentation

Stakeholder communication

Herramientas

Apache Spark

PySpark/Scala

Spark SQL

Distributed processing

Partitioning

Tuning

Batch/Streaming pipelines

Descripción del empleo

Job Title: Apache Spark Developer

Location: Remote

Position Type: Full-time, Direct W2 - [Not open to C2C or 1099]

Salary Range: $115,000-$165,000 Annually

Experience Required: 4+ years

Sponsorship

U.S. Citizens, Green Card holders, EAD holders, and H-1B transfer candidates are encouraged to apply. Bright Vision Technologies is unable to sponsor new H-1B visa petitions for this position.

Job Summary

Bright Vision Technologies is seeking a Apache Spark Developer to design, build, validate, and support data solutions that make trusted information available for enterprise operations, analytics, and decision-making. The work includes data integration, modeling, quality, performance, and governance. The successful candidate will apply practical expertise in Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines, work with cross-functional teams, and contribute to reliable, maintainable solutions through the delivery lifecycle.

Key Responsibilities

• Develop and maintain data pipelines, transformations, reports, models, or platform components as required by the role.
• Translate source-to-target and business requirements into validated technical data solutions.
• Implement data quality checks, access controls, monitoring, and failure-recovery procedures.
• Tune SQL, processing jobs, models, dashboards, or platform resources for performance and cost.
• Document data definitions, lineage, operational procedures, and technical decisions.

Required Qualifications

• Experience Required: typically 4+ years in a related professional role; exact threshold must match the approved requisition.
• Practical experience with the role-specific technology stack: Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines.
• Professional experience in data engineering, analytics, data management, or the platform area relevant to this role.
• Strong SQL skills and practical experience with the data technologies identified for the position.
• Understanding of data modeling, ETL/ELT, data validation, and integration patterns.
• Experience with data quality, security, access controls, and production support.
• Ability to translate business requirements into accurate and maintainable data solutions.
• Strong analytical, documentation, and stakeholder communication skills.

Preferred Qualifications

• Additional hands-on depth in Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines.
• Experience with cloud services, automation, and modern delivery practices relevant to the project.
• Familiarity with secure development, accessibility, governance, or regulatory requirements where applicable.
• Relevant professional certifications or advanced training in the role’s technology area.

Bright Vision Technologies is an Equal Opportunity Employer.

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.