Remote Data Scientist - Spark ML & Lakehouse Expert

VivSoft Technologies LLC; United States; À distance; USD 135 000 - 145 000; Plein temps

Avantages offerts par ce poste

Medical benefits

Life Insurance

PTO and holidays

401K with employer match

Professional development reimbursement

Résumé du poste

VivSoft Technologies LLC is seeking an experienced Data Scientist to analyze complex, multi-source datasets, build predictive models, and deliver actionable insights for strategic decisions. The role emphasizes statistical rigor, distributed ML with Apache Spark, lakehouse architectures, and AI-assisted analytics.

The candidate must be a U.S. citizen with an active Secret clearance and have 5+ years in data science, Python/SQL proficiency, and experience with Grafana dashboards.

Qualifications

• Bachelor's degree in a technical field or equivalent qualifying experience.
• Minimum 5 years of professional Data Science/Analytics experience.
• U.S. Citizenship with active Secret clearance.
• Strong statistical foundation: regression, probabilistic methods, hypothesis testing, time-series analysis.
• Hands-on experience with distributed ML using Spark at scale.
• Proficiency in Python and SQL; experience with distributed SQL engines.
• Understanding lakehouse architectures and partitioning/file layout optimization.
• Experience with LLM-assisted AI tools and AI-enabled analytics workflows.
• Experience creating dashboards and metrics with Grafana or similar tools.

Responsabilités

• Analyze large, multi-source datasets using statistical methods and time-series analysis.
• Develop, validate, and deploy distributed ML models with Spark MLlib.
• Query and analyze lakehouse data with Athena, Trino, and Spark SQL.
• Apply LLM-assisted AI tools to accelerate data exploration and validate results.
• Define operational metrics and build dashboards using Grafana.
• Design experiments and hypothesis tests to evaluate changes and model performance.
• Collaborate with Data Engineers and AI Engineers on data requirements and productionization.
• Document methods, assumptions, and uncertainties for stakeholders.

Connaissances

Statistics

Python

SQL

Apache Spark

Spark MLlib

Lakehouse

LLM-assisted tools

Grafana

Formation

Bachelor's degree in a related technical field

Outils

Apache Spark

Spark MLlib

AWS Athena

Trino

Spark SQL

Apache Iceberg

Grafana

Description du poste

VivSoft Technologies LLC is seeking an experienced Data Scientist to analyze complex, multi-source datasets, build predictive models, and deliver actionable insights for strategic decisions. The role emphasizes statistical rigor, distributed ML with Apache Spark, lakehouse architectures, and AI-assisted analytics.

The candidate must be a U.S. citizen with an active Secret clearance and have 5+ years in data science, Python/SQL proficiency, and experience with Grafana dashboards.