TS/SCI Data Scientist — Spark, Python, ETL (On-Site)

Tomorrow Hire Llc.; Chantilly; On-site; EUR 204,000 - 222,000; Full time

Benefits offered by this job

Company-Paid Health Insurance

Life and Disability Insurance

401(k) Retirement Contribution 15%

200 hours PTO + 11 holidays

Recruitment and business development 0

Job summary

Tomorrow Hire Llc. in Chantilly, VA seeks a Data Scientist to design, build, and operate data processing pipelines for structured and unstructured datasets. You will transform logs into actionable reports and dashboards and support cloud-based analytics capabilities.

The role requires hands-on experience with Spark, PySpark, Python, SQL, ETL processes, and big data technologies, plus ability to work with customers and partners to translate objectives into technical solutions in an Agile setting.

Qualifications

• Demonstrated experience with Spark, PySpark, and Python.
• Demonstrated experience with ETL and data mapping/extraction/loading.
• Experience developing analytic reports with CloudWatch and Kibana.
• Experience transforming OS and data logs into reports, metrics and dashboards.
• Experience using RegEx in data extraction/transformation.
• Experience with SQL, MySQL, and PostgreSQL.
• Experience processing XML and JSON data formats.
• Experience with notebooks and Visual Studio for data modeling.

Responsibilities

• Design, develop, and maintain data processing and ETL workflows for structured and unstructured datasets.
• Perform data mapping, extraction, transformation, loading, standardization, and validation across data sources.
• Use Spark, PySpark, and Python to process and analyze complex datasets.
• Convert OS, system, event logs into analytic reports, metrics, and dashboards.
• Develop analytic reports using CloudWatch and Kibana.
• Perform data quality analysis to ensure data integrity.
• Create ETL design documentation with source-to-target mappings and data dictionaries.
• Interface with customers and integration partners to clarify objectives.
• Support Agile development; contribute to task definitions, scope, and reviews.
• Develop and maintain processing pipelines, workflows, and documentation.
• Triage and transform datasets into standardized data models.

Skills

Spark

PySpark

Python

SQL

ETL processes

Big data technologies

CloudWatch

Kibana

RegEx

Tools

Databricks

EMR

Elasticsearch

Logstash

Kibana

Notebooks

Visual Studio

Job description

Tomorrow Hire Llc. in Chantilly, VA seeks a Data Scientist to design, build, and operate data processing pipelines for structured and unstructured datasets. You will transform logs into actionable reports and dashboards and support cloud-based analytics capabilities.

The role requires hands-on experience with Spark, PySpark, Python, SQL, ETL processes, and big data technologies, plus ability to work with customers and partners to translate objectives into technical solutions in an Agile setting.