Senior Data Scientist - Remote, End-to-End Pipelines

West 4th Strategy; United States; Remote; USD 140,000 - 155,000; Full time

Job summary

West 4th Strategy seeks an experienced Data Scientist to design, build, and maintain scalable data pipelines for the DoD. You will apply Databricks, Python, Spark, and SQL to transform complex DoW datasets into actionable insights and dashboards.

The role emphasizes quality controls, governance, and enterprise analytics in a fully remote environment. Ideal candidates bring 3–10 years in data science/analytics, strong ETL experience, and a track record of delivering data products in

Qualifications

• Three (3) to ten (10) years of directly related experience as a Data Analyst or Data Scientist.
• Hands-on expertise with Databricks, Python, Spark, SQL, and distributed-compute tools for ETL and data transformation.
• Demonstrated ability to build, maintain, and optimize end-to-end data pipelines with strong data-quality controls.
• Experience implementing validation frameworks, schema enforcement, anomaly detection, and other data-quality techniques.
• Experience integrating structured and semi-structured datasets from multiple systems and applying business rules for governed downstream delivery.
• Ability to automate ingestion, transformation, and reconciliation workflows using Python scripts, SQL logic, and Databricks orchestration.
• Strong analytical and troubleshooting skills, including the ability to diagnose pipeline failures and propose remediations.

Responsibilities

• Design, build, and maintain scalable end-to-end data pipelines and analytical workflows supporting DoW mission data
• Develop ETL and data-transformation processes using Databricks, Python, Spark, SQL, and distributed-compute tools
• Automate data ingestion, transformation, reconciliation, and downstream delivery across multiple source systems
• Implement data-quality controls, validation frameworks, schema enforcement, anomaly detection, and integrity checks
• Integrate structured and semi-structured datasets while applying business rules to ensure accurate, governed data products
• Troubleshoot ETL issues and pipeline failures, identify root causes, and implement effective remediations
• Collaborate with cross-functional teams and mission stakeholders to translate requirements into scalable analytical solutions
• Improve data-processing efficiency and reliability across enterprise analytics workflows
• Develop dashboards, models, and decision-support artifacts that support reconciliation, reporting, and mission-critical analysis

Skills

Databricks

Python

Spark

SQL

Data pipelines

ETL

Education

B.A./B.S. or M.A./M.S. in a relevant field

Tools

Delta Lake

Unity Catalog

Auto Loader

Streaming

Job description

West 4th Strategy seeks an experienced Data Scientist to design, build, and maintain scalable data pipelines for the DoD. You will apply Databricks, Python, Spark, and SQL to transform complex DoW datasets into actionable insights and dashboards.

The role emphasizes quality controls, governance, and enterprise analytics in a fully remote environment. Ideal candidates bring 3–10 years in data science/analytics, strong ETL experience, and a track record of delivering data products in