Senior Data Engineer - Cloud ML & Spark SME (Remote)

Bln24, Llc.; McLean (VA); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Medical benefits

Remote work options

Job summary

BLN24 in McLean, VA seeks a Technical SME: Data Engineer to transform large regulatory data into actionable insights. You will design decision-analytic and ML models in a cloud-native environment, focusing on reliability and governance.

The role emphasizes Spark-based pipelines, data cleansing, and collaboration with policy and technical teams to communicate results. Prior federal or regulatory experience and GitHub collaboration are a plus.

Qualifications

• 5+ years of experience with decision analysis and ML algorithms in a cloud-native environment.
• Experience with Spark architecture, core APIs, SparkSQL, and streaming capabilities.
• Data cleaning and comparative trend analyses on large-scale data.
• Bachelor's in Mathematics/Data Science; Master's preferred.

Responsibilities

• Design, build, and implement ML models in a cloud-native environment.
• Develop large-scale data processing pipelines using Spark APIs, SparkSQL, and streaming capabilities.
• Perform data cleaning and create comparative trend analyses on large-scale datasets.
• Translate organizational goals into working ML models, statistical models, and pattern recognition solutions.
• Ensure ML and AI model work complies with AI governance policy and bias-testing requirements.
• Contribute to open-source and community solutions, managing source code in GitHub.
• Collaborate with program, policy, and technical teams to communicate findings and model results.

Skills

Decision analysis

Machine learning

Data cleaning

Communication of findings

Education

Bachelor's degree in Mathematics, Data Science, or similar

Master's degree in Mathematics, Data Science, or similar (preferred)

Tools

Apache Spark

SparkSQL

Spark Streaming

GitHub

Zeppelin

AWS EMR Spark

Job description

BLN24 in McLean, VA seeks a Technical SME: Data Engineer to transform large regulatory data into actionable insights. You will design decision-analytic and ML models in a cloud-native environment, focusing on reliability and governance.

The role emphasizes Spark-based pipelines, data cleansing, and collaboration with policy and technical teams to communicate results. Prior federal or regulatory experience and GitHub collaboration are a plus.