Senior Data Engineer (OpAI) — Naval Data Pipelines

The Marlin Alliance, Inc.; San Diego (CA); Sur place; USD 110 000 - 180 000; Plein temps

Résumé du poste

The Marlin Alliance, Inc. is seeking a Senior Data Engineer (OpAI) to design, build, and operationalize advanced data pipelines and analytics supporting Navy and DoD mission challenges. This role requires deep experience across data engineering, distributed systems, event streaming, cloud data frameworks, and mission-focused analytics.

Incorporated in 2002, The Marlin Alliance specializes in transforming client operations with governed, machine-consumable data and secure DoD solutions.

Qualifications

• Strong programming skills in Python, Go, Rust, Pandas, R, SQL, or related languages.
• 10 years of experience in data/analytical roles within tech, data, or related fields.
• Willingness to travel.
• 100% On Site willingness.
• Ability to safely carry tools and equipment aboard ship and navigate shipboard environments.
• Ability to operate in Navy vessel environments and confined spaces.
• Ability to comply with Navy safety requirements and wear PPE.
• Ability to perform activities on shipboard operations or testing evolutions.
• Candidates should be prepared to complete a coding exercise during interview.

Responsabilités

• Collaborate with cross-functional teams to address Navy operational challenges using data pipelines and analytics.
• Design, develop, and implement data pipelines and analytics for naval applications.
• Perform exploratory data analysis, algorithm development, and testing.
• Normalize and structure data to common standards for interoperability.
• Work with data formats such as CSV, JSON, XML, Parquet, and ORC.
• Develop and deploy data pipelines in real-world operational environments.
• Deploy, monitor, and optimize data pipelines for high performance and reliability.
• Implement event streaming pipelines using Kafka, AWS Kinesis, RabbitMQ, or ZeroMQ.
• Utilize distributed computing platforms such as AWS Lambda, Dask, or Spark.
• Leverage cloud-native tools including AWS S3, RDS, EFS, SNS, and SQS.
• Utilize data pipeline frameworks such as AirByte, Airflow, dbt, Iceberg, and Snowflake.
• Work with GIS data using ArcGIS, PostGIS, and related tooling.
• Implement containers with Docker or Kubernetes.
• Apply cybersecurity principles to DoD data applications.
• Communicate findings with technical and mission stakeholders.

Connaissances

Python

Go

Rust

Pandas

R

SQL

Formation

Master of Science in Computer Science, Data Science, Geography, Math, Machine Learning, or Statistics

Outils

Apache Airflow

dbt

Apache Iceberg

Snowflake

ArcGIS

PostGIS

Kafka

AWS Lambda

Dask

Spark

Description du poste

The Marlin Alliance, Inc. is seeking a Senior Data Engineer (OpAI) to design, build, and operationalize advanced data pipelines and analytics supporting Navy and DoD mission challenges. This role requires deep experience across data engineering, distributed systems, event streaming, cloud data frameworks, and mission-focused analytics.

Incorporated in 2002, The Marlin Alliance specializes in transforming client operations with governed, machine-consumable data and secure DoD solutions.