Data Platform Engineer

Delaware Nation Industries; Washington; On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical coverage (PPO or HDHP)

Vision coverage

Dental coverage

Matching 401K

Short- and Long-Term Disability

Pet Insurance

Professional Development/Education Re

Parking and Transit Benefits

Job summary

Delaware Nation Industries is seeking a Platform Architect to design and maintain scalable cloud-native data platforms across AWS/Azure/GCP. Lead data lake/warehouse strategies, enable self-service through CI/CD templates and IaC, and ensure data security and compliance.

You will collaborate with Data Architects, Software Developers and Data Scientists to deliver end-to-end data products, implement ETL/ELT pipelines, and optimize performance and cost.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related technical field.
• Minimum 4 years in data engineering, platform engineering, or a highly technical DevOps or data role.
• Proficiency in Python, Java, or Scala; advanced SQL skills; and experience with NoSQL and distributed database systems.
• Hands-on experience with data lake and warehouse technologies such as Databricks, Snowflake, Apache Spark, or Apache Kafka.
• Familiarity with containerization tools (Docker, Kubernetes), workflow orchestration platforms (Airflow, Dagster), and Infrastructure as Code tools (Terraform).
• Must have a TS/SCI Security clearance

Responsibilities

• Design and maintain scalable, cloud-native data platforms (data lakes, lake houses, data warehouses).
• Build reusable CI/CD templates and Infrastructure as Code to empower data scientists and analysts.
• Develop ETL and ELT frameworks for batch and streaming data and ensure data security and compliance.
• Monitor platform performance, storage, and query responsiveness; collaborate to deliver end-to-end data products.

Skills

Python

Java

Scala

Advanced SQL

NoSQL

Distributed databases

Databricks

Snowflake

Apache Spark

Apache Kafka

Docker

Kubernetes

Terraform

Airflow

Dagster

Education

Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related technical field

Tools

RESTful APIs

Job description

Platform Architecture:

• Design and maintain scalable, cloud-native data platforms, including data lakes, lake houses, and data warehouses (e.g., AWS, Azure, GCP).

Self-Service Enablement:

• Build reusable CI/CD templates and Infrastructure as Code to allow data scientists and analysts to provision environments and build pipelines independently.
• Develop robust ETL and ELT frameworks for both batch and streaming data.
  Implement strict role-based access controls, data encryption, data lineage tracking, and compliance frameworks to protect sensitive digital health or enterprise data.
• Monitor platform performance, storage use, and query responsiveness to ensure high availability and cost efficiency. Collaborate with Data Architects, Software Developers, and Data Scientists to integrate RESTful APIs and deliver cohesive end-to-end data products.

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related technical field.
• Minimum 4 years in data engineering, platform engineering, or a highly technical DevOps or data role.
• Proficiency in Python, Java, or Scala; advanced SQL skills; and experience with NoSQL and distributed database systems.
• Hands-on experience with data lake and warehouse technologies such as Databricks, Snowflake, Apache Spark, or Apache Kafka.
• Familiarity with containerization tools (Docker, Kubernetes), workflow orchestration platforms (Airflow, Dagster), and Infrastructure as Code tools (Terraform).
• Must have a TS/SCI Security clearance

Benefits Include:

• Covers 100% of employee benefit premiums, including Medical (PPO or HDHP Option), Vision, Dental
• Matching 401K
• Short- and Long-Term Disability
• Pet Insurance
• Professional Development/Education Reimbursement
• Parking and Transit Benefits for NY, NJ, ATL, and DC Metro areas

Other Duties:

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice.