Data Engineer — Big Data & AWS Pipelines

careers-dminc; Crownsville (MD); On-site; USD 75,000 - 91,000; Full time

Job summary

DMI, LLC in Crownsville, MD is seeking a full-time Data Engineer to support a strategic program for the State of Maryland. The role focuses on building and maintaining robust data pipelines, leveraging AWS big data tools, and enabling analytics across multiple teams.

The candidate will work with stakeholders to optimize data architecture, ensure secure data handling, and drive actionable insights from large data sets.

Qualifications

• Bachelor's degree in a technical field (CS, IS, Eng, or related).
• 5+ years as a Data Engineer with product development focus.
• Excellent written and verbal communication across teams.
• Strong analytics for unstructured datasets.
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with SQL and NoSQL databases (Postgres, MongoDB, Elasticsearch).
• Experience with AWS services: EC2, EMR, RDS, Redshift.
• Experience with stream-processing: Storm, Spark-Streaming.
• Programming in Python/Java/Scala; strong SQL skills.
• Ability to build and optimize large data pipelines and data sets.

Responsibilities

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets meeting business requirements.
• Automate processes and optimize data delivery for scalability.
• Build infrastructure for ETL using SQL and AWS big data tech.
• Develop analytics tools to derive insights on acquisition and efficiency.
• Collaborate with Executives, Product, Data, and Design teams on data needs.
• Ensure data separation and security across regions and centers.
• Develop data tools for analytics and data science teams.

Skills

Problem-solving

Communication

Analytical thinking

Cross-functional collaboration

Education

Bachelor's degree in CS/Engineering/IT

Tools

Hadoop

Spark

Kafka

PostgreSQL

MongoDB

Elasticsearch

AWS (EC2/EMR/RDS/Redshift)

Storm

Spark-Streaming

Python

Java

Scala

SQL

Job description

DMI, LLC in Crownsville, MD is seeking a full-time Data Engineer to support a strategic program for the State of Maryland. The role focuses on building and maintaining robust data pipelines, leveraging AWS big data tools, and enabling analytics across multiple teams.

The candidate will work with stakeholders to optimize data architecture, ensure secure data handling, and drive actionable insights from large data sets.