Data Engineer - Cloud, Big Data & Analytics

DMI; Crownsville (MD); Presencial; USD 93.000 - 114.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

401(k) match

Healthcare coverage

Tuition assistance

Wellness programs

Descripción de la vacante

DMI is seeking a full-time Data Engineer to support a strategic program with the State of Maryland. You will create and optimize data pipelines, integrate diverse data sources, and enable analytics across teams to drive operational insights and efficiency.

The role requires strong experience with big data tools (Hadoop, Spark, Kafka), SQL/NoSQL databases, and AWS services, with a focus on scalable, secure data infrastructure across regions.

Formación

• 5+ years in a Data Engineer role with product development focus.
• Excellent written and verbal communication across teams.
• Strong analytics with unstructured datasets.
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Relational SQL and NoSQL databases including Postgres, MongoDB, Elasticsearch.
• AWS cloud services: EC2, EMR, RDS, Redshift.
• Experience with stream-processing systems: Storm, Spark-Streaming.
• Programming: Python, Java, Scala.
• Advanced SQL and diverse database familiarity.
• Experience building and optimizing big data pipelines and data sets.

Responsabilidades

• Create and maintain data pipeline architectures.
• Assemble large, complex data sets to meet business requirements.
• Automate processes and redesign infrastructure for scalability.
• Build infrastructure for ETL from diverse sources using SQL and AWS big data tech.
• Develop analytics tools using the data pipeline for actionable insights.
• Collaborate with Exec, Product, Data and Design teams for data needs.
• Ensure data security across multiple data centers and AWS regions.

Conocimientos

Data engineering

SQL

Python

NoSQL

ETL

AWS

Spark

Hadoop

Kafka

Cross-functional communication

Educación

Bachelor’s degree in CS/IS/Engineering/related field

Herramientas

Hadoop

Spark

Kafka

PostgreSQL

MongoDB

Elasticsearch

AWS (EC2, EMR, RDS, Redshift)

Storm/Spark-Streaming

Descripción del empleo

DMI is seeking a full-time Data Engineer to support a strategic program with the State of Maryland. You will create and optimize data pipelines, integrate diverse data sources, and enable analytics across teams to drive operational insights and efficiency.

The role requires strong experience with big data tools (Hadoop, Spark, Kafka), SQL/NoSQL databases, and AWS services, with a focus on scalable, secure data infrastructure across regions.