Senior Data Engineer - Cloud Data Pipelines & Governance

MACHINE LEARNING TECHNOLOGIES LLC; Harrisburg (Dauphin County); On-site; USD 96,000 - 152,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC in Harrisburg, PA seeks a Senior Data Engineer to design and implement cloud data pipelines for a manufacturing domain. You will work with AWS services, implement scalable data models, and ensure data quality across streaming and batch workloads.

You will collaborate with teams to define data governance, lineage, and integration patterns, leveraging Spark, Hadoop, and modern ETL tools in a fast-paced environment. U.S. work authorization required.

Qualifications

• Hands-on experience with cloud-based data services such as AWS (S3, EC2, Glue, EMR, RDS, Redshift, Athena, Lambda, DynamoDB).
• Proficiency in Python, R, Java, C++, or Scala for data processing.
• Strong SQL and NoSQL database knowledge (Oracle, MS SQL Server, Postgres, Cassandra).
• Experience with Git and CI/CD pipelines.
• Knowledge of data modeling techniques: dimensional modeling, data vault, star/snowflake.
• Familiarity with AWS Glue Data Catalog and data governance concepts.
• REST API design and integration patterns.
• Experience with Hadoop, Spark, Kafka; and workflow tools like Airflow.
• Experience with ETL tools such as Informatica, MuleSoft, Talend, TIBCO.

Skills

AWS

Python

Java

C++

Scala

SQL

NoSQL

Git

CI/CD

Data Modeling

REST API

Hadoop

Spark

Kafka

Airflow

ETL Tools

Tools

AWS Glue Data Catalog

Job description

MACHINE LEARNING TECHNOLOGIES LLC in Harrisburg, PA seeks a Senior Data Engineer to design and implement cloud data pipelines for a manufacturing domain. You will work with AWS services, implement scalable data models, and ensure data quality across streaming and batch workloads.

You will collaborate with teams to define data governance, lineage, and integration patterns, leveraging Spark, Hadoop, and modern ETL tools in a fast-paced environment. U.S. work authorization required.