Senior Data Engineer - Cloud & Big Data Pipelines

Artifintech; Harrisburg (Dauphin County); In loco; USD 120.000 - 160.000; Tempo pieno

Descrizione del lavoro

Artifintech in Harrisburg, PA seeks a data engineer to design, build, and optimize cloud-based data services and analytics pipelines. You will develop data models, implement data governance, and integrate data across systems using SQL/NoSQL databases, REST APIs, and modern ETL tools.

Responsibilities include working with AWS tools (S3, Glue, Redshift), big data frameworks (Hadoop, Spark), and orchestration platforms (Airflow, Azkaban, Luigi) to support reliable data-driven decision making for

Competenze

• Hands-on experience with cloud-based data services such as AWS
• Proficiency in programming languages: Python, R, Java, C++, Scala
• Proficiency in relational SQL and NoSQL databases, including Oracle, MS SQL Server, Postgres, Cassandra
• Experience with version control systems such as Git and CI/CD pipelines
• Knowledge of data modeling techniques including dimensional modeling, data vault, and star/snowflake schemas
• Familiarity with data cataloging and metadata management tools such as AWS Glue Data Catalog
• Understanding of data governance, data lineage, and data quality frameworks
• Knowledge of REST API design and integration patterns
• Experience with big data tools: Hadoop, Spark, Kafka
• Experience with data pipeline and workflow management tools: Airflow, Azkaban, Luigi
• Experience with data integration services solutions from vendors such as Informatica, MuleSoft, Talend, and TIBCO
• Experience with stream-processing systems: Storm, Spark-Streaming

Conoscenze

AWS cloud services

Python

R

Java

C++

Scala

SQL databases

NoSQL databases

Oracle

PostgreSQL

Cassandra

Git

CI/CD pipelines

Data modeling

Dimensional modeling

Data vault

Star/snowflake schemas

AWS Glue Data Catalog

Data governance

Data lineage

Data quality

REST API design

Hadoop

Spark

Kafka

Airflow

Azkaban

Luigi

Informatica

MuleSoft

Talend

TIBCO

Storm

Spark-Streaming

Strumenti

Git

CI/CD pipelines

Apache Hadoop

Apache Spark

Kafka

Airflow

Azkaban

Luigi

Informatica

MuleSoft

Talend

TIBCO

Descrizione del lavoro

Artifintech in Harrisburg, PA seeks a data engineer to design, build, and optimize cloud-based data services and analytics pipelines. You will develop data models, implement data governance, and integrate data across systems using SQL/NoSQL databases, REST APIs, and modern ETL tools.

Responsibilities include working with AWS tools (S3, Glue, Redshift), big data frameworks (Hadoop, Spark), and orchestration platforms (Airflow, Azkaban, Luigi) to support reliable data-driven decision making for