Remote Data Engineer & Insights Architect

Infoorigin Inc; Harrisburg (Dauphin County); Remoto; USD 124.000 - 138.000; Tempo pieno

Descrizione del lavoro

Infoorigin Inc is seeking an experienced Data Engineer & Insights Analyst to design, build, and operate scalable data pipelines in a cloud-first environment. You will work with AWS services (S3, Glue, Redshift, EMR, Athena, Lambda) and develop ETL/ELT solutions using Python, SQL, Java, or Scala.

The role involves data integration from multiple sources, building analytics models, dashboards, and reports to support business decisions while ensuring data quality and governance.

Competenze

• 10+ years in Data Engineering or related roles.
• Strong AWS cloud services experience (S3, Glue, Redshift, EMR, Lambda, Athena).
• Proficiency in Python, Java, Scala, or R.
• Advanced SQL and relational/NoSQL databases (Oracle, MS SQL Server, PostgreSQL, Cassandra).
• Experience with Spark, Hadoop, Kafka; ETL/ELT development.
• Experience with Airflow or similar workflow tools; REST APIs, Git, CI/CD.

Mansioni

• Design, develop, and maintain scalable data pipelines and architecture.
• Build cloud-based data solutions using AWS services listed above.
• Develop and optimize ETL/ELT processes using Python/SQL/Java/Scala.
• Integrate and manage large datasets from multiple sources.
• Work with Spark, Hadoop, and Kafka for big data processing.
• Create data models, dashboards, reports for BI and analytics.
• Ensure data quality, governance, security, and privacy.
• Support data migration and system modernization projects.

Strumenti

AWS S3

AWS Glue

AWS Redshift

AWS EMR

AWS Lambda

AWS Athena

Python

Java

Scala

R

SQL

Oracle

MS SQL Server

PostgreSQL

Cassandra

Apache Spark

Hadoop

Kafka

Informatica

MuleSoft

Talend

TIBCO

Apache Airflow

Luigi

Azkaban

REST APIs

Git

CI/CD

Data Modeling

Data Vault

Data Governance

Metadata Management

Data Lineage

Descrizione del lavoro

Infoorigin Inc is seeking an experienced Data Engineer & Insights Analyst to design, build, and operate scalable data pipelines in a cloud-first environment. You will work with AWS services (S3, Glue, Redshift, EMR, Athena, Lambda) and develop ETL/ELT solutions using Python, SQL, Java, or Scala.

The role involves data integration from multiple sources, building analytics models, dashboards, and reports to support business decisions while ensuring data quality and governance.