Data Engineer & Insights Analyst - Contract - Remote

Infoorigin Inc; Harrisburg (Dauphin County); Remoto; USD 124.000 - 138.000; Tempo pieno

Descrizione del lavoro

Infoorigin Inc is seeking an experienced Data Engineer & Insights Analyst to design, build, and operate scalable data pipelines in a cloud-first environment. You will work with AWS services (S3, Glue, Redshift, EMR, Athena, Lambda) and develop ETL/ELT solutions using Python, SQL, Java, or Scala.

The role involves data integration from multiple sources, building analytics models, dashboards, and reports to support business decisions while ensuring data quality and governance.

Competenze

• 10+ years in Data Engineering or related roles.
• Strong AWS cloud services experience (S3, Glue, Redshift, EMR, Lambda, Athena).
• Proficiency in Python, Java, Scala, or R.
• Advanced SQL and relational/NoSQL databases (Oracle, MS SQL Server, PostgreSQL, Cassandra).
• Experience with Spark, Hadoop, Kafka; ETL/ELT development.
• Experience with Airflow or similar workflow tools; REST APIs, Git, CI/CD.

Mansioni

• Design, develop, and maintain scalable data pipelines and architecture.
• Build cloud-based data solutions using AWS services listed above.
• Develop and optimize ETL/ELT processes using Python/SQL/Java/Scala.
• Integrate and manage large datasets from multiple sources.
• Work with Spark, Hadoop, and Kafka for big data processing.
• Create data models, dashboards, reports for BI and analytics.
• Ensure data quality, governance, security, and privacy.
• Support data migration and system modernization projects.

Strumenti

AWS S3

AWS Glue

AWS Redshift

AWS EMR

AWS Lambda

AWS Athena

Python

Java

Scala

R

SQL

Oracle

MS SQL Server

PostgreSQL

Cassandra

Apache Spark

Hadoop

Kafka

Informatica

MuleSoft

Talend

TIBCO

Apache Airflow

Luigi

Azkaban

REST APIs

Git

CI/CD

Data Modeling

Data Vault

Data Governance

Metadata Management

Data Lineage

Descrizione del lavoro

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process.

Harrisburg, PA, US

2 days ago Requisition ID: 2394

Salary Range: $90.00 To $100.00 Hourly

Location: Harrisburg,PA

Work Mode: Remote

Employment Type: Contract

Interview Mode: First Video then In Person

Job Description

We are looking for an experienced Data Engineer & Insights Analyst with 10+ years of experience in designing, developing, and maintaining scalable data pipelines and cloud-based data solutions. The ideal candidate should have strong expertise in AWS services, Python, SQL, ETL processes, and Big Data technologies.

The candidate will be responsible for collecting, integrating, transforming, and analyzing large and complex datasets to support business intelligence, reporting, and data-driven decision-making. The role also involves developing data architecture, improving data quality, and collaborating with data scientists, analysts, and business teams.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and data architecture.
• Build cloud-based data solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, Lambda, and RDS.
• Develop and optimize ETL/ELT processes using Python, SQL, Java, or Scala.
• Integrate, transform, and manage large datasets from multiple sources.
• Work with Big Data technologies such as Apache Spark, Hadoop, and Kafka.
• Build and manage data orchestration workflows using Apache Airflow, AWS Step Functions, or similar tools.
• Develop and maintain relational and NoSQL databases.
• Create data models, dashboards, reports, and analytical solutions to support business decision-making.
• Implement data quality checks, monitoring, logging, and validation processes.
• Ensure data governance, security, privacy, and compliance standards.
• Support data migration, conversion, and system modernization projects.
• Collaborate with data scientists, research analysts, and business stakeholders to deliver reliable data solutions.

Required Skills & Qualifications

Minimum 10+ years of experience in Data Engineering, Data Integration, or related roles.

Strong hands‑on experience with AWS cloud services, including S3, Glue, Redshift, EMR, Lambda, and Athena.

Proficiency in programming languages such as Python, Java, Scala, or R.

Advanced knowledge of SQL and relational/NoSQL databases such as Oracle, MS SQL Server, PostgreSQL, and Cassandra.

Experience with Big Data technologies including Apache Spark, Hadoop, and Kafka.

Hands‑on experience with ETL tools such as Informatica, MuleSoft, Talend, or TIBCO.

Knowledge of Apache Airflow, Luigi, Azkaban, or similar workflow management tools.

Experience with Git, CI/CD pipelines, REST APIs, and data integration.

Strong understanding of data modeling, dimensional modeling, Star/Snowflake schemas, and Data Vault.

Knowledge of data governance, metadata management, data lineage, and data quality frameworks.

Strong analytical, problem‑solving, project management, and communication skills.

Preferred Experience

Experience working with higher education or student-level datasets.

Knowledge of integrating education data with employment and wage records.

Experience handling large, complex, and confidential datasets.

Experience developing analytics solutions, dashboards, and reports for business or government organizations.

Ideal Candidate Profile

A strong Data Engineer with a combination of AWS cloud expertise, Python/SQL programming, ETL development, and Big Data experience, along with the ability to transform complex datasets into meaningful insights and support data-driven decision-making.