Data Engineer I - Build Scalable Pipelines & Cloud Data

Unrivaled Metal Buildings; New York (NY); On-site; USD 70,000 - 90,000; Full time

Job summary

A leading company in metal structures based in New York is seeking a Junior Data Engineer to develop scalable data processing pipelines. The successful candidate will collaborate with a data team to enhance data sources and ensure data integrity. Required qualifications include a BA or BS in Computer Science or related fields, along with experience in Apache Spark, SQL, and ETL processes. Knowledge of Informatica is a plus. This position requires US citizenship.

Qualifications

• Bachelor's degree in a relevant field is required.
• Experience with ETL processes using Apache Spark or Databricks is important.
• Familiarity with SQL or Spark SQL is needed.

Responsibilities

• Develop and maintain scalable automated data pipelines.
• Construct cloud data solutions based on best practices.
• Support regular and ad hoc data querying and analysis.

Skills

Apache Spark

ETL pipelines

SQL

Automated testing

Dimensional modeling

Education

BA or BS in Computer Science, Information Systems, or related discipline

Tools

Databricks

Spark SQL

Informatica

Job description

A leading company in metal structures based in New York is seeking a Junior Data Engineer to develop scalable data processing pipelines. The successful candidate will collaborate with a data team to enhance data sources and ensure data integrity. Required qualifications include a BA or BS in Computer Science or related fields, along with experience in Apache Spark, SQL, and ETL processes. Knowledge of Informatica is a plus. This position requires US citizenship.