Data Engineer

Compunnel, Inc.; Jersey City (NJ); On-site; USD 100,000 - 130,000; Full time

Job summary

A technology company in Jersey City is seeking an experienced Data Engineer to build and maintain scalable data infrastructure that supports analytics and machine learning initiatives. The ideal candidate will focus on ensuring data is reliable, accessible, and optimized for performance across various processing systems. Required experience includes 7–10 years in data engineering, along with strong SQL and programming skills in Python, Scala, or Java. The role offers opportunities to manage data platforms like Snowflake and optimize pipelines.

Qualifications

• 7–10 years of experience in data engineering or a related field.

Responsibilities

• Build and maintain ETL/ELT pipelines for batch and streaming data processing.
• Manage and optimize data platforms including data warehouses and data lakes.
• Work with distributed processing systems such as Spark and Kafka.
• Implement data quality checks, validation processes, monitoring, and lineage tracking.
• Optimize data pipelines for scalability, performance, and efficiency.

Skills

Strong SQL skills

Programming skills in Python

Programming skills in Scala

Programming skills in Java

Experience with big data tools

Knowledge of cloud-based data architectures

Tools

Snowflake

BigQuery

S3

Spark

Kafka

Job description

We are seeking a Data Engineer to build and maintain scalable data infrastructure that supports analytics and machine learning initiatives. This role focuses on ensuring data is reliable, accessible, and optimized for performance across batch and real-time processing systems.

Key Responsibilities

• Build and maintain ETL/ELT pipelines for batch and streaming data processing
• Manage and optimize data platforms including data warehouses and data lakes such as Snowflake, BigQuery, and S3
• Work with distributed processing systems such as Spark and Kafka
• Implement data quality checks, validation processes, monitoring, and lineage tracking
• Optimize data pipelines for scalability, performance, and efficiency

Required Qualifications

• 7–10 years of experience in data engineering or a related field

Preferred Qualifications

• Strong SQL and programming skills in Python, Scala, or Java
• Experience with big data tools and workflow orchestration systems
• Knowledge of cloud-based data architectures
• Understanding of data modeling and schema design