Data Engineer

Robotics Technologies LLC; Jersey City (NJ); Sur place; USD 95 000 - 135 000; Plein temps

Résumé du poste

Robotics Technologies LLC in Jersey City, NJ seeks an experienced Data Engineer to design and maintain scalable data pipelines, warehouses, and integration solutions transforming raw data into analytics-ready datasets for BI, reporting, and data science.

You will work with Python, SQL, PySpark, cloud platforms (AWS/Azure/GCP), and modern data platforms like Snowflake, Databricks, Redshift, or BigQuery, while improving data quality and pipeline reliability.

Qualifications

• Bachelor's degree or equivalent experience.
• 5+ years of data engineering or ETL experience.
• Strong proficiency in Python and SQL.
• Experience with cloud data platforms and distributed processing.
• Understanding of relational databases, data warehousing, and data lake architecture.
• Experience with performance tuning, debugging, and production support.

Responsabilités

• Design, develop, and maintain robust ETL/ELT pipelines for structured and semi-structured data.
• Ingest data from APIs, databases, files, and streaming sources.
• Build scalable data transformation workflows using Python, SQL, and Spark.
• Develop and optimize data warehouse tables, data models, and analytical datasets.
• Implement batch and real-time data processing solutions.
• Improve query performance, pipeline reliability, and data processing efficiency.
• Implement data quality checks, validation rules, reconciliation, and error-handling mechanisms.
• Monitor production pipelines and troubleshoot data failures.
• Apply data security, access controls, and governance standards.
• Collaborate with data analysts, data scientists, architects, and business stakeholders.
• Automate deployments and support CI/CD practices.
• Maintain technical documentation and participate in Agile development activities.

Connaissances

Python

SQL

PySpark

ETL/ELT

Data platforms

Big Data

Databases

Cloud

Data modeling

DevOps

Formation

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field

Outils

Informatica

Azure Data Factory

AWS Glue

Snowflake

Databricks

Redshift

BigQuery

Spark

Hadoop

Kafka

PostgreSQL

SQL Server

Oracle

MySQL

AWS

Azure

GCP

Description du poste

We are seeking an experienced Data Engineer to build and maintain scalable data pipelines, data warehouses, and data integration solutions. The candidate will transform raw data into reliable, analytics-ready datasets and support business intelligence, reporting, and data science initiatives.

Required Technical Skills

Programming: Python, SQL, PySpark.

ETL/ELT: Informatica, Azure Data Factory, AWS Glue, or equivalent data integration tools.

Data Platforms: Snowflake, Databricks, Amazon Redshift, or Google BigQuery.

Big Data: Apache Spark, Hadoop, Kafka.

Databases: PostgreSQL, SQL Server, Oracle, or MySQL.

Cloud: AWS, Azure, or GCP.

Data Modeling: Star schema, snowflake schema, dimensional modeling, and data warehouse design.

DevOps: Git, CI/CD, Docker, and automated testing.

Key Responsibilities

Design, develop, and maintain robust ETL/ELT pipelines for structured and semi-structured data.

Ingest data from APIs, databases, files, and streaming sources.

Build scalable data transformation workflows using Python, SQL, and Spark.

Develop and optimize data warehouse tables, data models, and analytical datasets.

Implement batch and real-time data processing solutions.

Improve query performance, pipeline reliability, and data processing efficiency.

Implement data quality checks, validation rules, reconciliation, and error-handling mechanisms.

Monitor production pipelines and troubleshoot data failures.

Apply data security, access controls, and governance standards.

Collaborate with data analysts, data scientists, architects, and business stakeholders.

Automate deployments and support CI/CD practices.

Maintain technical documentation and participate in Agile development activities.

Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent experience.

5+ years of experience in data engineering, data integration, or ETL development.

Strong proficiency in Python, SQL, and data transformation techniques.

Hands-on experience with cloud data platforms and distributed processing.

Understanding of relational databases, data warehousing, and data lake architecture.

Experience with performance tuning, debugging, and production support.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.