Senior Data Engineer: Build Scalable Pipelines & Warehouses

Valiant Technologies LLC; Jersey City (NJ); On-site; USD 110,000 - 150,000; Full time

Job summary

Valiant Technologies LLC is seeking an experienced Data Engineer to build scalable data pipelines, data warehouses, and data integration solutions for analytics, BI, and data science initiatives.

You will transform raw data into analytics-ready datasets and collaborate with analysts, scientists, and stakeholders to enable impactful data insights. Strong Python/SQL and cloud data platform experience are essential.

Qualifications

• Bachelor's degree in CS/IT/Engineering or equivalent experience.
• 5+ years of data engineering, data integration, or ETL development.
• Proficiency in Python and SQL, strong data transformation techniques.
• Hands-on with cloud data platforms and distributed processing.
• Understanding of relational databases, data warehousing, and lake architectures.
• Experience with performance tuning, debugging, and production support.

Responsibilities

• Design, develop, and maintain robust ETL/ELT pipelines for structured and semi-structured data.
• Ingest data from APIs, databases, files, and streaming sources.
• Build scalable data transformation workflows using Python, SQL, and Spark.
• Develop and optimize data warehouse tables, data models, and analytical datasets.
• Implement batch and real-time data processing solutions.
• Improve query performance, pipeline reliability, and data processing efficiency.
• Implement data quality checks, validation rules, reconciliation, and error-handling mechanisms.
• Monitor production pipelines and troubleshoot data failures.
• Apply data security, access controls, and governance standards.
• Collaborate with data analysts, data scientists, architects, and business stakeholders.
• Automate deployments and support CI/CD practices.
• Maintain technical documentation and participate in Agile development activities.

Skills

Python

SQL

PySpark

Education

Bachelor's degree in Computer Science or related field

Tools

Snowflake

Databricks

Amazon Redshift

Google BigQuery

Apache Spark

Hadoop

Kafka

PostgreSQL

SQL Server

Oracle

MySQL

AWS

Azure

GCP

Git

CI/CD

Docker

Job description

Valiant Technologies LLC is seeking an experienced Data Engineer to build scalable data pipelines, data warehouses, and data integration solutions for analytics, BI, and data science initiatives.

You will transform raw data into analytics-ready datasets and collaborate with analysts, scientists, and stakeholders to enable impactful data insights. Strong Python/SQL and cloud data platform experience are essential.