Data Engineer

Vforce Infotech; Edison (NJ); On-site; USD 60,000 - 80,000; Full time

Job summary

Vforce Infotech in Edison, NJ is seeking a Data Engineer to design, develop, and maintain scalable data pipelines and platforms supporting analytics, BI, and ML initiatives.

You will build ETL workflows, model data, and work with cloud and big data tech (Hadoop, Spark, Hive, SQL Server, Oracle, Azure Data Lake, AWS Redshift) to deliver reliable insights and empower data-driven decisions. This onsite role emphasizes collaboration with cross-functional teams and governance standards.

Qualifications

• Proven experience designing large-scale big data systems (Hadoop/Spark/Hive)
• Strong SQL skills with SQL Server and Oracle; cloud options like Azure Data Lake
• ETL development with Informatica or Talend; cloud-native ETL knowledge is a plus
• Data modeling techniques, including dimensional modeling for data warehousing
• Programming in Python and Java for data engineering tasks
• Experience with AWS and Azure cloud platforms and big data services
• Knowledge of analytics concepts including model training, query management, and BI tools like Looker
• Familiarity with Bash, RESTful APIs, and Linux/Unix environments for automation

Responsibilities

• Develop, implement, and optimize ETL pipelines to move data to data warehouses and lakes
• Design and maintain scalable data models and schemas for query performance
• Build and manage big data systems with Hadoop ecosystem components (Hive, Spark)
• Collaborate with cross-functional teams to integrate data sources and enforce governance
• Develop RESTful APIs and automate workflows using Bash or Python
• Support BI by creating dashboards/reports with Looker
• Contribute to agile development cycles to improve data infrastructure and security

Skills

SQL

Python

Java

Bash

Data modeling

ETL design

Big data concepts

Looker

Tools

Informatica

Talend

Azure Data Lake

AWS Redshift

Microsoft SQL Server

Oracle

Hadoop

Apache Hive

Spark

RESTful APIs

Linux/Unix

Looker

Job description

Vforce Infotech is looking for a Data Engineer in Edison, NJ (onsite) to design, develop, and maintain scalable data pipelines and platforms that support advanced analytics, business intelligence, and machine learning initiatives.

Responsibilities

• Develop, implement, and optimize ETL (Extract, Transform, Load) pipelines to move data from multiple sources into centralized data warehouses and data lakes, using Informatica, Talend, or custom scripting.
• Design and maintain scalable data models and schemas using dimensional modeling to improve query performance in SQL environments including Microsoft SQL Server, Oracle, and cloud-based platforms such as Azure Data Lake and AWS Redshift.
• Build and manage big data systems with Hadoop ecosystem components including Apache Hive and Spark to process large volumes of structured and unstructured data.
• Partner with cross-functional teams to integrate linked data sources and apply data management best practices across public cloud platforms including Azure Data Lake and AWS Cloud.
• Develop RESTful APIs and automate workflows using Bash (Unix shell scripting) or Python to improve data access and pipeline automation.
• Support business intelligence by creating dashboards, reports, and visualizations using tools such as Looker to communicate insights to stakeholders.
• Contribute in agile development cycles to improve the data infrastructure, focusing on high availability, security, and compliance with organizational standards.

Requirements

• Proven experience designing and implementing large-scale big data systems using Hadoop, Spark, Hive, or similar frameworks.
• Strong SQL skills, including experience with Microsoft SQL Server, Oracle, and cloud-based options such as Azure Data Lake and cloud databases.
• Hands-on ETL experience using tools such as Informatica or Talend, with knowledge of cloud-native ETL solutions considered a plus.
• Knowledge of data modeling techniques, including dimensional modeling for data warehousing.
• Programming experience with languages including Python and Java for data engineering software development tasks.
• Experience with AWS and Azure, particularly public cloud storage solutions and big data services.
• Understanding of analytics concepts such as model training, query management, analysis practices, and business intelligence tools like Looker.
• Familiarity with shell scripting (Bash), RESTful API development, and Linux/Unix environments for automation.

Technologies

• ETL, Informatica, Talend, custom scripting
• Dimensional modeling, SQL
• Microsoft SQL Server, Oracle, Azure Data Lake, AWS Redshift
• Hadoop, Apache Hive, Spark
• RESTful APIs, Bash, Python
• Looker, AWS, Azure, AWS Cloud
• Linux/Unix

Role Summary

Vforce Infotech is seeking a Data Engineer to help drive data-driven decision-making across the organization. The role focuses on building and maintaining scalable data pipelines and systems for advanced analytics, business intelligence, and machine learning. The position emphasizes leveraging big data platforms, cloud technologies, and modern data management practices to deliver actionable insights and support a data-centric culture.

Experience

• Proven experience designing and implementing large-scale big data systems using Hadoop, Spark, Hive, or similar frameworks.
• Strong proficiency in SQL and experience with Microsoft SQL Server, Oracle, and cloud-based options such as Azure Data Lake or cloud databases.
• Hands-on ETL development experience with tools such as Informatica or Talend, with familiarity with cloud-native ETL solutions noted as a plus.
• Solid understanding of data modeling techniques, including dimensional modeling for data warehousing.
• Expertise in programming languages such as Python and Java for data engineering tasks.
• Experience working with cloud platforms (AWS, Azure) with emphasis on public cloud storage solutions and big data services.
• Knowledge of analytics concepts including model training, query management, analysis skills, and business intelligence tools such as Looker.
• Familiarity with Bash, RESTful API development, and Linux/Unix environments for automation.

Compensation and Location

Location: Edison, NJ (onsite)

Salary: USD 60,000 - 80,000 per year