Data Engineer

VDart Inc; Parsippany-Troy Hills (NJ); On-site; USD 110,000 - 180,000; Full time

Job summary

VDart Inc is hiring a Senior Data Engineer for an onsite role in Princeton, NJ. The candidate will accelerate the Data Platform Stack to support developers, data analysts, and architects on data initiatives, ensuring consistent data delivery architecture across projects.

Responsibilities include ETL tuning, SQL tuning, data flow documentation, and designing data conversion strategies from legacy systems to new platforms. Strong experience in data warehousing patterns and AWS services is required.

Qualifications

• 7+ years of ETL/Data engineering experience.
• 8+ years in BI and data warehousing initiatives.
• Proficient with relational databases and SQL.
• Experience with AWS data pipelines and cloud services.

Responsibilities

• Analyze and interpret complex data sets; identify data anomalies and resolve issues.
• Relate business processes to data subject domains and data models.
• Collaborate with Data Leads, Analysts, and QA to validate requirements.

Skills

ETL Data Transformation

SQL

AWS

Data Warehousing

Python

Spark

Education

Bachelor's in Mathematics/CS or related field

Postgraduate degree preferred

Tools

Informatica

Talend

Microsoft SSIS

Matillion ELT

Snowflake

Job description

Senior Data Engineer

Contract

Princeton, NJ (Onsite)

We are looking for a Senior Data Engineer to expedite our Data Platform Stack to support our developers, database architects, data analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects in a dynamic environment.

Responsibilities

• Analyze and interpret complex data sets. Ability to identify data anomalies and resolve data issues
• Understand specific business processes and domain concepts and relate them to data subject domains
• Collaborate with Data Leads, Data Analysts and QA analysts to validate requirements, participate in user requirement sessions
• Perform tests and validate data flows and prepare ETL processes according to business requirements
• Perform ETL tuning and SQL tuning
• Ability to document data flows representing business logic in ETL routines
• Design and implement data conversion strategy from legacy to new platforms
• Perform design validation, reconciliation, and error handling in data load processes
• Design and prepare technical specifications and guidelines including ER diagrams and related documents Qualifications
• Must be well versed with Data warehousing concepts including design patterns (Star schemas, Snowflake design schemas). Must be aware of data modeling concepts including the data modeling Normal forms
• Knowledge of AWS Infrastructure including S3, SNS, Ec2, CloudWatch and RDS
• 8-9 years working in ETL/Data transformation projects with one or more related products such as Informatica or Talend or Microsoft SSIS
• 8+ years working in business intelligence, data warehousing initiatives
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases like Oracle or Ms Sql Server or Vertica.
• Good to have at least 1+ years working with Matillion ELT tool and Snowflake Database
• Good to have experience in building AWS Data Pipelines using Python or Spark, SparkSQL in any of Cloud Environments (AWS / Azure / Google).
• Good to have - Experience with any of the NoSQL datastores such as ElasticSearch, MongoDB, DynamoDB, Cassandra

Education

Bachelor's in mathematics, Computer Science or related technical field. Post graduate degree preferred. Minimum 7+ years of relevant experience.