#3 - DATA ENGINEER

Digipulse Technologies, Inc.; Cherry Hill Township, Northern (NJ, KY); Hybrid; USD 120,000 - 160,000; Full time

Job summary

Digipulse Technologies, Inc. seeks a highly skilled data engineer to design, develop, and maintain scalable data pipelines and ETL processes. You will collaborate with stakeholders to translate data requirements into robust data infrastructure and models supporting analytics and reporting.

Responsibilities include ensuring data integrity, performing quality checks, and documenting best practices while relocating or traveling as needed to client sites across the United States.

Qualifications

• Master’s degree in computer science/computer applications/engineering.
• Bachelor’s degree plus five years of progressive related experience in lieu of a master’s.
• Relocation/telecommuting may be required plus travel to client locations in the United States.

Responsibilities

• Design, develop and maintain scalable data pipelines, datasets, and systems for the company’s data infrastructure.
• Collaborate with stakeholders to understand data requirements.
• Develop ETL processes to transform raw data for analysis and cost effectiveness.
• Design and implement data models to support analytics and reporting needs.
• Ensure data integrity, consistency, and performance and identify errors and performance issues.
• Perform data quality checks for accuracy and consistency across systems and platforms.
• Document data pipelines, processes and best practices for knowledge sharing and future reference.
• Identify and resolve issues to ensure uninterrupted data flow and availability.

Skills

Oracle

SQL Server

UNIX

Python

AWS

Azure

Git

Apache Spark

Apache Kafka

Airflow

Google BigQuery

SQL

ETL

Informatica

DB2

Snowflake

Education

Master’s degree in computer science/computer applications/engineering

Bachelor’s degree in computer science/computer applications/engineering plus five years of progressive experience

Job description

Critical role in designing, developing and maintaining scalable data pipelines, data sets, and systems for the company’s data infrastructure. Will be collaborating with stakeholders to understand data requirements; Develop ETL (Extract, Transform, Load) processes to change raw data into usable formats for analysis, use and cost effectiveness utilizing techniques such as partitioning, indexing, and caching; Design and implement data models to support the business analytical and reporting needs; ensure data integrity, consistency, and performance and identify errors and performance issues; perform data quality checks for accuracy and consistency of data across systems and platforms; Work closely with business analysts/software engineers to understand their data needs and provide technical expertise and support. Document data pipelines, processes, and best practices for knowledge sharing and future reference; Identify and resolve issues to ensure uninterrupted data flow and availability. Relocation/ telecommuting may be required plus travel to various unanticipated client locations within the United States for short- and long-term assignments.

LANGUAGES, SKILLS AND TOOLS

3 or more of the following tools shall be utilized: Oracle, SQL Server, UNIX, Python, AWS, Azure, Git, Apache (Spark, Kafka, Airflow), Google BigQuery. SQL, ETL, Informatica, DB2, Snowflake

EDUCATION

Master’s degree in computer science/computer applications/engineering (Mechanical/ Information Technology/Civil/ Electrical/Electronics). Will accept a bachelor’s degree in computer science/computer application(s)/engineering (Mechanical/ Information Technology/Civil/ Electrical/Electronics) plus five (5) years of progressive experience in related fields in lieu of a master’s degree. Will accept foreign education US equivalent.