DataStage Developer

Epsilon Solutions Ltd.; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

A leading company in data solutions is seeking a Senior Data Engineer to design and implement high-quality data pipelines. The ideal candidate will have extensive experience in SQL and ETL processes, along with a strong understanding of the Software Development Life Cycle. This role involves collaborating with development teams and presenting technical topics to ensure best practices are followed.

Qualifications

• 8+ years of experience in a complex development environment.
• Extensive hands-on experience in ETL data-stage and complex SQL.
• Experience in creating stored procedures and Unix shell scripting.

Responsibilities

• Design and implement data pipelines with high quality standards.
• Facilitate meetings to design and troubleshoot projects.
• Ensure ETL pipelines are validated for completeness and accuracy.

Skills

PL / SQL

SQL

ETL

Unix shell scripting

GitHub

Job description

Get AI-powered advice on this job and more exclusive features.

Responsibilities :

• Strong experience in design and implement data pipelines.
• Strong PL / SQL and SQL skills in relational database environment.
• Create and review technical design documents, understand how the design will be used in the code development process, and facilitate meetings to design, troubleshoot, and execute projects.
• Participate in walkthrough reviews of technical specifications, programs, code, and unit test plans.
• Plan design / implementation activities, ensure technical solution quality, provide third-level support for various technologies, and drive technical platform evolution and improvements.
• Present technical topics at regular team meetings and manage low-level planning of work packages.
• Estimate activities / tasks required to perform design, coding, and unit testing.
• Ensure ETL pipelines are produced with the highest quality standards, metadata and validated for completeness and accuracy.
• Work closely with development teams to learn about needs, current processes and to promote best practices.
• Knowledge of the Software Development Life Cycle (SDLC) - Agile, Waterfall, and Iterative methods.
• Working knowledge GitHub, CI / CD Pipeline.

Must Have :

• 8+ years of experience working in complex and time-sensitive development environment.
• Extensive hands-on experience in ETL data-stage.
• Extensive hands-on complex SQL experience (MSSQL Server, Teradata).
• Extensive experience in creating stored procedure and Unix shell scripting.
• Support at-scale testing to enable simulations, UAT and reporting.