Senior Data Engineer

Persistent Systems; Ottawa; Hybrid; CAD 80,000 - 100,000; Full time

Job summary

A leading digital engineering firm in Ottawa is looking for a Senior Data Engineer to build data pipelines and work with enterprise-level systems. The ideal candidate will have over 5 years of experience in Python and SQL, alongside expertise in data warehousing and cloud architectures. This role offers hybrid work options and a competitive salary along with benefits including insurance coverage, talent development, and flexible working hours.

Benefits

Competitive salary and benefits package

Flexible work hours

Insurance coverage for family

Qualifications

• 5+ years of Python coding experience.
• 5+ years of SQL Server development for large datasets.
• Experience in developing and deploying ETL pipelines using Databricks Pyspark.

Responsibilities

• Build and optimize data pipelines for efficient data ingestion.
• Design, develop, and deploy Spark programs in Databricks.
• Monitor and troubleshoot Databricks jobs for performance.

Skills

Python programming

SQL development

Data warehousing

Cloud architectures

ETL pipeline development

Data modeling

Tools

Databricks

Azure Synapse

Snowflake

Job description

Overview

Senior Talent Acquisition - Persistent Systems

About Persistent

We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 12 of the 30 most innovative global companies, 60% of the largest banks in the US and India, and numerous innovators across the healthcare ecosystem.

Our disruptor’s mindset, commitment to client success, and agility to thrive in the dynamic environment have enabled us to sustain our growth momentum by reporting $360.2M revenue in Q3 FY25, delivering 4.3% Q-o-Q and 19.9% Y-o-Y growth. Our 23,900+ global team members, located in 19 countries, have been instrumental in helping the market leaders transform their industries. We are also pleased to share that Persistent won in four categories at the prestigious 2024 ISG Star of Excellence Awards, including the Overall Award based on the voice of the customer. We were included in the Dow Jones Sustainability World Index, setting high standards in sustainability and corporate responsibility. We were awarded for our state-of-the-art learning and development initiatives at the 16th TISS LeapVault CLO Awards. In addition, we were cited as the fastest-growing IT services brand in the 2024 Brand Finance India 100 Report. Throughout our market-leading growth, we’ve maintained a strong employee satisfaction score of 8.2 / 10.

About Position

This position is for a Senior Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.

Responsibilities

• Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
• Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
• Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
• Proficient in developing programs in Python and SQL
• Experience with Data warehouse Dimensional data modeling.
• Working with event based / streaming technologies to ingest and process data.
• Working with structured, semi structured and unstructured data.
• Optimize Databricks jobs for performance and scalability to handle big data workloads.
• Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
• Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
• Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
• Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Expertise You'll Bring

• 5+ years Python coding experience.
• 5+ years - SQL Server based development of large datasets
• 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
• Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
• Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
• Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
• Experience with Cloud based data architectures, messaging, and analytics.
• Any experience with Airflow is a Plus.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Diversity and Inclusion

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We offer hybrid work options and flexible working hours to accommodate various needs and preferences.
• Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment. We are committed to creating an inclusive environment where all employees can thrive.

Values and opportunities

• Accelerate growth, both professionally and personally
• Impact the world in powerful, positive ways, using the latest technologies
• Enjoy collaborative innovation, with diversity and work-life wellbeing at the core
• Unlock global opportunities to work and learn with the industry’s best

Let’s unleash your full potential at Persistent

For more detail, please contact – Recruiter name (Recruiter email id)

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”