Senior Data Platform Engineer

EPAM Systems; Toronto; On-site; CAD 120,000 - 135,000; Full time

Benefits offered by this job

Extended Healthcare & Dental

RRSP with Company match

Professional learning opportunities

Telehealth

Paid Time Off

Stock Purchase Program

Unlimited access to LinkedIn learning

Job summary

EPAM Systems is seeking a Senior Data Platform Engineer to design and optimize data platforms on AWS, focusing on Python-based pipelines and secure access across data products. You will work with technologies like EMR, Lake Formation, and Iceberg while ensuring high performance and data integrity.

Responsibilities include building scalable data platforms, implementing data fabric concepts, and automating infrastructure with Terraform in a collaborative, multinational team environment.

Qualifications

• Extensive experience with AWS data ecosystem services (Lake Formation, EMR, Glue, EC2, CloudWatch).
• Strong Python and Spark development for data pipelines and data products.
• Experience in cloud automation and deployment with Terraform.
• Experience delivering data platforms at scale with focus on security and data governance.

Responsibilities

• Design and build scalable secure data platforms on AWS.
• Develop and maintain data pipelines using Python, SQL and Spark.
• Implement open table formats like Hudi or Iceberg for modern data lakes.
• Automate infrastructure and deployments using Terraform.

Skills

Python

SQL

Spark

Terraform

AWS

Tools

EMR

Glue Catalog

Lake Formation

Iceberg

Hudi

Job description

We are looking for a skilled Senior Data Platform Engineer with a strong Python background to join our team. This role is ideal for a data engineering professional experienced in delivering robust data platforms and implementing data fabric solutions. As a Senior Data Platform Engineer, you will be instrumental in building and optimizing the data infrastructure on AWS for our customers, ensuring high performance, data integrity, and secure access across data products.

Req: 997715695

Responsibilities

• Design and build scalable secure data platforms on AWS using services such as EMR, Glue Catalog and Lake Formation
• Develop and maintain efficient data pipelines using Python, SQL and Spark with a focus on performance and reliability
• Implement open table formats like Hudi or Iceberg to support modern data lake architectures
• Automate infrastructure and deployment using Terraform ensuring consistent and repeatable environments

Requirements

• Extensive experience with AWS data ecosystem services such as Lake Formation, EMR, Glue, EC2 and CloudWatch including the configuration and optimization of these services for data processing with a strong focus on security, scalability and logging
• Solid understanding and hands-on experience with open table formats such as Hudi or Iceberg
• Proven track record of coding and software development within high-performing data engineering teams with a focus on delivering data products at scale
• Demonstrated experience with cloud automation and deployment using tools like Terraform
• Strong SQL and Spark skills for effective data transformation and processing
• Ability to enforce and uphold data quality through validation, cleansing and governance best practices to ensure data accuracy and consistency

Nice to have

• Experience in the financial industry particularly in investment banking
• Knowledge of additional data processing libraries and tools
• Expertise in one of the major real-time data processing frameworks such as Apache Flink or Kafka Streams
• Experience in building event-driven and/or streaming data services

We offer

• Extended Healthcare with Prescription Drugs, Dental and Vision, and Healthcare Spending Account (Company Paid)
• Life and AD&D Insurance (Company Paid)
• Employee Assistance Program (Company Paid)
• Telehealth (Company Paid)
• Short-term Disability (Company Paid)
• Long-Term Disability
• Paid Time Off (including vacation and sick days)
• Registered Retirement Savings Plan (RRSP) with Company match
• Maternity/Parental/Adoption Leave Top-up
• Employee Stock Purchase Program
• Critical Illness Insurance
• Employee Discounts
• Unlimited access to LinkedIn learning solutions

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our clients, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.Engineer the Future with a Career at EPAM (https://www.youtube.com/embed/NU_mnNITn2o?si=IiCxyQ4sr1YJWxDG)

This posting includes a base salary range EPAM Canada would reasonably expect to pay the selected candidate. Individual compensation offers within the range are based on a variety of factors, including, but not limited to, experience, credentials, education, training, the demand for the role, skillset, and overall business and local labour market considerations. Most candidates are hired at a salary within the range disclosed. Salary range: CA$120,000 - CA$135,000. In addition, the details highlighted in this job posting above are a general description of all other expected benefits and compensation for the position.

EPAM Canada welcomes and encourages applications from candidates with disabilities. Please contact WFA Human Resource CA [e-mail] if you have questions in this regard, or if you require an accommodation to complete the application process. Click here (https://www.epam.com/careers/locations/canada) to review EPAM’s Accessibility for Ontarians with Disabilities Accessibility Policies and Multi-Year Access.

An artificial intelligence system is software that is developed with one or more techniques that can, for a given set of human-defined objectives, using algorithmic information processing, generate outputs such as content, predictions, recommendations, or decisions with varying levels of autonomy(“AI”). Tasks that humans have traditionally done by thinking and reasoning are increasingly being done by, or with the help of, AI to help create efficiencies. EPAM may use AI during the recruitment process, in connection with collecting or processing your personal data. Some (non-exhaustive) examples of tasks that EPAM may use AI for include conducting initial screening, creating transcripts of interviews, and assessing applications/CVs against defined job description criteria to make suggestions to the individuals evaluating your candidacy. Your personal data and the results of any processing are not shared with AI applications outside of EPAM infrastructure. While EPAM may use AI to help create efficiencies during the recruitment process, EPAM does not use AI to make hiring decisions, which is done by EPAM Talent Acquisition and management.

EPAM Systems, Inc. is an equal opportunity employer. We recognize the value of diversity and inclusion in creating success for our customers, business partners, shareholders, employees and communities. We are committed to recruiting, hiring, developing and promoting employees without discrimination. As a global employer, this commitment includes complying with all laws in the countries in which we operate. Nevertheless, we believe equal employment practices should not be limited to what the law requires. Equal opportunity and inclusion are essential to motivate, empower and recognize the best in everyone.

At EPAM, employment actions are based on individual qualifications, without regard to race, color, religion, creed, gender, pregnancy status, sexual orientation, gender identity, gender expression, marital or familial status, national origin, ancestry, genetics, age, disability status, veteran status, citizenship status when otherwise legally able to work, or any other characteristic protected by law.