Data Engineer

Altis Technology; United States; Remote; USD 85,000 - 106,000; Full time

Job summary

Altis Technology is seeking an experienced Data Engineer to optimize large-scale ETL pipelines and convert Python code to PySpark for a healthcare data context across Canada. This remote contract role focuses on improving processing efficiency and reliability of nightly workflows.

You will collaborate with business and IT teams, enhancing data processing speed, scalability, and pipeline automation, while maintaining data integrity and quality for analytics.

Qualifications

• 7+ years of Apache Spark (PySpark) experience with large-scale data processing.
• 3+ years Python development, ETL and data transformation.
• 3+ years with GitHub/GitLab for version control.
• Strong ETL, testing, validation and data pipeline integration.
• Asset: AWS EMR, Airflow, S3, Glue, Redshift, Lake Formation and IaC tools such as Terraform/CloudFormation.

Responsibilities

• Convert existing Python code into optimized PySpark for ETL pipelines.
• Test, validate, and implement code changes to maintain data integrity.
• Review data enrichment and nightly pipeline performance improvements.
• Develop code optimizations for speed, scalability, and efficiency.
• Document processes and suggest improvements to data workflows.
• Collaborate with IT to enhance pipeline automation as time permits.

Skills

PySpark

Python

GitHub/GitLab

ETL pipelines

Spark performance

Airflow

AWS EMR

AWS data services

Terraform/CloudFormation

Communication

Job description

Data Engineer, Python & PySpark (Contract)

Location: Remote, Canada
Language: English, strong written and verbal communication skills
Duration: November 2026 to March 2027, anticipated start November 2, 2026

About the Opportunity

Are you a skilled Data Engineer who enjoys solving complex data challenges and improving performance? An organization in the healthcare information sector is seeking an experienced Data Engineer to optimize high-volume ETL pipelines that process critical healthcare data from across Canada.

In this role, you'll collaborate with business and IT teams to improve data processing efficiency, convert Python code to PySpark, and strengthen the reliability of nightly data workflows. Your work will help ensure accurate, timely data is available to support meaningful healthcare analytics.

What's In It for You

• Work on a high-impact project supporting healthcare data and analytics across Canada.
• Enjoy the flexibility of a fully remote contract opportunity.
• Collaborate with knowledgeable business and IT professionals on meaningful technical challenges.
• Apply your expertise to improve large-scale data processing and pipeline performance.

Your Responsibilities

• You'll convert existing Python code into optimized PySpark, ensuring accuracy, performance, and seamless integration into ETL pipelines.
• You'll test, validate, and implement code changes to maintain data integrity and processing reliability.
• You'll review existing data enrichment packages and identify opportunities to improve nightly pipeline performance.
• You'll develop and integrate code optimizations to improve processing speed, scalability, and efficiency.
• You'll document technical processes and recommend improvements to existing data workflows.
• You'll collaborate with IT teams, as time permits, to enhance pipeline automation, functionality, and overall efficiency.

Skills and Qualifications

• 7+ years of experience with Apache Spark (PySpark), including large-scale data processing and performance optimization.
• 3+ years of hands-on Python development experience, ideally involving ETL pipelines and data transformation.
• 3+ years of experience using GitLab or GitHub for version control and collaborative development.
• Strong understanding of ETL processes, code optimization, testing, validation, and data pipeline integration.
• Experience with AWS EMR Clusters and Apache Airflow is considered an asset.
• Familiarity with AWS data services, including S3, Glue, Redshift, and Lake Formation, as well as infrastructure-as-code tools such as Terraform or CloudFormation, is an asset.
• Strong analytical, problem-solving, documentation, and communication skills, with the ability to collaborate across technical and business teams.

All qualified applicants will receive fair consideration for employment. We welcome individuals of all backgrounds, experiences, and identities including those who identify as women, members of racialized groups, Indigenous Peoples, persons with disabilities, and 2SLGBTQIA+ communities. If you require an accommodation, please review our accessibility policy and reach out to our accessibility officer with any questions. Our human recruiters review all applications and always make the final hiring decision. On occasion, we also use AI-assisted tools to help review applications.