Intermediate Data Engineer

NES Fircroft Ltd; Calgary; On-site; CAD 80,000 - 110,000; Full time

Job summary

A leading engineering staffing provider seeks an Intermediate Data Engineer to design scalable data architectures and optimize workflows. The role involves developing data pipelines, managing ETL processes, and collaborating with teams to deliver high-quality data solutions. Ideal candidates will have hands-on experience with PySpark, AWS Glue, and strong analytical skills.

Qualifications

• 1–3 years of hands-on experience with PySpark and AWS Glue.
• 3+ years of Python scripting and SQL query optimization.
• 2–4 years in data pipeline development and cloud platforms.

Responsibilities

• Develop and maintain scalable data pipelines using PySpark.
• Design and manage serverless ETL workflows with AWS Glue.
• Collaborate to integrate Microsoft Fabric for analytics.

Skills

PySpark

AWS Glue

Python

SQL

Data Pipeline Development

Cloud Platforms

Data Modeling

ETL/ELT Workflow Design

Version Control (Git)

Big Data Tools

Analytical Thinking

Job description

Intermediate Data Engineer

We are seeking a talented Intermediate Data Engineer passionate about designing scalable data architectures and optimizing complex workflows. This role suits someone with hands-on experience in cloud environments, robust data pipeline development, and modern data engineering frameworks. Join a forward-thinking team committed to innovation, collaboration, and delivering high-quality data solutions.

Key Responsibilities:

1. Develop, optimize, and maintain scalable data pipelines using PySpark and big data ecosystems.
2. Design, implement, and manage serverless ETL/ELT workflows with AWS Glue and related AWS services.
3. Collaborate with teams to integrate Microsoft Fabric (analytics and lakehouse architecture) where applicable.
4. Create reusable data transformation scripts and applications using Python.
5. Write and maintain complex SQL queries for data analysis and transformation across relational databases.
6. Partner with stakeholders to understand requirements and design efficient data models and end-to-end data integration solutions.
7. Ensure best practices in version control, data quality, and workflow automation.

Must-Have Skills & Experience:

1. PySpark: 1–3 years of hands-on experience.
2. AWS Glue: 1–3 years with serverless data processing.
3. Python: 3+ years with scripting and automation skills.
4. SQL: 3+ years of writing and optimizing complex queries.
5. Data Pipeline Development: 2–4 years of experience.
6. Cloud Platforms: 2+ years working within AWS and/or Azure.
7. Data Modeling: 1–2 years designing scalable schemas.
8. ETL/ELT Workflow Design: 2–3 years with orchestration and automation.
9. Version Control (Git): 1–2 years in collaborative projects.
10. Big Data Tools (e.g., Hadoop, Spark): 1–2 years with distributed data systems.
11. Analytical Thinking: Strong debugging, performance tuning, and workflow optimization skills.

Bonus Points:

• Exposure to or foundational knowledge of Microsoft Fabric is a strong asset.

With over 90 years of combined experience, NES Fircroft (NES) is a leading engineering staffing provider across sectors including Oil & Gas, Power & Renewables, Chemicals, Construction & Infrastructure, Life Sciences, Mining, and Manufacturing worldwide. With more than 80 offices in 45 countries, we provide engineering and technical expertise globally. We support our contractors beyond recruitment, assisting with visas, work permits, benefits, and accommodations to ensure safety and compliance.