Senior Cloud Data Engineer: Databricks & Spark

CGI Group, Inc.; Salt Lake City (UT); On-site; USD 80,000 - 139,000; Full time

Benefits offered by this job

Competitive compensation

Comprehensive insurance options

401(k) matching contributions and the

Paid time off

Paid parental leave

Tuition assistance

Wellness programs

Job summary

CGI Group, Inc. is seeking a Senior Data Engineer to design, develop, and support secure, scalable enterprise data platforms using Databricks, Spark, and Azure.

This on-site role is in the Salt Lake City, UT area and focuses on building cloud data pipelines and analytics capabilities. You will design ETL/ELT pipelines, optimize SQL, and implement data modeling for BI and AI initiatives while collaborating with architects, product owners, and cross-functional teams.

Qualifications

• Bachelor's degree or equivalent in a technical field.
• 6+ years designing, developing, and supporting enterprise data platforms or cloud analytics.
• Hands-on experience with Databricks and Apache Spark (PySpark).
• Proficient in Python and SQL with strong SQL optimization skills.
• Experience with Databricks Workspaces, Delta Lake, Unity Catalog, and DLT.
• Familiarity with Azure Data Factory and Azure cloud services.
• Experience with Kafka, REST APIs, JSON/XML/SOAP and data integration.
• Proficient in Linux and shell scripting; CI/CD with Azure DevOps or GitHub Actions.

Responsibilities

• Design, develop, test, deploy, and maintain enterprise data pipelines.
• Build ETL/ELT pipelines with Databricks, Spark, Delta Lake, and ADF.
• Create scalable data models for BI, analytics, and AI initiatives.
• Develop, optimize, and maintain SQL queries and transformations.
• Develop streaming and messaging solutions using Kafka.
• Monitor, troubleshoot, and optimize production pipelines; implement long-term fixes.
• Apply data quality, governance, security, and performance best practices across platforms.
• Mentor junior engineers and contribute to engineering standards.

Skills

SQL

Python

Scala

ETL/ELT design

Data modeling

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Apache Spark

Delta Lake

Azure Data Factory

Azure

Git

Unity Catalog

Kafka

REST APIs

SOAP web services

Job description

CGI Group, Inc. is seeking a Senior Data Engineer to design, develop, and support secure, scalable enterprise data platforms using Databricks, Spark, and Azure.

This on-site role is in the Salt Lake City, UT area and focuses on building cloud data pipelines and analytics capabilities. You will design ETL/ELT pipelines, optimize SQL, and implement data modeling for BI and AI initiatives while collaborating with architects, product owners, and cross-functional teams.