Senior Data Engineer (Databricks & Cloud Analytics)

CGI Group, Inc.; Salt Lake City (UT); On-site; USD 80,000 - 139,000; Full time

Benefits offered by this job

Competitive compensation

Comprehensive insurance options

401(k) matching contributions and the

Paid time off

Paid parental leave

Tuition assistance

Wellness programs

Job summary

CGI Group, Inc. is seeking a Senior Data Engineer to design, develop, and support secure, scalable enterprise data platforms using Databricks, Spark, and Azure.

This on-site role is in the Salt Lake City, UT area and focuses on building cloud data pipelines and analytics capabilities. You will design ETL/ELT pipelines, optimize SQL, and implement data modeling for BI and AI initiatives while collaborating with architects, product owners, and cross-functional teams.

Qualifications

• Bachelor's degree or equivalent in a technical field.
• 6+ years designing, developing, and supporting enterprise data platforms or cloud analytics.
• Hands-on experience with Databricks and Apache Spark (PySpark).
• Proficient in Python and SQL with strong SQL optimization skills.
• Experience with Databricks Workspaces, Delta Lake, Unity Catalog, and DLT.
• Familiarity with Azure Data Factory and Azure cloud services.
• Experience with Kafka, REST APIs, JSON/XML/SOAP and data integration.
• Proficient in Linux and shell scripting; CI/CD with Azure DevOps or GitHub Actions.

Responsibilities

• Design, develop, test, deploy, and maintain enterprise data pipelines.
• Build ETL/ELT pipelines with Databricks, Spark, Delta Lake, and ADF.
• Create scalable data models for BI, analytics, and AI initiatives.
• Develop, optimize, and maintain SQL queries and transformations.
• Develop streaming and messaging solutions using Kafka.
• Monitor, troubleshoot, and optimize production pipelines; implement long-term fixes.
• Apply data quality, governance, security, and performance best practices across platforms.
• Mentor junior engineers and contribute to engineering standards.

Skills

SQL

Python

Scala

ETL/ELT design

Data modeling

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Apache Spark

Delta Lake

Azure Data Factory

Azure

Git

Unity Catalog

Kafka

REST APIs

SOAP web services

Job description

CGI Group, Inc. is seeking a Senior Data Engineer (Databricks & Cloud Analytics) to design, develop, and support secure, scalable, high-performing enterprise data platforms. This role is onsite in the Salt Lake City, UT area and focuses on building cloud data pipelines and analytics capabilities using Databricks, Apache Spark, and Azure services.

Compensation: USD 79,600 to 139,300 per year. Experience: 6+ years.

What you’ll be doing

• Design, develop, test, deploy, and maintain enterprise data engineering solutions using modern cloud and big data technologies.
• Build scalable ETL/ELT pipelines with Databricks, Apache Spark (PySpark), Delta Lake, and Azure Data Factory.
• Create high-performance ingestion, transformation, and integration frameworks that support enterprise analytics and reporting.
• Develop, optimize, and maintain complex SQL queries, stored procedures, and transformation processes.
• Design scalable data models for business intelligence, analytics, and AI initiatives.
• Integrate enterprise data exchange using RESTful APIs, event-driven architectures, and legacy SOAP services.
• Develop and maintain streaming and messaging solutions using Apache Kafka.
• Monitor, troubleshoot, and optimize production pipelines, performing root cause analysis and implementing long-term fixes.
• Apply data quality, governance, security, and performance best practices across enterprise platforms.
• Use Git and follow CI/CD and enterprise DevOps best practices.
• Work with Solution Architects, Product Owners, Business Analysts, and cross-functional engineering teams to translate business needs into technical solutions.
• Participate in Agile ceremonies, including sprint planning, backlog refinement, architecture discussions, code reviews, and retrospectives.
• Create technical documentation, deployment artifacts, testing documentation, and operational runbooks.
• Mentor junior engineers and contribute to engineering standards, best practices, and continuous improvement initiatives.

What you bring

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related technical discipline (or equivalent professional experience).
• 6+ years designing, developing, and supporting enterprise data platforms, cloud analytics solutions, or large-scale data engineering initiatives.
• Strong hands-on experience with Databricks.
• Strong hands-on experience with Apache Spark (PySpark).
• Strong hands-on experience with Python and SQL.
• Strong hands-on experience with Scala.
• Experience with Databricks Workspaces, Delta Lake, and Unity Catalog.
• Experience with Delta Live Tables (DLT), Databricks SQL, MLflow, and Databricks Jobs.
• Strong SQL development experience, including query optimization and performance tuning.
• Experience designing and implementing ETL/ELT with Azure Data Factory (or comparable cloud integration platforms).
• Experience with Apache Kafka (or other event streaming technologies).
• Experience integrating enterprise applications using REST APIs, JSON, XML, and SOAP web services.
• Experience with Azure Data Lake Storage (ADLS Gen2) (or comparable cloud storage platforms).
• Experience using Git for source code management in collaborative development.
• Experience working in Linux, including shell scripting and command-line utilities.
• CI/CD experience using Azure DevOps, GitHub Actions, or similar DevOps platforms is preferred.
• Terraform familiarity is preferred.
• Strong analytical, troubleshooting, and problem-solving skills; ability to manage multiple priorities and work independently while mentoring teammates and contributing to technical leadership.
• Experience in Agile environments using Scrum, Kanban, or SAFe methodologies.

Beneficial ways CGI supports you

• Competitive compensation
• Comprehensive insurance options
• 401(k) matching contributions and the share purchase plan
• Paid time off for vacation, holidays, and sick time
• Paid parental leave
• Learning opportunities and tuition assistance
• Wellness and well being programs

Collaboration and communication

• Clearly communicate complex technical concepts to both technical and non-technical audiences.
• Collaborate effectively with architects, developers, business analysts, product owners, and client stakeholders.
• Build trusted relationships across cross-functional teams while delivering high-quality solutions.
• Foster knowledge sharing, continuous learning, and engineering excellence.