Databricks Data Engineering Advisor - Hybrid Role

Cigna Health and Life Insurance Company; Plano (TX); Hybrid; USD 120,000 - 170,000; Full time

Benefits offered by this job

Hybrid work schedule

Job summary

The Cigna Group in Plano, TX seeks Software Engineering Advisors to design and maintain scalable data pipelines in Databricks, delivering high-quality data for client deliverables. You will collaborate with cross-functional teams to ensure HIPAA-compliant, reliable analytics infrastructure.

Responsibilities focus on ETL workflow design using PySpark, SQL, and Scala, building a robust data lake and warehouse, and enabling CI/CD with GitHub Actions for automated deployment.

Qualifications

• Master’s degree in Data Science, Computer Science or related field with 3 years’ ETL design experience or Bachelor’s with 7 years’ experience.
• Proficient in PySpark, Scala, SQL, and Shell scripting for robust ETL pipelines.
• Experience with multiple database systems (PostgreSQL, MySQL, SQL Server) and big data platforms like Hadoop, Spark, Kafka.

Responsibilities

• Design and implement modular ETL workflows for data ingestion, cleansing, transformation and optimization.
• Monitor production jobs and provide operational support for reliability and business continuity.
• Deliver enterprise data solutions that support analytics and reporting.
• Develop consolidated enterprise data warehouse and data lake across critical domains.
• Collaborate with stakeholders to translate business requirements into technical solutions.

Skills

ETL pipelines

Data analysis

Problem solving

Education

Master's degree in Data Science or Computer Science

7+ years experience with Bachelor's

Tools

Databricks

PostgreSQL

MySQL

SQL Server

Cassandra

Snowflake

Hadoop

Hive

Spark

Kafka

AWS Glue

IAM

EC2

EMR

RDS

S3

Athena

Step Functions

Lambda

GitHub

GitLab

Tableau

Power BI

Delta tables

Job description

The Cigna Group in Plano, TX seeks Software Engineering Advisors to design and maintain scalable data pipelines in Databricks, delivering high-quality data for client deliverables. You will collaborate with cross-functional teams to ensure HIPAA-compliant, reliable analytics infrastructure.

Responsibilities focus on ETL workflow design using PySpark, SQL, and Scala, building a robust data lake and warehouse, and enabling CI/CD with GitHub Actions for automated deployment.