Senior Data & AI Engineer – Cloud ETL & Big Data

Optum; Fort Washington (Montgomery County); On-site; USD 92,000 - 164,000; Full time

Benefits offered by this job

Paid Time Off

Medical Plan

Dental & Vision Insurance

401(k) Savings Plan

Education Reimbursement

Employee Stock Purchase Plan

Job summary

Optum is seeking a Senior Software Engineer to design, build, and deploy enterprise-scale data platforms in Azure. You will develop AI-powered data pipelines, implement ETL/ELT processes, and collaborate with cross-functional teams in an agile cloud environment.

You will work with Spark, Scala, Python, SQL, and Databricks, optimize performance, and contribute to responsible use of AI while embracing continuous innovation.

Qualifications

• 5+ years of professional software engineering experience.
• 5+ years in data engineering and ETL development.
• 5+ years with SQL, T-SQL and ETL development.
• 3+ years using Scala, Python, JSON and web services.
• 3+ years with Spark, Databricks, Hadoop or Snowflake.
• 1+ years cloud exposure with Azure/AWS.
• 1+ years CI/CD and DevOps practices.
• 1+ years shell scripting and automation.

Responsibilities

• Design, develop, and deploy AI-powered data solutions with responsible AI.
• Streamline data workflows and automate data transformation across pipelines.
• Evaluate emerging tech for data engineering innovation and architecture.
• Build and maintain scalable ETL/ELT pipelines and big data infra (Spark/Scala/Python/Java).
• Develop advanced SQL/T-SQL and automated validation in cloud databases.
• Configure cloud data tools: Azure SQL, Databricks, ADLS, Data Factory.
• Create CI/CD DevOps pipelines and automation scripts (PowerShell, Bash).
• Perform performance tuning, code reviews and automated testing for distributed platforms.

Skills

Software Engineering

Data Engineering

SQL/T-SQL/ETL

Scala/Python/JSON

Distributed systems

Python development

Java/J2EE/Spring

Azure/AWS

CI/CD/DevOps

Shell scripting

AI/ML-driven solutions

Education

Bachelor's degree or equivalent

Tools

Spark

Databricks

Hadoop

Snowflake

Azure

SQL Server/T-SQL

Job description

Optum is seeking a Senior Software Engineer to design, build, and deploy enterprise-scale data platforms in Azure. You will develop AI-powered data pipelines, implement ETL/ELT processes, and collaborate with cross-functional teams in an agile cloud environment.

You will work with Spark, Scala, Python, SQL, and Databricks, optimize performance, and contribute to responsible use of AI while embracing continuous innovation.