Senior Data Engineer

DXC Luxoft

Irvine (CA)

On-site

USD 180,000 - 240,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Luxoft is seeking a senior data engineering professional to build data pipelines and data products for enhanced investment research. You will collaborate with stakeholders, design scalable data solutions, and ensure quality, lineage, and security within an AWS-based AI framework, applying an AI-first mindset.

The role emphasizes strong Python development, experience with modern data stores, and agile delivery, with additional value for financial domain familiarity.

Qualifications

  • 10+ years of professional software development, including 5+ years in data engineering.
  • Advanced proficiency in Python for scalable backend services and data processing.
  • Design and implement data pipelines and data integration solutions with latency and cost in mind.
  • Experience with relational databases and modern data storage technologies (graph, vector, analytical platforms).
  • Experience with data quality and governance, including validations, entitlements, audit, and lineage.
  • Experience with MCP Gateway, including security aspects.
  • Experience with cloud platforms hosting AI solutions (e.g., AWS Bedrock AgentCore).
  • Experience operating in agile delivery environments.
  • Strong communication skills and interaction with business users; finance/investment domain experience is a plus.

Responsibilities

  • Collaborate with stakeholders to translate objectives into technical solutions.
  • Design, build, and enhance data pipelines and integration frameworks for AI, analytics, and business apps.
  • Improve data quality, reliability, lineage, and monitoring.
  • Integrate data solutions with the organization's AI infrastructure (AWS-based) and security-minded tools.
  • Apply an AI-first approach: use AI agents to design, build, test, and support solutions.

Skills

10+ years of software development
5+ years data engineering
Python proficiency
Data pipelines design
Data integration solutions
Latency and cost awareness
Relational and modern data stores
Data quality and governance
Security-focused data solutions
Agile delivery experience
Strong stakeholder communication

Tools

Databricks
Spark
Delta Lake
dbt
Aurora
Neptune
AWS ECS Fargate
Lambda
SQS
Terraform
AWS CDK

Job description

Project description

Build data pipelines and data products to enhance investment research capabilities for a top US & global investment firm.

Responsibilities
  • Collaborate closely with business stakeholders, product managers, and engineering teams to translate business objectives into technical solutions.
  • Design, build, and enhance data pipelines and integration frameworks supporting AI, analytics, and business applications.
  • Improve data quality, reliability, lineage, and monitoring.
  • Integrate data solutions with the organization's AI infrastructure (AWS based) and tools with security in mind.
  • Implement AI first approach: use AI agents as a primary tool to design, build, test, and support solutions
SKILLS
Must have
  • 10+ years of professional software development, including 5+ years of data engineering experience.
  • Advanced proficiency in Python, including experience building scalable backend services and data processing solutions.
  • Strong hands-on experience designing and implementing data pipelines, data integration solutions, with a latency and cost in mind
  • Experience working with relational databases and modern data storage technologies, including graph, vector, or analytical data platforms.
  • Experience with data quality and data governance approaches, including validations in the pipeline, entitlements, audit, and lineage
  • Experience working with MCP Gateway, including the security aspect.
  • Experience working with cloud platform to host AI solutions, such as Amazon Bedrock AgentCore.
  • Experience operating in agile delivery environments.
  • Strong communication skills and ability to interact efficiently with various stakeholder groups including business users. Experience working with financial domain users, especially investment business, is a big plus.
Nice to have
  • Financial services, especially investment domain.
  • Experience with Databricks, Spark, Delta Lake, or similar modern data engineering platforms.
  • Experience with dbt.
  • Experience designing enterprise data lakes, lakehouses, or large-scale analytical platforms.
  • Experience with Aurora, Neptune, and other AWS data services.Strong hands-on experience designing and implementing data pipelines, data integration solutions, and large-scale data processing architectures.
  • Experience architecting, provisioning, and managing production infrastructure on AWS, including services such as ECS Fargate, Lambda, SQS, and related cloud-native technologies.
  • Experience defining cloud architecture programmatically using Infrastructure-as-Code (IaC) tools such as AWS CDK or Terraform.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

DXC Luxoft • Los Angeles (CA)

On-site
USD 140,000 - 210,000
Data/AI engineer with Python
Data/AI engineer with Python

Luxoft Holding • Los Angeles (CA)

On-site
USD 150,000 - 210,000
Data/AI engineer with Python
Data/AI engineer with Python

Luxoft Holding • Irvine (CA)

On-site
USD 180,000 - 240,000
Data/AI engineer with Python
Data/AI engineer with Python

Luxoft • United States

Remote
USD 180,000 - 240,000
Senior Data & AI Engineer | Scalable Pipelines & AI-First
Senior Data & AI Engineer | Scalable Pipelines & AI-First

Luxoft • Los Angeles (CA)

On-site
USD 150,000 - 210,000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
Senior Data Engineer
Senior Data Engineer

SIG Susquehanna • Pennsylvania

On-site
USD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

TechDigital Group • Denver (CO)

On-site
USD 120,000 - 170,000
Senior Data Engineer
Senior Data Engineer

Susquehanna International Group, LLP • Bala Cynwyd (PA)

On-site
USD 110,000 - 170,000
Senior Data Engineer
Senior Data Engineer

twentyAI • New York (NY)

On-site
USD 140,000 - 190,000