Senior Data Engineer

Luxoft

Irvine (CA)

On-site

USD 140,000 - 200,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Luxoft in Irvine, CA is seeking an experienced Senior Data Engineer to build and scale data pipelines and AI-ready data platforms. You will collaborate with stakeholders to translate business needs into robust data solutions, emphasizing data quality, lineage, and governance.

The role involves integrating with AWS-based AI infrastructure, including Bedrock AgentCore, and applying an AI-first approach to design, build, test, and support solutions.

Qualifications

  • Over 10 years of professional software development, with 5+ years in data engineering.
  • Advanced Python proficiency for scalable backend and data processing.
  • Design and implement data pipelines and integration solutions with latency and cost awareness.
  • Experience with relational, graph, vector, or analytical data stores.
  • Data quality, governance, validations, audit, and lineage practices.
  • Experience with MCP Gateway security and AWS-based AI infrastructure.

Responsibilities

  • Collaborate with business stakeholders, product managers, and engineering to translate objectives into technical solutions.
  • Design, build, and enhance data pipelines and integration frameworks for AI, analytics, and business apps.
  • Improve data quality, reliability, lineage, and monitoring.
  • Integrate data solutions with the organization's AI infrastructure (AWS-based) with security in mind.
  • Implement AI-first approach: use AI agents as a primary tool to design, build, test, and support solutions.

Skills

Software development
Python backend
Data pipelines
Data integration
Relational/graph data stores
Data quality & governance
MCP Gateway security
AWS Bedrock AgentCore
Agile delivery
Stakeholder communication

Tools

Databricks
Spark
Delta Lake
dbt
Aurora
Neptune
AWS ECS Fargate
Terraform
AWS CDK

Job description

Project description

Build data pipelines and data products to enhance investment research capabilities for a top US & global investment firm.

Responsibilities
  • Collaborate closely with business stakeholders, product managers, and engineering teams to translate business objectives into technical solutions.
  • Design, build, and enhance data pipelines and integration frameworks supporting AI, analytics, and business applications.
  • Improve data quality, reliability, lineage, and monitoring.
  • Integrate data solutions with the organization's AI infrastructure (AWS based) and tools with security in mind.
  • Implement AI first approach: use AI agents as a primary tool to design, build, test, and support solutions
SKILLS
Must have
  • 10+ years of professional software development, including 5+ years of data engineering experience.
  • Advanced proficiency in Python, including experience building scalable backend services and data processing solutions.
  • Strong hands-on experience designing and implementing data pipelines, data integration solutions, with a latency and cost in mind
  • Experience working with relational databases and modern data storage technologies, including graph, vector, or analytical data platforms.
  • Experience with data quality and data governance approaches, including validations in the pipeline, entitlements, audit, and lineage
  • Experience working with MCP Gateway, including the security aspect.
  • Experience working with cloud platform to host AI solutions, such as Amazon Bedrock AgentCore.
  • Experience operating in agile delivery environments.
  • Strong communication skills and ability to interact efficiently with various stakeholder groups including business users. Experience working with financial domain users, especially investment business, is a big plus.
Nice to have
  • Financial services, especially investment domain.
  • Experience with Databricks, Spark, Delta Lake, or similar modern data engineering platforms.
  • Experience with dbt.
  • Experience designing enterprise data lakes, lakehouses, or large-scale analytical platforms.
  • Experience with Aurora, Neptune, and other AWS data services.Strong hands-on experience designing and implementing data pipelines, data integration solutions, and large-scale data processing architectures.
  • Experience architecting, provisioning, and managing production infrastructure on AWS, including services such as ECS Fargate, Lambda, SQS, and related cloud-native technologies.
  • Experience defining cloud architecture programmatically using Infrastructure-as-Code (IaC) tools such as AWS CDK or Terraform.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

DXC Luxoft • Irvine (CA)

On-site
USD 180,000 - 240,000
Senior Data Engineer
Senior Data Engineer

DXC Luxoft • Los Angeles (CA)

On-site
USD 140,000 - 210,000
Data/AI engineer with Python
Data/AI engineer with Python

Luxoft • United States

Remote
USD 180,000 - 240,000
Data/AI engineer with Python
Data/AI engineer with Python

Luxoft • Irvine (CA)

On-site
USD 180,000 - 240,000
Data/AI engineer with Python
Data/AI engineer with Python

Luxoft • Los Angeles (CA)

On-site
USD 150,000 - 210,000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
Senior Data Engineer
Senior Data Engineer

TechDigital Group • Denver (CO)

On-site
USD 120,000 - 170,000
Senior Data Engineer
Senior Data Engineer

SIG • Bala Cynwyd (PA)

On-site
USD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

twentyAI • New York (NY)

On-site
USD 140,000 - 190,000
Senior Data Engineer
Senior Data Engineer

SIG Susquehanna • Pennsylvania

On-site
USD 120,000 - 160,000