Senior Data Engineer — Scalable Pipelines for AI-Ready Data

Machine Learning Technologies, LLC; Sunnyvale (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Machine Learning Technologies, LLC seeks a Senior Data Engineer to design, build, and support scalable data solutions for enterprise Wealth & Asset Management applications. The role focuses on data ingestion, transformation, storage, integration, quality, governance, and processing across structured and unstructured data sources.

The candidate should have 8+ years of experience, hands-on Python/SQL, and expertise with PostgreSQL, Amazon RDS, DynamoDB, S3, and data-quality controls.

Qualifications

• 8+ years of experience in data engineering or related roles.
• Hands-on experience with Python and SQL.
• Experience with AWS data services and data governance.
• Experience with ETL/ELT pipelines and data modeling.
• Experience working within large enterprise or regulated environments.

Responsibilities

• Design and develop scalable data ingestion and ETL/ELT pipelines.
• Build solutions for structured, semi-structured, and unstructured data.
• Develop reusable data-processing components using Python and SQL.
• Design and support data models using PostgreSQL, Amazon RDS, DynamoDB, and Amazon S3.
• Support document ingestion and extraction using Amazon Textract, where applicable.
• Prepare and transform data for application, search, analytics, and AI-enabled use cases.
• Support vector-based retrieval using PostgreSQL/pgvector, where required.
• Implement data quality, validation, reconciliation, metadata, lineage, retention, and governance controls.
• Implement secure data access and encryption for sensitive information.
• Optimize data pipelines and databases for performance, reliability, scalability, and cost.
• Implement monitoring and troubleshoot data-processing and integration issues.
• Collaborate with application, AI, DevOps, architecture, cybersecurity, and business teams.

Skills

Python

SQL

Distributed Computing

AWS

Data Modeling

ETL/ELT

Security & Governance

Tools

PostgreSQL

Amazon RDS

DynamoDB

S3

Amazon Textract

pgvector

Job description

Machine Learning Technologies, LLC seeks a Senior Data Engineer to design, build, and support scalable data solutions for enterprise Wealth & Asset Management applications. The role focuses on data ingestion, transformation, storage, integration, quality, governance, and processing across structured and unstructured data sources.

The candidate should have 8+ years of experience, hands-on Python/SQL, and expertise with PostgreSQL, Amazon RDS, DynamoDB, S3, and data-quality controls.