Senior Data Engineer — Scalable Pipelines & Data Governance

CBTS; Farmington Hills (MI); In loco; USD 96.000 - 110.000; Tempo pieno

Descrizione del lavoro

CBTS is seeking a Senior Data Engineer to design, build, and support scalable data solutions across wealth & asset management applications. The role emphasizes ingestion, transformation, storage, and governance for structured and unstructured data.

You'll develop ETL/ELT pipelines in Python and SQL, model data with PostgreSQL, Amazon RDS, DynamoDB, and S3, and enable AI-ready data workflows. Security, monitoring, and collaboration with cross-functional teams are essential.

Competenze

• 8+ years of experience in data engineering, data integration, or related roles.
• Strong hands-on experience with Python, SQL, PostgreSQL, Amazon RDS, DynamoDB, and S3.
• Experience developing and supporting ETL/ELT pipelines and data-processing workflows.
• Experience with data modeling, APIs, JSON, Parquet, and pgvector.
• Strong understanding of data quality, metadata, governance, security, and operational monitoring.
• Experience working within large enterprise or regulated environments.
• Experience supporting document-processing and AI-enabled data solutions.

Mansioni

• Design and develop scalable data ingestion and ETL/ELT pipelines.
• Build solutions for structured, semi-structured, and unstructured data.
• Develop reusable data-processing and transformation components using Python and SQL.
• Design and support data models using PostgreSQL, Amazon RDS, DynamoDB, and Amazon S3.
• Support document ingestion and extraction using Amazon Textract, where applicable.
• Prepare and transform data for application, search, analytics, and AI-enabled use cases.
• Support vector-based retrieval using PostgreSQL/pgvector, where required.
• Implement data quality, validation, reconciliation, metadata, lineage, retention, and governance controls.
• Implement secure data access and encryption for sensitive information.
• Optimize data pipelines and databases for performance, reliability, scalability, and cost.
• Implement monitoring and troubleshoot data-processing and integration issues.
• Collaborate with application, AI, DevOps, architecture, cybersecurity, and business teams.

Conoscenze

Python

SQL

ETL/ELT pipelines

Data modeling

APIs

JSON

Parquet

pgvector

Data governance

Data quality

Security

Monitoring

PostgreSQL

Amazon RDS

DynamoDB

S3

Strumenti

PostgreSQL

Amazon RDS

DynamoDB

Amazon S3

Amazon Textract

Descrizione del lavoro

CBTS is seeking a Senior Data Engineer to design, build, and support scalable data solutions across wealth & asset management applications. The role emphasizes ingestion, transformation, storage, and governance for structured and unstructured data.

You'll develop ETL/ELT pipelines in Python and SQL, model data with PostgreSQL, Amazon RDS, DynamoDB, and S3, and enable AI-ready data workflows. Security, monitoring, and collaboration with cross-functional teams are essential.