Databricks Platform Engineer for FinTech Data & AI

OpenTalent; Roseland (LA); On-site; USD 120,000 - 160,000; Full time

Job summary

OpenTalent is seeking a skilled Senior Data Engineer to design and implement data pipelines and lakehouse architectures using Databricks. You will build Delta Lake tables (bronze/silver/gold) for critical financial datasets and manage Genie Spaces with semantic models and NL-to-SQL tuning for finance use cases.

You will also develop PySpark/Python data workflows for ERP ingestion and transformations, and integrate Databricks Model Serving with large language models like Claude to enhance

Responsibilities

• Design and build Delta Lake tables on Databricks (bronze/silver/gold medallion architecture) for financial datasets (AR, GL, invoices, collections)
• Build and manage Databricks Genie Spaces — configure semantic models, write GENIE-compatible SQL, and tune NL-to-SQL behavior for finance use cases
• Develop PySpark and Python-based data pipelines (Databricks Jobs Workflows) for ERP data ingestion, transformation, and aggregation
• Integrate Databricks Model Serving with LLMs (Claude,...)

Job description

OpenTalent is seeking a skilled Senior Data Engineer to design and implement data pipelines and lakehouse architectures using Databricks. You will build Delta Lake tables (bronze/silver/gold) for critical financial datasets and manage Genie Spaces with semantic models and NL-to-SQL tuning for finance use cases.

You will also develop PySpark/Python data workflows for ERP ingestion and transformations, and integrate Databricks Model Serving with large language models like Claude to enhance