Data Platform Engineer

Optomi; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

Optomi, in partnership with a financial services company, is seeking a Data Platform Engineer to advance the next generation data warehouse and analytics platforms. You will build platform capabilities to support data pipelines, integrations, and workflows that enable trusted, high-quality data for decision-making.

The role emphasizes hands-on data engineering, collaboration with cross-functional teams, and implementing industry best practices in data ingestion, governance, and data access.

Qualifications

• Hands-on data engineering experience with Python, SQL, DBT, and version control in Gitlab/Bitbucket.

Responsibilities

• Build data platform features and pipelines supporting self-service analytics and varying data domains.
• Develop data ingestion patterns for real-time, near real-time, and batch processes.

Skills

Python

SQL

DBT

Git

AWS

Tools

Databricks

Redshift

Terraform

Informatica

Ascend.io

Job description

Optomi, in partnership with a financial services company, is seeking a Data Platform Engineer to join their team! The Data Platform Engineer will be a key player in the implementation of the next generation data warehouse and analytics platforms, building platform capabilities that support the build out of data pipelines, integrations, and workflows that inform and enable decision-making with trusted, high-quality data.

Qualifications:

• Hands-on experience with data engineering, using tools like Python, SQL, DBT (Data Build Tool), ascend.io, or Informatica with source code control in Gitlab/Bitbucket.
• Experience working with AWS-based cloud engineering technologies like Redshift, Databricks, Glue, Step Functions, EC2, Cluster management, and configuration.
• Experience with Config As Code/Infrastructure As Code with tools like Terraform
• Basic understanding of modern Data Platform capabilities
• Ability to work in a team environment and not take yourself too seriously.
• Preferred: Experience building/maintaining software and/or engineering platforms and frameworks

Responsibilities:

• Create data platform features, such as Enterprise role-based access controls, data anonymization, user onboarding and setup, and workspaces within Databricks.
• Create data ingestion patterns and pipelines, following standards that support self-service analytics users across all bank domains (deposits, loans, checking, etc.), via real-time, near real-time, and batch processes.
• Be a hands-on contributor that can build data products as needed, from source to target ingestion, transformative data models and data marts that provide high-quality, trusted data for self-service consumers.
• Interact with a variety of engineering team members to enable their professional capabilities, development, and understanding of data platform features
• Promote the adoption and execution of industry best practices related to data ingestion and transformation, from source to target model development, dashboard analytics, and data access, quality, and governance.
• Help establish and document designs, standards, and user guides to help engineering teams consume the data platform features that you create.