Data Engineer

Wealth Management; Town of Texas (WI); Hybrid; USD 100,000 - 140,000; Full time

Job summary

Wealth Management is seeking a Data Engineer to architect data solutions, build pipelines, and optimize ETL/ELT processes across Azure, SQL Server, and NoSQL storage. Strong SQL, Python, and cloud experience are required to deliver scalable data platforms for analytics.

Qualified candidates have a Bachelor's degree in CS/IT, 5+ years in data engineering, and hands-on Azure services (Data Factory, Synapse, Cosmos DB).

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 5+ years developing data-related solutions and software.
• 5+ years with relational databases and Microsoft Azure platform.
• 2+ years with Azure IaaS/PaaS and other clouds.
• 2+ years designing on-prem and cloud infrastructure (Azure).
• 2+ years hands-on Azure cloud with T-SQL, Azure SQL, Azure Storage, Data Factory, Synapse, Cosmos DB, GitHub, Azure DevOps, CI/CD.
• Advanced knowledge of ETL/ELT tools (SSIS, Informatica, Kafka, Spark, MuleSoft).
• Advanced knowledge of SQL Server / Oracle / NoSQL.
• Advanced knowledge of Python, SQL, Scala or similar.
• Advanced knowledge of IT infrastructure standards and DevOps tools.

Responsibilities

• Use Agile practices to elicit and refine requirements with BI teams.
• Develop, configure, and manage integration tools, databases, warehouses and analytical systems.
• Design and deploy data extraction, transformation, and loading pipelines from databases, APIs, and files.
• Develop and deploy data storage models and dimensional models across platforms.
• Coordinate security, monitoring, and DevOps capabilities with responsible teams.
• Provide operations support and incident management for data pipelines and data flows.
• Document processes, procedures and technical designs.
• Coach junior data and BI personnel across the company.

Skills

Python

SQL

Azure

ETL/ELT

Data pipelines

Kafka

Spark

Cosmos DB

NoSQL

CI/CD

Education

Bachelor's degree in CS/IT or related field

Tools

Azure DevOps

GitHub

CI/CD pipelines

SSIS

Informatica

Azure SQL/SQL Server

Azure Data Factory

Azure Synapse

Cosmos DB

Job description

Company: Wealth Management

Position: Data Engineer

Pay: $100K - $140K + Bonus

Locations: - First 90 days on site and then 1 day a week WFH - Plano, TX & Camas, WA

Work Authorization: ONLY USC and GC no other visas will be considered.

Education: Bachelor's degree in Computer Science, Information Technology, or other relevant field

Experience

• 5+ years' experience developing data-related solutions and software
• 5+ years of experience working with relational databases and applying it in various applications, including within the Microsoft Azure platform
• 2+ years of experience with multiple cloud technologies in the Microsoft Stack (Azure IaaS and PaaS) along with familiarity with alternative cloud technologies
• 2+ years of experience designing and development on-premises and cloud-based (Azure) infrastructure and platform components
• 2+ years of hands-on development and deployment experience with Azure cloud using T-SQL, Azure SQL, Azure Storage, Azure Data Factory, Azure Synapse, Cosmos DB, GitHub, Azure DevOps, and CI/CD pipelines
• Advanced knowledge of Extract/Transform/Load (ETL) and/or Extract/Load/Transform (ELT) tools, including both batch and real-time data transmission applications such as SSIS, Informatica, Kafka, Spark, MuleSoft, or equivalent software
• Advanced knowledge of database technologies such as Microsoft SQL Server, Oracle, or NoSQL databases
• Advanced knowledge of multiple programming languages, such as Python, SQL, Scala, or similar
• Advanced knowledge of IT infrastructure standards and tools, such as application performance monitoring, IT service management, or DevOps software

Responsibilities

• Use Agile practices to elicit and refine requirements through an iterative process of planning, defining acceptance criteria, prioritizing, developing and delivering enterprise data asset solutions in collaboration with business intelligence teams or other IT teams
• Develop, configure, customize and manage integration tools, databases, warehouses and analytical systems
• Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources including databases, APIs, and data files
• Develop and deploy structured, semi-structured, and unstructured data storage models and dimensional data models on various platforms to meet business requirements
• Coordinate security, application monitoring, development tooling, and related capabilities with responsible teams
• Provide operational support and incident management for data pipelines and data flows, including proactively updating internal clients and relevant parties on status changes and issues encountered
• Author and maintain accurate and up-to-date documentation for processes, procedures, and technical designs
• Coach junior data and business intelligence personnel across the company, including developing material and guiding junior personnel on their technical skill growth