Data Engineer

D.A. Davidson; Oregon; On-site; USD 74,000 - 118,000; Full time

Benefits offered by this job

Medical, Dental and Vision

401(k) and ESOP contribution

Vacation and sick leave

Paid holidays

Professional Development Opportunities

Tuition Reimbursement ($15,000)

Discounted personal insurance

Charitable gift-matching

Davidson Day of Giving

Job summary

D.A. Davidson Companies is seeking a Data Engineer to expand and optimize data pipeline architecture, monitor and troubleshoot data flows, and deliver secure data provisioning. You will collaborate with software teams, DBAs, data analysts and end users on complex data initiatives to ensure best-practice delivery.

The role emphasizes building scalable pipelines, maintaining data quality, and supporting data-related technical issues for stakeholders across the firm.

Qualifications

• 5+ years of Data Engineering experience in an oversight capacity.
• Extensive domain-specific experience in the Financial Services industry.
• Experience with Microsoft cloud-based technologies in a hybrid architecture.
• Advanced working TSQL knowledge and experience with relational databases, query authoring, stored procedures, end-to-end data pipeline development.
• Experience performing operational analysis on internal and external data and processes to uncover failure points and identify opportunities for improvement.
• Strong analytic skills related to working with complex, multi-layered data pipelines and dependent datasets.
• Experience facilitating calls to capture end-user requirements with technical and non-technical users.
• Holistic awareness of processes supporting data preparation, metadata, dependencies, lineages, compliance and workload management.
• Understanding of data modeling concepts: conceptual, logical, relational and dimensional/multi-dimensional modeling.
• Understanding of meta-model and metadata management requirements.
• Experience with data structures/interfaces for applications and business processes.
• Experience with Microsoft Fabric: pipelines/notebooks/Lakehouse/Medalion architecture
• Experience with data pipeline tools such as SSIS and Azure Integration Services
• Experience using orchestration tools such as ActiveBatch
• Experience with web services and API integrations
• Experience with scripting languages such as Python and PowerShell
• Experience with Agile, DevOps and DataOps methods and technologies (Source Code Control, Versioning, Test Automation, CI, CD, Telemetry)
• Commitment to confidentiality and data security
• Strong communication and client-facing skills
• Ability to work with external and internal clients and maintain attendance

Responsibilities

• Design, implement and maintain robust, efficient data pipeline architecture.
• Identify and implement internal process improvements to automate and scale data delivery.
• Build and maintain service-based architecture for publication of data objects.
• Collaborate with data architects and analysts to evolve the data environment.
• Support data-related issues for Business and IT stakeholders.
• Develop frameworks and guidelines to ensure data structures are accurate, compliant and secure.
• Establish data quality and protection standards across the enterprise.
• Define performance and quality metrics and ensure compliance with policies.
• Participate in on-call rotation to monitor and resolve data integration alerts.

Skills

SQL

Data pipelines

Data modeling

Python

PowerShell

Azure

SSIS

Azure Integration Services

ActiveBatch

Web services/API

Tools

MS SQL Server

Microsoft Fabric

Azure Data Factory

Oracle/Relational databases

Job description

D.A. Davidson Companies is an independent, employee-owned company with a rich history spanning 90 years. We are dedicated to conducting our business in accordance with the highest standards of integrity and ethics, and delivering outstanding service to our clients and each other. We support a friendly, open and supportive culture, and encourage candid communication and productive engagement that make our companies and each of us better. Just as we work to improve our clients’ financial well-being, we also work to strengthen local communities—and giving back is one of our core values. You can learn more about our company culture and impact in our latest annual report.

Summary:

Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, as well as monitoring, troubleshooting and performance tuning data flows used in the collection, integration, and provisioning of data. This role requires experience building data pipelines and optimizing entire data systems as well as greenfield opportunities. This role works alongside other software development teams, database architects, data analysts and end users on complex data initiatives, and ensures our data delivery architecture is consistent with best practices.

Company Overview:

D.A. Davidson Companies is an independent, employee-owned company with a rich history spanning 90 years. We are dedicated to conducting our business in accordance with the highest standards of integrity and ethics, while delivering outstanding service to our clients and coworkers. We support a friendly, open and adaptive culture, and encourage candid communication and productive collaboration across throughout the firm. Just as we work to improve our clients and employees’ well-being, we also work to strengthen local communities—and giving back is one of our core values.

Qualifications:

• 5 or more years of Data Engineering experience in an oversight capacity
• Extensive domain-specific experience in the Financial Services industry
• Experience with Microsoft cloud-based technologies in a hybrid architecture
• Advanced working TSQL knowledge and experience working with relational databases, query authoring, stored procedure development, end-to-end data pipeline development
• Experience performing operational analysis on internal and external data and processes to uncover failure points and identify opportunities for improvement
• Strong analytic skills related to working with complex, multi-layered data pipelines and dependent datasets
• Experience facilitating calls to capture end-user requirements with technical and non-technical users
• Holistic awareness of processes supporting data preparation, metadata, dependencies, lineages, compliance and workload management
• Understanding of data modeling concepts like:
  • o Conceptual data modeling
  • o Logical data modeling
  • o Relational data modeling
  • o Dimensional and multi-dimensional data modeling
• Understanding of meta-model and metadata management requirements
• Specific skills include:
  • o Extensive experience with SQL syntax
  • o Experience designing and implementing data structures and interfaces for applications and business processes
  • o Experience with Microsoft Fabric: pipelines, notebooks, Lakehouse/Warehouse concepts, and Medalion architecture
  • o Experience with relational database platforms: preferably MS SQL Server
  • o Experience with data pipeline tools such as: SSIS and Azure Integration Services
  • o Experience using orchestration tools such as: ActiveBatch
  • o Experience with web services and API integrations
  • o Experience with scripting languages such as: Python and Powershell
  • o Experience with Agile, DevOps and DataOps methods and technologies: Source Code Control, Versioning, Test Automation, Continuous Integration, Automated Deployment, Recoverability, Telemetry, etc.
• Commitment to maintain client confidentiality and data security
• Communicate in a clear and service-oriented manner; use appropriate, professional language and grammar to effectively exchange ideas and information
• Ability to proactively work with both external and internal clients; relate with others in a professional manner to accomplish work responsibilities and objectives
• Ability to maintain regular, predictable attendance

Job Responsibilities:

• Design, implement and maintain a robust, efficient and compliant data pipeline architecture
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build and maintain a service-based architecture for the publication of consumable data and information objects
• Work with data architects and data analysts to enhance and evolve the data environment
• Work with Business and IT stakeholders to assist with data-related technical issues and support their data and information requirements
• Define and develop frameworks, guidelines, best practices and examples to ensure data structures and integration processes are accurate, compliant and secure
• Facilitate the development and implementation of data quality standards, data protection standards and adoption requirements across the enterprise
• Define indicators of performance and quality metrics and ensure compliance with data related policies, standards, roles and responsibilities, and adoption requirements
• Work in an on-call rotation to monitor, troubleshoot and resolve data integration alerts and failures

What we offer:

Competitive salary plus excellent benefits and perks including, but not limited to:

• Medical, Dental and Vision
• Company 401(k)and ESOP contribution
• Generous sick, vacation, and maternity/parental leave
• Paid holidays
• Professional Development Opportunities
• Tuition Reimbursement ($15,000 lifetime cap)
• Discounted personal insurance including home, auto and recreational vehicles
• Charitable gift-matching program
• Davidson Day of Giving – Our tradition of positively impacting communities in which we live and work.

The potential base pay hiring range for this role is $73,500 – $117,900 annually. The compensation offered will be determined on a case-by-case basis considering a variety of factors including, but not limited to, the skills, relevant work experience, and geographic location of each specific candidate.

$73,500 - $117,900 a year

At D.A. Davidson, we are committed to fostering a diverse environment that supports the development and inclusivity of all employees.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.