Data Engineer

Socket.dev; Washington; Hybrid; USD 100,000 - 140,000; Full time

Job summary

Wealth Management is seeking a Data Engineer in the United States. The role requires 5+ years in data solutions, Azure expertise, and strong SQL/ETL skills. Initially on-site for 90 days at Plano, TX and Camas, WA, then one day weekly WFH. A Bachelor's degree in CS/IT is required, with USC/GC work authorization.

You'll design data pipelines, manage databases, and collaborate with IT teams using Agile practices. Competitive salary with bonus potential.

Qualifications

• Bachelor's degree in Computer Science, Information Technology or related field.
• 5+ years building data-related solutions and software.
• 5+ years working with relational databases and Microsoft Azure.
• 2+ years with Azure IaaS/PaaS and cloud infrastructure experience.
• 2+ years using Azure Data Factory, Synapse, Cosmos DB, GitHub and CI/CD.
• ETL/ELT expertise with SSIS, Informatica, Kafka, Spark or MuleSoft.
• Strong SQL, Python, Scala and other programming languages.
• Experience with DevOps tools and IT infrastructure standards.

Responsibilities

• Elicit and refine requirements using Agile methods with BI and IT teams.
• Develop and manage integration tools, databases, warehouses and analytics systems.
• Design and deploy data pipelines from databases, APIs and files.
• Model structured, semi-structured and unstructured data for platforms.
• Coordinate security, monitoring, and development tooling with teams.
• Provide operational support and incident management for data pipelines.
• Document processes, procedures, and technical designs.
• Coach junior data and BI personnel across the company.

Skills

Data engineering

Relational databases

Azure

Azure IaaS/PaaS

Hybrid cloud

Azure Data Factory

ETL/ELT

Databases (SQL/NoSQL)

Programming (Python/SQL/Scala)

DevOps practices

Education

Bachelor's degree in CS/IT or related field

Tools

Azure Data Factory

Azure Synapse

SSIS

Kafka

Spark

GitHub

Azure DevOps

Job description

Company: Wealth Management

Position: Data Engineer

Pay: $100K - $140K + Bonus

Locations: - First 90 days on site and then 1 day a week WFH - Plano, TX & Camas, WA

Work Authorization: ONLY USC and GC no other visas will be considered.

Education: Bachelor's degree in Computer Science, Information Technology, or other relevant field

Experience

• 5+ years' experience developing data-related solutions and software
• 5+ years of experience working with relational databases and applying it in various applications, including within the Microsoft Azure platform
• 2+ years of experience with multiple cloud technologies in the Microsoft Stack (Azure IaaS and PaaS) along with familiarity with alternative cloud technologies
• 2+ years of experience designing and development on-premises and cloud-based (Azure) infrastructure and platform components
• 2+ years of hands-on development and deployment experience with Azure cloud using T-SQL, Azure SQL, Azure Storage, Azure Data Factory, Azure Synapse, Cosmos DB, GitHub, Azure DevOps, and CI/CD pipelines
• Advanced knowledge of Extract/Transform/Load (ETL) and/or Extract/Load/Transform (ELT) tools, including both batch and real-time data transmission applications such as SSIS, Informatica, Kafka, Spark, MuleSoft, or equivalent software
• Advanced knowledge of database technologies such as Microsoft SQL Server, Oracle, or NoSQL databases
• Advanced knowledge of multiple programming languages, such as Python, SQL, Scala, or similar
• Advanced knowledge of IT infrastructure standards and tools, such as application performance monitoring, IT service management, or DevOps software

Responsibilities

• Use Agile practices to elicit and refine requirements through an iterative process of planning, defining acceptance criteria, prioritizing, developing and delivering enterprise data asset solutions in collaboration with business intelligence teams or other IT teams
• Develop, configure, customize and manage integration tools, databases, warehouses and analytical systems
• Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources including databases, APIs, and data files
• Develop and deploy structured, semi-structured, and unstructured data storage models and dimensional data models on various platforms to meet business requirements
• Coordinate security, application monitoring, development tooling, and related capabilities with responsible teams
• Provide operational support and incident management for data pipelines and data flows, including proactively updating internal clients and relevant parties on status changes and issues encountered
• Author and maintain accurate and up-to-date documentation for processes, procedures, and technical designs
• Coach junior data and business intelligence personnel across the company, including developing material and guiding junior personnel on their technical skill growth