Senior Data Engineer

VS Tech Solutions; Boise (ID); Remote; USD 110,000 - 150,000; Full time

Benefits offered by this job

Comprehensive Healthcare: Medical, Dental and Vision

401(k) with company match

Fully remote opportunities available

Training and certification opportunities

Job summary

A leading tech solutions firm in Boise is seeking a Data Solutions Engineer to design and develop data solutions that improve efficiency in enterprise systems. The ideal candidate will have extensive experience with cloud environments, data pipelines, and analytics, and will be responsible for building complex architectures and conducting insightful data analyses. The firm offers a competitive salary, comprehensive healthcare, and flexible work schedules, with opportunities for remote work and professional growth.

Qualifications

• Experience with data management and development in a Cloud environment.
• Experience designing high-performing reporting/analytical schemas.
• Experience with machine learning and AI.
• Root cause analysis on data/processes to answer business questions.
• Processing large, disconnected datasets and extracting value.
• Experience with data warehousing and multidimensional data models.
• ETL development with AWS/Azure and data migrations.
• Designing high-performing reporting/analytical schemas.
• Programming in Python, R or Java; knowledge of C# is a plus.
• Experience with distributed data tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark).
• Real-time data and streaming applications; messaging and stream processing.
• Experience with Snowflake/Redshift and online data warehouses.
• Exposure to Machine Learning / AI / Predictive Analytics and unstructured datasets.

Responsibilities

• Create and maintain optimal data pipeline architectures.
• Build infrastructure for optimal extraction, transformation, and loading (ETL) of data.
• Conduct complex data analysis and report on results.
• Prepare data for prescriptive and predictive modeling.
• Assemble large, complex data sets meeting business requirements.
• Design and build BI solutions: reports, dashboards, data marts, ETL.
• Determine transformation requirements and develop new data models.
• Identify and implement processes to improve data delivery and scalability.
• Build ETL/ELT infrastructure using SQL, AWS and Azure.
• Develop analytics tools using pipeline data to reveal insights.
• Collaborate with clients and project teams on data issues and needs.

Skills

Data management in a Cloud environment

Data modeling

Data analysis

Relational database design

Building data pipelines

Data warehousing

ETL development

Programming skills in Python, R or Java

Experience with AWS and Azure

Real-time data processing

Tools

SQL

AWS

Azure

MapReduce

Hadoop

Spark

Java

SQL

Big Data

Spark

Hadoop

Snowflake/Redshift

Job description

Design and develop data and integration solutions that elevates enterprise systems efficiency, performance, and value. You will join a team of high-achieving technical consulting professionals and help provide solutions to our clients most challenging enterprise IT problems.

As a key part of our team, you will recognize, subscribe, and apply best practices, methodologies, tools, and techniques to meet client requirements, timelines, and budgets. You will work closely with the client to understand both their business processes and analytics needs to design and build data pipelines and cloud data solutions. You will have the opportunity to guide best practices in data warehousing, data processing, and data management design. At Resource Data we strive for a long-term, stable workforce, and offer our employees competitive salary and benefits with flexibility to suit their individual needs. Come join our team!

Job Responsibilities

• Create and maintain optimal data pipeline architectures
• Create data integrations between source and destination systems
• Conduct complex data analysis and report on results
• Prepare data for prescriptive and predictive modeling
• Assemble large, complex data sets that meet functional / non-functional business requirements
• Design and build effective and scalable Business Intelligence solutions including Operational Reports, Data Visualizations, Dashboards, Reporting Data Marts and ETL/Data Integration solutions
• Determine transformation requirements and develop processes to bring structured and unstructured data from the source to a new physical Data Model
• Identify, design, and implement process improvements for our clients: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources using SQL, Azure, and AWS technologies
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics
• Work with clients and project teams to assist with data-related technical issues and support their data infrastructure needs

Required Skills & Experience

• Experience with data management experience, development, and maintenance in a Cloud environment
• Experience in data modeling, data analysis, and relational database design
• Experience building and optimizing data pipelines, architectures, and datasets
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
• Experience manipulating, processing, and extracting value from large, disconnected datasets
• Experience with data warehousing and multidimensional data models
• Experience with data migration projects
• Experience with ETL development
• Experience with AWS and Azure
• Experience with designing high-performing reporting/analytical schemas
• Experience in data structures, algorithms, and strong programming skills in Python, R or Java
• Experience working with large enterprise clients and systems
• Prior experience in consulting or analytics project delivery through the entire software lifecycle: Requirements, Design, Development, Testing, Deployment
• Experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, or Spark)
• Experience working on real-time data and streaming applications
• Working knowledge of message queuing, stream processing, and highly scalable big data data stores
• Experience with online Data Warehouses (Snowflake, Redshift, etc.)
• Experience with Machine Learning, AI, or Predictive Analytics
• Experience with unstructured datasets
• Experience with C#, Java, Python, and R
• Comprehensive Healthcare: Medical, Dental and Vision
• Healthy work-life balance with full flex schedules
• 401(k) with company match
• Fully remote opportunities available for the right candidate
• Moving allowance available for the right candidate
• Progressive roles and projects that encourage ownership and leadership
• Opportunities to learn and gain experience in complimentary areas such as Project management, Business Analysis, Software Development, etc.
• Training and certification opportunities to support your career