Data Engineer

Rapinno Tech; Oregon (WI); Hybrid; USD 70,000 - 100,000; Full time

Job summary

A leading technology company is seeking a Data Engineer to drive digital innovation by leveraging new technologies to transform core data assets. The ideal candidate will have extensive knowledge of data principles and experience with both SQL and NoSQL applications. Responsibilities include defining migration plans, presenting cost/benefit analyses to leadership, and promoting the reuse of data assets. Candidates with a data engineering certification will be preferred.

Qualifications

• Extensive knowledge of data principles, patterns, and practices.
• Experience with SQL and NoSQL applications on Big Data Platforms.
• Experience building cost-effective solutions using elastic architectures.

Responsibilities

• Drive digital innovation using innovative technologies.
• Define migration plans to address gaps in data platforms.
• Lead analysis of technology environments for improvement.

Skills

Data principles knowledge

SQL database design

Data analysis skills

Written and oral communication

Data security understanding

Cloud technologies (Azure)

Education

Data engineering certification

Tools

Azure Data Factory

Databricks

Job description

Qualifications

• Extensive knowledge of data principles, patterns, processes, and practices
• Any experience defining evolutionary data solutions and underlying technologies
• Experience with SQL database design, data modeling
• Analyze and organize raw data
• Build data systems and pipelines
• Evaluate business needs and objectives
• Interpret trends and patterns
• Conduct complex data analysis and report on results
• Demonstrated written and oral communication skills
• Basic understanding of network and data security architecture
• Strong knowledge of industry trends
• Knowledge in a minimum of two of the following technical disciplines: data warehousing, data management, analytics development, data science, application programming interfaces (APIs), data integration, cloud, servers and storage, and database management
• Experience building cost effective and performance driven solutions using elastic architectures in Microsoft Azure leveraging Cosmos, Azure Data Factory and Databricks Platforms.
• Experience with SQL and NoSQL applications on Big Data Platforms

Desired Previous Experience/Education

• Any experience with operational data science, machine learning or artificial intelligence solutions
• Any experience with data science solutions or platforms
• Data engineering certification (e.g IBM Certified Data Engineer) is a plus

Key Responsibilities

Essential Job Functions:

• Drive digital innovation by leveraging innovative new technologies and approaches to renovate, extend, and transform the existing core data assets, including SQL-based, NoSQL-based, and Cloud-based data platforms
• Define high-level migration plans to address the gaps between the current and future state
• Present opportunities with cost/benefit analysis to leadership to shape sound architectural decisions
• Lead the analysis of the technology environment to detect critical deficiencies and recommend solutions for improvement
• Promote the reuse of data assets, including the management of the data catalog for reference