Big Data Architect

Morph Enterprise; Washington (District of Columbia); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Morph Enterprise is seeking an experienced IT Consultant to support the design, development, implementation and maintenance of an enterprise Big Data solution as part of the Data Modernization Effort.

The role focuses on building a scalable Data Lake and analytics platform, leveraging Databricks, Azure tools (Data Lake, Synapse) and ETL pipelines, to serve IoT, open data portals and data science applications across the organization.

Qualifications

• Bachelor's degree in Information Technology or related field or equivalent experience.
• Minimum 5 years of experience in Big Data storage, analytics, and architecture.
• Experience with cloud deployments on Microsoft Azure and data platform tooling.
• Familiarity with data visualization tools such as Tableau, MicroStrategy, ArcGIS, Kibana, Oracle.

Responsibilities

• Support design, development, implementation and maintenance of an enterprise Big Data solution.
• Assist in Data Modernization efforts including IoT/Smart City projects and data lake architecture.
• Work with Databricks, Azure Synapse, Data Factory and ETL pipelines to enable data operations.
• Collaborate with stakeholders on data governance, security and cost management.

Skills

Databricks

Data Lakes

Azure Cloud

Data Pipelines

SQL

Python

Java

R

Tableau

Notebooks

REST/SOAP

Education

Bachelor's degree in IT or related field

Tools

Azure Data Factory

Streamsets

Synapse

Databricks

Job description

In person interview

Remote - need candidates within 50 miles from client location. Occasional onsite upon request required.

We are seeking an experienced IT Consultant to support the design, development, implementation and maintenance of an enterprise Big Data solution as part of the Data Modernization Effort.

This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations, including the Internet of Things (IoT) / Smart City projects, enterprise data warehouse, the open data portal, and data science applications. This architecture includes an Databricks, Microsoft Azure platform tools (including Data Lake, Synapse) and data pipeline/ETL development tools (including Streamsets, Azure Data Factory). The platform will be designed for use and integration with other Enterprise Data tools such as Esri, Tableau, MicroStrategy, API Gateways, and Oracle databases and integration tools.

Minimum Education/Certification Requirements

Bachelor's degree in Information Technology or related field or equivalent experience

Skills and Experience

• Experience implementing modern Big Data storage and analytics platforms such as Databricks and Data Lakes
• Required 5 Years
• Knowledge of modern Big Data and Data Architecture and Implementation best practices
• Required 5 Years
• Knowledge of architecture and implementation of networking, security and storage on cloud platforms such as Microsoft Azure
• Required 5 Years
• Experience with operations (runtime, warehousing, pipelines, auditing, sharing cost management, user management) for data platforms such as Databricks
• Required 5 Years
• Experience with deployment of data tools and storage on cloud platforms such as Microsoft Azure
• Required 5 Years
• Knowledge of Data-centric systems for the analysis and visualization of data, such as Tableau, MicroStrategy, ArcGIS, Kibana, Oracle
• Required 5 Years
• Experience querying structured and unstructured data sources including SQL and NoSQL databases
• Required 5 Years
• Experience modeling and ingesting data into and between various data systems through the use of Data Pipelines
• Required 5 Years
• Experience with API / Web Services (REST/SOAP)
• Required 3 Years
• Experience with complex event processing and real-time streaming data
• Required 3 Years
• Experience with deployment and management of data science tools and modules such as Notebooks and R
• Required 3 Years
• Experience with ETL, data processing, analytics using languages such as Python, Java or R
• Required 3 Years
• Databricks Certified Data Engineer Professional
• Highly desired
• 16+ yrs planning, coordinating, and monitoring project activities
• Required 16 Years
• 16+ yrs leading projects, ensuring they are in compliance with established standards/procedures
• Required 16 Years
• Bachelor's degree in IT or related field or equivalent experience
• Required
• Experience deploying apps, gateways, agents and models on data platforms such as Databricks
• Nice to have 2 Years