Big Data Architect IT Consultant Master

AHU Technologies Inc.; United States; Remote; USD 120,000 - 150,000; Full time

Job summary

AHU Technologies Inc. seeks an experienced IT Consultant to support design, development, implementation and maintenance of an enterprise Big Data solution for a District-wide data modernization effort.

The role covers Databricks, Azure Data Lake/Synapse, and data pipelines across IoT, data warehouse, and open data portal with analytics tools. You will join a senior data team and work on architecture, deployments, and governance for real-time data streams and analytics platforms using Databricks,

Qualifications

• Bachelor’s degree in Information Technology or related field or equivalent experience.

Responsibilities

• Coordinates IT project management, engineering, maintenance, QA, and risk management.
• Plans, coordinates, and monitors project activities.
• Develops technical applications to support users.
• Develops, implements, maintains and enforces documented standards and procedures for the design, development, installation, modification, and documentation of assigned systems.
• Provides training for system products and procedures.
• Performs application upgrades.
• Performs, monitoring, maintenance, or reporting on real-time databases, real-time network and serial data communications, and real-time graphics and logic applications.
• Troubleshoots problems.
• Ensures project life-cycle is in compliance with District standards and procedures.

Skills

Databricks

Azure Cloud

Data Lake

ETL pipelines

APIs REST/SOAP

Real-time streaming

Python/Java/R

Data Visualization tools

Education

Bachelor’s degree in IT or related field

Tools

Databricks

Azure Data Factory

Streamsets

Synapse

Tableau

Esri

MicroStrategy

Job description

Job Description:

Short Description:

The DC Client seeks an experienced IT Consultant to support the design, development, implementation and maintenance of an enterprise Big Data solution as part of the Client Data Modernization Effort.

Complete Description:

This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations for the District of Columbia government, including the Internet of Things (IoT) / Smart City projects, enterprise data warehouse, the open data portal, and data science applications. This is an exciting opportunity to work as a part of a collaborative senior data team supporting DC’s Client. This architecture includes an Databricks, Microsoft Azure platform tools (including Data Lake, Synapse) and data pipeline/ETL development tools (including Streamsets, Azure Data Factory). The platform will be designed for District wide use and integration with other Client Enterprise Data tools such as Esri, Tableau, MicroStrategy, API Gateways, and Oracle databases and integration tools.

CONTRACT JOB DESCRIPTION:

Responsibilities:

• Coordinates IT project management, engineering, maintenance, QA, and risk management.
• Plans, coordinates, and monitors project activities.
• Develops technical applications to support users.
• Develops, implements, maintains and enforces documented standards and procedures for the design, development, installation, modification, and documentation of assigned systems.
• Provides training for system products and procedures.
• Performs application upgrades.
• Performs, monitoring, maintenance, or reporting on real- time databases, real-time network and serial data communications, and real-time graphics and logic applications.
• Troubleshoots problems.
• Ensures project life-cycle is in compliance with District standards and procedures.

Minimum Education/Certification Requirements:

• Bachelor’s degree in Information Technology or related field or equivalent experience.

Skills:

• Experience implementing modern Big Data storage and analytics platforms such as Databricks and Data Lakes. 5 Years Required
• Knowledge of modern Big Data and Data Architecture and Implementation best practices. 5 Years Required
• Knowledge of architecture and implementation of networking, security and storage on cloud platforms such as Microsoft Azure. 5 Years Required
• Experience with operations (runtime, warehousing, pipelines, auditing, sharing cost management, user management) for data platforms such as Databricks. 5 Years Required
• Experience with deployment of data tools and storage on cloud platforms such as Microsoft Azure. 5 Years Required
• Knowledge of Data-centric systems for the analysis and visualization of data, such as Tableau, MicroStrategy, ArcGIS, Kibana, Oracle. 5 Years Required
• Experience querying structured and unstructured data sources including SQL and NoSQL databases. 5 Years Required
• Experience modeling and ingesting data into and between various data systems through the use of Data Pipelines. 5 Years Required
• Experience with API / Web Services (REST/SOAP). 3 Years Required
• Experience with complex event processing and real-time streaming data. 3 Years Required
• Experience with deployment and management of data science tools and modules such as Notebooks and R. 3 Years Required
• Experience with ETL, data processing, analytics using languages such as Python, Java or R. 3 Years Required
• Databricks Certified Data Engineer Professional. Highly Desired
• 16+ yrs planning, coordinating, and monitoring project activities. 16 Years Required
• 16+ yrs leading projects, ensuring they are in compliance with established standards/procedures. 16 Years Required
• Experience deploying apps, gateways, agents and models on data platforms such as Databricks. 2 Years Nice to have

This is a remote position.