Senior Data Architecture for Azure Databricks & Big Data

InstantServe LLC; Washington (District of Columbia); On-site; USD 140,000 - 190,000; Full time

Job summary

InstantServe LLC seeks a senior IT Consultant to drive a Big Data/Data Modernization initiative. You will design, develop, and maintain scalable Databricks and Microsoft Azure data platforms, data lakes, pipelines, integrations, and analytics solutions.

The role requires extensive experience across Databricks, Azure cloud architecture, APIs, streaming, and data visualization tools, with a focus on scalable, secure deployments.

Qualifications

• Requires 16+ years in IT project planning, coordination, and monitoring.
• Requires 16+ years leading projects with standards compliance.
• Requires 5+ years in Databricks, Big Data, Data Lakes, and modern data architecture.
• Requires 5+ years Azure cloud architecture, networking, security, and storage.
• Requires 5+ years operating Databricks data platforms with pipelines, auditing, cost, and user management.
• Requires 5+ years deploying Azure data tools and storage solutions.
• Requires 5+ years with SQL/NoSQL and structured/unstructured data.
• Requires 5+ years designing data pipelines and ETL/ELT.
• Requires 5+ years with data analytics/visualization tools such as Tableau, MicroStrategy, ArcGIS/Esri, Kibana, or Oracle.
• Requires 3+ years with REST/SOAP APIs and Web Services.
• Requires 3+ years with real-time streaming and complex event processing.
• Requires 3+ years using Python, Java, or R for ETL/data processing/analytics.
• Requires 3+ years managing data science tools such as Databricks Notebooks and R.
• Bachelor's degree in IT or related field, or equivalent experience.

Responsibilities

• Design, develop, and maintain scalable Databricks and Azure data platforms.
• Create data lakes, pipelines, integrations, and analytics solutions.
• Support enterprise Big Data/Data Modernization initiatives.

Skills

Databricks

Big Data

Data Lakes

Azure

SQL/NoSQL

ETL/ELT

Python/Java/R

Real-time streaming

APIs

Data analytics/visualization tools

Education

Bachelor's degree in IT or related field

Tools

Databricks Notebooks

Azure Data Factory

Azure Data Lake

Azure Synapse

Tableau

MicroStrategy

ArcGIS/Esri

Kibana

Oracle

Job description

InstantServe LLC seeks a senior IT Consultant to drive a Big Data/Data Modernization initiative. You will design, develop, and maintain scalable Databricks and Microsoft Azure data platforms, data lakes, pipelines, integrations, and analytics solutions.

The role requires extensive experience across Databricks, Azure cloud architecture, APIs, streaming, and data visualization tools, with a focus on scalable, secure deployments.