NCDIT - Data Analyst

Expert Technology Services; Raleigh (NC); Hybrid; USD 80,000 - 110,000; Full time

Job summary

NCDIT is seeking a Data Analyst for a hybrid role focusing on Databricks (PySpark) and visualization tooling. The analyst will develop business requirements, support change management, and work with stakeholders to align data solutions with business needs.

Responsibilities include data analysis, data mappings, dashboard development in Power BI and Databricks, and collaboration with a technical lead and development team to build high-quality data products.

Qualifications

• Hands-on experience with Databricks (PySpark) for data analysis and transformation.
• Experience building dashboards with Power BI and Databricks native tools.
• Ability to develop business requirements and change management documentation.
• Collaborates with stakeholders and development team to align data solutions with business needs.
• Experience in data quality, data mappings, and building data products.

Responsibilities

• Conduct comprehensive data analysis, create data mappings, develop dashboards, and ensure data quality and integrity.
• Leverage Spark SQL within Databricks to query and analyze large datasets, writing efficient and complex SQL queries.
• Collaborate closely with data engineers to design and deliver high-quality data products.
• Develop detailed data mappings to support integration and transformation of data from diverse sources into structured, analysis-ready formats.
• Design and build dashboards using Power BI or Databricks native visualization tools to communicate insights.
• Build Gold-layer data products to support dashboards, APIs, and UI tools.
• Create clear and comprehensive documentation for data pipelines, mappings, models, and dashboard functionality.
• Perform statistical analysis, data mining, and machine learning to uncover patterns and actionable insights.

Skills

Databricks and PySpark

Spark SQL

Data Visualization and Dashboarding

Data Mapping and Modeling

Business Requirements and Stakeholder

Data Quality and Analysis

Job description

NCDIT - Data Analyst

This is a hybrid position. The manager is unsure how often he will need the contractor onsite, but the maximum requirement would be three days a week on Tuesday, Wednesday, and Thursday.

The ideal candidate will have hands-on expertise with Databricks (PySpark) and visualization tools, including both Databricks native tools and Power BI. In this role, you will be responsible for developing business requirements, supporting change management documentation, and actively collaborating with stakeholders to ensure alignment between data solutions and business needs. You will work closely with a technical lead and participate in design discussions and planning with the broader development team.

Key Responsibilities

Conduct comprehensive data analysis, create data mappings, develop dashboards, and ensure data quality and integrity

• Leverage Spark SQL within Databricks to query and analyze large datasets, writing efficient and complex SQL queries
• Collaborate closely with data engineers to design and deliver high-quality data products
• Develop detailed data mappings to support the integration and transformation of data from diverse sources into structured, analysis-ready formats
• Design and build intuitive, informative dashboards using tools such as Power BI or Databricks' native visualization tools to effectively communicate insights
• Build Gold-layer data products to support custom-built dashboards, APIs, and UI tools
• Create clear and comprehensive documentation for data pipelines, mappings, models, and dashboard functionality
• Perform statistical analysis, data mining, and machine learning to uncover patterns, trends, and actionable insights

Skill Matrix

Skill Required/Desired Years of Experience Databricks and PySpark Proficiency: Hands-on experience working in the Databricks platform and using PySpark for data analysis and transformation Required 5 Years Advanced Spark SQL: Ability to write efficient, complex queries to analyze large datasets within Databricks Required 5 Years Data Visualization and Dashboarding: Building clear, intuitive dashboards in Power BI and Databricks native visualization tools to communicate insights Required 5 Years Data Mapping and Modeling: Developing detailed mappings that integrate and transform data Required 5 Years Business Requirements and Stakeholder Collaboration: Gathering, analyzing, and developing business requirements with stakeholders Required 5 Years Data Quality and Analysis: Conducting thorough data analysis and ensuring data quality Required 5 Years