Senior Data Analyst - Databricks, PySpark & Power BI

Rose International; Raleigh (NC); On-site; USD 90,000 - 120,000; Full time

Benefits offered by this job

Health insurance

Job summary

Rose International seeks a data analytics professional in Raleigh, NC to design and deliver data pipelines, mappings, and dashboards.

The role requires hands-on Databricks (PySpark) work, Spark SQL, and Power BI visualization, with collaboration across data engineers and stakeholders. You will map data, ensure quality, and support change management while contributing to enterprise data initiatives.

Qualifications

• Hands-on Databricks (PySpark) experience for data analysis and transformation.
• Strong Spark SQL skills for efficient large-scale queries.
• Proficient in building dashboards with Power BI.
• Experience in data mapping and data modeling.
• Ability to gather business requirements and liaise with stakeholders.
• Experience with data quality analysis and validation.

Responsibilities

• Conduct comprehensive data analysis, create data mappings, develop dashboards, and ensure data quality and integrity.
• Leverage Spark SQL within Databricks to query and analyze large datasets, writing efficient and complex SQL queries.
• Collaborate closely with data engineers to design and deliver high-quality data products.
• Develop detailed data mappings to support the integration and transformation of data from diverse sources into structured, analysis-ready formats.
• Design and build intuitive, informative dashboards using tools such as Power BI or Databricks' native visualization tools to communicate insights effectively.
• Build Gold-layer data products to support custom-built dashboards, APIs, and UI tools.
• Create clear and comprehensive documentation for data pipelines, mappings, models, and dashboard functionality.
• Perform statistical analysis, data mining, and machine learning to uncover patterns, trends, and actionable insights.
• Only those lawfully authorized to work in the designated country associated with the position will be considered.
• Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.

Skills

Databricks

PySpark

Spark SQL

Power BI

Databricks visualization

Data mapping

Data modeling

Business requirements

Stakeholder collaboration

Data quality

Data analysis

Tools

Databricks

Power BI

PySpark

Job description

Required Skills

• Databricks and PySpark proficiency: hands-on experience working in the Databricks platform and using PySpark for data analysis and transformation (5 Years)


• Advanced Spark SQL: the ability to write efficient, complex queries to analyze large datasets within Databricks (5 Years)


• Data visualization and dashboarding: building clear, intuitive dashboards in Power BI and Databricks’ native visualization tools to communicate insight (5 Years)


• Data mapping and modeling: developing detailed mappings that integrate and transform data (5 Years)


• Business requirements and stakeholder collaboration: gathering and developing business requirements (5 Years)


• Data quality and analysis: conducting thorough data analysis (5 Years)

The ideal candidate will have hands-on expertise with Databricks (PySpark) and visualization tools, including both Databricks native tools and Power BI. In this role, you will develop business requirements, support change management documentation, and collaborate with stakeholders to align data solutions with business needs. You will work closely with a technical lead and participate in design discussions and planning with the broader development team

Job Duties

• Conduct comprehensive data analysis, create data mappings, develop dashboards, and ensure data quality and integrity


• Leverage Spark SQL within Databricks to query and analyze large datasets, writing efficient and complex SQL queries


• Collaborate closely with data engineers to design and deliver high-quality data products


• Develop detailed data mappings to support the integration and transformation of data from diverse sources into structured, analysis-ready formats


• Design and build intuitive, informative dashboards using tools such as Power BI or Databricks' native visualization tools to communicate insights effectively


• Build Gold-layer data products to support custom-built dashboards, APIs, and UI tools


• Create clear and comprehensive documentation for data pipelines, mappings, models, and dashboard functionality


• Perform statistical analysis, data mining, and machine learning to uncover patterns, trends, and actionable insights


• Only those lawfully authorized to work in the designated country associated with the position will be considered.


• Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.

About Rose

• Founded in 1993


• Office Locations Across the U.S.


• 150+ Clients: Corporations and Government Agencies


• Employee Oriented Company


• Challenging Assignments Across the U.S.


• Continuous Professional Development

EMPLOYEE COMMENTS

• We want you to work with us, but don't take our word for it. Take a look at this sampling of employee comments. They speak for themselves.