Data Analyst

Software Technology Inc.; Raleigh (NC); On-site; USD 90,000 - 120,000; Full time

Job summary

Software Technology Inc. Raleigh, NC seeks a data analyst / data engineer contractor to conduct comprehensive data analysis, build data mappings, and develop dashboards using Spark SQL in Databricks and Power BI.

You will work with data engineers to deliver high-quality data products and maintain data quality across sources. The role emphasizes building gold-layer data products, documenting pipelines, mappings, models, and dashboard functionality, and performing statistical analysis and ML to

Qualifications

• Hands-on Databricks and PySpark for data analysis and transformation.
• Advanced Spark SQL for large datasets in Databricks.
• Creating dashboards in Power BI and Databricks visualizations.
• Develop detailed data mappings and data modeling.
• Gathering business requirements and collaborating with stakeholders.
• Ensuring data quality and thorough data analysis.

Responsibilities

• Conduct comprehensive data analysis, create data mappings, develop dashboards, and ensure data quality and integrity.
• Leverage Spark SQL within Databricks to query and analyze large datasets, writing efficient and complex SQL queries.
• Collaborate with data engineers to design and deliver high-quality data products.
• Develop detailed data mappings to support integration and transformation of data from diverse sources.
• Design and build dashboards using Power BI or Databricks visual tools to communicate insights clearly.
• Build Gold-layer data products to support dashboards, APIs, and UI tools.
• Create clear documentation for data pipelines, mappings, models, and dashboards.
• Perform statistical analysis, data mining, and machine learning to uncover patterns and insights.

Skills

Databricks PySpark

Spark SQL

Data Visualization

Data Mapping

Stakeholder Collaboration

Data Quality

Job description

Location: 3700 Wake Forest Rd Raleigh, NC 27609

Duration: 12 Months

Key Responsibilities:

• Conduct comprehensive data analysis, create data mappings, develop dashboards, and ensure data quality and integrity
• Leverage Spark SQL within Databricks to query and analyze large datasets, writing efficient and complex SQL queries
• Collaborate closely with data engineers to design and deliver high-quality data products
• Develop detailed data mappings to support the integration and transformation of data from diverse sources into structured, analysis-ready formats
• Design and build intuitive, informative dashboards using tools such as Power BI or Databricks' native visualization tools to effectively communicate insights
• Build Gold-layer data products to support custom-built dashboards, APIs, and UI tools
• Create clear and comprehensive documentation for data pipelines, mappings, models, and dashboard functionality
• Perform statistical analysis, data mining, and machine learning to uncover patterns, trends, and actionable insights

Required Skills:

• Databricks and PySpark proficiency: hands-on experience working in the Databricks platform and using PySpark for data analysis and transformation. – Required / 5 Years
• Advanced Spark SQL: the ability to write efficient, complex queries to analyze large datasets within Databricks. – Required / 5 Years
• Data visualization and dashboarding: building clear, intuitive dashboards in Power BI and Databricks' native visualization tools to communicate insight – Required / 5 Years
• Data mapping and modeling: developing detailed mappings that integrate and transform data – Required / 5 Years
• Business requirements and stakeholder collaboration: gathering and developing business requirements – Required / 5 Years
• Data quality and analysis: conducting thorough data analysis – Required / 5 Years