Data Engineer II: BI Dashboards, ETL & Spark

Early Warning Services LLC; San Francisco (CA); Hybrid; USD 99,000 - 132,000; Full time

Benefits offered by this job

Healthcare Coverage

401(k) Matching

Paid Time Off

Parental Leave

Job summary

Early Warning Services LLC is seeking a Data Engineer to design and develop BI solutions across multiple technology stacks, translating metrics into actionable information to inform planning, measuring, and performance improvements.

You will collaborate with business users to define reports, build data ETL, and mentor interns while aligning data infrastructure with Data Science teams. The role is hybrid and offers a competitive salary range and comprehensive benefits.

Qualifications

• Bachelor's degree or equivalent experience.
• Experience with PySpark/Python/Spark/Scala in a Linux environment for Data Engineering development.
• Knowledge of Tableau Server and Tableau Dashboard.
• Demonstrated ability with testing, problem solving and analysis.
• Knowledge of dashboard development, reporting, data modeling, ETL and systems design.
• Experience with SQL Spark.
• Software/data engineering in Python.
• Machine Learning toolkits in Python/R.
• Building reusable data ingestion/storage frameworks in Hadoop or AWS/S3.
• Relational databases, query optimization, indexing, partitioning.
• Experience collaborating on data infrastructure in a regulated enterprise.
• Strong communication skills.
• Background and drug screen.

Responsibilities

• Work with business users to define requirements for reports and dashboards and identify data gaps.
• Design and develop backend solutions for new data sources using Cloudera stack.
• Use Tableau to create complex dashboards, scorecards, and reports with trends and projections.
• Conduct in-depth data analysis and causal reasoning from available data.
• Design ETL and data manipulations to support analyses and reports.
• Investigate industry best-practices and guide data platforms, tools, and processes.
• Recommend standards for BI tools and data attributes.
• Provide support and training to business teams as needed.
• Write data infrastructure and analytics tools for Data Science.
• Mentor and train interns and guide Data Scientists on software engineering practices.
• Collaborate with EW analytics leadership and engineers on platform enhancements.
• Collaborate on improving ETL and cluster computing.
• Support risk management and data confidentiality.

Skills

Communication

Testing & analysis

Dashboard design

SQL

Python

ETL

Education

Bachelor's degree

Tools

Tableau Server

Hive/Impala

Linux

Hadoop

AWS S3

Job description

Early Warning Services LLC is seeking a Data Engineer to design and develop BI solutions across multiple technology stacks, translating metrics into actionable information to inform planning, measuring, and performance improvements.

You will collaborate with business users to define reports, build data ETL, and mentor interns while aligning data infrastructure with Data Science teams. The role is hybrid and offers a competitive salary range and comprehensive benefits.