Data Engineer II

Early Warning Services LLC; Scottsdale (AZ); Hybrid; USD 83,000 - 110,000; Full time

Benefits offered by this job

Health benefits

401(k) with company match

Paid time off

Hybrid work model

Job summary

Early Warning Services LLC is seeking a Data Engineer II to design, build, and optimize BI across multiple stacks. You will craft ETL, develop backend data sources, and deliver dashboards that inform planning and performance metrics.

The role emphasizes data quality, risk management, and collaboration with Data Science, engineering, and analytics leadership. Hybrid Scottsdale operations and a strong focus on scalable data platforms.

Qualifications

• Bachelor’s degree or higher in a related field.
• 2–4 years in PySpark/Python/Spark/Scala in a Linux data engineering environment.
• Experience with Tableau Server and Tableau dashboards.
• Strong problem-solving, testing, and analytical skills.
• Knowledge of dashboard development, data modeling, ETL, and systems design.
• Experience with SQL and Spark; Python for software/data engineering.
• Familiarity with Hadoop, AWS/S3, Hive/Impala.
• Experience collaborating across teams in a regulated enterprise.
• Excellent communication and teamwork; background check required.

Responsibilities

• Partner with users to define reporting and dashboard requirements.
• Design and develop backend data sources using Cloudera stack.
• Create complex dashboards and reports with Tableau and scorecards.
• Perform in-depth data analysis and cause-effect investigations.
• Design ETL processes for production and ad-hoc analyses.
• Guide data platform improvements and establish BI standards.
• Provide training and support to business teams as needed.
• Build reusable data ingestion and storage frameworks (Hadoop/AWS).
• Mentor interns and align BI with strategic initiatives.
• Collaborate with engineers to enhance the Data Science platform.

Skills

PySpark/Python/Spark/Scala

Tableau Server

SQL

Hadoop

AWS/S3

Linux

Data modeling

Data quality

Strong communication

Education

Bachelor’s degree

Tools

Cloudera

Tableau

Tableau Server

Hive

Impala

Linux

Hadoop

AWS

Job description

Early Warning Services is seeking a Data Engineer II to evaluate, design, and develop business intelligence solutions across multiple technology stacks. The role supports reporting and dashboard needs, builds ETL and backend data solutions, and contributes to data quality, risk management, and enhancements to the Data Science platform.

Responsibilities

• Partner with business users to define reporting and dashboard requirements, including identifying gaps in data, logic, and business understanding.
• Design and develop backend solutions for new data sources using the Cloudera technology stack.
• Use Tableau to create complex, visually oriented, interactive dashboards, scorecards, and reports, including supporting trends and projections.
• Perform in-depth data analysis to produce logical results and execute cause-and-effect analysis based on available data.
• Design data ETL and manipulations to enable production and ad-hoc analyses and reporting.
• Investigate industry best practices and help guide strategic data platforms, tools, and processes.
• Recommend standards, policies, and procedures for the form, structure, and attributes of BI tools and systems.
• Provide support and training to business teams as needed.
• Write data infrastructure and analytics software tools for Data Science.
• Mentor and train interns.
• Guide Data Scientists on software engineering best practices.
• Collaborate with analytics leadership and engineers across Early Warning to deliver architectural and software enhancements to the Data Science platform.
• Work with Data Science leadership to improve ETL and cluster computing.
• Support the company’s commitment to risk management by protecting the integrity and confidentiality of systems and data.

Overall Purpose

The Data Engineer evaluates, designs, and develops business intelligence solutions across multiple technology stacks. The role works across business functions and technology partners to translate metrics into actionable information for planning, measurement, trending, and operational performance improvements. Responsibilities include researching technology best practices, implementing frameworks, aligning BI direction with strategic business initiatives, analyzing metric sources, monitoring data quality, defining logical interdependencies, developing datamarts, and building end-to-end business process dashboards.

Required Qualifications

• Education and experience typically obtained through a Bachelor’s degree.
• 2-4 years of progressive work experience in PySpark/Python/Spark/Scala in a Linux environment for data engineering development.
• Understanding of Tableau Server and Tableau Dashboard.
• Demonstrated ability with testing, problem solving, and analysis.
• Knowledge of principles, practices, and techniques of dashboard development, reporting, data modeling, ETL, and systems design.
• Experience working with SQL and Spark.
• Software and data engineering in Python.
• Machine learning toolkits in Python/R.
• Experience building reusable frameworks for data ingestion and storage in Hadoop or AWS/S3.
• Experience with relational databases, including optimizing and tuning queries, indexing, partitioning, and related practices.
• Experience collaborating with internal engineering and technology teams to build data infrastructure in a regulated, enterprise environment.
• Strong communication skills.
• Background and drug screen.

Preferred Qualifications

• Prior demonstrated experience (2-4 years).
• Scala/Java and PySpark experience.
• Experience with Hive/Impala and Linux.
• Fin-tech experience.

Technologies

• Cloudera, Tableau, Tableau Server
• PySpark, Python, Spark, Scala
• Linux, SQL
• Hadoop, AWS, S3
• Hive, Impala
• Python/R

Compensation

• Base pay scale for Phoenix, AZ / Chicago, IL: $83,000 - $110,000 per year.
• Base pay scale for New York, NY / San Francisco, CA: $99,000 - $132,000 per year.
• Discretionary incentive plan and benefits are also available.

Benefits

• Competitive medical (PPO/HDHP), dental, and vision plans, with company contributions to a Health Savings Account (HSA) or pre-tax savings through Flexible Spending Accounts (FSA) for commuting, health, and dependent care expenses.
• 401(k) Retirement Plan with a 100% Company Safe Harbor Match on the first 6% deferral immediately upon eligibility.
• Paid Time Off: Flexible Time Off for Exempt (salaried) employees, generous PTO for Non-Exempt (hourly) employees, plus 11 paid company holidays and a paid volunteer day.
• 12 weeks of Paid Parental Leave.
• Maven Family Planning support for egg freezing, fertility, adoption, surrogacy, pregnancy, postpartum, early pediatrics, and returning to work.

Physical Requirements

• Work is primarily sedentary and requires extensive use of a computer, including sitting for periods of approximately four hours.
• May require occasional standing, walking, kneeling, and reaching.
• Must be able to lift 10 pounds occasionally and/or negligible amount of force frequently.
• Requires visual acuity and dexterity to view, prepare, and manipulate documents and office equipment, including personal computers.
• Requires the ability to communicate with internal and/or external customers.
• Employee must be able to perform essential functions and physical requirements of the position with or without reasonable accommodation.

Work Authorization

Candidates responding to this posting must independently possess eligibility to work in the United States, for any employer, at the date of hire. This position is ineligible for employment Visa sponsorship.

Location and Hiring Details

Scottsdale, AZ (hybrid)

Salary: USD 83,000 - 132,000 per year

Minimum Experience: 2 years

Education: Bachelor’s degree