Data Engineer

Stepping Up Solutions; San Francisco (CA); On-site; USD 120,000 - 150,000; Full time

Job summary

Stepping Up Solutions is seeking a skilled Data Engineer to join their Data Technology team. The successful candidate will design and implement scalable data infrastructure while ensuring the efficiency of data transformations developed by data scientists.

The role involves optimizing a data processing portal for real-time analytics and maintaining data in both MySQL and NoSQL systems. Candidates should have significant experience in a data-intensive environment and proficiency in Java or Python.

Qualifications

• 5+ years working in a data-intensive environment.
• 2+ years experience in distributed data platforms.
• Expert in SQL - MySQL preferred.
• 4+ years experience in Java or Python.
• Experience building RESTful APIs.

Responsibilities

• Take ownership of the data processing portal for real-time analytics.
• Migrate data processing from AWS to in-house servers.
• Script and analyze data, and query databases.
• Optimize and maintain the portal.

Skills

Data warehouse experience

Distributed data platforms

SQL proficiency

Java or Python programming

RESTful API development

Agile development practices

Tools

Hadoop

Kafka

Apache Spark

MySQL

NoSQL

Job description

Job Description

RadiumOne is seeking a Data Engineer to join our Data Technology team with the responsibility of designing and implementing scalable data infrastructure, as well as implementing data transformations developed by data scientists as scalable and robust processes. In this role, the successful candidate will be responsible for the following:

• You will take ownership of the data processing portal for the companies two real-time analytics platforms.
• You will be responsible with the migration from the current AWS to our in-house servers (Kafka – Spark) allowing for the portal to become real-time.
• You will load, script, and analyze the data, as well as query databases to develop and provide use cases.
• Responsible with optimizing, maintenance, and production support of the portal.

Qualifications

• 5+ years working in a data-intensive environment like a data warehouse or an analytics system.
• 2+ Years Experience working in distributed data platforms like Hadoop, Hive, Kafka etc. and with distributed data sets. Apache Spark is a nice‑to‑have.
• Expert in SQL - MySQL preferred and experience in NoSQL is a bonus.
• 4+ years Experience in Java or Python - Scala is a plus.
• Experience building RESTful APIs.
• Experience in agile software development practices (code versioning, Test Driven Development, Unit testing, continuous integration).
• Any domain is fine, but Digital Marketing preferred.
• Local candidates preferred as onsite interviews are a must.

Additional Information

All your information will be kept confidential according to EEO guidelines.