Engineer, Big Data - Databricks/Python/SQL/Power BI - Remote

Lensa; Mesa (AZ); Remote; USD 80,000 - 120,000; Full time

Job summary

An innovative firm is on the lookout for a talented Data Engineer to spearhead the design and development of scalable data solutions. This role is pivotal in selecting optimal architectures and implementing robust data ingestion and processing pipelines, ensuring high performance and reliability. You'll collaborate with various teams to gather requirements and troubleshoot technical issues, contributing significantly to the organization's data strategy. If you are passionate about data engineering and eager to make a difference in a dynamic environment, this is the perfect opportunity for you.

Qualifications

• Experience with stream-processing systems and Big Data tools.
• Strong database and data governance skills are essential.
• Programming experience in Java, Scala, or Python required.

Responsibilities

• Define architecture and establish standards for scalable solutions.
• Implement data ingestion/extraction processes from diverse sources.
• Collaborate with teams to gather requirements and deliver solutions.

Skills

Kafka

Storm

Spark-Streaming

Spark

Hive

Impala

Presto

ETL tools

NoSQL databases

Java

Scala

Python

Web APIs

Education

Bachelor's Degree

Master's Degree

Tools

Kafka

Spark

Hive

Impala

Presto

ETL tools

NoSQL databases

Job description

The job description provides a comprehensive overview of the data engineering role, including responsibilities, skills, and qualifications. However, it could benefit from improved formatting for better readability and focus. Here is a refined version:

Data Engineer - Big Data Solutions

We are seeking a skilled Data Engineer to design, develop, and maintain scalable data solutions. The role involves selecting optimal architectures, implementing data ingestion and processing pipelines, and ensuring high performance and reliability of data systems.

Responsibilities

1. Define ideal architecture, evaluate tools and frameworks, and establish standards and best practices for scalable business solutions.
2. Implement batch and real-time data ingestion/extraction processes using ETL, streaming, APIs, etc., across diverse data sources.
3. Design and build high-performance, scalable, and reliable data solutions.
4. Develop and document robust data systems for analytics.
5. Collaborate with multiple teams and business partners to gather requirements and deliver optimal solutions.
6. Participate in troubleshooting infrastructure and technical issues.

Minimum Requirements

• Bachelor's Degree in a relevant field.
• Experience with stream-processing systems like Kafka, Storm, or Spark-Streaming.
• Proficiency with Big Data tools such as Spark, Hive, Impala, Presto, etc.
• Experience integrating data from multiple sources using ETL tools.
• Knowledge of NoSQL databases like HBase or MemSQL.
• Strong database, data warehouse, and data governance skills.
• Programming experience in Java, Scala, or Python.
• Experience with Web APIs (REST/SOAP).

Preferred Qualifications

• Master's Degree.
• Experience in the healthcare industry is a plus.

This role offers a competitive salary range and benefits. Interested candidates should apply through the appropriate channels. Molina Healthcare is an Equal Opportunity Employer.