Engineer, Big Data - Databricks/Python/SQL/Power BI - Remote

Lensa; Milwaukee (WI); Remote; USD 77,000 - 156,000; Full time

Job summary

An established industry player is seeking a Big Data Developer to join their innovative team in Milwaukee. This role focuses on collecting and analyzing large data sets, ensuring optimal architecture and best practices are followed. You will work closely with various teams to design robust data solutions that emphasize performance and scalability. The ideal candidate will have experience with Hadoop, Kafka, and various Big Data tools, as well as a strong background in data governance. If you're passionate about leveraging data to drive business solutions, this opportunity is perfect for you.

Qualifications

• Experience in building stream-processing systems using Kafka or Spark.
• Proven experience with Big Data tools like Spark, Hive, and Impala.
• Strong experience in Data Governance and Data Quality management.

Responsibilities

• Collect, store, process, and analyze large sets of data.
• Design and build data solutions with an emphasis on performance.
• Implement Batch and Real-time data ingestion/extraction processes.

Skills

Data Architecture

ETL Processes

Hadoop

Streaming Systems

Data Modeling

Java

Python

NoSQL Databases

Data Governance

Education

Bachelor's Degree

Master's Degree

Tools

Kafka

Spark

HBase

Talend

Job description

2 days ago Be among the first 25 applicants

Lensa is the leading career site for job seekers at every stage of their career. Our client, Molina Healthcare, is seeking professionals. Apply via Lensa today!

Job Description

Job Summary

Responsible for collecting, storing, processing, and analyzing large sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. He/she will also be responsible to follow architecture and best practices used across the enterprise.

Knowledge/Skills/Abilities

• Define ideal Architecture, Evaluating tools and Frameworks, Standards & Best Practices for implementing scalable business solutions
• Implement Batch and Real-time data ingestion/extraction processes through ETL, Streaming, API, etc., between diverse source and target systems with structured and unstructured datasets
• Design and build data solutions with an emphasis on performance, scalability, and high-reliability
• Code, test, and document new or modified data systems to create robust and scalable applications for data analytics
• Build data model for analytics and application layers
• Working closely with multiple teams and Business partners, for collecting requirement and providing optimal solution
• Proven experience on Hadoop cluster components and services (like HDFS, YARN, ZOOKEEPER, AMBARI/CLOUDERA MANAGER, SENTRY/RANGER, KERBEROS, etc.)
• Ability to participate in troubleshooting technical issues while engaged with infrastructure and vendor support teams.
  
  

Job Qualifications

Required Education

Bachelor's Degree

Required Experience

• Experience in building stream-processing systems, using solutions such as Kafka, Storm or Spark-Streaming
• Proven experience on Big Data tools such as, Spark, Hive, Impala, Polybase, Phoenix, Presto, Kylin, etc.
• Experience with integration of data from multiple data sources (using ETL tool such, Talend, etc.)
• Experience building solutions with NoSQL databases, such as HBase, Memsql
• Strong experience on Database technologies, Data Warehouse, Data Validation & Certification, Data Quality, Metadata Management and Data Governance
• Experience with programming language such as, Java/Scala/Python, etc.
• Experience implementing Web application and Web Services APIs (REST/SOAP)
  
  

Preferred Education

Master's Degree

Preferred Experience

Experience in the healthcare industry is preferred

To all current Molina employees: If you are interested in applying for this position, please apply through the intranet job listing.

Molina Healthcare offers a competitive benefits and compensation package. Molina Healthcare is an Equal Opportunity Employer (EOE) M/F/D/V.

Pay Range: $77,969 - $155,508 / ANNUAL

• Actual compensation may vary from posting based on geographic location, work experience, education and/or skill level.

Seniority level

• Seniority level

  Entry level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Lensa by 2x

Get notified about new Big Data Developer jobs in Milwaukee, WI.

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.