Engineer, Big Data - Databricks/Python/SQL/Power BI - Remote

Lensa; New York (NY); Remote; USD 77,000 - 156,000; Full time

Job summary

Join a forward-thinking company as a Big Data Engineer, where you'll be at the forefront of data solutions. In this fully remote role, you'll design and implement scalable data architectures, ensuring high performance and reliability. Collaborate closely with teams to optimize data processes and tackle challenges in data ingestion and analytics. If you're passionate about leveraging data to drive insights and innovation, this is your chance to make a significant impact in a dynamic environment that values your expertise.

Qualifications

• Experience in building stream-processing systems using Kafka or Spark-Streaming.
• Proven experience with Big Data tools and integration of data from multiple sources.

Responsibilities

• Collect, store, process, and analyze large data sets.
• Implement batch and real-time data ingestion/extraction processes.

Skills

Big Data Tools (Spark, Hive, Impala)

ETL Processes

Data Modeling

Programming (Java/Scala/Python)

Hadoop Components (HDFS, YARN)

Web Services APIs (REST/SOAP)

Education

Bachelor's Degree

Master's Degree

Tools

Kafka

Talend

NoSQL Databases (HBase, Memsql)

Job description

Molina Healthcare

Engineer, Big Data - Databricks/Python/SQL/Power BI - Remote

Remote

Scalepex

AWS Data Engineer - Fully Remote - US Only

Remote

Motion Recruitment Partners LLC

Staff Java Engineer/Workflow Automation experience/SoCal Remote

Remote

West 4th Strategy

IRS Middleware Engineer (Remote)

Remote

NuHire, LLC

Mainframe System Programmer - 100% Remote

Remote

TEKsystems

100% Remote Software Developer (.NET/C#) *Secret Clearance Needed*

Remote

DemandLab

24-03-Martech Solutions Architect (Fully Remote - North America)

Remote

Cisco Systems, Inc.

Lead ML Engineer - Meraki Assurance, Remote, U.S./Canada

Remote

Weights & Biases

Senior Software Engineer, Identity Team (Remote)

Remote

Dexian - DISYS

Data Modeler (Microsoft Fabric)

Remote

TEKsystems

100% Remote .Net Developer Position

Remote

SherlockTalent

Python Backend Developer Data Engineer 100% Remote

Remote

Oracle DBA - Remote

Cyrten

Oracle DBA - Remote

Remote

Bivium Group

Superstar Fully Remote Back end - Java/C++/Javascript - AI, ML, Fraud startup

Remote

Software partner italia

Tableau Developer - full remote

Remote

Jobot

DevOps Engineer (Azure) - 100% REMOTE

Remote

Join DevOps

DevOps Engineer (Azure) - 100% REMOTE

Remote

Cynet Systems

Robotic Process Automation Developer - Remote / Telecommute

Remote

Relyance AI

Senior Software Engineer, Static Code Analysis

Remote

black.ai

Senior Software Engineer (Python) - Warehouse Platform (Open to remote across ANZ)

Remote

DevOps Engineering Lead with Series C Startup (Fully Remote)

Responsible for collecting, storing, processing, and analyzing large sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. He/she will also be responsible to follow architecture and best practices used across the enterprise.

Knowledge/Skills/Abilities

• Define ideal Architecture, Evaluating tools and Frameworks, Standards & Best Practices for implementing scalable business solutions

• Implement Batch and Real-time data ingestion/extraction processes through ETL, Streaming, API, etc., between diverse source and target systems with structured and unstructured datasets

• Design and build data solutions with an emphasis on performance, scalability, and high-reliability

• Code, test, and document new or modified data systems to create robust and scalable applications for data analytics

• Build data model for analytics and application layers

• Working closely with multiple teams and Business partners, for collecting requirement and providing optimal solution

• Proven experience on Hadoop cluster components and services (like HDFS, YARN, ZOOKEEPER, AMBARI/CLOUDERA MANAGER, SENTRY/RANGER, KERBEROS, etc.)

• Ability to participate in troubleshooting technical issues while engaged with infrastructure and vendor support teams.

Job Qualifications

Required Education

Bachelor's Degree

Required Experience

• Experience in building stream-processing systems, using solutions such as Kafka, Storm or Spark-Streaming

• Proven experience on Big Data tools such as, Spark, Hive, Impala, Polybase, Phoenix, Presto, Kylin, etc.

• Experience with integration of data from multiple data sources (using ETL tool such, Talend, etc.)

• Experience building solutions with NoSQL databases, such as HBase, Memsql

• Strong experience on Database technologies, Data Warehouse, Data Validation & Certification, Data Quality, Metadata Management and Data Governance

• Experience with programming language such as, Java/Scala/Python, etc.

• Experience implementing Web application and Web Services APIs (REST/SOAP)

Preferred Education

Master's Degree

Preferred Experience

Experience in the healthcare industry is preferred

To all current Molina employees: If you are interested in applying for this position, please apply through the intranet job listing.

Molina Healthcare offers a competitive benefits and compensation package. Molina Healthcare is an Equal Opportunity Employer (EOE) M/F/D/V.

Pay Range: $77,969 - $155,508 / ANNUAL

*Actual compensation may vary from posting based on geographic location, work experience, education and/or skill level.

Job Description ❋ Why Scalepex? Scalepex is a dynamic services firm specializing in providing solutions for premium brands like Nike, Pepsi, Toyota, Virgin and Walgreens. Our mission is to connect prominent market leaders with top-tier professionals from around the world, fostering collaboration,...

One of our clients, a reputable software company located in Orange County, California, is currently looking to hire a Staff-level Java Engineer for a full-time role. This position is remote; however, they prefer candidates who reside in Southern California and are open to occasional in-office...

Middleware Engineer ROLE We need an experienced Middleware Engineer at the Internal Revenue Service (IRS) Middleware Services Branch (MSB). The MSB is leading critical infrastructure modernization initiatives as part of the IRS IT Modernization Plan and the Inflation Reduction Act Strategic...

Job Description We are seeking a skilled Mainframe Infrastructure Systems Programmer to join our IT team and support our mission-critical mainframe environment. Job Summary: The Mainframe Infrastructure Systems Programmer is responsible for the installation, configuration, maintenance, and...

Job Description Top Three Skills: 1. Mission Planning 2. C# (desktop development) 3. .NET Mandatory: Active Secret Clearance. DS2 is an organization that is committed to working effectively as a team with a clear focus on the customer and a belief that hiring talented individuals will help us...

Job Description The Martech Solutions Architect team member is a technically-focused marketer and problem-solver that has a deep curiosity and passion for creating and building software solutions that combine marketing and sales technology with process, automation and data governance in order to...

Applications are accepted until further notice. About Cisco Meraki and your role: At Cisco Meraki, our intuitive products enable organizations of all sizes to deliver cloud-managed networking at scale. To provide best-in-class technologies to our customers, we've created an unrivaled company...

At Weights & Biases, our mission is to build the best tools for AI developers. We founded our company on the insight that while there were excellent tools for developers to build better code, there were no similarly great tools to help ML practitioners build better models. Starting with our first...

FULLY REMOTE - MUST WORK EASTERN TIME ZONE STRONG MICROSOFT FABRIC EXPERIENCE STRONG COMMUNICATION SKILLS ETL experience, SSIS, Azure, SQL skills, amazon web services experience nice to have. Data modeler, strong experience data modeling, Microsoft house, Top 3 must haves: enterprise data warehouse...

Job Description Our client is looking to hire Mid-Level .NET Developers to join their teams supporting various web applications supporting the Air Force. Top Skills' Details 2-3 years experience with the following web development technologies: 1. MVC frameworks - A senior candidate will need to be...

Job Title: Python Backend Developer Location: REMOTE Anywhere in the world Job Type: Perm Full-Time Salary: US $100K++ Depending on Experience Job Reference: 7148 We are looking for an entrepreneurial minded Python Backend Developer to help us disrupt the e-commerce industry. We believe it is time...

Oracle DBA - Remote Position Location:Remote Preferred Time Zones:EST, CST, MTN Rate Type:W2 ONLY Compensation: Upto $70 per hr Length:1 to 3 years We are looking for a highly skilled and experienced Oracle DBA to join our team. The ideal candidate will have a strong understanding of Oracle...

Salary range: $120,000 - $170,000 Description: We have a 20+ year history with this group of serial entrepreneurs - with MULTIPLE successful exits over this time. NOTE - This role is more focused on data back end than on the front end. It emphasizes data, databases, and middleware. Our client is...

This range is provided by Jobot. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $130,000.00/yr - $140,000.00/yr Want to learn more about this role and Jobot? Click our Jobot logo and follow our LinkedIn page! Job details DevOps...

Want to learn more about this role and Jobot? Click our Jobot logo and follow our LinkedIn page! Job details DevOps Engineer with well-known and well-established non-profit research organization! This Jobot Job is hosted by Katherine Krull Are you a fit? Easy Apply now by clicking the "Easy Apply"...

Responsibilities: Collaborate with business partners and team members to identify business process automation opportunities and associated requirements. Evaluate business requests for automation and develop process automation recommendations. Build new processes and objects using our development...

Senior Software Engineer, Static Code Analysis United States (Remote) As Relyance AI’s Senior Software Engineer, Static Code Analysis, you will architect and implement the services and platform that powers the program analysis component of our product. This role requires you to think critically and...

Join the team redefining how the world experiences design. Thanks for stopping by. We know job hunting can be a little time consuming and you're probably keen to find out what's on offer, so we'll get straight to the point. Where and how you can work Our flagship campus is in Sydney. We also have a...

Who are you? Ideally, you are a technical leader with expertise in React, Next.js, TypeScript, and Node.js, excel in architectural decision-making, actively contribute to the codebase, and drive technical excellence. You should have a problem-solving approach, prioritize impactful solutions, and...

Job Summary Responsible for collecting, storing, processing, and analyzing large sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. He/she will also be responsible to follow architecture and best...