Data Engineer

Wal-Mart; Boston (MA); Remote; Full time

Job summary

A leading technology firm is seeking a Data Engineer to develop an internal AI platform for enhancing performance reviews and career frameworks. This remote position requires strong experience in Python, SQL, and data modeling, and offers a competitive hourly pay range. Join a dynamic team focused on innovation and efficiency in data processing.

Qualifications

• 3-5 years of experience required.
• 3+ years of Python, SQL, SparkSQL experience.
• Experience with data lake architectures for large-scale data processing.

Responsibilities

• Help define company data assets and Spark SQL jobs.
• Collaborate with engineers and product managers to understand data needs.
• Design and build collections of data models for various use cases.

Skills

Python development

SQL

SparkSQL

schema design

dimensional data modeling

medallion architectures

Education

BSc degree in Computer Science or related technical field

Tools

Databricks

Job description

FocusKPI is looking for a Data Engineer on W2 to join one of our clients, a high-tech SaaS company.

The team is seeking a software engineer contractor to develop an internal AI platform for SPRiTEs GPT to save time for clients' writing feedback and managers' writing reviews. This AI tool will seamlessly integrate with their HR system, facilitating managers in summarizing the impact and feedback derived from existing data within Workday. Additionally, the platform will allow both managers and employees to explore their career frameworks, enabling queries and questions using the data at their disposal. This project will save the client 1,000+ hours per year by streamlining the performance review experience, while also increasing the quality of the experience.

Work Location: Remote - anywhere in the US (Except New York City metro, San Francisco metro, & Seattle metro)

Duration: 12-month contract

Pay Range: $41/hr to $47/hr

Note: No C2C resumes are considered.

Responsibilities:

1. Help define company data assets (data model), Spark SQL jobs to populate data models.
2. Collaborate with engineers, product managers, and data scientists to understand data needs, representing key data insights in a meaningful way.
3. Help define and design data integrations and data quality frameworks, as well as evaluate open-source/vendor tools for data lineage.
4. Design, build, and launch collections of data models that support multiple use cases across different products or domains.
5. Optimize pipelines to facilitate easier development of data artifacts.

Qualifications:

1. 3-5 years of experience required.
2. BSc degree in Computer Science or related technical field.
3. 3+ years of Python development experience.
4. 3+ years of SQL, SparkSQL experience.
5. 3+ years of experience with schema design, dimensional data modeling, and medallion architectures.
6. Experience with the Databricks platform and data lake architectures for large-scale data processing and analytics.
7. Experience designing, building, and maintaining data processing systems.

Note: No C2C resumes are considered.

Thank you!

FocusKPI Hiring Team

Founded in 2010, FocusKPI, Inc. (FocusKPI) is a data science and technology firm specializing in predictive analytics practice and methodologies. FocusKPI is a US company headquartered in Silicon Valley, California, with an East Coast office in Boston, Massachusetts.

NOTICE: Please be aware of fraudulent emails regarding job postings, job offers, and fake checks. FocusKPI's recruiting team will strictly reach out via @focuskpi.com email domain. If you have received fraudulent emails, please report them at https://reportfraud.ftc.gov/. The domain @focuskpijobs.com is fraudulent and not related to FocusKPI. Please do not reply or communicate with anyone using that domain.