Data Engineer

Gravity IT Resources; Cincinnati (OH); Hybrid; USD 85,000 - 115,000; Part time

Job summary

A leading technology staffing firm is seeking skilled Data Engineers to join their Data Science team in a hybrid role in Cincinnati, OH. The candidates will design and maintain scalable data pipelines, integrate various data sources, and optimize processes for machine learning workflows. This position necessitates proficiency in Python and experience with big data technologies. Competitive contract terms available.

Qualifications

• 3+ years of experience in data engineering or related role.
• Familiar with natural language processing NLP techniques.
• Understanding of LLM architectures and data requirements.

Responsibilities

• Design, develop, and maintain scalable ETL processes.
• Integrate data from various sources including databases and APIs.
• Collaborate with data scientists and optimize data pipelines.

Skills

Proficiency in Python

Strong analytical skills

Excellent communication abilities

Education

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field

Tools

ETL tools (e.g., Apache NiFi)

SQL databases (e.g., MySQL, PostgreSQL)

Cloud platforms (e.g., AWS, Azure)

Job description

To Apply for this Job

Role: Data Engineers
Location: Hybrid- Cincinnati, OH
Duration: Six Months Contract
Eligibility: U.S. Citizen Only

Job Summary: We are seeking three skilled Data Engineer to join our Data Science team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, machine learning, and Retrieval-Augmented Generation (RAG) type Large Language Model (LLM) workflows. This role requires a strong technical background, excellent problem-solving skills, and the ability to work collaboratively with data scientists, analysts, and other stakeholders.

Key Responsibilities

1. Data Pipeline Development:
   • Design, develop, and maintain robust and scalable ETL (Extract, Transform, Load) processes.
   • Ensure data is collected, processed, and stored efficiently and accurately.
2. Data Integration:
   • Integrate data from various sources, including databases, APIs, and third-party data providers.
   • Ensure data consistency and integrity across different systems.
3. RAG Type LLM Workflows:
   • Develop and maintain data pipelines specifically tailored for Retrieval-Augmented Generation (RAG) type Large Language Model (LLM) workflows.
   • Ensure efficient data retrieval and augmentation processes to support LLM training and inference.
   • Collaborate with data scientists to optimize data pipelines for LLM performance and accuracy.
4. Semantic/Ontology Data Layers:
   • Develop and maintain semantic and ontology data layers to enhance data integration and retrieval.
   • Ensure data is semantically enriched to support advanced analytics and machine learning models.
5. Collaboration:
   • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
   • Provide technical support and guidance on data-related issues.
6. Data Quality and Governance:
   • Implement data quality checks and validation processes to ensure data accuracy and reliability.
   • Adhere to data governance policies and best practices.
7. Performance Optimization:
   • Monitor and optimize the performance of data pipelines and infrastructure.
   • Troubleshoot and resolve data-related issues in a timely manner.
8. Support for Analysis:
   • Support short-term ad-hoc analysis by providing quick and reliable data access.
   • Contribute to longer-term goals by developing scalable and maintainable data solutions.
9. Documentation:
   • Maintain comprehensive documentation of data pipelines, processes, and infrastructure.
   • Ensure knowledge transfer and continuity within the team.

Technical Requirements

1. Education and Experience:
   • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
   • 3+ years of experience in data engineering or a related role.
2. Technical Skills:
   • Proficiency in Python (mandatory).
   • Experience with other programming languages such as Java or Scala is a plus.
   • Experience with SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB).
   • Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka).
   • Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services.
3. RAG Type LLM Skills:
   • Experience with data pipelines for LLM workflows, including data retrieval and augmentation.
   • Familiarity with natural language processing (NLP) techniques and tools.
   • Understanding of LLM architectures and their data requirements.
4. Semantic/Ontology Data Layers:
   • Familiarity with semantic and ontology data layers and their application in data integration and retrieval.
5. Tools and Frameworks:
   • Experience with ETL tools and frameworks (e.g., Apache NiFi, Airflow, Talend).
   • Familiarity with data visualization tools (e.g., Tableau, Power BI) is a plus.
6. Soft Skills:
   • Strong analytical and problem-solving skills.
   • Excellent communication and collaboration abilities.
   • Ability to work in a fast-paced, dynamic environment.

Preferred Qualifications

• Experience with machine learning and data science workflows.
• Knowledge of data governance and compliance standards.
• Certification in cloud platforms or data engineering.

Equal Employment Opportunity Statement

Gravity IT Resources is an Equal Opportunity Employer. We are committed to creating an inclusive environment for all employees and applicants. We do not discriminate on the basis of race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, disability, genetic information, veteran status, or any other legally protected characteristic. All employment decisions are based on qualifications, merit, and business needs.