Data Engineer: End-to-End Pipelines & Analytics

Particle41Llc; United States; On-site; USD 90,000 - 130,000; Full time

Job summary

Particle41Llc is seeking a Data Consultant to design, build, and maintain robust data pipelines and infrastructure for diverse client needs. You will work end-to-end on data solutions, collaborating with cross-functional teams to ensure scalable, high-quality data delivery.

You will engage in requirements gathering, Agile development, testing, and continuous learning to stay ahead of industry trends and tools.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• Experience as a Data Engineer or similar role with 3+ years of experience.
• Proficiency in Python and SQL/NoSQL
• Knowledge of data warehousing concepts and cloud data platforms.

Responsibilities

• Design, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines.
• Build and optimize data storage solutions (data lakes/warehouses).
• Integrate structured and unstructured data from multiple systems.
• Ensure data quality through validation, cleansing, and transformation.

Skills

Python

SQL

NoSQL

Flask

Spark

Pandas

Databricks

API frameworks

Education

Bachelors in CS/Engineering

Tools

ELK stack

Redis

Git

Linux

pytest

requests

subprocess

regex

Job description

Particle41Llc is seeking a Data Consultant to design, build, and maintain robust data pipelines and infrastructure for diverse client needs. You will work end-to-end on data solutions, collaborating with cross-functional teams to ensure scalable, high-quality data delivery.

You will engage in requirements gathering, Agile development, testing, and continuous learning to stay ahead of industry trends and tools.