Data Engineering Consultant for Scalable Pipelines

Particle41; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

Particle41 is seeking a Data Consultant to design, build, and maintain scalable data pipelines and infrastructure for diverse client needs.

You will collaborate with cross-functional teams to deliver end-to-end data solutions, ensuring high-quality, scalable data delivery and robust analytics capabilities. A strong Python background and experience with databases, ETL, and cloud platforms are essential.

Qualifications

• Bachelor's degree in a related field is required.
• 3+ years of experience in data engineering or data consulting.
• Strong Python coding abilities for data workflows.
• Experience with SQL and NoSQL databases and data warehousing concepts.
• Familiarity with cloud platforms (AWS/Azure/GCP) and ETL tooling.

Responsibilities

• Design, develop, and maintain scalable ETL pipelines to process large volumes of data from diverse sources.
• Build and optimize data storage solutions, such as data lakes and data warehouses, for efficient retrieval.
• Integrate structured and unstructured data from multiple systems to create a unified view for analysis.
• Ensure data accuracy, consistency, and completeness via validation, cleansing, and transformation.
• Maintain documentation for data processes, tools, and systems and promote best practices.

Skills

Python programming

SQL & NoSQL databases

ETL pipelines

Cloud data platforms

Data warehousing concepts

Spark / PySpark

Linux / shell scripting

API frameworks (Flask)

Git / version control

Data modeling

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

MySQL

PostgreSQL

MongoDB

Redis

Apache Airflow

Databricks / Spark

Job description

Particle41 is seeking a Data Consultant to design, build, and maintain scalable data pipelines and infrastructure for diverse client needs.

You will collaborate with cross-functional teams to deliver end-to-end data solutions, ensuring high-quality, scalable data delivery and robust analytics capabilities. A strong Python background and experience with databases, ETL, and cloud platforms are essential.