Data Consultant: ETL & Modern Data Pipelines

Embedded Shishya; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

Particle41 is seeking a talented Data Consultant to design, build, and maintain scalable data pipelines and infrastructure. You will work on end-to-end data solutions, collaborating with cross-functional teams to ensure high-quality, scalable data delivery.

The role involves ETL development, data storage optimization, and integration of diverse data sources. You will contribute to rigorous data validation and documentation while embracing Agile practices and continuous learning.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• 3+ years of data engineering experience with ETL pipelines and data warehousing.
• Proficiency in Python, SQL, and NoSQL databases.
• Experience with cloud data platforms (AWS/Azure/GCP) and Spark/PySpark.
• Familiarity with data governance, validation, and documentation best practices.

Responsibilities

• Design, build, and maintain scalable ETL pipelines for large data volumes.
• Develop data storage solutions (data lakes/warehouses) for efficient access.
• Integrate structured and unstructured data for unified analytics views.
• Ensure data quality through validation, cleansing, and transformations.
• Collaborate with product teams to gather requirements and translate them into technical solutions.
• Participate in Agile ceremonies and write unit/integration tests.

Skills

Python

SQL

NoSQL

ETL pipelines

Data warehousing

Spark

Pandas

Databricks

API development

Education

Bachelor's degree in CS/Engineering/related

Tools

Flask

SQL/NoSQL databases

AWS/Azure/GCP

Git

Linux

Job description

Particle41 is seeking a talented Data Consultant to design, build, and maintain scalable data pipelines and infrastructure. You will work on end-to-end data solutions, collaborating with cross-functional teams to ensure high-quality, scalable data delivery.

The role involves ETL development, data storage optimization, and integration of diverse data sources. You will contribute to rigorous data validation and documentation while embracing Agile practices and continuous learning.