Data Consultant at Particle41 | Python, Spark & Cloud

Particle41; United States; Remote; USD 110,000 - 150,000; Full time

Job summary

Particle41 is seeking a Data Consultant to design, build, and maintain scalable data pipelines and infrastructure across client environments. You will work with Python, Spark, and cloud platforms to deliver robust data solutions for diverse industries.

The role emphasizes ETL development, data lake/warehouse design, and cross-functional collaboration within an Elite culture. Candidates should be eligible to work in the United States and be comfortable with a remote-friendly consulting setup.

Qualifications

• 3+ years of data engineering experience required.
• Proficient in Python and SQL; experience with NoSQL databases.
• Experience building and maintaining ETL pipelines and data lakes/warehouses.
• Familiarity with cloud platforms (AWS/Azure/GCP) and Databricks/Spark.
• Strong problem-solving, collaboration and communication skills.

Responsibilities

• Design, develop, and maintain scalable ETL pipelines for large data volumes.
• Build and optimize data storage solutions (lakes/warehouses) for analytics.
• Integrate structured and unstructured data from multiple sources.
• Ensure data accuracy and quality through validation and cleaning.
• Document data processes and promote best practices; participate in agile sprints.

Skills

Python

SQL

NoSQL

Data Engineering

Cloud Platforms

ETL

Education

Bachelor's degree in CS/Engineering

Tools

Databricks

Spark

PySpark

OpenCV

scikit-learn

ELK Stack

Redis

Job description

Data Consultant at Particle41 | Python, Spark & Cloud — Remote

Role Level & Market Fit: With a 3+ year experience requirement and a broad technical mandate spanning ETL pipelines, cloud platforms, and ML libraries, this role sits at a mid-to-senior data engineering level. Market rates for Data Engineers with this stack in the US typically range from $110,000–$150,000/year depending on location and company size. The absence of a posted salary is a yellow flag worth probing during interviews.

Skills You'll Develop: This role offers strong exposure to high-demand skills:

• Cloud-native data engineering (AWS, Azure, GCP) — consistently top-tier in job market demand.
• Databricks, PySpark, and lakehouse architectures — rapidly growing skillsets in the data space.
• ML-adjacent tooling (scikit-learn, OpenCV) — bridges data engineering and data science.
• ELK stack and distributed task queues — valuable for data platform and DevOps crossover roles.

Company Culture Signals: Particle41 is a consulting firm, meaning you'll likely work across multiple client environments and industries — a strong accelerator for breadth of experience. The ELITE values framework suggests a structured, mission-driven culture. Consulting roles inherently offer faster skill acquisition but can mean variable project intensity.

Green Flags: Broad technical exposure, cross-functional collaboration, and cloud‑agnostic work (AWS/Azure/GCP) build highly transferable skills. Equal opportunity commitment is explicitly stated.

Red Flags: No salary transparency, no mention of benefits, PTO, or remote policy. Confirm these details before advancing in the process.

Data Consultant

Particle41 is seeking a talented and versatile Data Consultant to join our innovative team. You will play a key role in designing, building, and maintaining robust data pipelines and infrastructure to support our clients' data needs. You will work on end-to-end data solutions, collaborating with cross-functional teams to ensure high-quality, scalable, and efficient data delivery. This is an exciting opportunity to contribute to impactful projects, solve complex data challenges, and grow your skills in a supportive and dynamic environment.

In This Role, You Will:

Software Development

• Design, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines to process large volumes of data from diverse sources.
• Build and optimize data storage solutions, such as data lakes and data warehouses, to ensure efficient data retrieval and processing.
• Integrate structured and unstructured data from various internal and external systems to create a unified view for analysis.
• Ensure data accuracy, consistency, and completeness through rigorous validation, cleansing, and transformation processes.
• Maintain comprehensive documentation for data processes, tools, and systems while promoting best practices for efficient workflows.

Requirements Gathering and Analysis

• Collaborate with product managers and other stakeholders to gather requirements and translate them into technical solutions.
• Participate in requirement analysis sessions to understand business needs and user requirements.
• Provide technical insights and recommendations during the requirements‑gathering process.

Agile Development

• Participate in Agile development processes, including sprint planning, daily stand‑ups, and sprint reviews.
• Work closely with Agile teams to deliver software solutions on time and within scope.
• Adapt to changing priorities and requirements in a fast‑paced Agile environment.

Testing and Debugging

• Conduct thorough testing and debugging to ensure the reliability, security, and performance of applications.
• Write unit tests and validate the functionality of developed features and individual elements.
• Write integration tests to ensure different elements within a given application function as intended and meet desired requirements.
• Identify and resolve software defects, code smells, and performance bottlenecks.

Continuous Learning and Innovation

• Stay updated with the latest technologies and trends in full‑stack development.
• Propose innovative solutions to improve the performance, security, scalability, and maintainability of applications.
• Continuously seek opportunities to optimize and refactor existing codebase for better efficiency.
• Stay up‑to‑date with cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Collaborate effectively with cross‑functional teams, including testers and product managers.
• Foster a collaborative and inclusive work environment where ideas are shared and valued.

Skills and Experience We Value:

• Bachelor's degree in Computer Science, Engineering, or related field.
• Proven experience as a Data Engineer, with over 3 years of experience.
• Proficiency in Python programming language.
• Experience with database technologies such as SQL (e.g., MySQL, PostgreSQL) and NoSQL (e.g., MongoDB) databases.
• Strong understanding of programming libraries/frameworks and technologies such as Flask, API frameworks, data warehousing/lakehouse principles, database and ORM, data analysis, Databricks, Pandas, Spark, PySpark, Machine Learning, OpenCV, and scikit‑learn.
• ELK stack, Redis, distributed task queues.
• Strong understanding of data warehousing/lakehousing principles and concurrent/parallel processing concepts.
• Familiarity with at least one cloud data engineering stack (Azure, AWS, or GCP) and the ability to quickly learn and adapt to new ETL/ELT tools across various cloud providers.
• Familiarity with version control systems like Git and collaborative development workflows.
• Competence in working on Linux OS and creating shell scripts.
• Solid understanding of software engineering principles, design patterns, and best practices.
• Excellent problem‑solving and analytical skills, with a keen attention to detail.
• Effective communication skills, both written and verbal, and the ability to collaborate in a team environment.
• Adaptability and willingness to learn new technologies and tools as needed.

About Particle41
Our core values of Empowering, Leadership, Innovation, Teamwork, and Excellence drive everything we do to achieve the ultimate outcomes for our clients — Empowering Leadership for Innovation in Teamwork with Excellence (ELITE).

• E – Empowering: Enabling individuals to reach their full potential.
• L – Leadership: Taking initiative and guiding each other toward success.
• I – Innovation: Embracing creativity and new ideas to stay ahead.
• T – Teamwork: Collaborating with empathy to achieve common goals.
• E – Excellence: Striving for the highest quality in everything we do.

We seek team members who embody these values and are committed to contributing to our mission. Particle41 welcomes individuals from all backgrounds and provides equal employment opportunities to all employees and applicants, ensuring that hiring and employment decisions are based on merit and qualifications without discrimination based on race, color, religion, caste, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, local, or international laws.

This position is for USA locations only.

Is this Data Consultant role fully remote? The job posting does not explicitly state remote or on‑site, but it is restricted to USA locations only. Candidates should confirm the work arrangement (remote, hybrid, or on‑site) directly with Particle41 during the interview process. What is the minimum experience required for this role? Particle41 requires at least 3 years of proven experience in data engineering, along with a bachelor's degree in Computer Science, Engineering, or a related field. What cloud platforms should I know for this position? Familiarity with at least one of AWS, Microsoft Azure, or Google Cloud Platform (GCP) is required, with the ability to adapt to ETL/ELT tools across different cloud providers. Is there a salary range listed for this Data Consultant position? No salary information is provided in the job posting. Candidates are encouraged to discuss compensation expectations directly with the Particle41 hiring team. Can international candidates apply for this role? No — the posting explicitly states this position is for USA locations only. Only applicants authorized to work in the United States should apply.