Senior Data Engineer - Data Pipelines & Analytics Leader

ConsultNet Technology Services and Solutions; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

ConsultNet Technology Services and Solutions seeks a Data Engineer to evaluate, design, and execute data structures, processes, and logic to deliver business value through enterprise data assets. You will work with subject matter experts to create scalable data assets using advanced data techniques and tools.

You will collaborate with data products teams to build pipelines, implement Spark-based transformations, and deliver robust data stores while ensuring data quality and governance across the

Qualifications

• 8 years of professional experience in data engineering.
• Hands-on with AWS and data platforms.
• Proficient in Python frameworks.
• Experience with Qlik Replicate and Snowflake.
• Expertise in building data ingestion pipelines and data quality testing.
• Familiarity with DevOps CI/CD, Docker, and Kubernetes.
• Background in Big Data Engineering and Advanced Data Analytics.

Responsibilities

• Design, build, and maintain data-based structures and systems.
• Create robust data pipelines for ingestion, transformation, and storage.
• Develop programs using Spark for data movement.
• Collaborate with data products and stakeholders to deliver usable data stores.
• Ensure data is prepared and ready for business use cases.
• Design and deploy microservices to serve data assets.
• Translate business needs into data designs and visualizations.
• Guide data strategy and aid in data product automation.
• Act as advisor to business leads on data opportunities.

Skills

Big Data Engineering

Advanced Data Analytics

Data Pipeline Design

DevOps CI/CD

Python Frameworks

Tools

AWS

Docker

Kubernetes

Qlik Replicate

Snowflake

Spark

Job description

ConsultNet Technology Services and Solutions seeks a Data Engineer to evaluate, design, and execute data structures, processes, and logic to deliver business value through enterprise data assets. You will work with subject matter experts to create scalable data assets using advanced data techniques and tools.

You will collaborate with data products teams to build pipelines, implement Spark-based transformations, and deliver robust data stores while ensuring data quality and governance across the