Data Engineer with Vertica experience

Mindfore Technologies; United States; On-site; USD 90,000 - 130,000; Full time

Job summary

Mindfore Technologies is seeking a Data Engineer to design and implement robust ETL/ELT pipelines. The role is remote and focuses on managing large datasets with tools like Snowflake, MySQL, and Apache Airflow. Ideal candidates have strong experience in ETL/ELT development, are proficient in Shell/Bash scripting and Python, and understand data modeling and SQL performance tuning. You will collaborate with data analysts to optimize processes and document technical architecture.

Qualifications

• Good experience in ETL/ELT development.
• Strong experience with MySQL and PL/SQL.
• Hands-on experience with Vertica and Snowflake.
• Proficient in Shell/Bash scripting and Python.
• Solid understanding of data modeling and SQL performance tuning.
• Familiarity with DBT for transformation workflows.
• Basic knowledge of Fivetran and Apache Airflow.
• Experience working in an Agile environment.
• Excellent problem-solving and communication skills.
• Experience with Git version control.
• Exposure to CI/CD pipelines for data engineering.
• Knowledge of AWS cloud platforms.
• Familiarity with data governance and security best practices.

Responsibilities

• Design and implement robust ETL/ELT pipelines to ingest, transform, and load data from various sources.
• Work with relational and columnar databases including MySQL, PL/SQL, and Vertica to manage large datasets.
• Develop and schedule data workflows using Shell/Bash scripting and Python.
• Build and maintain data pipelines on Snowflake using ELT best practices.
• Collaborate with data analysts, data scientists, and other stakeholders to understand data needs.
• Optimize existing processes for scalability and performance.
• Use tools like Airflow, Fivetran, and DBT for orchestration, transformation, and data movement.
• Monitor data pipeline performance and resolve issues in a timely manner.
• Document processes, data flows, and technical architecture.

Skills

ETL/ELT development

MySQL

PL/SQL

Snowflake

Vertica

Shell/Bash scripting

Python

DBT (Data Build Tool)

Fivetran

Apache Airflow

Data modeling

SQL performance tuning

Git version control

CI/CD pipelines

AWS cloud platforms

Data governance

Job description

Role: Data Engineer with snowflake, vertica, ETL, MySQL, Airflow

Location: Remote

Duration: 6 months

Responsibilities

• Design and implement robust ETL/ELT pipelines to ingest, transform, and load data from various sources.
• Work with relational and columnar databases including MySQL, PL/SQL, and Vertica to manage large datasets.
• Develop and schedule data workflows using Shell/Bash scripting and Python.
• Build and maintain data pipelines on Snowflake using ELT best practices.
• Collaborate with data analysts, data scientists, and other stakeholders to understand data needs.
• Optimize existing processes for scalability and performance.
• Use tools like Airflow, Fivetran, and DBT for orchestration, transformation, and data movement.
• Monitor data pipeline performance and resolve issues in a timely manner.
• Document processes, data flows, and technical architecture.

Required Skills & Qualifications

• Good experience in ETL/ELT development.
• Strong experience with MySQL and PL/SQL.
• Hands‑on experience with Vertica and Snowflake.
• Proficient in Shell/Bash scripting and Python.
• Solid understanding of data modeling and SQL performance tuning.
• Familiarity with DBT (Data Build Tool) for transformation workflows.
• Basic knowledge of Fivetran and Apache Airflow.
• Experience working in an Agile environment.
• Excellent problem‑solving and communication skills.
• Experience with Git version control.
• Exposure to CI/CD pipelines for data engineering.
• Knowledge of AWS cloud platforms.
• Familiarity with data governance and security best practices.