Overview
Job Summary: We are seeking an experienced Data Engineer with proven expertise in Vertica Database functionalities to design, develop, and optimize scalable data solutions. The ideal candidate will have a strong background in SQL, ETL processes, and data modelling, along with hands-on experience in managing large datasets and ensuring high-performance data systems.
Responsibilities
- Design, implement, and maintain Vertica-based data solutions, ensuring scalability, reliability, and performance.
- Develop and optimize ETL pipelines to integrate structured and unstructured data from multiple sources into Vertica.
- Perform data modelling, schema design, and database optimization aligned with business requirements.
- Conduct performance tuning, indexing, and query optimization for large-scale Vertica databases.
- Collaborate with cross-functional teams including Data Analysts, Data Scientists, and Business Teams to deliver efficient data solutions.
- Implement data quality checks, validation processes, and automation scripts for seamless data flow.
- Manage and monitor data ingestion processes, ensuring consistency, integrity, and availability of data.
- Document system processes, data models, and architecture diagrams.
- Stay updated with emerging trends in big data, data warehousing, and cloud-based data solutions.
Technical Competencies
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Minimum 4+ years of experience as a Data Engineer or in a similar data-focused role.
- Hands-on expertise in Vertica Database — data design, modelling, optimization, and performance tuning.
- Strong proficiency in SQL and query optimization techniques.
- In-depth understanding of ETL concepts, tools, and data integration workflows.
- Experience with data warehousing concepts and best practices.
- Familiarity with big data technologies such as Hadoop, Spark, etc.
- Exposure to cloud platforms like AWS or Azure is a plus.
- Experience with Linux environments and shell scripting for automation tasks.
- Strong problem-solving, analytical, and debugging skills.
- Excellent communication and teamwork skills.
- Self-driven, with the ability to manage multiple projects independently.
Desirable Skills
- Certification or advanced training in Vertica, SQL, or Data Engineering tools.
- Knowledge of data visualization tools (e.g., Power BI, Tableau) and Python scripting for data manipulation.
- Experience working in Agile or DevOps environments.