Senior Data Engineer (Snowflake)
Agivant is seeking a talented and passionate Senior Data Engineer to join our growing data team. In this role, you will play a key part in building and scaling our data infrastructure, enabling data-driven decision-making across the organization. You will be responsible for designing, developing, and maintaining efficient and reliable data pipelines for both ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes.
Responsibilities:
- Design, develop, and maintain robust and scalable data pipelines for ELT and ETL processes, ensuring data accuracy, completeness, and timeliness.
- Work with stakeholders to understand data requirements and translate them into efficient data models and pipelines.
- Build and optimize data pipelines using technologies such as Elastic Search, AWS S3, Snowflake, and NFS.
- Develop and maintain data warehouse schemas and ETL/ELT processes to support business intelligence and analytics needs.
- Implement data quality checks and monitoring to ensure data integrity and identify potential issues.
- Collaborate with data scientists and analysts to ensure data accessibility and usability for analytical purposes.
- Stay current with industry best practices, CI/CD/DevSecOps, Scrum, and emerging technologies in data engineering.
- Contribute to the development and enhancement of our data warehouse architecture.
Minimum Requirements:
- Bachelor's degree in Computer Science, Engineering, or related field.
- 5+ years of experience as a Data Engineer with a focus on ELT/ETL processes.
- At least 3+ years of experience with Snowflake data warehousing technologies.
- At least 3+ years of experience creating and maintaining Airflow ETL pipelines.
- Minimum 3+ years of professional experience with Python for data manipulation and automation.
- Working experience with Elastic Search and its application in data pipelines.
- Proficiency in SQL and data modeling techniques.
- Strong understanding of cloud storage solutions like AWS S3.
- Experience with NFS and other file storage systems.
- Excellent problem-solving, analytical, communication, and collaboration skills.
Job Type:
Multiple categories including Data Engineer, DevOps Engineers, Technical Specialists, Database Administrator, Cloud Architects.
Must Have Skills:
- Snowflake - 3 Years (Intermediate)
- ETL - 3 Years (Intermediate)
- Python - 3 Years (Intermediate)
- Apache Airflow - 3 Years (Intermediate)
- ElasticSearch - 1 Year (Beginner)
Sign-in & see how your skills match this job.
Sign-in & get noticed by top recruiters and get hired fast.
Senior Data Engineer with Snowflake and ETL (Remote, 8+ Years)
Optim Hire (LAD Software Solutions Pvt Ltd)