Data Engineer

Key Responsibilities:

Designing and implementing scalable processes to manage large data sets, ensuring quality and consistency across sources.

This involves developing and maintaining data pipelines, creating optimal extraction patterns, and aligning cloud strategy with data architecture.

As the Data Engineer, you will also engineer data formats for analytics, develop APIs for applications, and collaborate with stakeholders to deliver solutions while driving process improvements, enhancing scalability, and supporting testing and deployment of new features.

Minimum Requirements:

1. At least 4 years of relevant data engineering experience
2. Bachelor's degree in computer science, business informatics, mathematics, statistics, engineering, or related field
3. Strong understanding of data structures, algorithms, and software design
4. Experience with structured and unstructured data, data stores, RDBMS, and data warehouses
5. Proficiency in cloud tools (e.g., Redshift, Athena, Glue, Lambda)
6. Proficiency in programming languages such as Python, Scala, Java, or C
7. Experience with Apache Spark and cloud services (AWS, Azure, GCP)
8. Knowledge of version control systems like Git and SVN
9. Familiarity with DevOps practices, including CI / CD and Infrastructure as Code
10. Exposure to AWS platform environments such as CodePipeline, CodeBuild, CodeDeploy
11. Experience with big data, ETL, and data management processes
12. Experience in API development and cloud architecture
13. Strong analytical and problem-solving abilities
14. Ability to work collaboratively in an agile environment

Additional Skills & Attributes needed:

1. Ability to work effectively with cross-functional teams
2. Strong communication skills to articulate complex data concepts to non-technical stakeholders
3. Continuous learning mindset and commitment to professional development
4. Innovative thinking and flexibility to adapt to changing business needs
5. Integrity, accountability, and strong work ethic
6. Enthusiasm for experimenting with new technologies and methodologies