A leading technology firm in the United States is seeking a Senior Data Engineer to build scalable data pipelines. The candidate will work with cross-functional teams to ensure high quality data for analytics and BI tools. Ideal applicants should have extensive experience in data solutions, proficiency in Python or comparable languages, and knowledge of cloud platforms like AWS. Strong communication skills and the ability to mentor junior team members are also essential for success in this fast-paced environment.
Qualifications
7+ years of experience in data solutions.
3+ years coding in Python or similar scripting language.
3+ years developing data pipelines in AWS or comparable platforms.
Responsibilities
Build and maintain scalable Data Pipelines for complex data sets.
Collaborate with teams to ensure data solutions meet requirements.
Contribute to design and documentation for data ingestion and processing.
Skills
Python or Scala
AWS Cloud Platform
Real-time data streaming tools
MPP databases (Snowflake, Redshift)
Agile software development
Big data technologies (Hadoop, Spark)
Education
Bachelor's degree in Computer Science or related field
Tools
Kafka
Kinesis
AWS Glue
Matillion
Job description
A leading technology firm in the United States is seeking a Senior Data Engineer to build scalable data pipelines. The candidate will work with cross-functional teams to ensure high quality data for analytics and BI tools. Ideal applicants should have extensive experience in data solutions, proficiency in Python or comparable languages, and knowledge of cloud platforms like AWS. Strong communication skills and the ability to mentor junior team members are also essential for success in this fast-paced environment.