A leading IT consulting company is seeking a highly experienced Data Engineer to build and optimize data pipelines. The ideal candidate will have extensive experience in Python, AWS, and Big Data technologies, along with strong problem-solving and communication skills. This mid-senior level contract position offers a chance to work in a collaborative environment that values diversity and inclusion.
Qualifications
10 years of data engineering experience.
Proficient in Python, AWS, Spark, and SQL.
Experience with CI/CD practices and Big Data platforms.
Responsibilities
Build and optimize data pipelines for processing and streaming.
Write clean and maintainable Python code.
Collaborate with peers and leaders while maintaining high work quality.
Skills
Python
AWS
Spark
SQL
Big Data
CI/CD
Problem-solving
Communication
Tools
Databricks
EMR
Job description
Job Description
We are seeking a highly experienced Data Engineer to join Cloud Bridge Solutions Inc. The ideal candidate will have:
10 years of data engineering experience
Proficiency in writing clean, concise, tested, and maintainable Python code
Experience building and deploying applications in AWS
Proficiency with Spark and SQL
Experience with Databricks or EMR
Knowledge of CI/CD practices and experience updating build pipelines
Hands-on experience working with Big Data platforms, building and optimizing data pipelines involving data processing and streaming
Experience with test automation frameworks, performance optimization, and security
Ability to learn and apply new technologies and programming practices
Strong problem-solving, troubleshooting, and decision-making skills
Organized, detail-oriented, and able to develop collaborative relationships with peers and leaders
High standards of integrity and work quality
Excellent verbal and written communication skills
Valuing diversity and fostering inclusive interactions