Data Engineer

Pyramid Consulting, Inc; Colombia; Presencial; COP 12.000.000 - 18.000.000; Jornada completa

Descripción de la vacante

Pyramid Consulting, Inc. is seeking an entry-level data engineer to design and develop software that processes, stores, and serves data for use by others. The role involves building ETL processes, creating scalable data pipelines, and ensuring data quality for analytics and reporting.

You will integrate data from various sources, applying best practices for data accessibility and security, while collaborating with senior team members to learn and refine techniques in a structured environment.

Formación

• Typically requires a college degree (or equivalent) with up to one year of experience, but may not have any.
• Has conceptual knowledge of theories, principles, and practices within the data discipline.
• Designs and develops complex software that processes, stores, and serves data for use by others.

Responsabilidades

• Design and develop complex software that processes, stores and serves data for use by others.
• Writes complex ETL processes and develops data pipelines to support analytics and reporting.
• Ensures that data pipelines are scalable, repeatable and secure.

Conocimientos

ETL concepts

Data pipelines

Data quality

Educación

Bachelor's degree or equivalent

Herramientas

Java

Hadoop

Hive

Cassandra

Pig

MySQL

NoSQL

Descripción del empleo

Job Description: Design and develops complex software that processes, stores and serves data for use by others. Designs and develops complex and large-scale data structures and pipelines to organize, collect and standardize data to generate insights and addresses reporting needs.

Writes complex ETL (Extract / Transform / Load) processes, designs database systems and develops tools for real-time and offline analytic processing. Ensures that data pipelines are scalable, repeatable and secure. Improves data consistency and integrity.

Integrates data from a variety of sources, assuring that they adhere to data quality and accessibility standards. Has knowledge of large-scale search applications and building high-volume data pipelines. Knowledge of Java, Hadoop, Hive, Cassandra, Pig, MySQL or NoSQL or similar.

Complexity & Problem Solving

• Learns routine assignments of limited scope and complexity.


• Follows practices and procedures to solve standard or routine problems.

Autonomy & Supervision

• Receives general instructions on routine work and detailed guidance from more senior members on all new tasks.


• Work is typically reviewed in detail at frequent intervals for accuracy.

Communication & Influence

• Builds stable internal working relationships.


• Communicates and seeks guidance/feedback regularly from more senior members of the team.


• Primarily interacts with supervisors, project leads, mentors, or other professionals in the same discipline.


• Explains facts, policies, and practices related to discipline.

Knowledge & Experience

• Typically requires a college degree (or equivalent) with up to one year of experience but may not have any.


• Has conceptual knowledge of theories, principles, and practices within discipline and industry.