Senior Data Engineer

Coforge; Brasil; Presencial; BRL 120 000 - 190 000; Tempo integral

Resumo da oferta

Coforge is hiring a Data Engineer to translate business needs into scalable data solutions and architectures. You will design and maintain data pipelines and models across the BMP Data Foundation, spanning Hive, Snowflake, and data lake environments.

You will contribute to Streamlit pipelines and chatbot capabilities, collaborating with analytics, data science, and business teams to ensure data availability, quality, and usability for dashboards and reporting.

Qualificações

• Master’s degree in computer science, data engineering, engineering, or related field.
• Experience in data engineering, data platform development, or related roles.
• Strong SQL and Python programming.
• Experience with big data and distributed processing (Spark/PySpark).
• Experience with orchestration tools (Airflow) and cloud data platforms (AWS, Snowflake).
• Understanding of data modeling, data quality, and governance.
• Version control with Git and collaborative development workflows.
• Excellent communication and ability to work with stakeholders.

Responsabilidades

• You translate business and analytical needs into scalable, reliable data solutions and architectures.
• You design, build, and maintain scalable data pipelines and data models across BMP Data Foundation (Hive, Snowflake, data lake).
• You support Streamlit-based pipelines and chatbot capabilities to enhance data access.
• You collaborate with analytics, data science, and business teams to ensure data availability, quality, and usability for dashboards and reporting.
• You enable and support advanced analytics, ML and AI capabilities with proper data infrastructure.
• You contribute to the design and evolution of the data/ML ecosystem to scale AI initiatives across the organization.

Conhecimentos

Data engineering

SQL

Python

Big data

Airflow

Spark / PySpark

AWS

Snowflake

Data modeling

Data governance

Git

Communication

Formação académica

Master’s degree in Computer Science or related field

Ferramentas

Airflow

Spark

Snowflake

AWS

Git

Descrição da oferta de emprego

We at Coforge are hiring Data Engineer with the following skill set.

Key Responsibilities

• You have a strong engineering and problem-solving mindset. You translate business and analytical needs into scalable, reliable data solutions and architectures.
• You design, build, and maintain scalable data pipelines and data models that support business performance monitoring, analytics, and reporting, while contributing to the development of the BMP Data Foundation across Hive, Snowflake and data lake environments.
• You support the buildout of data products and applications, including contributing to Streamlit-based pipelines and the development of chatbot capabilities to enhance data access and user interaction.
• You collaborate closely with analytics, data science, and business teams to ensure data availability, quality, and usability for dashboards, reporting, and advanced analyses.
• You enable and support the buildout of advanced analytics, machine learning and AI capabilities, ensuring the necessary data infrastructure, pipelines, and environments are in place to support model development and deployment.
• You contribute to the design and evolution of the data and ML ecosystem, helping establish the infrastructure, processes, and foundations required to scale AI/ML initiatives across the organization.

Required Skills & Qualifications

• Master’s degree in computer science, Data Engineering, Engineering, or a related quantitative field.
• Experience in data engineering, data platform development, or related roles.
• Strong experience with SQL and at least one programming language (Python or equivalent).
• Familiarity with big data and distributed processing frameworks (e.g., Spark / PySpark).
• Experience building and maintaining data pipelines and working with modern data architectures.
• Experience with orchestration tools (e.g., Airflow) and pipeline automation.
• Experience with cloud-based data platforms (e.g., AWS) and data warehousing solutions (e.g., Snowflake).
• Strong understanding of data modeling, data quality, and data governance principles.
• Experience with version control systems (Git) and collaborative development workflows.
• Strong problem-solving skills and ability to work with ambiguous requirements.
• Excellent communication skills and ability to collaborate with both technical and non-technical stakeholders.

Preferred Skills:

• Experience working with data lake architectures and hybrid data environments.
• Experience supporting machine learning pipelines and infrastructure.
• Exposure to data applications (e.g., Streamlit) and conversational interfaces (chatbots).
• Experience with AI-assisted development tools and practices.
• Experience contributing to documentation and knowledge-sharing platforms (e.g., Confluence).