Principal Data Engineer - ETL Development

Forward Eye Technologies

Dadri

Presencial

INR 2.500.000 - 4.500.000

Jornada completa

Hace 11 días

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

Forward Eye Technologies seeks a senior BI/ETL engineer to design, develop, and optimize data pipelines and analytics workflows. You will build and maintain ETL processes, ensure data quality, and implement scalable data solutions for enterprise needs.

You will drive DevOps practices, CI/CD pipelines with GitLab, and collaborate with stakeholders to translate business requirements into robust data architectures while upholding governance and security standards.

Formación

  • 8+ years in IT with BI, data warehousing and analytics
  • Proven DevOps, CI/CD, GitLab workflows
  • Proficient in ETL development and data workflows with SQL/PL/SQL, Python, Linux shell

Responsabilidades

  • Design, develop, and implement ETL processes into data warehouses.
  • Maintain and enhance ETL pipelines for data quality and consistency.
  • Implement CI/CD pipelines for EDW code with GitLab.
  • Manage workflows for code repositories across environments.
  • Analyze data and develop dashboards and reports.
  • Develop Python and PL/SQL scripts for data tasks.
  • Ensure data governance, security, and compliance.
  • Collaborate with stakeholders to translate requirements into data solutions.

Conocimientos

BI & Analytics
ETL Development
Linux/DevOps
GitLab workflows

Herramientas

Python
Node.js
PL/SQL
SQL
Linux shell scripting
GitLab

Descripción del empleo

Job Responsibilities


  • 1. ETL Development and Data Processing:

    • Design, develop, and implement ETL processes to extract, transform, and load data from various sources into data warehouses or analytics systems.

    • Maintain and enhance ETL pipelines to ensure data quality, integrity, and consistency.



  • 2. DevOps and CI/CD Pipeline Management:

    • Implement and support CI/CD pipelines for Enterprise Data Warehouse (EDW) code development and deployment using GitLab.

    • Manage and configure workflows for code repositories, ensuring seamless code integration and promotion across environments.



  • 3. Data Analysis and Reporting:

    • Apply statistical analysis and data mining techniques to uncover trends, patterns, and insights within large datasets.

    • Develop and maintain dashboards, reports, and visualizations to communicate key insights to stakeholders.



  • 4. Programming and Scripting:

    • Develop and maintain Linux shell scripting, Python, and PL/SQL code for data extraction, transformation, and automation tasks.

    • Create efficient scripts for data replication, migration, and data integration between systems.



  • 5. Quality Assurance and System Optimization:

    • Perform quality assurance checks on system installations, configurations, and code to ensure performance and scalability.

    • Recommend improvements to optimize performance and reliability of data processes and systems.



  • 6. Business Understanding and Translation:

    • Work closely with business stakeholders to understand their goals, processes, and requirements, translating them into technical data solutions.

    • Ensure alignment between technical solutions and business objectives to drive strategic decision-making.



  • 7. Data Governance and Security:

    • Implement data governance best practices to ensure the security, integrity, and privacy of enterprise data.

    • Adhere to data security regulations and policies, ensuring that data is handled with confidentiality and compliance.



  • 8. Collaboration and Stakeholder Communication:

    • Collaborate with cross-functional teams, including data analysts, engineers, and business teams, to deliver impactful data solutions.

    • Present data findings and actionable insights to stakeholders at various organizational levels, both written and verbally.




Required Qualifications


  • Experience:

    • 8+ years of experience in IT with a focus on Business Intelligence, Data Warehousing, and Analytics systems.

    • Proven experience with DevOps methodologies, CI/CD pipelines, and GitLab workflows.

    • Proficient in ETL development and creating data workflows in SQL, PL/SQL, Python, and Linux shell scripting.



  • Technical Skills:

    • Strong knowledge of open-source technologies, Linux, and GitLab for codebase management.

    • Experience in data replication and data migration processes.

    • Hands-on experience with Python and Node.js for programming and automation tasks.



  • Soft Skills:

    • Excellent problem-solving and analytical abilities.

    • Strong communication skills with the ability to convey complex technical concepts to non-technical stakeholders.

    • Ability to manage multiple projects in a dynamic and fast-paced environment.



  • Preferred Skills:

    • Experience with data governance principles and ensuring data security compliance.

    • Familiarity with data quality assurance and optimization techniques.

    • Understanding of modern data platforms such as cloud-based data warehouses and data lakes.




Location

Hyderabad,Ahmedabad,pune,chennai,kolkata.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Principal Data Engineer - ETL Development
Principal Data Engineer - ETL Development

Forward Eye Technologies • Pune District

Presencial
INR 1.500.000 - 2.600.000
iOS Developer - Flutter/SWIFT
iOS Developer - Flutter/SWIFT

Forward Eye Technologies • Dadri

Presencial
INR 2.500.000 - 4.000.000
iOS Developer - Flutter/SWIFT
iOS Developer - Flutter/SWIFT

Forward Eye Technologies • Pune District

Presencial
INR 1.800.000 - 3.800.000
Data Engineer
Data Engineer

Earnmodes • Pune District

Híbrido
INR 600.000 - 900.000
Data Engineer
Data Engineer

Sutherland Company • Hyderabad

Presencial
INR 1.200.000 - 1.800.000
Hybrid work model
Lead Data Engineer
Lead Data Engineer

Indxx • Gurugram District

Presencial
INR 3.600.000 - 5.200.000
ETL Developer
ETL Developer

BMW Techworks India • Pune District

Presencial
INR 900.000 - 1.500.000
Data Specialist - R01573377
Data Specialist - R01573377

Brillio • Andhra Pradesh

Presencial
INR 800.000 - 1.200.000
Data Engineer
Data Engineer

Inference Labs • Bengaluru

Presencial
INR 1.200.000 - 2.200.000
Data Engineer
Data Engineer

Hudson Data • India

Presencial
INR 1.800.000 - 3.400.000