A leading technology solutions provider is seeking a talented ETL Developer to design, develop, and maintain ETL processes. This role will involve integrating data from various sources and ensuring data quality using Informatica Power Center, SQL, and other relevant tools. The ideal candidate should have solid experience with big data technologies like HDFS and Spark, and contribute to performance optimization and documentation efforts. Join a dynamic team focused on delivering high-quality solutions in Plano, TX.
Qualifications
Experience with Informatica Power Center or other relevant tools.
Deep understanding of big data technologies such as HDFS, YARN, and MapReduce.
Utilize SQL/PLSQL for data extraction and transformation.
Responsibilities
Design, develop, and maintain ETL processes.
Integrate data from various sources and ensure data quality.
Optimize SQL scripts and queries for performance.
Skills
ETL Process Development
SQL Proficiency
Data Integration
Agile Methodology
Performance Optimization
Tools
Informatica Power Center
Spark
Kafka
HDFS
SQL/PLSQL
Job description
Job location: Plano, TX & multiple locations
Duration : Full Time
Job Description:-
ETL Process Development: Design, develop, and maintain ETL processes using Informatica Power Center or other relevant Informatica tools.
Deep understanding of HDFS, YARN, MapReduce, Hive, Pig, HBase, Flume, Zookeeper, Oozie.
Experience with Spark, Kafka, NoSQL databases.
Experience in Agile Methodology
Experience with code versioning tools like Bit-Bucket
SQL Proficiency: Utilize SQL/PLSQL to extract, transform, and load data.
Exposure to advanced transformations like data transformations, Parsing JSON/XML messages
Experience in Job scheduling tools Like Autosys
Data Integration: Integrate data from various sources, ensuring data consistency and quality.
Data Warehouse Design: Design and maintain data warehouses to support business intelligence activities.
Performance Optimization: Optimize SQL script/queries for speed and efficiency.
Troubleshooting: Identify and resolve issues in ETL processes.
Documentation: Create and maintain technical documentation for ETL processes.
Testing: Perform unit, integration, and system testing on ETL processes.
Collaboration: Collaborate with cross-functional teams to ensure successful implementation of ETL processes.
Data Quality: Ensure data quality by implementing data cleansing and transformation processes.
Data Modeling: Develop and maintain relational and dimensional data models.