Experienced in Informatica Big Data Management and keen to be involved in enterprise-wide data transformation projects? Come join our financial client who is seeking for an experienced leader!
Bachelor in IT, Computer Science or Engineering;
Hands on experience using Big Data technologies like Hadoop distribution (Hortonworks), Hive, HBase, Spark, Pig, Sqoop, Kafka and Spark Streaming.
Experience using Informatica Big Data Management technologies;
At least 5 years of solid hands-on development experience with ETL tools to transform complex data structure in multiple data sources environment, such as Talend, SSIS and IBM DataStage;
At least 5 years of big data programming techniques on coding in Python, Java, R and Scala;
Experience in creating data model (relational and/or data warehouse), data mart design and implementation;
Strong knowledge in various database technologies (RDBMS, NoSQL and columnar);
Ability to communicate and present technical information in a clear and unambiguous manner;
Strong ability to work independently and cooperate with diverse teams in a multiple stakeholders environment;
Strong sense of work ownership, high affinity with anything data and a desire for constant improvements.
Financial Services experience.
Design, develop, document and implement end-to-end data pipelines and data integration processes, both batch and real time;
Perform data analysis, data profiling, data cleansing, data lineage, data mapping and data transformation;
Develop ETL / ELT jobs and workflows, and deployment of data solutions;
Monitor, recommend, develop and implement ways to improve data quality including reliability, efficiency and cleanliness to optimize and fine tune processes;
Recommend, execute and deliver best practices in data management and data lifecycle processes, including modular development of data processes, coding and configuration standards, error handling and notification standards, auditing standards, and data archival standards;
Prepare test data, create and execute test plans, test cases and test scripts;
Collaborate with different stakeholders to understand data needs, gather requirements and implement data solutions to deliver business goals;
Provide technical support for any data issues and change requests, document all investigations, findings, recommendations and resolutions.