| With globalization of financial markets and widely usage of computer network technology, the electronic financial has been reshaping the financial markets around the world, at the same time, the Internet also has become the main source to obtain the financial information for enterprise, institutions and individuals. As professional financial information service provider, it’s a big challenge to effectively scrape financial information in real time from the large scale and complicate web data. RicGenerator is an application system, which is able to scrap finical information from financial web site around the world in real time, then generate particular data file after data process and conversion.In the RicGenerator project, the author involved in the analysis, design and implementation for system architecting, designing and implementing3-layer architecture--presentation layer, business logic layer and data access layer. The author also implemented some sharing module development, e.g. file system utility, Excel process utility and system logging. The author involved in the user interface design and implementation based multi-thread technology. For the development of Web content download and Web data extraction, the author is mainly responsible for the two module design and implementation. Furthermore, the author completed the Hong Kong market sub-module development by myself, which include requirement analysis, system design, implementation and testing. The Hong Kong market sub-module includes19different tasks which are all financial data scraping and process, e.g. Short Sell, Broker Page, Trading News, and Warrant.For all the financial web data extraction and process of Hong Kong market, RicGenerator simplify operation process, reduce the manpower cost, and improve the efficiency and quality for Web financial data acquisition, the quality of financial information service is improved and the company core competence is enhanced in industry. |
PDF Full Text Request