Font Size: a A A

Query Optimization With Information Integration For Astronomical Field

Posted on:2017-03-29Degree:MasterType:Thesis
Country:ChinaCandidate:C ZhangFull Text:PDF
GTID:2310330533469119Subject:Software engineering
Abstract/Summary:PDF Full Text Request
In astronomical area,during recent ten years,there is a astronomical project called LSST has been given more consideration,and it is used to observe sky and the period will be 10 years.The data it collects will be very huge,almost 60 PB which will be used to uncover sky.Using a single machine to store the large volume of data will be impossible and lack of extensibilities.To process the large volume of data,some normal database management like MySQL or SQL Server will not be the exact solution.In such a situation,there is a need to search a solution to store,query and give support for database management system with several PBs level data.A feasible solution would be to build the information integration architecture which can connect different database nodes and provide centralized view for users.There will be some new problems if using the information integration architecture to solve the problem of the LSST project,like how to do the query with functions,whether every funcstion from original database can be used wi thin this architecture.The biggest problem is how to deal with user defined functions,and which is the best way to do the query within the information integration architecture in term of speed.In this project,all of these problems will be answered.Als o we will discuss some standard fucntions and Q3 C functions and find propertities of them to make them work in the intergrated architecture.After finding these propertities,several groups will be generated and the solutions to different groups were given.To implement all of this,techiniques like GAV and LAV in information integration,Q3 C astronomical query,sql/med and foreign data wrapper,DBlink and pl/pgsql server programming will be introduced in a row.At last,the optimal query solution will be provided for the integrated architecture.In order to follow the centralized feature of information integration,the propertities of different functions will be discoveried as much as possible to generate the generic functions,which will be used to split user defined functions.
Keywords/Search Tags:Astronomical query optimization, sql/med, Q3c, PostgreSQL, pl/pgsql
PDF Full Text Request
Related items