Design And Implementation Of Internet Flight Ticket Data Capture And Fare Warning System

With the rapid growth of the high-tech, e-ticket system has been widely used in airline companies. The e-ticket system has been adopted into many airline companies’ distribution systems. At the mean time, the number of the flight ticket agencies and websites has been increasing dramatically. In addition, in order to maximise the market profits under the competitive markets, companies tend to use price strategies to adjust the ticket prices. However, this situation leads to the low-price attack that companies change the frequency and scope of the price constantly. Nevertheless, Civil Aviation Administration of China is failed to control the situation. Since there are tremendous of airlines, websites and data are analysed manually that lead to inefficiency, inaccuracy and low automation. As a result, it is unable to achieve the comprehensive price forecasting and monitoring.The deep web crawler technology will solve the problems above by implementing a price data fetching and forecasting system. This system has a robust ability of data fetching and is able to warn the price change ahead of time. There are two cores of the systems: first, the design of the crawlers can justify the correlation between the price and HTML FORM. Therefore, the crawlers will fill in the conditions and submit automatically to catch the result pages with qualified data. Then compare the result pages to the template to get the available ticket data and store with the structured format in the database. Last, to ensure the quality of the data, all missing and repeated data will be removed from the dataset and the remains will be analysed by using the weighted moving average time series prediction algorithm. A price-forecasting trend chart will be available after analysing and comparing the current and past data. The system will alarm when it noticed the ticket price is below the thresholds. Finally, the system is tested and the result is analysed.This study is from civil aviation regulatory authority pre-research program, that aiming to design and implement an e-ticket data fetching and forecasting system. The system has passed the test, which shows its ability of catching the deep web data and analysing-forecasting the price trend. Consequently, the system solved the current issue in Civil Aviation Administration and has great practical value.