Improvement And Application Of System Usability Scale In Longitudinal Study Of Perceived Usability

Perceived usability represents users' satisfaction with the system.It reflects the user's subjective feelings with the product,and also represent the reputation and the loyalty of users.But the perceived usability will changes over time.Measuring the change of perceived usability has a positive significance for system usability engineering.Based on the theories and methods of standardized questionnaires and longitudinal studies,we established the Chinese version of system usability scale(SUS)and data quality checking method.We also designed a SUS duplicates to deal with the retest-effects and constructed a comprehensive evaluation method for the longitudinal study of perceived usability.The main researches of this paper are as follows:(i)In order to cope with the lack of measurement tools in longitudinal research,we established Chinese version of SUS.Through the analysis of the deviation of cross-cultural adaptation and the characteristics of SUS,this paper constructs a cross-cultural adaptation and experimental evaluation system.The questionnaire completed through the “forwardback translation” method and the “structured interview-back interview”.The psychological measure experiment shows that the Chinese SUS has good reliability,validity and sensitivity.The comparison with the direct translation version shows that the Chinese SUS has more measurement advantages and can satisfied the requirements of perceived usability measurement.(ii)To solve the problem of data quality cleaning in longitudinal research,we establish a new data inspection method for SUS.The new approach is based on the characteristics of SUS and the quality control methods currently in use.We also set up an evaluation system for the effectiveness of the new method.Method verification experiments reveal the difference of data quality in various measurement environments,and prove that the quality inspection method designed in this paper can better identify low quality measurement data than the original ways.(iii)To reduce the retest-effects of measurement in longitudinal study,we proposed a SUS duplicate.According to the characteristics and invariance of questionnaire duplicate,we established the design method and SUS deplicate.The reliability measurement experiment shows that the SUS duplicate designed in this paper has high reliability and can replace the original SUS.The verification experiment of memory effect shows that the SUS duplicate can significantly reduce the retest-effects.(iv)The SUS questionnaire is used to complete the longitudinal study of ModelingAnalysis Integration System.We applied the Chinese SUS,data inspection method and duplicate to the measurement design of the longitudinal study.We also proposed the usage of SUS duplicate and the comprehensive evaluation based on the two measurement modes.The longitudinal research experiment of Modeling-Analysis Integration System shows that the multi-mode comprehensive testing can reflect the real evaluation process of users.The SUS measurement method proposed in this paper can effectively complete the longitudinal study and can provide basis for usability strategy.This paper provides a reliable testing tool,an appropriate measurement method and a research example for the longitudinal study of perceived usability,as well as a concrete experimental proof for extending the application of SUS.