Research On Image Recognition With The Utilization Of Spatial Structure Information And Its Application

Images have two-dimensional inherent spatial structures,the pixels spatially close to each other have similar gray values which means images are locally spatially smooth.To extract features,traditional methods usually convert an original image into a vector,resulting in the destruction of spatial structure.Thus 2D image-based feature extraction methods emerge,typically,such as 2DLDA and 2DPCA,which reduce time complexity significantly.However,2D-based methods manipulate on the whole raw(or column)of an image,leading to spatially under-smoothing.To overcome such shortcomings,spatial regularization is proposed by explicitly imposing a Laplacian penalty to constrain the projection coefficients to be spatially smooth and achieve better performance than 2D-based methods,but sharing the genetic high computing cost with 1D methods.Implicit spatial regularization(ISR)constrains spatial smoothness within each local image region by dividing and reshaping image and then executing 2D-based feature extraction methods,resulting in a performance improvement of the typical bi-side 2DLDA over SSSL(a typical ESR method).However,ISR obtains the spatial smooth implicitly but it has lack of explicit spatial constraints such that the feature space obtained by ISR is still not smooth enough.The optimization criteria of bi-side 2DLDA are not jointly convex simultaneously,resulting in high computing cost and globally optimal solution can not be guaranteed.Over past years,though strategies of taking advantage of spatial structure information have been separately developed for improving performance of image classification,they can’t make full use of spatial structure information,meanwhile result in appropriate computing cost.In this paper,we do a series of researches based on the utilization of spatial structure information,and develop two strategies of taking advantage of spatial structure information combining with feature extraction and image-oriented ordinal regression,and obtain the following contributions:1.To overcome the limitations and shortcomings of the existing methods,we introduce a novel linear discriminant model called fast discriminant feature extraction framework combining implicit spatial smoothness with explicit one for two-dimensional image recognition(2D-CISSE).2D-CISSE considers the utilization of spatial structure information as well as computational complexity,and the key step of 2D-CISSE is to preprocess spatial smooth for images,then ISR is executed.2D-CISSE not only retains spatial smooth explicitly,but also reinforces the explicit spatial constraints.Not only can it achieve globally optimal solution,but it also have generality,i.e.any out-of-shelf image smoothing methods and 2D-based feature extraction methods can be embedded into our framework.Finally,experimental results on four face datasets(Yale,ORL,CMU PIE and AR)and handwritten digit datasets(MNIST and USPS)demonstrate the effectiveness and superiority of our 2D-CISSE.2.Existing image-oriented ordinal regression(OR)methods do not utilize spatial structure information.Inspired by Support Matrix Machine(SMM),motivated by the use of direct manipulation strategy on images and the low-rank assumption,we improve explicit constraints support vector ordinal regression to improve explicit constraints support matrix machine ordinal regression(EXC-SMOR).EXC-SMOR enjoys a property of grouping effect,i.e.,strongly correlated columns or rows tend to be selected altogether or not,and spatial structure information can be maintain and utilized.Experimental results on on typical ordinal image datasets JAFFE and UMIST show the better performance of classification over SVORs.