| The goal of this project was to develop a battery of assessments to evaluate an undergraduate NMR curriculum at Penn State University. As a chemical education project, we sought to approach the problem of curriculum assessment from a scientific perspective, while remaining grounded in the education research literature and practices. We chose the phrase hypothesis driven assessment to convey this process of relating the scientific method to the study of educational methods, modules, and curricula. We began from a hypothesis, that deeper understanding of one particular analytical technique (NMR) will increase undergraduate students' abilities to solve chemical problems. We designed an experiment to investigate this hypothesis, and data collected were analyzed and interpreted in light of the hypothesis and several related research questions.;The expansion of the NMR curriculum at Penn State was funded through the NSF's Course, Curriculum, and Laboratory Improvement (CCLI) program, and assessment was required. The goal of this project, as stated in the grant proposal, was to provide NMR content in greater depth by integrating NMR modules throughout the curriculum in physical chemistry, instrumental, and organic chemistry laboratory courses. Hands-on contact with the NMR spectrometer and NMR data and repeated exposure of the analytical technique within different contexts (courses) were unique factors of this curriculum. Therefore, we maintained a focus on these aspects throughout the evaluation process. The most challenging and time-consuming aspect of any assessment is the development of testing instruments and methods to provide useful data. After key variables were defined, testing instruments were designed to measure these variables based on educational literature (Chapter 2). The primary variables measured in this assessment were: depth of understanding of NMR, basic NMR knowledge, problem solving skills (HETCOR problem), confidence for skills used in class (within the hands-on NMR modules), confidence for NMR tasks (not practiced), and confidence for general science tasks. Detailed discussion of the instruments, testing methods and experimental design used in this assessment are provided (Chapter 3). All data were analyzed quantitatively using methods adapted from the educational literature (Chapter 4). Data were analyzed and the descriptive statistics, independent t-tests between the experimental and control groups, and correlation statistics were calculated for each variable. In addition, for those variables included on the pretest, dependent t-tests between pretest and posttest scores were also calculated.;The results of study 1 and study 2 were used to draw conclusions based on the hypothesis and research questions proposed in this work (Chapter 4). Data collected in this assessment were used to answer the following research questions: (1) Primary research question: Is depth of understanding of NMR linked to problem solving skills? (2) Are the NMR modules working as intended? Do they promote depth of understanding of NMR? (a) Will students who complete NMR modules have a greater depth of understanding of NMR than students who do not complete the modules? (b) Is depth of understanding increasing over the course of the experiment? (3) Is confidence an intermediary between depth of understanding and problem solving skills? Is it linked to both variables? (4) What levels of confidence are affected by the NMR modules? (a) Will confidence for the NMR class skills used in the modules themselves be greater for those who have completed the modules? (b) Will confidence for NMR tasks not practiced in the course be affected? (c) Will confidence for general science tasks be affected? (d) Are different levels of confidence (class skills, NMR tasks, general science tasks) linked to each other?;Results from this NMR curriculum assessment could also have implications outside of the courses studied, and so there is potential to impact the chemical education community (section 5.2.1). In addition to providing reliable testing instruments/measures that could be used outside the university, the results of this research contribute to the study of problem solving in chemistry, learner characteristics within the context of chemical education studies, and NMR specific educational evaluations. Valuable information was gathered through the current method of evaluation for the NMR curriculum. However, improvements could be made to the existing assessment, and an alternate assessment that could supplement the information found in this study has been proposed (Chapter 5). |
