Interpreting the 2008 Results

When reviewing the results of the survey, please keep in mind some of the following issues:

Variables not accounted for in the analysis

The results presented are meant to describe the overall pattern of the data. They do not take into account or "control for" any characteristics of the respondents. Although additional analysis can "control for" some of these effects, the current report presents an overall snapshot of the results due to the large number of possible variables.

Statistically Significant Differences

Although the graphs may suggest differences among groups, in many cases these differences are not statistically—or meaningfully—different.

• On the staff survey, for most of the job category results, differences are unlikely to be due to chance. However, these differences may be the result of other variables that have not been "controlled for."
• On the staff survey, for most of the campus results, small differences between groups are likely to be due to chance fluctuations and the groups can be treated as equivalent to one another.
• On the faculty survey, for most of the campus results, the differences between campuses were statistically significant. That is, these differences are unlikely to be due to chance.

Practical Significance

Differences that may be statistically significant may not be practically significant. For example, one job category may have a score of 2.6 on work satisfaction and another may have a score of 2.4 on work satisfaction. This difference may be statistically significant, but not practically significant as they both show relatively favorable attitudes toward work. Practical significance rests on judgments of whether a difference is relevant or of any importance in the real world.

Sample Size and Variability

In some cases, the number of participants in a particular group is small. Results from a smaller group of participants are less stable and reliable as compared to results from a larger group of participants. Overall, standard errors (a simple measure of the degree of uncertainty of an average) were low (0.008-0.017) indicating that the different dimensions assessed in the Pulse Survey such as job satisfaction, pay satisfaction, etc. were sound estimates of the overall University population. Standard errors were slightly larger (0.06-0.14) for the Crookston and Morris campuses, due to their smaller sample size.