Campus Climate Survey

Campus climate is "the current attitudes, behaviors, standards, and practices of employees and students of an institution."¹ The campus climate is often shaped through personal experiences, perceptions, and institutional efforts.

¹ Dr. Susan Rankin of Rankin & Associates Consulting.

A healthy campus climate supports positive educational experiences and identity development for students. Moreover, it encourages productivity and a sense of value for faculty and staff. Overall, a healthy campus climate promotes successful outcomes and well-being for all.

Students, faculty, and staff support the idea that data from such a survey will be useful in planning for the future and improving WCU's campus climate. The previous study conducted in 2010 resulted in the development of several initiatives at WCU in response to the results. These included featuring WCU faculty and staff on the website and WCU publications as ways to recognize and acknowledge their value to the WCU community, implementation of a Sexual Misconduct Policy and an on-line reporting mechanism, adding a Sexual Misconduct Advocate for victims of sexual violence, increased LGBTQA training and programming across the campus, modifications to the University Forum RFP process to increase programming related to campus climate issues, and more.

Target participation in the survey is 100%. Every response matters and is valuable in providing the most beneficial feedback and results.

This initiative will include four primary phases:

1. Survey development (spring/summer 2015)
2. Survey implementation that will seek input from all faculty, staff, and students (fall 2015)
3. Reporting of results (spring 2016)
4. Development of strategic actions (spring 2016) and initial implementation of actions (2016-17)

The Campus Climate Working Group (CSWG) is charged with developing and implementing WCU's climate survey. The CSWG consists of faculty, staff, and students from various constituent groups at WCU. After a review of potential vendors, WCU selected Rankin & Associates Consulting to conduct the survey in 2010 and will again facilitate the process in 2015. Rankin & Associates reports directly to the working group. Although the CSWG will regularly update the WCU community about its progress, the working group—in consultation with Rankin & Associates—is solely responsible for the development, implementation, and interpretation of the survey and its results.

Rankin & Associates Consulting is the consulting firm working directly with WCU on this project. Dr. Rankin, principal of R&A is an emeritus faculty member of Education Policy Studies and College Student Affairs at The Pennsylvania State University and a senior research associate in the Center for the Study of Higher Education. She has extensive experience in institutional climate assessment and institutional climate transformation based on data-driven action and strategic planning. Dr. Rankin has conducted multi-location institutional climate studies at more than 120 institutions across the country. She developed and utilizes the Transformational Tapestry model as a research design for campus climate studies. The model is a "comprehensive, five-phase strategic model of assessment, planning and intervention. The model is designed to assist campus communities in conducting inclusive assessments of their institutional climate to better understand the challenges facing their respective communities."²

² Rankin, S. R., & Reason, R. D. (2008). Transformational Tapestry Model: A comprehensive approach to transforming campus climate. Journal of Diversity in Higher Education, 1(4), 262-274. doi: 10.1037/a0014018

The administration of a survey relating to a very sensitive subject like campus climate is likely to yield higher response rates and provide more credible findings if led by an independent, outside agency. Members of a college community may feel particularly inhibited to respond honestly to a survey administered by their own institution for fear of retaliation.

The Climate Study Work Group is responsible for developing the survey questions. The team reviews selected survey questions proposed by Dr. Rankin. Dr. Rankin has administered climate assessments to more than 120 institutions across the nation and has developed a repository of tested questions.

Although the working group believes the survey process itself is informative, we have sought and received commitment from the senior administration that data will be used to plan for an improved climate at WCU. All stakeholders—faculty, staff, and students—will be invited to participate in the development of post-survey action initiatives.

It is important in campus climate research for survey participants to "see" themselves in response choices to prevent "othering" an individual or an individual's characteristics. Some researchers maintain that assigning someone to the status of "other" is a form of marginalization and should be minimized, particularly in campus climate research which has an intended purpose of inclusiveness. Along these lines, survey respondents will see a long list of possible choices for many demographic questions. However, it is reasonably impossible to include every possible choice to every question, but the goal is to reduce the number of respondents who must choose "other."

Confidentiality is vital to the success of campus climate research, particularly as sensitive and personal topics are discussed. While the survey cannot guarantee complete confidentiality because of the nature of multiple demographic questions, the consultant will take multiple precautionary measures to enhance individual confidentiality and the de-identification of data. No data already protected through regulation or policy (e.g., Social Security number, campus identification number, medical information) is obtained through the survey. In the event of any publication or presentation resulting from the assessment, no personally identifiable information will be shared.

Confidentiality in participating will be maintained to the highest degree permitted by the technology used (e.g., IP addresses will be stripped when the survey is submitted). No guarantees can be made regarding the interception of data sent via the Internet by any third parties; however, to avoid interception of data, the survey is run on a firewalled web server with forced 256-bit SSL security. In addition, the consultant and university will not report any group data for groups of fewer than five individuals, because those "small cell sizes" may be small enough to compromise confidentiality. Instead, the consultant and university will combine the groups or take other measures to eliminate any potential for demographic information to be identifiable. Additionally, any comments submitted in response to the survey will be separated at the time of submission to the consultant so they are not attributed to any individual demographic characteristics. Identifiable information submitted in qualitative comments will be redacted and the university will only receive these redacted comments.

Participation in the survey is completely voluntary, and participants do not have to answer any question— except the first position question (e.g., are you staff, faculty, student)—and can skip any other questions they consider to be uncomfortable. Paper and pencil surveys are also available, and will be sent directly to the consultant.

Information in the introductory section of the survey will describe the manner in which confidentiality will be guaranteed, and additional communication to participants will provide expanded information on the nature of confidentiality, possible threats to confidentiality, and procedures developed to ensure de-identification of data.

The primary investigator from WCU for the IRB process is Lisa Yannick, Assistant Vice President, Institutional Effectiveness and Planning. An IRB application will be submitted for the project. Once the project is approved, the survey will be administered.

The consultant will provide a final report that will include:

1. an executive summary
2. a report narrative of the findings based on cross tabulations selected by the consultant
3. frequencies, percentages, means, and standard deviations of quantitative data
4. content analysis of the textual data.

The reports provide high-level summaries of the findings and will identify themes found in the data. Generalizations for populations are limited to those groups or subgroups with response rates of at least 30%. The committee will review draft reports and provide feedback to the consultant prior to public release.

WCU has worked with the consultant to develop a research data security description and protocol, which includes specific information on data encryption, the handling of personally identifiable information, physical security, and a protocol for handling unlikely breaches of data security. The data from online participants will be submitted to a secure server hosted by the consultant. The survey is run on a firewalled web server with forced 256-bit SSL security and is stored on a SQL database that can only be accessed locally. The server itself may only be accessed using encrypted SSH connections originating from the local network. Rankin & Associates Consulting project coordinator Dr. Rankin will have access to the raw data along with several Rankin & Associates data analysts. All Rankin & Associates analysts have CITI (Human Subjects) training and approval and have worked on similar projects for other institutions. The web server runs with the SE-Linux security extensions (that were developed by the NSA). The server is also in RAID to highly reduce the chance of any data loss due to hardware failure. The server performs a nightly security audit from data acquired via the system logs and notifies the administrators. The number of system administrators will be limited and each will have had required background checks.

The consultant has conducted more than 120 institutional surveys and maintains an aggregate merged database. The data from the WCU project will be merged with all other existing climate data stored indefinitely on the consultant's secure server. No institutional identifiers are included in the full merged data set held by the consultant. The raw unit-level data with institutional identifiers is kept on the server for six months and then destroyed. The paper and pencil surveys are returned to the consultant directly and kept in a locked file drawer in a locked office. The consultant destroys the paper and pencil responses after they are merged with the online data. The consultant will notify the committee chairs of any breach or suspected breach of data security of the consultant's server.

The consultant will provide WCU with a data file at the completion of the project.

The survey will be administered to all faculty, staff, and students at WCU. Climate exists in micro-climates, so creating opportunities to maximize participation is important as well as maximizing opportunities to reach minority populations. Along these lines, the consultant has recommended not using random sampling as we may miss particular populations where numbers are very small. Since one goal of the project is inclusiveness and allowing "invisible voices" to be heard, this sampling technique is not used. In addition, randomized stratified sampling is not used because we do not have population data on most identities. For example, WCU collects population data on gender and race/ethnicity, but not on disability status or sexual orientation. Consequently, a sample approach could miss many groups.