#GAFE Perceptions Report: Part 2 - Comparing Surveys & DataMonday, January 18, 20162:07 PM
This post is part 2 in my series #GAFE Impact Report, sharing data and analysis about student and teacher perceptions of the impact of Google Apps for Education. The results come from a 2014 survey I designed, implemented, and analyzed in my school. Be sure to check out Part 1: Overview & Infographic. Though limited to my school, I believe these results to be informative and representative of many schools in the early stages of GAFE integration. Please share your thoughts and feedback on these posts, the survey, or the findings in the comments or on Twitter.
Once the inspiration for this study hit, I knew what I needed to do. Ideas, questions, and complications circled through my mind for a few days. I listed my ideas, tried to put them in order, and to figure out what I was really looking for. Who did I want to survey? How? Where? Why? What was I going to do with the data? I had some answers to these questions and more ideas than I knew what to do with. Little did I know it at the time, but a lot of this process was what led me to my current doctoral studies. With the #GAFE Impact Report, I learned a lot of survey design, methodology, and data analysis, which helped focus my interests back towards further studies.
Luckily, I had some friends at work to bounce ideas off of and quickly made some decisions. I would create Google forms for all teachers and students. Students were easy; I could ask my English teacher colleagues to assign the survey, either in class or for homework. I decided to collect usernames in my domain so I could ensure unique responses from each students and let teachers know when their students had all completed it--although their responses remained private. For the teachers, I e-mailed a different Google form with a plea for their help. I explained my goals and purpose and asked that they complete the form over a two-week window. I then followed up in person with some departments, and after a lot of leg work had overall success. Although my administration okayed my work, it was important that I ask for honest feedback and data as a colleague and not as a forced or mandated survey from a supervisor.
The surveys took a while to design and finalize, and I’m pretty happy with the questions I asked, even now. By Thanksgiving or so, I was ready to roll out my baby.
Survey DesignThankfully, my friend and mentor Tina has her PhD. She had the knowledge, experience, and insight into survey design, methodology, and motivating busy teachers to respond, which I sorely lacked. I didn’t need a doctoral-level project here, but I wanted to make sure that my study was fair, purposeful, and meaningful. She helped me decide on a mixed-methods approach, including both quantitative and quantitative questions.
The quantitative questions provided the hard data and were required. The qualitative ones asked for supporting responses, and some were optional. I wanted to make the survey easy for responders, with the hopes that this would give me more in depth responses. And it mostly worked. There were some topics, like the value of electronic feedback, that were important to me, but ultimately proved to be too much. I wanted to survey to be clear and focused, so I tried to connect everything back to the impact of Google Apps on Teaching and Learning.
StudentsThe students survey asked about when, how, and why they used GAFE, and about its impact on teaching, learning, engagement, etc. It took most students about 20 minutes to complete.
Find the student survey here.
TeachersThe teacher survey asked almost all of the same questions for the teacher's perspective but had an extra layer. All students at OHS had used Google to some degree, so all of their responses were valuable. But for teachers who had never really used GAFE in their teaching, some of the questions were designed to fail--or at least collect vague or incomplete data. I can’t expect a clear understanding of the impact of GAFE if a teacher hasn’t used it in his or her teaching.
Instead, I used the page branching feature in Google Forms to differentiate the questions. The first page is the same for all teachers and ends with the question: How often have you been able to use GAFE in your classroom this year? Teachers who answered always, often, or sometimes continued with an evaluation of its impact. Those who replied rarely or never followed with questions about why they hadn’t used it and what they would need to use it more.
Find the teacher survey here.
Comparing Data: The BeginningWithin a few weeks, and after some gentle reminders, I had survey data from 630 students (47%) and 43 teachers (43%), enough to provide a statistical representation of my school’s population.
Next time, we’ll take a look at that data and it’s evolution in more detail. You can find the Comparative Data Sheet online to get a head start.