Does Test Anxiety Diminish the Benefits of Frequent Low-Stake Assessment?

The underlying assumption to my question is that frequent low-stake assessment is beneficial to student learning. In the discipline of neural science, prefrontal cortex activation was found during testing “retrieval” where none was found during study “encoding” which suggests that the retrieval required for testing promotes memory of that information Liu et al. (2014). Newton & Winches (2018) propose that you create a “culture of redemption” when students can learn from the feedback they receive and use it to improve on the next assessment.

Anecdotally, I have found that frequent low-stake assessment has led to better attendance, engagement, and performance. I perceive this because students tell me they like the small quizzes and overall attendance and grades are improved in the classes that I use this strategy.

However, I perceive there to be an increase in test anxiety and so when given the opportunity to think about a Scholarship of Teaching and Learning (So TL) Project I thought a focus on test anxiety would be helpful. Bledsoe & Baskin (2014) suggest that stress levels go down when students receive regular feedback on their learning and this can be achieved through formative assessment. I wonder if the amount of times students are placed in a testing situation increases their cumulative stress and subsequently their performance.

The last activity in the eCampus Ontario mooc, Module Six – Teacher for Scholar is to propose a plan for a So TL project and here is mine.

The Question: Does test anxiety diminish the benefits of frequent low-stake formative assessment?
How Could This Be Measured?

  • Quantitative study that includes comparing two sections of students taking the same or similar course. One section has frequent formative assessment and the other section does not.
  • Qualitative study that includes student interviews and student surveys regarding their perception of test anxiety, performance and the benefits to formative testing vs. no formative testing

Research Considerations:

Since I would be interviewing students I would complete an application to the Research Ethics Board (REB) at my institution and complete the TCPS 2 online tutorial. There are very strict rules and specific steps required when conducting research involving humans. This is for the protection of students and I would follow this diligently.

I am out of my comfort zone with formal research so I think it would be helpful to include colleagues with formal research experience and expand the sample size of students and disciplines. Porter (2019) suggests that faculty struggle with this part of the module because they go too big. I know, I need to seek out experienced researchers to keep this manageable.

Evidence Required to Convince Others:

External audiences would want to see a large enough sample size to convince them that test anxiety either impacts or does not impact performance with the use of frequent formative assessment.

Other Questions External Audiences May Have:

  • Course Type
  • Year of student study
  • Student self-reports are measured objectively
  • Prior anxiety or “other” mental health implications

Where Would this Information be Shared?

One of the key elements I identified when I first started thinking about So TL is to share the information for feedback. I think this information could be shared via:

  • Annual Program Review (APR)
  • Scholarship Forum held annually
  • E3 workshop, when faculty engage with other faculty to share what they are doing
  • Peer reviewed article

I am not sure that formal research is for me. However, I think my question regarding frequent formal assessment and test anxiety is an important one. At minimum a thorough literature review is required. In a broader context thinking about conducting assessment in different ways is an important element to my teaching practice and one that warrants contemplation.


Photo by Philipp Cordts on Unsplash

References:

Bledsoe, T. S., & Baskin, J. (2014). Recognizing Student Fear: The Elephant in the Classroom. College Teaching, 62(1), 32–41. https://doi.org/10.1080/87567555.2013.831022

Liu, X. L., Liang, P., Li, K., & Reder, L. M. (2014). Uncovering the Neural Mechanisms Underlying Learning from Tests. PLoS ONE, 9(3), 1–7. https://doi.org/10.1371/journal.pone.0092025

Porter, D. (2019). Extend MOOC Behind the Design – Scholar. (T. Greene, Interviewer) Ontario Extend MOOC. Retrieved April 24, 2019, from https://www.youtube.com/watch?time_continue=6&v=wSdTu4POL8s

Newton, J., & Winches, B. (2018). How Did They Maximize Learning for All of Those Students? Reading Improvement, 55(2), 79–82. Retrieved from https://search.ebscohost.com/login.aspx?direct=true&db=a9h&AN=130164173&site=ehost-live&scope=site

What is So TL and Why is it Important?

The first two activities in the Scholar for Teaching Module of the Ontario Extend mOOC is to think about what the key characteristics are for Scholarship of Teaching and Learning (So TL) and what would motivate people to participate.

The Key Elements of So TL that I identified are:

  • Start with questions, inquiry that focuses not only on your teaching but also the student’s learning.
  • Observe your teaching on the student’s learning. What are the results and do they answer your questions?
  • Do something with those observations. Such as rewrite a lesson or an assessment. Make a change based on your observations.
  • Go public. Meaning share the observations to be evaluated by many. I almost see this as a type of feedback. Feedback from students, colleagues or a personal learning community.

Bast (2013) describes So TL as a systemic process in evaluating what happens in the classroom against the syllabus in the same way we would evaluate research against a hypothesis. In my own teaching practice I match assessment against course outcomes. Bast (2013) posits that So TL misses the final step because it does not measure the results against the hypothesis. This makes me think that there is something more meaningful to uncover in the process of measuring learning against the course outcomes.

What I Think Motivates People to Participate in So TL?

  • Better student engagement and outcomes.
  • Renewed faculty excitement about teaching and greater self-awareness.
  • Prevents stagnation.
  • Improved relationships between faculty-faculty, faculty-learner, and learner to faculty.
  • Constant reinvention through reflective practice gives faculty confidence as educators in addition to subject matter expertise.

In a broader sense I think faculty are motivated to be involved in So TL process because improved student engagement and improved outcomes are going to excite everyone involved in the process. This excitement will lead to improved relationships. At a granular level if a faculty member is confident in their ability as an educator and subject matter expert they are going to feel great in their profession. Porter (2019) tells us that mastery as an educator is a process that comes from trying out small things and adjusting as you “climb” towards your goal. I think, continuous reinvention through reflective practice is how we climb.


Photo by Samantha Sophia on Unsplash

References:
Bast,R. (2019). Key Characteristics of the Scholarship of Teaching and Learning. CELatElon.Retrieved April 25, 2019, from https://www.youtube.com/watch?v=yvDKHHyx7YY

Porter, D. (2019). Extend MOOC Behind the Design – Scholar. (T. Greene, Interviewer) Ontario Extend MOOC. Retrieved April 24, 2019, from https://www.youtube.com/watch?time_continue=6&v=wSdTu4POL8s

When the Experiment Blows Up

Have you ever tried ed tech in your classroom and it just blew up? By blew up I mean did not go as planned.

The final activity in the experimenter module for the eCampus Ontario mOOC is to reflect on the activities that we experimented with (in the deep dive) please see my previous blog post at https://wp.me/paFIXs-4X. Since, I think I have answered most of the reflection questions (in that post) I am going to focus on an experiment I tried this winter.

This winter I had students in my Communication in Health Care course use Flipgrid to record videos, then respond to each other’s videos and then respond to those responses. To learn more about Flipgrid follow this link https://flipgrid.com/.

The use of video recorded skits was not new but the technology was. I like video recorded skits because I have a large class and when marking live I sometimes miss things. Video recorded skits allowed introverted, anxious or self-conscious students to record in a comfortable place without an audience. The use of Flipgrid allowed responses to be made in video instead of the traditional typed discussion board.

The problem was my students are super keen (I know this is not really a problem) and a few had chosen to use fancy cameras meaning not their cell-phone camera. I did not know that resolution would be a problem when uploading to Flipgrid. So, on upload day things got a little messy. In the past, I would have said it blew up.

However, this really cool thing happened. @jesslyndw from Teaching and Learning figured out the resolution of the fancy cameras was causing the upload issue. Suddenly, my students were explaining all of the problem solving solutions they had tried. Yes, there was frustration but students persevered and they eventually solved the issue by adding in a reply with a link to their video.

The next interesting thing that I discovered was the relevance of the tech to the course content. Students were able to practice their therapeutic communication techniques such as language choice, non-verbals, and questioning techniques. I was so impressed with the level of engagement and effort that students put into their responses and then to the responses to those responses. Many students told me that the video assignment was when they had their key learning moments. Plus, it was fun to mark.

The reason I think this experiment is relevant to my final reflection of the experimenter module is in the past my fear of the blow up has prevented me from trying ed tech in the classroom. What I have learned through my own exploration and experimentation (in this module) is that I do not need to know the tech perfectly. I just need to be able to create a safe-place where students and faculty can explore the tech together. A place where frustration is allowed and problem solving is encouraged. Bates (2014) suggests that an experimenter supports student learning by trying, reflecting upon and learning new approaches. I think by being willing to learn from experimentation blow ups I can increase my engagement and student’s engagement.

In the future, I plan to spend more time cultivating the safe place of exploration and to consider the student perspective of what is in it for me (WIFM). I will do this by ensuring enough time is built in for problem solving, that I make connections to the problem solving skills (that they are using in the assignment) to their future employment, and that I encourage reflective learning from ed-tech issues. I will do this because the beautiful explosion that takes place when the experiment blows up is really where the learning happens.

References:
Bates, T. (2014, October 1). Online Learning and Distance Education Resources.
eCampus Ontario. (2019). EXTEND 101-EN.1 – Extend MOOC. Module 5: Experimenter.

Deep Dive Through Experimenter

The next activity in eCampus Ontario Experimenter Module Five was to take a deep dive into activities that would take longer to complete and could be incorporated into my teaching practice. I spent time exploring many of the activities but I settled on the following.

Create a Course Trailer.
The examples given in the activity were marketing videos using real people (eCampus Ontario, 2019). I decided to use a short video I had created (for a daily extend) to answer the question what is in it for me (WIFM)? Course trailers are advertisements that tell students why they should be interested in a course. Essentially, it answers the WIFM.

I created this video using the video editor app (that came with my Surface Pro) and Unsplash images https://unsplash.com. I plan to upload this video with my welcome announcement at the beginning of the course. The restriction of using the video editor app is I cannot save or embed the video directly into my free WordPress account. However, I was able to upload the video to Microsoft Stream an Office 365 app. Microsoft Stream works like YouTube but is closed to the organization. Since, my organization offers Office 365 to students and faculty I will be able to share it with my students.

Initially, I had too many words and they could not be read and absorbed in the short amount of time they were displayed. I had to pare down the words and extend the time that words displayed. I had to consider images that take the place of words so that I projected what I wanted to say within the time constraints. The video can be found in this tweet so you be the judge. https://twitter.com/Kcarte02/status/1110643940502327296

Snip Capture Of My Course Trailer

Create Interactive Activities Using H5P.
I know very little about coding but this tool made me feel as if I was coding. H5P states, “create, share and reuse interactive HTML5 content in your browser”. To learn more and create your own account click the link https://h5p.org/.

I wanted to spend time learning this tool because H5p comes with the Pressbooks (EDU) for educators account. As an Ontario educator I have access to a Pressbooks EDU account so that I can create Open Education Resources (OERs) (ecampus Ontario, 2018). The ability to add interactive activities will make reading more engaging for students. It should be noted that H5P can be used in combination with a WordPress account but it requires a paid upgrade.

Please see some Medical Terminology flash cards and fill-in-the blank drag and drop activities that I created in H5P. My hope is to add these to an OER about building a medical language vocabulary in the future.

  • https://h5p.org/node/489376
  • https://h5p.org/node/489386?feed_me=nps

References:
eCampus Ontario. (2019). EXTEND 101-EN.1 – Extend MOOC. Module 5: Experimenter.
eCampus Ontario. (2018, 11 27). The Gift of Pressbookds EDU Arrives Early for Ontario Educators. Retrieved from www.ecampusontario.ca: https://www.ecampusontario.ca/the-gift-of-pressbooks-edu-arrives-early-for-ontario-educators/

Extend Through Play

Module Five in the Ontario Extend mOOC is Experimenter. In this module we started off by playing. I say playing because daily extends are small stretches that are fun. We were encouraged to complete a minimum of three daily extends in Module Five. Daily extends are short activities that take about 20 minutes and encourage creativity. The assignment instructions stated there were no prizes but suddenly there were tweets regarding the daily leader board. Similar to Yoga were you are participating for your practice (and not competition) but secretly you know you are going to hold the pose longer then the person beside you. Suffice it to say, in the opening week of the module a lot of time was spent completing daily extends.

Listed below are three of my favourite daily extends this module:

Things I learned from the daily extends:

  • I am competitive.
  • To make tweets accessible:
    • describe images in the tweets
    • capitalize each letter in a hashtag
  • Completing a creative activity gets me motivated to learn.
    • This is a key learning I will remember to offer in my own facilitation
  • There is a ton of free stuff I never knew existed such as:
  • Not all creative stretches need to involve a lot of tech. Check out this book mashup.

This image is a book title mashup for #oext56 (We Share Everything, R.Munsch + Powerful Techniques for Teaching Adults, S. Brookfield + Leading Quietly J.L. Badaracco Jr.)

References:
eCampus Ontario. (2019). EXTEND 101-EN.1 – Extend MOOC. Module 5: Experimenter.

Digital Literacies: It’s Complicated!

My first activity in the Digital Literacies of Teaching module through eCampus Ontario extend mOOC is to consider what the concepts of digital literacies means to me. I say concepts and not definition because I have had to expand my thinking about digital literacy. Prior to the readings for this activity, I would have said someone is digitally literate if they know how to code, can use technology effectively, and are able to relay that information to other people. The JISC (2018) proposes that digital literacies should develop beyond basic digital performance and consideration should be given to the complexities and the situations. Now I would say it is complicated.

All Aboard Digital Skills in Higher Education

I think the image above captures the complexities as well as the potential that digital literacies can provide to a person’s growth both personally and professionally. Chung, Gill & O’Byrne (2013) identify the following 21st Century skills that they propose need to be addressed in web literacy framework “problem solving, creativity, communication and collaboration”. You can see elements of these skills and their intersections with other skills in the image of above. Now I know these skills are important but The question I have is how do I get people excited about it? As an educator I love these types of images but I am not sure that all of my students would.

Doug Belshaw proposes that in order to get people excited about digital literacies framework we have to find out what motivates them. He suggests memes are an intrinsic motivator. Watch below.

Doug Belshaw TEDx

I have learned through this activity that the concepts of digital literacies is complicated, changes with time and situations. The exciting part is there is something for everyone if we (educators) include opportunities to develop digital literacies. The British Columbia government (2018) provides a digital literacies framework and examples so that educators will be guided to integrate digital literacies into their lessons. In my opinion, a good place to start is to participate in building and maintaining the digital literacies framework.

References:

British Columbia Government. (2018). Digital Literacy. Retrieved 02 12, 2019, from Province of British Columbia: https://www2.gov.bc.ca/gov/content/education-training/k-12/teach/teaching-tools/digital-literacy

Chung, A.-M., Gill, I. B., & O’Byrne, I. (2013). Web Literacy 2.0. Retrieved from Mozilla.

JISC. (2018, 09). Developing Digital Literacies. Retrieved 02 12, 2019, from JISC Guides: https://www.jisc.ac.uk/full-guide/developing-digital-literacies

Teaching and Learning is Like Making Smoothies.

Teaching and Learning is Like Making Smoothies

Photo by Brenda Godinez on Unsplash

This final activity in Module 1: Teacher for Learning in the eCampus Ontario Mooc is to explorer my metaphor for teaching.

My metaphor for teaching and learning is smoothies. A smoothie has a solid protein base and I liken this is the content of my subject matter. When I first started preparing smoothies I stuck to to basic flavours such as banana and vanilla.


Then as I gained more confidence I tried different recipes maybe one day berry and the next day mango. I equate this to incorporating new teaching and learning strategies into my lessons. If I am having an off day I might go back to banana but that will get boring. So, I will seek out new recipes and see what new flavours are available


If I really want to step out of my comfort zone I will try adding in vegetables, at first they are not as sweet as fruit but they provide the people drinking the smoothie with energy. I liken this to stretching myself by incorporating new teaching strategies that I find challenging into my lessons. At first it looks different and I am not sure it is something to use in a smoothie and the students are not sure either. However, as they become engaged with the new flavour a new energy is in the room.


Photo by rawpixel on Unsplash


No matter which flavours I try I am always providing nutrients to my students. They get to try different recipes until they find a few flavours that they really like. I encourage them to experiment and come up with new recipes of their own and then share those recipes. I liken this to guiding student’s learning while encouraging students to find their own path.

I really want my students to like smoothies and I want them to know that smoothies are for everyone. However, maybe the flavour is not right. On occasion I have to accept that some students do not like smoothies. I have to help them find their drink maybe it is not a smoothie maybe it is a cup of tea.


Teachers Make Mistakes And It Can be A Good Thing.

The next activity in eCampus Ontario extend mOOC is to search through the faculty patchbook https://facultypatchbook.wordpress.com/ and find a paragraph that resonated with me. There were so many great patches that I found it hard to settle on just one.
This activity is based on the concept of Thought Vectors. I think the concept of Thought Vectors is an interesting way to describe learning. Thought Vectors can be thought of as an idea to be explored and expanded upon (eCampus Ontario, 2019). To learn more about the concept of Thought Vectors please see Jenny Stout’s explanation below.

My thought vector is about being open with students about my mistakes and the quote that resonated with me is:

“It may be uncomfortable but admitting one’s own mistakes and struggles is a great way to set the tone in a classroom where debates will happen. Hopefully, as a result, being wrong may seem a little less terrifying and disagreement may be an opportunity for learning rather than humiliation. After all, when does one learn more: when they get the right answer or the wrong answer? ” (Ryan, 2018)

This quote resonates with me because I know that being open to learn from my mistakes is when I learn the most. However, it is often hard to admit mistakes. As the subject matter expert (SME) in the classroom it may seem that admitting mistakes to students would undermine credibility in the classroom.

My experience has been the opposite. I am not suggesting that you can maintain credibility if you are constantly making mistakes but admitting that you do not know everything and sharing mistakes humanizes you. In turn, students will feel safe to try without fear of ridicule for making a mistake in front of you and their classmates. As (Ryan 2018) suggests, if you are open about your own struggles you are creating a learning space that is safe and an opportunity for learning.

The bonus to admitting that you do not know everything is that it gives students an opportunity to teach you something. When interactive whiteboards were first introduced into my classroom I struggled with getting them to work the way they should (on occasion I still have this problem). Some of my students (direct from high-school) were very comfortable with interactive white boards and were always happy to come up and provide assistance.

I think when I model vulnerability I am creating space in my classroom that normalizes mistakes. I build trust between my students, between my students and I, and that vulnerability is part of the learning process. The Community of Inquiry (COI) model suggests that supporting social presence is part of the learning process and creating trust among participants is part of that support (Athabasca University, 2013). My experience is that when students feel good about themselves they are ready to learn.

References:

Athabasca Univeristy. (2013). Community of Inquiry Model. Retrieved 2019, from Athabascau: https://coi.athabascau.ca/coi-model/

eCampus Ontario. (2019). EXTEND 101-EN.1 – Extend MOOC. Module 1: Teacher for Learning, Climate of the Course: Thought Vectors.

eCampus Ontario. (2019). EXTEND 101-EN.1 – Extend MOOC. Module 1: Teacher for Learning, Learning Nuggets.

Ryan, M. (2018). Promoting Disagreement. eCampus Ontario. Retrieved February 2019


Do You Suffer From Expert Blind Spot?


Photo by Darwin Vegher on Unsplash

This next Ontario Extend activity is find a concept in my discipline, break it into its component skills, and compare it to driving a car. Many students find learning software and managing computer files a challenge. I think it is like driving a car.

Do you have everything you need?
The first time you learn to drive a car you check to make sure you have the tools you need. The same goes for learning software and managing computer files do you have a computer, software and a login?

I know it feels scary but give it a try…
It feels scary the first time you are in the driver’s seat even with a good coach beside you. You need encouragement to slowly step on the gas, proceed and reminders to watch for pedestrians. It is different then riding a bicycle even though you did that for many years and thought it would be the same. The first time students use computer software (and realize it is different then email or social media) they are nervous and they need encouragement to try it on their own, reminders and repetition so that they can learn the steps in the process.

The Challenge…
The problem is once we have been driving for awhile, we assume the new driver will make sure they are in reverse before stepping on the gas to back out of the parking spot. In the same way that we assume the student new to file management will understand that if they do not “save as” their file they will save over the work in the file.

We make these assumptions because we have been doing this so long we no longer think about the steps in the process. I am learning in the Ontario Extend mOOC that is known as “Expert Blindspot” and it is suggested that we should be diligent in our effort to remember what it was like to learn at the beginning (eCampus Ontario, 2019).

Don’t give up…
Often when we are learning to drive we make mistakes and if they are big enough we want to give up and go back to our bicycle. However, with our eye on the freedom that driving will give us and encouragement from our coach we keep practicing. Same goes for learning software and managing files. How often does the new student lose their file or worse work many hours only to discover they have been working in a temporary download and never saved it in the first place? Many students want to quit but with encouragement they keep practicing.

Transformation:
One day the new driver is driving without thinking about it. Muscle memory has kicked in and they have their freedom. Same with software and managing files. One day, without realizing it students are locating, editing and saving files without thinking about it. They now suffer from “expert blind spot”.

What is the cure?
The cure for expert blindness (in my opinion) is to learn something new and regularly so that I can remember what it is like to be a beginner.

References:
eCampus Ontario. (2019). EXTEND 101-EN.1 – Extend MOOC. Module 1: Teacher for Learning Mastery.




WIFM:What’s In It For Me?


Photo by rawpixel on Unsplash

The fourth activity in the Ontario Extend MOOC is to think about what motivates students to come to class and to engage with course material? It is easy to think:

  • You need it for your future career
  • To earn your diploma
  • You will perform this task in the work world

Photo by Jordan Rowland on Unsplash

The truth is I am competing with many other priorities. Many of my students are parents, work many hours at their jobs, commute from out-of-town, are new to Canada (and the climate) look after older relatives and the lists goes on.

In this module we are to consider the following:

  1. Student’s prior knowledge
  2. Why do student’s want to learn something new?
  3. Relevance for students to future activities and future classes

In my health-care communication’s class, I ascertain student’s prior knowledge through the breakdown of a small case study. The case studies are common communication interactions that many of my students will have encountered as a “consumer of health care” through life experience. As we apply course content to the case study students have an opportunity to share their own experiences and perceptions to what is happening in the case study. Boehmer & Linsky (1990) ascertain that when using a case study method that students are engaged with the material not merely reading it.

Why do student’s want to learn something new? If they relate to the case study then they can apply the communication tools (that they are learning) to communicate effectively the next time they encounter a similar situation. Referring to Universal Design for Learning (UDL) theory this optimizes the value for the student because they can use it in their every-day life (UDL Guidelines, 2019)

Relevance for future activities and classes. If the students come to class and participate in breaking down the case studies they are well prepared for assessments. If students feel they can be successful they are motivated to come. By ensuring that students can clearly see the connection between assessment and class lessons students are confident in their success.


Photo by rawpixel on Unsplash

References:

Boehrer, J. and M. Linsky. “Teaching with Cases: Learning to Question.” In M.D. Svinicki (ed.), The Changing Face of College Teaching. New Directions for Teaching and Learning, no. 42. San Francisco,: Jossey-Bass, 1990

eCampus Ontario. (2019). EXTEND 101-EN.1 – Extend MOOC. Module 1: Teacher for Learning Motivation.

CAST (2018). Universal Design for Learning Guidelines version 2.2. Retrieved from http://udlguidelines.cast.org