Assessment Matters! Evaluation Tools and Feedback Strategies in

Assessment Matters! Evaluation Tools and Feedback Strategies in

Assessment Matters! Evaluation Tools and Feedback Strategies in a Blended Classroom Irina Ivliyeva Arts, Languages, and Philosophy Department Missouri S&T (formerly UMR) [email protected] 1

Content Terminology; subject background; students and classes; Evaluation, Assessment, Feedback: students motivation; strategies, tools and practical examples; Pedagogical implications for enhancing the interactive learning environment. 2

I. Terminology and Definitions Blended (hybrid) classroom Assessment Feedback

Evaluation Communication What is Hybrid or Blended? 1. Web-based learning activities are introduced to complement face-to-face (FTF) work; 2. FTF time is reduced, though not eliminated altogether; 3. Web-based and face-to-face

components are designed to interact pedagogically. Hybrid or Blended classroom by % Content Delivered Online Blended/ Hybrid 30 to 79% blends online and face-to-face delivery; substantial proportion of content

delivered online; uses online discussions and some face-to-face meetings. What is Assessment? - educational evaluation: a method of evaluating student performance and attainment. Synonyms: evaluation, appraisal, estimation,

measurement, judgment, review, consideration, opinion. Encarta World English Dictionary[North American Edition] & (P) 2009 http://www.bing.com/Dictionary/search?q=define+assessment&form=QB What is Feedback? - response, comments in the form of opinions about and reactions to something, intended to provide useful

information for future decisions and development. Synonyms: response, reaction, comment, criticism, advice, pointer, opinion, view, reply. Encarta World English Dictionary[North American Edition] & (P) 2009 http://www.bing.com/Dictionary/search?q=define+feedback&FORM=DTPDIA What is Evaluation?

- assessment of value: the act of considering or examining something in order to judge its value, quality, importance, extent, or condition. Synonyms: assessment, appraisal, estimation, calculation, valuation, estimate. http://www.bing.com/Dictionary/search?q=define+Evaluation&form=QB Encarta World English Dictionary[North American Edition] & (P) 2009

What is Communication? - the exchange of information between people, e.g. by means of speaking, writing, or using a common system of signs or behavior; - rapport: a sense of mutual understanding and sympathy. Synonyms: contact, interaction, transfer, consultation, exchange, transmission.

Encarta World English Dictionary[North American Edition] & (P) 2009 http://www.bing.com/Dictionary/search?q=define+Communication&form=QB "The single biggest problem in communication is the illusion that it has taken place." ~ George Bernard Shaw II. Assessment of Learning Outcomes

What do we assess: 1. Students Competencies 2. Students Behavior 3. Students Skills 4. Instructors effectiveness of teaching 5. Quality of classroom communication Feedback is the breakfast of champions. ~ Ken Blanchard

The Importance of Giving Feedback 1. To promote learners motivation. 2. To provide learners with the sense of their own achievement. 3. To extend the learning and thinking process beyond the (final) grade. Problems with Assessment/Feedback What exactly is grading:

commenting, marking, giving feedback, assessing, evaluating, correcting, etc Instructors role: coach or referee, counselor or judge? How to make A/F objective? Types of Feedback Statistical feedback Personal (human)

feedback Statistical feedback - is quantifying students performance: a) study habits comparison; b) correlation: completed activities and performance on the assessment; c) characteristics of learners behavior.

Personal feedback - is individually tailored feedback. Challenges: emotionally charged; time consuming; explicit or implicit ? verbal or non-verbal? Assessment /Feedback and Technology

Advantages: using technology, data can be collected and analyzed quickly; fast turnaround time for providing more meaningful feedback; saving paper and time. III. Students and classes Fall 2009 Elementary Russian 001 (language class,

instruction in Russian) 19 students. Spring 2010 Russian Civilization 360 (upper level humanities class, instruction in English) 19 students. 19 Elementary Russian 001

Russian Civilization 360 IV. Evaluation and Assessment Tools Examples: 1. First email and initial survey (Russ 360) 2. Grade survey (Russ 001) 3. Self-assessment (Russ 001) 4. Blogs (Russ 360)

Student - instructor interactions 1. Email invitation to class and Blackboard postings (syllabus, etc.); 2. Request to fill out online survey; 3. Print out, sign and bring to class Permission to use forms; 4. Finally, first face-to-face meeting in class. 23

Student Permission-to-Use Form Date__________ Students Name_________ Course and Term___________ Instructors Name__________________ I grant the instructor identified above unlimited permission to make public or reference those items checked in the list below. This permission applies to work I have completed in the course indicated. _______Sound recordings of my voice

_______Examples of my written work _______My comments in e-mails _______My comments in chats _______My comments in electronic forums _______My name as part of a directory listing of students in the class _______ My blog postings on Blackboard _______ My postings on Wiki pages on Blackboard I understand that when my work is used, if possible, an acknowledgement identifying the work as mine will be included. Signature___________________ Date___________________ 24

The First Email From: Irina Ivliyeva [mailto:[email protected]] Sent: Saturday, January 09, 2010 1:53 PM To: "MST-RUSSIAN-360-1A-71282-SP2010" Subject: Welcome to Russian Civilization 360 in the Spring semester 2010!: MST-RUSSIAN-360-1A-71282-SP2010 Please log into the Russian 360 class on Blackboard and follow the instructions below: 1) Under Course information you will find your syllabus. Please read it before you come to your first class on Tuesday, January 12.

2) Under Course information you will find Permission to Use Form. Please print this page out, fill it out and bring with you to your first class meeting. 3) Under Staff Information you will find your instructors weekly schedule and contact information. Do not hesitate to contact your instructor when necessary. 4) Please complete this confidential online survey before our first class meeting. Click on the link below to take survey. http://www.surveymonkey.com/s/JHXBLS2 I am looking forward to seeing you in class on Tuesday, January 12 at 11 am, in 103 EMGT! -- Dr. Irina Ivliyeva

Russian Civilization 360 Russian Civilization 360: Survey results Class profile: 19 enrolled, 11 surveys completed; 18 males, 1 female ; 8 Americans (native language English); 11 foreign students (native language

Arabic). Question 6. How did you first learn about Russian Civilization 360? From a friend From your advisor Directly from the instructor From the Registrars web page From the Undergraduate catalogue Flyer advertisement in the building

Email 0.0% Search Engine 0.0% http://www.surveymonkey.com/s/JHXBLS2 63.6% 0.0% 27.3% 0.0%

9.1% 18.2% (7) (3) (1) (2) Question 7. Give at least one example of an image, impression, or concept of Russian culture you may

have had before signing up for this course. Group-orientated society. Less concerned about individual rights and more focus on the entire nation and government. The buildings and the cone tops. Not sure what they are actually called. I find the Kremlin to be a ubiquitous icon of Russia. Nothing (2 responses).

http://www.surveymonkey.com/s/JHXBLS2 Question 7. Give at least one example of an image, impression, or concept of Russian culture you may have had before signing up for this course. New culture. Russians love American gangster cinema. Russians like things that are big. Well i dont really know much about Russia

beside its really big country, and that why i am taking this course to learn more. Not a lot. i know the every one have to be with army. beautiful country. None. Elementary Russian 001 Russian 001 Fall 2009 The Grade Survey (after the midterm exam)

19 students enrolled, 14 completed this survey between November 5-18, 2009 Web link to Survey Monkey: http://www.surveymonkey.com/s/B2B6QVG 8. What do you think would help you bring your grade up on the next exam? 1. 2. 3.

4. 5. 6. Studying more Wed, Nov 18, 2009 3:58 PM Find... Rework the translations Tue, Nov 17, 2009 1:59 PM Find... more studying Tue, Nov 17, 2009 8:00 AM Find... more studying Mon, Nov 16, 2009 6:58 PM Find... vocab studying Mon, Nov 16, 2009 5:26 PM Find... Having more time. In some ways the test schedule seems

exhausting, in others it does make sure you are keeping up. I feel like I'm slowly falling behind. Mon, Nov 16, 2009 5:22 PM Find... 7. Better memorization of grammar and vocabulary Mon, Nov 16, 2009 4:07 PM Find... 8. What do you think would help you bring your grade up on the next exam? 8. More effective studying/reviewing Mon, Nov 16, 2009 3:53 PM Find...

9. Keep Studying Mon, Nov 16, 2009 3:51 PM Find... 10. more study time Mon, Nov 16, 2009 3:40 PM Find... 11. More time after class to study. Wed, Nov 11, 2009 10:08 PM Find... 12. Studying more Tue, Nov 10, 2009 5:56 PM Find... 13. Study in Russia Tue, Nov 10, 2009 5:12 PM Find... 14. Study more, and study longer Tue, Nov 10, 2009 4:14 PM Find... Self-Assessment

A man cannot be comfortable without his own approval. ~ Mark Twain V. Self-assessment guidelines (in syllabus) Describe your reasons for taking the class, your goals and expectations, and compare them with practical outcomes/results. Describe (briefly) your reading,

writing, comprehension and speaking skills in Russian. Please share when and how you may be able to use the skills (job, graduate school, further studies, studies abroad, interpersonal communication, etc.). Evaluate your knowledge about Russias culture, traditions and customs before and after taking this class. Please tell us about your future plans (if any) regarding Russian. Self-Assessment sample (Russ 001, male student, Math major)

I really enjoyed my semester taking Russian 001. I originally signed up for the class to fulfill a degree requirement because my department would not take my two years of Japanese as a foreign language credit. However over the course of the semester I found it every interesting. I had a very limited knowledge of Russian culture and language. I did not expect to learn much as we did in a semester, and was pleasantly surprised. I will continue in Russian 002, unfortunately I will graduate and be unable to take further courses after that.

Self-Assessment sample (Russ 001, male student, Math major) I am hoping the graduate school I end up choosing has a Russian program so I can continue learning. One thing that has always bothered me about foreign language classes in the Midwest is the lack of native speakers to communicate with. However when I am not at school (summers, semesters off) I live and

work in California. I was very surprised with how many Russian speakers I met in California. Self-Assessment sample (Russ 001, male student, Math major) Working at NASA has provided a surprising amount of Russian encounters. One night I had dinner and drinks with a former astronaut and a Russian laser physicist. I also found myself in a meeting with a former Russian

cosmonaut. My knowledge of Russian culture before this class was very limited and may have even included some ideas from your talk on stereotypes. Self-Assessment sample (Russ 001, male student, Math major) My knowledge of the Russian language was also very limited. I feel more comfortable with Russian now, though some words that are full on consonants

trip me up. I also worry about sounding "funny" when I speak, sounding with an American diction. After May, before returning to work and graduate school, I plan on taking a trip to Russia. I would really enjoy using what I learned, and getting more confident in my Russian language skills. Blog Definition

VI. online diary on Web site; a frequently updated personal journal chronicling links at a Web site, intended for public viewing. http://www.bing.com/Dictionary/search?q=define+blog&FORM=DTPDIA Encarta World English Dictionary[North American Edition] & (P) 2009 Microsoft

Functions 1. To promote interaction; 2. To share ideas / peer evaluation; 3. To create the sense of community in class; 4. To reduce turnaround grading / feedback time;

5. To extend learning and communication beyond the classroom space and time; 6. To be available 24/7; 7. To save paper and ink. http://blackboard.mst.edu/webapps/portal/frameset.jsp Benefits of Peer and Self-Assessment improve students motivation and

understanding of the assessment process; increase students sense of involvement and ownership of the assessment process; Benefits of Peer and Self-Assessment practice advanced communication skills; learn to be autonomous learners; promote active learning; be able to evaluate critically the quality of

their own work now and forever. VII. Pedagogical Implications Good teachers are costly, but bad teachers cost more. ~Bob Talbert 3 Ps of Good Teaching

Personal contact Positive reinforcement Peer pressure - Dr. Lance Haynes, ALP, Missouri S&T In Lieu of Conclusion Teaching from a Student's Perspective (1 min. 37 sec.) http://www.youtube.com/watch?v=K2lwKdKz2DY&feature=rel ated

Traditional teaching (1 min. 17 sec.) http://www.youtube.com/watch?v=C-S54bbX6eA&feature=relat ed In Lieu of Conclusion The mediocre teacher tells. The good teacher explains. The superior teacher demonstrates. The great teacher inspires.

~William Arthur Ward References Black, P and Wiliam, D (2002). Assessment for Learning: Beyond the Black Box (2002). www.assessmentreform-group.org.uk/publications.html Brown, H.D. (1994). Teaching by principle: An interactive approach to language pedagogy. Englewood Cliffs, NJ: Prentice Hall. Freeman, MA and McKenzie, J (2002). Implementing and evaluating SPARK, a confidential web-based template for self and peer assessment of student teamwork: benefits of evaluating across different subjects. British Journal of Educational Technology, 33 (5), pp553-572.

Cited at www.educ.dab.uts.edu.au/darrall/sparksite Leontev, A. A. (1991). K opredeleniiu rechevoi situatsii. In Obshchaia metodika obucheniia innostrannym iazykam (pp. 161-162). Moscow. Russkii iazyk. Pellegrino, JW, Chudowski, N, Glaser, R (Eds) (2001). Knowing What Students Know. Washington DC: National Academy of Sciences. Ridgway J and McCusker, S (2003). Using computers to assess new educational goals. Assessment in Education: Principles, Policy and Practice, Vol. 10, no 3, pp. 309-328(20) Ripley, M (2004). E-assessment question Foreign Languages and Higher Education: New Structures for a Changed World, MLA recommendations for teaching language: http://www.mla.org/flreport Rowell, P.M. (2002). Peer interactions in shared technological activity: A study of participation.

International Journal of Technology and Design Education, 12 (1), 1-22. Thompson, I. (1996). Assessing foreign language skills: Data from Russian. Modern Language Journal 80: 47-65. 52 Acknowledgments Missouri S&T Arts, Languages, and Philosophy Department Dr. W. Lance Haynes

My students Missouri S&T Education Technology Department 53 Questions? 54

Recently Viewed Presentations

  • Undecimated wavelet transform (Stationary Wavelet Transform)

    Undecimated wavelet transform (Stationary Wavelet Transform)

    Undecimated wavelet transform (Stationary Wavelet Transform) ECE 802 Standard DWT Classical DWT is not shift invariant: This means that DWT of a translated version of a signal x is not the same as the DWT of the original signal.
  • How Do Trees Grow? - | FRST 100

    How Do Trees Grow? - | FRST 100

    How Do Trees and Stands Grow? Blog Question for the Week of September 25: "Labels on UBC waste management trucks read 'powered by natural gas: a renewable resource'. Do you think natural gas is a renewable resource? Cite two references...
  • Title

    Title

    GTCNI Core Values Trust Honesty Commitment Respect Fairness Equality Integrity Tolerance Service A commitment to serve lies at the heart of professional behaviour. Members of the profession will exemplify the values in their work and their relationships with others; recognising...
  • The Skull - MR. Gruber's Classroom

    The Skull - MR. Gruber's Classroom

    In lizards, loss of the lower temporal bar produces the modified diapsid skull. This serves to partially liberate the posterior part of the skull from the snout, producing the mesokinetic part of the skull. Without these kinematic linkages, jaw closure...
  • Welcome to Third Grade! - OCPS TeacherPress

    Welcome to Third Grade! - OCPS TeacherPress

    Welcome to Open House. Please: Sign in. Sign up for a report card conference. Sign up for Teach In. Fill out a sweet note for your child and leave it on his/her desk for tomorrow.
  • Powerpointmal for Rana kommune - VITAMIN W

    Powerpointmal for Rana kommune - VITAMIN W

    Taksering av næringseiendommer Eiendomsskatteprosjektet 2010 -2011 Litt om bakgrunn og status Forstudie i Desember 2009 - januar 2010 ledet frem til følgende konklusjoner i sak til kommunestyret: Eiendomsskattesystemet i Rana var utdatert og lite oversiktelig Takseringsmetoden som ble benyttet var...
  • Candidates

    Candidates

    Officers President - Eugene Davis* Vice President - Bruce Stanley Treasurer - Larry Hotchkiss* Secretary- Steven Bingham Chapter Rep - Renee Bailey Iacona* * Need to be ASA members (Candidates elected unanimously (n = 25)) Delaware Chapter of ASA Jan...
  • Bad to the Bone Boxer" is Realistic Fiction. I know this ...

    Bad to the Bone Boxer" is Realistic Fiction. I know this ...

    This made Michelle sad so, she ran to the stairs and cried. Another reason she cried was because she called Rosie but instead of taking her to the mall she took a girl she didn't even know! Then her mom...