New Texts (Required):

1) Nash, S. & Bolin, C.(2003) Teamwork from the Inside Out Fieldbook. Palo Alto, CA: Davies-Black Publishing.

2) Horton, W (2001) Evaluating E-Learning. American Society for Trainingand Development (ASTD), Alexandria, VA.

3) Tessmer, M. (1993) Planning and Conducting Formative Evaluations. London: Kogan Page.

4) Jonassen, D.H. & Tessmer, M. (1999). Task Analysis Methods for Instructional Design. Mahwah, NJ: Lawrence Erlbaum Associates.

5) Reading Packet - Book Store, Johnson Center

New Texts (Optional)

Rubin, J. (1994). Handbook of Usability Testing: How to Plan, Design and Conduct Effective Tests. New York: John Wiley & Sons, Inc.

Krug,S. (2000). Don't Make Me Think. Indianapolis, IN:New Riders Publishing.

Texts continued from Fall semester:

Wenger, E.. (1998). Communities of Practice: Learning, Meaning, Identity. Cambridge: Cambridge University Press.

Kunivasky, M. (2003). Observing the User Experience: A Practitioner's Guide to User Research.

From Fall Reading Packet:

Online Learning: Concepts, Strategies and Application - Dabbagh & Bannan-Ritland Chapters 1, 2 & 3.

• Welcome back!
• Updates on Winter Break
• Review general spring schedule
• Housekeeping issues
• Portfolio requirements - continued reflections, contributions
• Individual paper - rough draft due Mar 26th for Peer review, final due April 16th
• Wenger book - sign up for chapter presentation

Team Breakout Sessions

• Proactive semester: integration of evaluation approaches, evaluation plan, usability testing, formative evaluation, iterative revision of prototypes, usage centered design, task analysis, content design, pilot testing, analyzing, defining and evaluating online communities of practice.
• Schedule - beginning of semster Mon-Wed meetings (generally) with readings, moving toward Mon-Tues only meetings before mid-semester and then one day week toward end of semester
• Defining Individual Strengths and Weaknesses: Individually fill out all quadrants, ask team members about your greatest weaknesses and greatest strengths, add to quandrants. Present your results to the rest of the team.
• Report out and debrief - What did you learn about yourself? What did you learn about other team members? What implications may this have for the team?

1) Read Nash & Bolin (2003) book, Introduction, Chapter 1pg 1- 41.

2) Revisit prototypes and project sites and recommendations from last semester, think about directions for team for this semester.

• Revisit prototypes and determine logistics for team meetings and project Website.

• Contribute Reflections
• Post Status Report

Meeting: 12:00-3:00pm Commerce Lab 
 

• Work through Chapter 5 - write team vision, purpose, values, ground rules and key results for this semester.

1) Read Nash & Bolin (2003) book - Chapter 6 (Complete excercises 43-45 and come prepared to complete exercise 46-50 in class on Wednesday).

2) Read Dabbagh & Bannan-Ritland (in reading packet) - Chapter 7 Evaluation for Online Learning: A Process Model and Examples for discussion on Wednesday

Meeting: 12:00-3:00pm Commerce Lab 

• Discuss Chapter 7 - Evaluation for Online Learning: A Process Model and Examples
• Discuss Evaluation Plan
• Work through Nash & Bolin excercises 46-50, defining roles and responsibilites and drafting objectives.
  

1) Read Nash & Bolin (2003) book - Chapter 7 (Complete excercises that can be done individually)

2) Read Tessmer - Chapters 1 & 2

3) Begin evaluation plan that will include the following elements:

• Need for evaluation
• Purpose of evaluation (Goals)
• Evaluation Strategy
• Objectives
• Social/cultural factors (resources/constraints)
• Desired results (information sought from evaluation)
• Levels of evaluation
• Formality or informality of methods and rationale
• Congruence of evaluation methods with learning activities
• Measurement approaches
• Formative evaluation plans including formative evaluation methods and/or usability tests as part of evaluation plan

Team Meeting time

• Begin to determine need, purpose of evaluation and write evaluation strategy statement as part of evaluation plan

• Contribute reflections to portfolio
• Post Status Report

XXX

Mon, Feb 2

(Fac meeting)

No class meeting

• Team meeting time

1) Read Nash & Bolin (2003) book - Chapter 8 (Complete excercises that can be completed individually).

Meeting: 12:00-3:00pm Commerce Lab 

• Design teams present need, purpose of evaluation and write evaluation strategy statement
• Discuss Nash & Bolin - chapter 7 and do some team exercises
• Discuss Nash & Bolin - chapter 8 and do team exercises
• Discuss and begin evaluation plan

1) Read Nash & Bolin (2003) book - Chapter 9 (Complete individual excercises).

2) Read Tessmer (1991) Chapters 3 & 4.

3) Read Barksdale & Lund (2001) in reading packet (pg.s 15-19).

Meeting: 12:00-3:00pm Commerce Lab 

Immersion Meeting

• Discuss balancing the evaluation strategy and link to "business need"
• Discuss formative evaluation methods -expert review and one to one
• Discuss Nash & Bolin - Chapter 9
• Revise need, purpose of evaluation and evaluation strategy statement
• Begin to draft objectives, social-cultural factors and desired results sections of evaluation plan

1) Read Tessmer - chapters 5 & 6

2) Read (or re-read) Kuniavsky (2003) Chapter 10 - Usability Tests

• Team Meeting Time
• Plan usability testing details

XXX

• Contribute reflections to portfolio
• Post Status Report

XXX

Meeting: 12:00 - 3:00pm Commerce Lab

• Present evaluation objectives, social-cultural factors and desired results sections of evaluation plan
• Discuss formative evaluation methods -small group and field test

For Reference: Usability.gov - National Cancer Institute

Usability Methods Toolbox

Meeting: 12:00-3:00pm Commerce Lab 

• Presentation by Leslie Carter on the intersection of ISD and usability
• Teams discuss recruitment, features to test, creation of tasks and script for usability testing

1) Read Horton (2001) Chapters 3- 6

Meeting: 12:00-3:00pm Commerce Lab 

• Discuss Kirkpatrick's levels of evaluation
• Work on drafting applicable levels of evaluation for evaluation plan
• Work on usability test planning - recruitment, features to test, creation of tasks and script for usability testing
• BEGIN RECRUITMENT FOR USABILITY TESTING NOW!

1) Read Horton (2001) Chapter 10, 11 & 12

2) Read Barksdale & Lund (2001) in reading packet - p.37-40 Types of Measurement Approaches

3) Read Marrelli (1998) in reading packet - p. 58-65.

Team Meeting:

• Work on Overall Evaluation Plan
• Incorporate Plans for Usability Testing in overall evaluation plan

XXX

• Contribute reflections to portfolio
• Post Status Report

XXX

Meeting: 12:00-3:00pm Commerce Lab   

• Design groups present applicable levels of evaluation for project
• Design groups present plans for usability testing
• Select methods, determine formality or informality and determine measurement approaches, discuss how you will collect and analyze data
• Draft last sections of the evaluation plan this week

XXX

• Draft last sections of the evaluation plan
• Work on carrying out usability tests

1) Read Jonassen, Tessmer & Hannum (1999) Chapters 1, 2 & 3 for next week.

2) Review - Wenger (1999) Prologue and Introduction - pgs.1-39 (if presenting in-depth reading)

XXX

Meeting: 12:00-3:00pm Commerce Lab 

• Finalize Evaluation Plans for semester
• Conducting Usability Testing

XXX

Team Meeting

• Finalize Evaluation Plans
• Conducting Usability Testing

XXX

• Completed evaluation plans submitted
• Contribute reflections to portfolio
• Post Status Report

Meeting: 12:00pm-3:00pm Commerce

• Design teams update on usability testing
• Discuss Task Analysis
• Conduct usabilty testing
  

1) Read Jonassen, Tessmer & Hannum (1999) Chapters 4-7

• Presentation of Wenger - Intro and prologue
• Discuss applicability of job, procedural and skills analysis to projects
• Create table with features of different analyses
• Conduct usability testing

Meeting: 12:00-3:00pm Commerce Lab 

• Conduct usability testing and begin to compile and analyze results

 1) Read Jonassen, Tessmer & Hannum (1999) Chapters 8, 9 & 10

2) Review - Wenger (1999) Introduction and Chapter 1- pgs.45-62 (if presenting in-depth reading) XX

Team Meeting time

• Conduct usability testing and begin to compile and analyze results

XXX

• Contribute reflections to portfolio
• Post Status Report

XXX

Results of Usability Testing and Task Analysis MethodsOPIC

No Class meeting

Meeting: 12:00-3:00pm Commerce Lab 

Job Hunting presentation - 1:00 pm

Team Meeting

UTOPICSpring Break Week

• No class

XXX

• IT Panel presentation

Meeting: 12:00-3:00pm Commerce Lab

• Discuss case-based reasoning, activity theory and critical incident/critical decision method
• Presentation - Wenger CH 2 - Jocelyn / Monisha
• Presentation - Wenger CH 3 - Mona / Robert
• Presentation - Wenger Chapter 4 - Danalyn

No Class Meeting:

• Work on presentation re: T/TAC meeting (TTAC groups)
• Work on implementation of evaluation plan and design efforts (all groups)

1) Briefly review - Wenger (1999) Chapter 5 - pgs. 122-134; Intro to Identity pg. 143-147 and Chapter 6 - pgs. 149-161 (if presenting in-depth reading)

2) Read Jonassen, Tessmer & Hannum (1999) Chapters 19, 20, & 21 for the week after spring breakX

 Team Meeting time

• Apply task analysis methods to project content if applicable
• Design or redesign based on emerging evaluation results
• Carrying out evaluation plan

XXX

• Contribute reflections to portfolio
• Post Status Report
• PORTFOLIO REVIEW

 XXX

Task Analysis & Communities of Practice

No class Meeting

• Work on presentation re: T/TAC meeting (TTAC groups)
• Work on implementation of evaluation plan and design efforts (all groups)

XXX

Meeting: 12:00-3:00pm Commerce Lab 

• Discuss Task Knowledge Structures, Subject Matter/Content Analysis, Conceptual Graph Analysis & Master Design Chart
• Presentation - Wenger Chapter 5 - Justin

Assessment Rubric/Criteria for IT Paper

Peer Review

Master Design Chart example

1) Read Jonassen, Tessmer & Hannum (1999) Chapters 25, 26 & 27 X

Meeting: 12:00-3:00pm Commerce Lab 

• Discuss Online Learning Book site - Instructional Strategy Support in Web-based Course Management Tools
• Presentation - Wenger Intro to Identity & Chapter 6 - Tabitha / Leslie
  

1) Briefly review - Wenger (1999) Chapter 7 - pgs.164-169 and Chapter 8 pgs. 173-183 (if presenting in-depth reading)

2) Read Northrup - A Framework for Designing Interactivity and Young & Young - Coverting Existing Training Products for the Web (in spring reading packet) for Tuesday.

Team Meeting Time

• Evaluation plan, application of task analysis procedures, design or redesign

XXX

No face-to-face meeting on Fridays

• Contribute reflections to portfolio
• Post Status Report
• ROUGH DRAFT OF PAPER DUE - for Peer Review

No class meeting

• Work on presentation re: T/TAC meeting (TTAC groups)
• Work on implementation of evaluation plan and design efforts (all groups)

XXX

 Meeting: 12:00-3:00pm Commerce Lab 

• Discuss Interactivity and ISD process with redesign (based on Northrup and Young & Young articles)
• Documentation Analysis, Observation and Survey Questions
• Presentation Wenger - chapter 7 - Dan / Michelle
• Presentation Wenger - chapter 8 - Heather / Barbara

1) Read Jonassen, Tessmer & Hannum (1999) Chapters 28,29 & 30

 No Class Meeting: 12:00-3:00pm Commerce Lab

• Evaluation plan, application of task analysis procedures, design or redesign

Team Meeting Time

• Task analysis of content, design or redesign
• Carrying out evaluation plan

No face-to-face meeting on Fridays

• Contribute reflections to portfolio
• Post Status Report
• PEER REVIEW OF PAPER DUE BACK TO AUTHOR (REVIEWS WILL BE TURNED IN WITH FINAL PAPER)

XXX

No Class Meeting

• Work on presentation re: T/TAC meeting (TTAC groups)
• Work on implementation of evaluation plan and design efforts (all groups)

XXX

Meeting: SPECIAL TIME 10:00am - 12:00pm (presentations facilitated by Mike)

• Presentation Wenger - Chapter 9 - Nantana
• Presentation Wenger - Synopsis: Design
• Presentation Wenger - Chapter 10 - Lisa

XXX

No Formal Class Meeting:

• Work on presentation re: T/TAC meeting (TTAC groups)
• Work on implementation of evaluation plan and design efforts (all groups)

10 am TTAC meeting - site user issues

1) Review - Wenger (1999) Chapter 11 - pgs.241-260 and Chapter 12 pgs. 263-275 (if presenting in-depth reading)

2) Review for reference: Young & Young - Converting Existing Training Products for the Web (in reading packet).

Team meeting

• Task analysis of content, design or redesign
• Carrying out Evaluation Plan

XXX

No face-to-face meeting on Fridays

• Contribute reflections to portfolio
• Post Status Report
• Revise paper

XXX

No class meeting

• Design, redesign, development
• Carrying out Evaluation Plan

XXX

Meeting: SPECIAL TIME 1:00pm-3:00pm (facilitated by Mike)

• Presentation Wenger - CH 11 - John
• Prepare for April 20th meeting (TTAC groups)
• Implement evaluation plans (all groups)

No Class Meeting:  

• Design, redesign, development
• Prepare for April 20th meeting (TTAC groups)
• Implement evaluation plans (all groups)

1) Review Wenger Chapter 12 pgs. 263-277

Team Meeting Time

• Design, redesign, development
• Carrying out Evaluation Plan

XXXXXX

No face-to-face meeting on Fridays

• Contribute reflections to portfolio
• Post Status Report

Meeting: 12:00-1:00pm Commerce Lab

• Rehearse VDOE presentation
• TTAC group members present to TOA
• PAPERS DUE (HAND IN FINALIZED PAPER AND WRITTEN PEER REVIEW)

No Class Meeting:

• TTAC Groups present at VDOE

XXX

No Class Meeting:

• Design or redesign
• Carrying out Evaluation Plan

Team meeting

• Design, redesign, development
• Carrying out Evaluation Plan

• Contribute reflections to portfolio
• Post Status Report

• Finalize Data/Results gathered from Evaluation Plan
• Finalize design, redesign, development

Meeting: 12:00-3:00pm Commerce Lab   

• Team updates on status of evaluation plan implementation and results
• Team updates on design, redesign and development efforts
• Discussion of final presentation elements

No Class Meeting:

• Finalize Data/Results gathered from Evaluation Plan
• Finalize design, redesign, development
• Synthesis of results of evaluation plan and design and development efforts into final presentation

Team Meeting:

• Finalize semester activities
• Work on final presentation

• Contribute reflections to portfolio
• Post Status Report
• PORTFOLIOS DUE

No class meeting (scheduled practice sessions with feedback)

• Prepare for final presentation
• Practice sessions
• Final Interviews

Meeting: 12:00-3:00pm Commerce Lab 

• Prepare for final presentation
• Practice sessions
• Final Interviews

Meeting: 12:00-3:00pm Commerce Lab 

• Prepare for final presentation
• Practice Sessions
• Final Interviews

Team Meeting

• Prepare for final presentation
• Final Interviews

No face to face meeting

• Prepare for final presentation
• Contribute reflections to portfolio
• Post Status Report
• Final Interviews