Interweaving Rubrics in Information Systems Program Assessments- Experiences from Action Research at Two Universities

By Petkova, Olga; Petkov, Doncho et al. | Issues in Informing Science & Information Technology, Annual 2008 | Go to article overview

Interweaving Rubrics in Information Systems Program Assessments- Experiences from Action Research at Two Universities


Petkova, Olga, Petkov, Doncho, D'Onofrio, Marianne J., Issues in Informing Science & Information Technology


Introduction

Educational assessment is an important aspect in promoting improvement in student learning and greater accountability in higher education. Its role is emphasized also by accrediting organizations at professional and regional levels. According to Ewell (2002:9), assessment as a term refers to the processes used to determine an individual's mastery of complex activities, generally through observed performance. Various academic program assessment methods are discussed in Palomba and Banta (1999).

Over the last few years assessment has become a major topic in Information Systems (IS) education research. Earlier publications in IS program assessment had dealt predominantly with indirect methods of program assessment based on student surveys (Pick & Kim, 2000; Williams & Price, 2000). A well defined agenda using exams as direct assessment measures related to the IS2002 model curriculum (Gorgone et al., 2002) was initiated at the Center for Computing Education

Research (CCER) (Landry et al., 2006; McKell, Reynolds, Longenecker, Landry, & Pardue, 2006; Reynolds, Longnecker, Landry, Pardue, & Applegate, 2004). The first account of a comprehensive effort on assessment at the level of an IS program was presented at ISECON 2004 by Petkova and Jarmoszko (2004) and was later expanded in Petkova, Jarmoszko, and D'Onofrio (2006). A comprehensive theoretical review on how various learning outcomes can be promoted in an IS program is presented in Todorova and Mills (2004). Stemler and Chamblin (2005) provide an account on how a well designed assessment process played a role in the accreditation of a Management Information Systems (MIS) program at a small liberal arts university. They used a set of common rubrics for assessing student performance on various artifacts. Another illustrative case study on implementing program assessment using the standardized tests by CCER at a private university is presented in White and McCarthy (2007). Such an approach is rigorous as it is tied strongly to the standard curriculum for the IS discipline IS2002.

Several other research efforts relate to narrower aspects of assessment in IS education. For example, assessment at the course level in Systems Analysis is discussed in Hoopes (2000). Amoroso (2004) has explored the use of online tools for assessing student learning in large classes. O'Neil (2005) and Robinson and Thoms (2001) have also focused on assessment of computer literacy knowledge. The use of multi-year projects as an assessment instrument in an IS program is discussed in Cooper and Heinze (2007).

A growing use of portfolios as an assessment instrument in other academic disciplines indicates their potential for IS education. Akar (2001) presents experiences with the use of portfolios in assessment in education. Portfolios seem to be a well established assessment method in education but to the best of the authors' knowledge there are limited accounts of their use in an IS or CS program apart from Higgs and Sabin (2005). The latter paper reports on research about the design of systems supporting portfolios. Love and Cooper (2004) have explored the design criteria for information systems supporting assessment portfolios. Sweat-Guy and Buzetto-More (2007) provide an analysis of common e-portfolio features and existing platforms.

Projects are a typical artifact with a strong presence in IS education. If projects are to be evaluated using rubrics in assessing student learning, the rubrics must be rigorously designed. These rubrics need to be standardized in different courses across the program (Petkov & Petkova, 2006). The use of unified rubrics in interrelated subjects is one way to address program level assessment. Projects from specific courses at important stages of the student studies within a program can be used as evidence of student progress with respect to the overall program goal (Petkov, Petkova, Jarmoszko,& D'Onofrio, 2007). …

The rest of this article is only available to active members of Questia

Sign up now for a free, 1-day trial and receive full access to:

  • Questia's entire collection
  • Automatic bibliography creation
  • More helpful research tools like notes, citations, and highlights
  • Ad-free environment

Already a member? Log in now.

Notes for this article

Add a new note
If you are trying to select text to create highlights or citations, remember that you must now click or tap on the first word, and then click or tap on the last word.
One moment ...
Default project is now your active project.
Project items

Items saved from this article

This article has been saved
Highlights (0)
Some of your highlights are legacy items.

Highlights saved before July 30, 2012 will not be displayed on their respective source pages.

You can easily re-create the highlights by opening the book page or article, selecting the text, and clicking “Highlight.”

Citations (0)
Some of your citations are legacy items.

Any citation created before July 30, 2012 will labeled as a “Cited page.” New citations will be saved as cited passages, pages or articles.

We also added the ability to view new citations from your projects or the book or article where you created them.

Notes (0)
Bookmarks (0)

You have no saved items from this article

Project items include:
  • Saved book/article
  • Highlights
  • Quotes/citations
  • Notes
  • Bookmarks
Notes
Cite this article

Cited article

Style
Citations are available only to our active members.
Sign up now to cite pages or passages in MLA, APA and Chicago citation styles.

(Einhorn, 1992, p. 25)

(Einhorn 25)

1

1. Lois J. Einhorn, Abraham Lincoln, the Orator: Penetrating the Lincoln Legend (Westport, CT: Greenwood Press, 1992), 25, http://www.questia.com/read/27419298.

Cited article

Interweaving Rubrics in Information Systems Program Assessments- Experiences from Action Research at Two Universities
Settings

Settings

Typeface
Text size Smaller Larger Reset View mode
Search within

Search within this article

Look up

Look up a word

  • Dictionary
  • Thesaurus
Please submit a word or phrase above.
Print this page

Print this page

Why can't I print more than one page at a time?

Full screen

matching results for page

Cited passage

Style
Citations are available only to our active members.
Sign up now to cite pages or passages in MLA, APA and Chicago citation styles.

"Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences." (Einhorn, 1992, p. 25).

"Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences." (Einhorn 25)

"Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences."1

1. Lois J. Einhorn, Abraham Lincoln, the Orator: Penetrating the Lincoln Legend (Westport, CT: Greenwood Press, 1992), 25, http://www.questia.com/read/27419298.

Cited passage

Thanks for trying Questia!

Please continue trying out our research tools, but please note, full functionality is available only to our active members.

Your work will be lost once you leave this Web page.

For full access in an ad-free environment, sign up now for a FREE, 1-day trial.

Already a member? Log in now.