After a Twitter convo about what's going on with badging initiatives and recently reading an article about badging in libraries that I (+ noted by some others) don't agree with, it feels like time for an update on my thoughts about badging.
When I first started thinking about badges and using badges, they seemed to help solve the problem of so many requests for library instruction, but without having the resources to physically be embedded in each class. I first designed and implemented badging into the one-credit course we used to have for information literacy. It was fully online and part of the coursework included tutorials and other online work. I created badges for our initial pilot that required instructor feedback and more conversation between instructor and student for badges to be earned (rather than automated earning through multiple choice, etc.). This pilot was very successful. Students enjoyed earning badges, saying it helped them organize what they were learning and that it provided more... closure perhaps... than just doing a tutorial or reading something and moving on. Since this course was geared toward freshmen, the badges added a student success component to help them think more about how to study and how to move through a course.
When we moved into the Fall semester pilot (still in 2013), when enrollment for this course gets to be the largest (over 100), we had to revise the badges and make them all mostly automated so that our GA could actually get through all of them plus her regular grading and instruction work for this course. Although students were still positive for the most part about the badges, it didn't feel as successful, to me at least, from an instructor standpoint. This could wind up being a discussion instead about class size, but I think both aspects played a role in my impression.
During this time, I thought since the info lit outcomes for our general education program weren't as strong (and mandatory?) as they needed to be, and that perhaps embedding badging options into gen ed courses would help usher in more info lit instruction, but where librarians wouldn't need to be coming in to do one-shots. We just don't have the resources for those anymore, and as Instruction Coordinator, I will firmly say I don't feel they are beneficial pedagogically to our instruction goals here at the UofA (we are phasing them out, #nomoreoneshots).
I wrote about my presentation to gen ed faculty here and also included student feedback from the pilots. Faculty were positive and it was a possibility to make this work. With a new online college established (UA Online), we also considered embedding badges in these programs since badges might work better with fully online courses. We also considered badges for the Writing Program at the beginning of this academic year. But just popping in automated badges in various spots of the curriculum (without greater collaboration with faculty, potentially) would essentially be the same thing as a one-shot, just virtually. This would be more physically possible, but not be so beneficial pedagogically. After bouncing around and evaluating what might work best instruction-wise, and based on the needs of these programs and departments, we reverted back to thinking about badges as a student success tool. So we have ultimately landed on collaborating with the College of Letters, Arts, & Sciences (CLAS) to use badges in their student success course for undecided students. We are working with our GA and ARL CEP Fellow to have them create and design these badges, and there will be 4 available to students in this program to introduce them to research.
This brings up the discussion also then of using badges with the Framework versus the Standards. I was able to design badges, that required instructor feedback and communication (not automated), to teach students about scholarship as conversation, research as iterative, and other frames. It was totally possible. But when we needed to shift badges to automated for our large pilot (and CLAS has over 1,000 students), this isn't really possible. And it has nothing to do with what is better, the Framework or the Standards--I do like the Framework better, FYI--but pedagogically, instructor feedback and interaction with students is going to be more effective and have a greater impact (that's my opinion, at least).
I do think badges are great for student success purposes and for engagement. Badges contribute to how a one might want to project their identity. After discussions on campus about badging stemming from the pilot I did, badges are being used in a large-scale student engagement initiative that's essentially related to AAC&U High Impact Practices. I think this is a great way for students to track what more holistic experiences they are having on campus and can help them conceptualize what they've done. When it comes to classroom instruction or information literacy initiatives, I think the use of badges gets more tricky and a number of factors need to be considered. And I prefer more fluidity in instructional design and collaborations with faculty that badges anchoring curriculum can't provide.
Now, one of those factors that always seems to pop up when badges are discussed is employer needs and employer impressions of students' value as future workers. I recently wrote about the state of higher education and info lit instruction in the winter 2015 issue of Communications in Information Literacy: A Pedagogy of Inquiry, so you can get more context on where I'm coming from with that article. My entire perspective of badges since I first became interested was about improving pedagogy, badges as instructional design, and trying to give students more autonomy over how they might want to represent themselves and their learning. If the badges and the learning piqued employers' interest and helped students get jobs after graduating, that's great, but should not be the sole purpose of badging (or education!). This is one of the main problems I have with a recent article about badges for employers in the Jan 2016 issue of C&RL. The use of "critical information literacy" in the title is a bit misleading, but regardless, critical (as in essential, according to this article's use of the word) anything for instruction shouldn't hinge on what employers say they need. This post is already getting quite long, so do read my CIL article if you'd like more on that. As others had pointed out to me, some of the other problems with the article include: lack of citations to librarians who have already published and presented on badge-related topics (and the citation of my work is incorrect--we saw my article is the only one cited of librarians who have researched this, and is also described strangely, plus my name isn't even included in the citation); it's confusing why HR reps and not even hiring managers were interviewed; and why this particular methodology was chosen.
I'm writing this quickly before I do an ACRL webinar soon (to talk about our use of the Framework and how we are phasing out one-shots... which I would love to write more about sometime in the future), but I knew if I didn't make this post now I might not have time again for awhile. Here's hoping there aren't any glaring errors. And hoping more that this post was useful to those of you asking about what I've learned about badging and how we're using them here at the University of Arizona.
Research & Learning Librarian and Instruction Coordinator, U of Arizona | MLIS & MS in Instructional Design
Showing posts with label general education. Show all posts
Showing posts with label general education. Show all posts
February 10, 2016
December 9, 2014
#acrlilrevisions Next Steps
It seems like we are almost at the final version of the ACRL Framework revisions. I submitted my feedback a couple weeks ago through the ACRL Student Learning & Information Literacy committee that I'm on (we are sending it collectively) and feel for the most part that I have a decent grasp on how we might use these at the University of Arizona. Even though it's not finalized yet, we've been needing to work with the draft as is for projects here, such as badging, programmatic instruction, and constructing our department's IL plan and philosophy not too long after we had a restructuring. I'm helping coordinate our plans for programmatic instruction here so I keep thinking and re-thinking about these frames.
When designing instruction, I like to come up with "big questions" or "understandings," as Wiggins and McTighe refer to. From looking at the frames and trying to think about how can librarians and teaching faculty collaboratively understand these concepts and work toward shared goals, I put some big questions together to try and capture broader thoughts. From there, a colleague and I also worked on writing some outcomes we could map through curriculum mapping once everything becomes finalized. I'm also using these in other work that can't wait for the final draft. I thought I'd share some of this here as some librarians in my department are also sharing this with librarians at ASU and NAU tomorrow at a joint mini-conference that I can't attend since I will actually be presenting our version of the framework so far with big questions and outcomes to general education faculty for their feedback.
Below is our draft thus far. I thought I'd share it in the hopes that it might help others grappling with this stuff. I changed "searching is strategic" back to "searching is exploration" for our purposes because we all liked that version better here. We are also trying to think of more simple frame names that we could use. Even with our bigger additions and small adjustments, it's not perfect, but we're getting there.
Since it seems there is/was some disagreement via Twitter about whether "conversation" or "discourse" might be better wording for the first frame... I am on the side of conversation. If we're talking about opening up the act of research and having students become creators, I think discourse is limiting. Discourses set rules and restrictions, not really inviting in great diversity. As Aleman (2014) says, "Those in power or in control of the discourse normalize certain principles and ways of being through discourse to perpetuate norms, and to demand compliance, conformity, and submission to these norms" (p. 113). Discourse limits diversity in perspective and often in mode of publication. I also love this quote from Ball in Egea that I shared not too long ago:
So I say keep it "conversation." Ok and now here are our frames and outcomes:
When designing instruction, I like to come up with "big questions" or "understandings," as Wiggins and McTighe refer to. From looking at the frames and trying to think about how can librarians and teaching faculty collaboratively understand these concepts and work toward shared goals, I put some big questions together to try and capture broader thoughts. From there, a colleague and I also worked on writing some outcomes we could map through curriculum mapping once everything becomes finalized. I'm also using these in other work that can't wait for the final draft. I thought I'd share some of this here as some librarians in my department are also sharing this with librarians at ASU and NAU tomorrow at a joint mini-conference that I can't attend since I will actually be presenting our version of the framework so far with big questions and outcomes to general education faculty for their feedback.
Below is our draft thus far. I thought I'd share it in the hopes that it might help others grappling with this stuff. I changed "searching is strategic" back to "searching is exploration" for our purposes because we all liked that version better here. We are also trying to think of more simple frame names that we could use. Even with our bigger additions and small adjustments, it's not perfect, but we're getting there.
discourse, problems, neoliberalism via Egea, O.M., 2013 pic.twitter.com/cIyP6Qb25o
— Nicole Pagowsky (@pumpedlibrarian) October 9, 2014
Frame 1: Scholarship is a Conversation
Scholarship is a conversation refers to the idea of ongoing discourse within a community of scholars who create, consume, and critique new insights and discoveries occurring over time as a result of competing perspectives and interpretations, building on each other.
Big Questions:
Ø What barriers exist when entering into the “conversation” of scholarship?
Ø How can we gain greater understanding of topics by examining the connections and ongoing narratives between different scholarly pieces?
Ø How do our responsibilities shift when moving from just consumers of information to critics and/or creators of it?
Students should be able to:
· Recognize the metaphor of “conversation” to describe the purpose of research
· Identify the contribution of specific scholarly pieces and varying perspectives to a disciplinary knowledge “conversation”
· Contribute to the scholarly conversation at an appropriate level, through the lens of becoming a creator/critic
Frame 2: Research as Inquiry
Research as inquiry means that research is an ongoing exploration, depending on continuous questioning where answers develop new questions or new lines of interest in any field.
Big Questions:
Ø How could understanding of a topic be improved through uncertainty in the process of research?
Ø How can varying needs shape the importance of certain types of information?
Ø How can we know what we don’t know? How do we go about figuring out what is not there instead of only what is visible by finding gaps in thought or content?
Students should be able to:
· Formulate research questions based on curiosity and gaps in information or data available
· Describe via reflection how the research process is iterative, requiring persistence
· Apply research methods that are appropriate for the need, context, and type of inquiry
Frame 3: Authority is Contextual and Constructed
Authority of information depends on where the source came from, the information need, and how the information will be used. It is constructed and contextual. Authority should be viewed with an attitude of informed skepticism and openness to new perspectives.
Big Questions:
Ø How or why do we decide if someone has “authority” on a topic?
Ø What might be expected of us as we become authorities ourselves?
Ø How might biases privilege some sources of authority and silence others, especially in terms of others’ worldviews, gender, sexual orientation, socio-economic class, etc.?
Students should be able to:
· Determine attributes of authoritative information for different needs, with the understanding that context plays a role in authority-based attributes
· Recognize that traditional notions of granting authority might hinder diverse ideas and world views
· Acknowledge that oneself may be seen as an authority in a particular area, and recognize the responsibilities entailed
Frame 4: Information Creation is a Process
Knowledge can be expressed in different styles, which has an impact on how information is used and shared. It is important to look to the underlying processes of creation as well as the final product to critically evaluate the usefulness of the information.
Big Questions:
Ø How might information be perceived differently based on how it’s packaged? E.g., why might there be an expectation to use scholarly sources in a college paper?
Ø Why do certain types of information automatically seem to have credibility where others might not?
Students should be able to:
· Articulate the purposes of various types of information as well as their distinguishing characteristics
· Distinguish between format and method of access, understanding that these are separate entities
· Identify which types of information best meet particular information needs
Frame 5: Searching is Exploration
Locating information requires a combination of curiosity, discovery, and luck. There is no one size fits all source for the needed information. Finding information is nonlinear and iterative, requiring the use of a broad range of information sources, flexibility, and the willingness to make mistakes and try again.
Big Questions:
Ø How can we best determine what we’re looking for so that we can identify an effective search strategy?
Ø How might differing information needs change an approach to searching?
Ø How can failure and mistakes help us in finding information?
Students should be able to:
· Make connections between the importance of matching information needs and search strategies to appropriate search tools
· Implement more advanced searching skills to respond to a discipline-based information need
· Reflect on the usefulness of making mistakes in the search process and how searching is not solely transactional
Frame 6: Information has Value
Information has value means that information possesses several dimensions of value, including as a commodity, as a means of education, as a means to influence, and as a means of negotiating and understanding the world. The flow of information through systems of production and dissemination is impacted by legal, sociopolitical, and economic interests.
Big Questions:
Ø How could value of information be wielded by powerful interests in ways that marginalize certain voices?
Ø How might the use or absence of citations impact the conversation of research?
Ø How could something like open access change creation, publishing, and learning?
Students should be able to:
· Distinguish between plagiarism and copyright violations
· Identify scholarly publication practices and their related implications for access to scholarly information
· Identify why some groups/individuals may be underrepresented or systematically marginalized within the systems that produce and disseminate information
January 9, 2014
Badges and buy-in
In November, I presented on digital badges to the University-Wide General Education Committee (UWGEC) that I am an advisory member for on behalf of the library. My colleague and I have finished our multi-semester course pilot where we used digital badges with content in the library's one-credit course for undergrads, and now we are looking to expand to greater campus and also gather faculty feedback. If faculty don't find value in digital badges, we won't get very far.
The reason I chose the UWGEC committee to present to is because all new gen ed courses are required to explain how information literacy (and other critical skills) will be incorporated into their class. There were a few applications that came through where it seemed faculty were unsure of how to either include IL skills in the class or just how to describe how IL skills would be included in the class. We do have a list of the (soon outdated) ACRL standards to help guide instructors, but there are of course issues with the standards, aside from them not really being intuitive to someone who is not a librarian. Additionally, since we don't have a FYE program, incorporating IL skills at the Gen Ed level would reach more students earlier on.
When badges can be embedded into courses, instructors can more actively understand IL concepts and skills that their students will need and map IL to current course design. Faculty were very excited to hear about this possibility of a mix and match digital badge option for including research skills in their courses. This wouldn't require much additional instruction time on their part, and everyone (faculty and the library) would have access to assessment data. Prior to this presentation, it felt badge talk on campus was stalled or even non-existent, but I found some interested instructors to become part of our Pilot Part II, and was also invited to another working group on campus to include digital badges in eportfolios (actually very similar to what UC-Davis has announced).
Some key points to consider that worked for me when presenting on badges to faculty:
And I'll share some student feedback from our pilot:
We will be analyzing our data for these two semesters and then will be starting another pilot for spring if all works as planned and presenting on our findings at ALA Annual 2014 in Vegas. I don't think there is a date or time set yet but the title of our presentation is: But did they learn anything? Using digital badges to create customizable learning experiences for motivation and assessment. Hope you'll join us! It will be an interactive session where audience members will start putting a badging system together for their institutions (and this is through LITA).
The reason I chose the UWGEC committee to present to is because all new gen ed courses are required to explain how information literacy (and other critical skills) will be incorporated into their class. There were a few applications that came through where it seemed faculty were unsure of how to either include IL skills in the class or just how to describe how IL skills would be included in the class. We do have a list of the (soon outdated) ACRL standards to help guide instructors, but there are of course issues with the standards, aside from them not really being intuitive to someone who is not a librarian. Additionally, since we don't have a FYE program, incorporating IL skills at the Gen Ed level would reach more students earlier on.
When badges can be embedded into courses, instructors can more actively understand IL concepts and skills that their students will need and map IL to current course design. Faculty were very excited to hear about this possibility of a mix and match digital badge option for including research skills in their courses. This wouldn't require much additional instruction time on their part, and everyone (faculty and the library) would have access to assessment data. Prior to this presentation, it felt badge talk on campus was stalled or even non-existent, but I found some interested instructors to become part of our Pilot Part II, and was also invited to another working group on campus to include digital badges in eportfolios (actually very similar to what UC-Davis has announced).
Some key points to consider that worked for me when presenting on badges to faculty:
- Focus less on gamification when introducing the concept and more on measuring skills and competency-based education
- If your campus is like ours and upper course level faculty complain that students are lacking research skills when they reach them, highlight how embedding skills early and through scaffolding throughout students' college years will benefit all in receiving better work and helping students be better prepared
- Share as much student feedback as you can. If students are enthusiastic, faculty of course want to use methods students will enjoy and be successful at
- Stress flexibility and cooperation. We are not giving campus mandatory modules that they have to incorporate into every class, it's a mix and match as I mentioned above where badges would be incorporated into classes based on content, skill-level, and need. We want to be strategic and not create more work for ourselves or faculty (or students)
- Reiterate student anxiety on finding jobs after graduation, and how being able to display and describe specific skills could give them an advantage with future employers while also helping students better understand what they have accomplished
And I'll share some student feedback from our pilot:
•“I liked when I did really well on a task when I got a badge for it”
•“I liked badges because they helped me feel accomplished and as if I was doing something worth while”
•“It was more fun than just completing a written assignment”
•“I enjoyed that the badges … were useful in keeping track of my work, but also of what I learned [and] that most of the time they made us really reflect and put our knowledge of the subject to use”
•“In order for me to complete assignments, I have to break them down into tasks. With the badges this was already set up for me. I found it fit into my learning style perfectly and I loved how I could track what I was doing within each badge”
![]() |
University of Arizona Libraries: LIBR197R Badges Pilot survey |
We will be analyzing our data for these two semesters and then will be starting another pilot for spring if all works as planned and presenting on our findings at ALA Annual 2014 in Vegas. I don't think there is a date or time set yet but the title of our presentation is: But did they learn anything? Using digital badges to create customizable learning experiences for motivation and assessment. Hope you'll join us! It will be an interactive session where audience members will start putting a badging system together for their institutions (and this is through LITA).
Subscribe to:
Posts (Atom)