Showing posts with label outcomes. Show all posts
Showing posts with label outcomes. Show all posts

June 13, 2015

Expertise and educators: Teachers make a difference

If you care about teaching, stop what you're doing and read Joshua Beatty's CAPAL 2015 paper, "Reading Freire for first world librarians." I had seen others tweeting about how great this paper was but hadn't had a chance to read it until now.

I can't really even count the amount of exclamation points I wrote all over my printed-out copy. There are a lot! We talk about a few things regarding critical pedagogy that have had me feeling conflicted. I wasn't sure how to put my uncertainty into words. Conversations regarding teacher authority, students-as-teachers, and borderline disdain for outcomes have had me feeling like "hmmm no" but not entirely sure how to express my hesitation clearly. And when I say "we," I mean librarians, teachers, and higher ed faculty who engage in discourse about critical pedagogy, but also sometimes those more informal discussions in our #critlib chats. And this is certainly not uncommon, a hashtag to talk about umbrella topics does not automatically imply there is monolithic agreement and a shared politics/approach/philosophy. This is why these conversations are great, because it's a safe space to talk about these things. I just haven't been able to fully articulate my disagreement about these issues until reading this paper.

So without repeating everything he says, essentially, the point is that first world librarians have been interpreting Freire incorrectly. Most of us--myself included--have only read Pedagogy of the Oppressed, which was written with a very specific time period and population in mind and does not apply to Western classrooms (especially in the U.S. education system). Beatty points out how "Freire believed that North American teachers had conflated the concept of authority with the concept of authoritarianism. For Freire, the difference was essential. Authoritarianism was opposed to the existence of freedom, and is illegitimate. Authority, in contrast, was not opposed to freedom, but necessary to it" (p. 6).

The teacher's authority comes from their knowledge of the subject matter; but as Beatty explains, Freire realized in our misreading of his work that in rejecting authoritarianism, we wind up rejecting the teacher's authority... the thing that is actually needed for reaching freedom. And when we reject the teacher's authority and focus on this idea of teacher as just a guide or facilitator and not an expert with authority, we are actually causing harm to both the students and the teacher.

How this causes harm to students: Teacher authority is thinly veiled behind this idea of a classroom of shared power, which is just not in existence. Problem-posing in truth would be to acknowledge the authority of the teacher, to discuss it and be aware of it, instead of pretending it doesn't exist or making it seem like it can go away. I have never fully abdicated my authority as a teacher when I am doing instruction, feeling that I would come across as insincere. I wrote a blog post previously about TMI and student retention, and how trying to appear as if on the same level as your students is not helpful to teaching. I had included a couple YouTube clip examples in the post that have seemed to disappear, but this one can illustrate the idea here from Kids in the Hall, He's Hip. He's Cool. He's 45! The dad is trying to act like his authority is invisible by being "cool" and imposing no limitations on his son. He "doesn't care" about restrictions such as curfew and even goes to offer his son a joint with his cool man stance on the couch armrest. But the son clearly sees through this facade, not taking his dad seriously, as if he's a joke (well, he literally is):



This is obviously an exaggerated example, but I think it is disingenuous to frame a classroom as hey we're all the same, teacher, students.... even though I have the authority to grade. Also, there really are right and wrong answers in a number of cases. Dialogue is important, though. Facilitating is also important, but not at the expense of denying the expertise of being a teacher.

How this causes harm to teachers: I have written about the identity of librarians, the identity of librarians specifically as educators, and presented on how incorporating critical pedagogy into information literacy education can help transform our image. What Beatty is saying in his paper ties directly to this issue inherent in women's work and female-dominated professions having an expectation for service work and caregiving. Caregiving and warmth is essential to a degree in successful teaching, as we recognize the human component necessary for learning (affect), but positioning teachers--and librarian teachers, a double-whammy--as simply guides or facilitators or helpers, we are reinforcing a renunciation of authority, respect, and the need for individuals (mostly women) in these roles. We can have authority without being authoritarians. We can be experts and strategic educators who use learning outcomes (especially as formative assessment) while also working with students to realize their own knowledge and interests via dialogue and bigger picture learning.

I have found somewhat of a clash between educational psychology / instructional design principles and critical pedagogy when considering design, outcomes, and the role of the educator. I was so glad to read Beatty's paper to help me realize exactly where I felt uncomfortable with this conflict and why it existed. He talks about a lot of other great things like the idea of neutrality, the importance of collaboration with faculty, and neoliberalism + educational technology... you should really read.

And so, if anyone really can be a facilitator or a guide or a helper, then who needs us? Freire's notion of laissez-faire education would be realized. Teachers make a difference, and we can use our authority to help students learn. 

December 9, 2014

#acrlilrevisions Next Steps

It seems like we are almost at the final version of the ACRL Framework revisions. I submitted my feedback a couple weeks ago through the ACRL Student Learning & Information Literacy committee that I'm on (we are sending it collectively) and feel for the most part that I have a decent grasp on how we might use these at the University of Arizona. Even though it's not finalized yet, we've been needing to work with the draft as is for projects here, such as badging, programmatic instruction, and constructing our department's IL plan and philosophy not too long after we had a restructuring. I'm helping coordinate our plans for programmatic instruction here so I keep thinking and re-thinking about these frames.

When designing instruction, I like to come up with "big questions" or "understandings," as Wiggins and McTighe refer to. From looking at the frames and trying to think about how can librarians and teaching faculty collaboratively understand these concepts and work toward shared goals, I put some big questions together to try and capture broader thoughts. From there, a colleague and I also worked on writing some outcomes we could map through curriculum mapping once everything becomes finalized. I'm also using these in other work that can't wait for the final draft. I thought I'd share some of this here as some librarians in my department are also sharing this with librarians at ASU and NAU tomorrow at a joint mini-conference that I can't attend since I will actually be presenting our version of the framework so far with big questions and outcomes to general education faculty for their feedback.

Below is our draft thus far. I thought I'd share it in the hopes that it might help others grappling with this stuff. I changed "searching is strategic" back to "searching is exploration" for our purposes because we all liked that version better here. We are also trying to think of more simple frame names that we could use. Even with our bigger additions and small adjustments, it's not perfect, but we're getting there.

Since it seems there is/was some disagreement via Twitter about whether "conversation" or "discourse" might be better wording for the first frame... I am on the side of conversation. If we're talking about opening up the act of research and having students become creators, I think discourse is limiting. Discourses set rules and restrictions, not really inviting in great diversity. As Aleman (2014) says, "Those in power or in control of the discourse normalize certain principles and ways of being through discourse to perpetuate norms, and to demand compliance, conformity, and submission to these norms" (p. 113). Discourse limits diversity in perspective and often in mode of publication. I also love this quote from Ball in Egea that I shared not too long ago: 
So I say keep it "conversation." Ok and now here are our frames and outcomes:

Frame 1: Scholarship is a Conversation
Scholarship is a conversation refers to the idea of ongoing discourse within a community of scholars who create, consume, and critique new insights and discoveries occurring over time as a result of competing perspectives and interpretations, building on each other.
Big Questions:
Ø  What barriers exist when entering into the “conversation” of scholarship?
Ø  How can we gain greater understanding of topics by examining the connections and ongoing narratives between different scholarly pieces?
Ø  How do our responsibilities shift when moving from just consumers of information to critics and/or creators of it?

Students should be able to:
·         Recognize the metaphor of “conversation” to describe the purpose of research
·         Identify the contribution of specific scholarly pieces and varying perspectives to a disciplinary knowledge “conversation”
·         Contribute to the scholarly conversation at an appropriate level, through the lens of becoming a creator/critic

Frame 2: Research as Inquiry
Research as inquiry means that research is an ongoing exploration, depending on continuous questioning where answers develop new questions or new lines of interest in any field.
Big Questions:
Ø  How could understanding of a topic be improved through uncertainty in the process of research?
Ø  How can varying needs shape the importance of certain types of information?
Ø  How can we know what we don’t know? How do we go about figuring out what is not there instead of only what is visible by finding gaps in thought or content?

Students should be able to:
·         Formulate research questions based on curiosity and gaps in information or data available
·         Describe via reflection how the research process is iterative, requiring persistence
·         Apply research methods that are appropriate for the need, context, and type of inquiry

Frame 3:  Authority is Contextual and Constructed
Authority of information depends on where the source came from, the information need, and how the information will be used. It is constructed and contextual. Authority should be viewed with an attitude of informed skepticism and openness to new perspectives.
Big Questions:
Ø  How or why do we decide if someone has “authority” on a topic?
Ø  What might be expected of us as we become authorities ourselves?
Ø  How might biases privilege some sources of authority and silence others, especially in terms of others’ worldviews, gender, sexual orientation, socio-economic class, etc.?

Students should be able to:
·         Determine attributes of authoritative information for different needs, with the understanding that context plays a role in authority-based attributes
·         Recognize that traditional notions of granting authority might hinder diverse ideas and world views
·         Acknowledge that oneself may be seen as an authority in a particular area, and recognize the responsibilities entailed

Frame 4: Information Creation is a Process
Knowledge can be expressed in different styles, which has an impact on how information is used and shared. It is important to look to the underlying processes of creation as well as the final product to critically evaluate the usefulness of the information.
Big Questions:
Ø  How might information be perceived differently based on how it’s packaged? E.g., why might there be an expectation to use scholarly sources in a college paper?
Ø  Why do certain types of information automatically seem to have credibility where others might not?

Students should be able to:
·         Articulate the purposes of various types of information as well as their distinguishing characteristics
·         Distinguish between format and method of access, understanding that these are separate entities
·         Identify which types of information best meet particular information needs

Frame 5: Searching is Exploration
Locating information requires a combination of curiosity, discovery, and luck. There is no one size fits all source for the needed information. Finding information is nonlinear and iterative, requiring the use of a broad range of information sources, flexibility, and the willingness to make mistakes and try again.
Big Questions:
Ø  How can we best determine what we’re looking for so that we can identify an effective search strategy?
Ø  How might differing information needs change an approach to searching?
Ø  How can failure and mistakes help us in finding information?

Students should be able to:
·         Make connections between the importance of matching information needs and search strategies to appropriate search tools
·         Implement more advanced searching skills to respond to a discipline-based information need
·         Reflect on the usefulness of making mistakes in the search process and how searching is not solely transactional

Frame 6: Information has Value
Information has value means that information possesses several dimensions of value, including as a commodity, as a means of education, as a means to influence, and as a means of negotiating and understanding the world. The flow of information through systems of production and dissemination is impacted by legal, sociopolitical, and economic interests.
Big Questions:
Ø  How could value of information be wielded by powerful interests in ways that marginalize certain voices?
Ø  How might the use or absence of citations impact the conversation of research?
Ø  How could something like open access change creation, publishing, and learning?

Students should be able to:
·         Distinguish between plagiarism and copyright violations
·         Identify scholarly publication practices and their related implications for access to scholarly information
·         Identify why some groups/individuals may be underrepresented or systematically marginalized within the systems that produce and disseminate information

August 26, 2014

A short post on #critlib outcomes and assessment


As #critlib is wrapping up for this week, the topic of assessment being prohibitive came up in regards to libraries contributing to social justice initiatives in communities when tragedies like Ferguson happen. I mentioned in the chat that I needed to develop a rubric for a campus committee, where we are working on our equivalent of AAC&U's High Impact Practices. I was able to include critical pedagogy components, and even the new ACRL framework to design it, so I am sharing by request. This is certainly not finalized or widely distributed, so just sharing my work so far:
(^ Click to fully view)



























Regarding the evil assessment talk, outcomes and assessment definitely can have #critlib components and work for "good" (vs "evil"). There are also affective learning outcomes (#feelings) that can tie in especially to feminist and critical pedagogy. Lisa Hinchliffe made some great points:


Although we do have institutional constraints in many cases and need to work with/around those, there are still a lot of opportunities to use assessment for more than just measuring required quantification. Perhaps this is a topic that could use more discussion in future #critlib chats!

August 15, 2014

Instructional design for librarians

image via edtechdojo.com
Instructional design (ID) is an important component of good instruction to understand, but because most librarians (myself included) were not trained in this in library school or afterward, it is something that we should catch up on to close the gap in our knowledge and skills. ID helps an instructor connect learning goals/outcomes with instructional practices and assessment in order to create a learning experience that could be more efficient and effective for learners. I'm sure most would agree that initial instruction experiences for librarians are trial-by-fire. 

ALA invited me to teach a course on an instruction-related topic for these reasons and so I thought instructional design would a good way to cover principles for both face-to-face and online teaching in any type of library. I asked Erica DeFrain to join me in teaching since she has some serious skills, as well as degrees in Instructional Design and (finishing up) her PhD in Educational Psychology. If this interests you, more information follows!

Course Instructors: Nicole Pagowsky & Erica DeFrain
September 15 - October 15, 2014

This four week, online course will allow you to work at your own pace while receiving feedback on projects and having conversations with your instructors and coursemates. Upon completion of the course you’ll have a fully developed lesson plan that includes pedagogically sound instructional strategies and a meaningful assessment plan.

What you will get out of this course:
  • How to use an instructional design (ID) model to create your own teaching, while being critical of the limitations of ID
  • How to leverage learning theories and knowledge of student motivation to create more compelling instruction
  • How to integrate assessment holistically into your curriculum, lesson, or learning object so that you can help students reflect on their own progress, while you reflect on your teaching
  • How to critically select and position technology within your instruction to enhance student learning
  • How to develop an awareness for critical pedagogical practices to create inclusive classroom atmospheres or learning objects
      
Erica is fancy - here is her instructor bio if you aren't familiar with her work:

Erica DeFrain is a librarian with over ten years of professional experience developing and designing instruction. In April of 2014 she joined the Research and Instructional Services department at the University of Nebraska - Lincoln as an Assistant Professor and Social Sciences Librarian. A doctoral candidate in Educational Psychology, she has an MLIS and MS in Educational Technology from the University of Arizona. A huge fan of the Guide on the Side, one of her Guides was featured as an ACRL PRIMO Site of the Month in April.


Nicole Pagowsky is a Research & Learning Librarian at the University of Arizona, and is the liaison for online learning, student retention and success initiatives, general education, and the College of Architecture and Planning. Both her MLIS and MS in Instructional Design & Technology degrees are from the University of Arizona. Nicole's research focuses on game-based learning, student motivation, and critical pedagogy. 


Hope anyone interested will join us, feel free to contact either Erica or myself if you have questions.

September 9, 2013

Reflection on Feminist Pedagogy for Library Instruction (book)

image from powderroom.jezebel.com
I just finished reading Maria T. Accardi's Feminist Pedagogy for Library Instruction (Library Juice Press, edited by Emily Drabinski). Aside from it resonating with me because I do try to employ critical library instruction and feminist pedagogy when I can, a lot of what Accardi discusses in the book also relates to what I'm doing with digital badges and also student retention.

First, for some background, Accardi explains that feminist pedagogy resides within critical pedagogy. Feminist pedagogy might carry the misconception of being instruction about women and feminism. Although it can often be related to that and employed in women's studies courses, it can be integrated in any form of curriculum. It typically exposes students to issues hidden in society, particularly injustices based on race, class, ability, sexual orientation, etc., and of course gender. Accardi quotes bell hooks (1994) for a concise description: "Feminist teaching techniques are anti-hierarchical, student-centered, promote community and collaboration, validate experiential knowledge, discourage passivity, and emphasize well being and self-actualization" (hooks in Accardi, p.31). To explain this further, it's to help students develop a critical consciousness and be able to take action on their learning.

So I wanted to look at some of the work I'm doing through this lens after this book made me think more clearly about what I am trying to accomplish.

Digital Badges: one of the issues I'm really struggling with for our badges are in scalability. There is a conflict between reaching many with limited FTE (meaning having automatic assessments that don't require intervention) versus reaching fewer, but retaining the ability to provide meaningful feedback and interact with students. One thing about badges is that typically they are awarded for rigid criteria. In a sense they need to be because a badge means something specific and ascribes value to a particular skill. So, if you have no concrete way of measuring this skill to determine if a badge was "rightfully earned" or not, what does it even mean if anyone or no one can actually obtain it? On the other hand, I believe students need to create their own learning and be proactive (feminist pedagogy), and I don't believe there should necessarily be an authority figure telling them what is right or wrong in absolute terms. Obviously, I know more about information literacy than they do, so I would need to develop content, etc., but as Accardi explains, feminist pedagogy is about being a guide and a facilitator rather than an all-knowing "sage-on-the-stage." A lot of the badges I have created focus on affective outcomes, students developing their own meaning of content, and opportunities for reflection and relating material to students' own lived experience. It's difficult enough to measure this as it is, let alone within the more rigid confines of a badge rubric. Not all badges need to be this way, but when attempting to design a suite of badges for campus, making as many automatic as possible without intervention on a 40k campus with 10 FTE instruction librarians tends to be more desirable. Using an automatic multiple choice quiz to determine skill acquisition is an easy, yet banking-model-esque method to award badges at scale. So something here I am trying to figure out is how to use feminist pedagogy but be simultaneously efficient? I'm working on some ideas for this, but it's certainly a point for discussion. How do you reconcile this in your teaching, particularly when instruction is for high numbers of students?

Student Retention: another area that I focus on. How conflicting that student retention is measured in rigid, big data and explained ROI, but it turns out some of the most effective methods to retain students include providing opportunities for personalization, social involvement, and affective learning outcomes. A lot of the instruction I do, and particularly for student success courses and "at-risk" groups includes promoting greater awareness and comfort in the library, rather than an explicit focus on content. I think student retention work would benefit greatly from feminist pedagogy, as would library instruction in general based on the high anxiety many students feel when using the library (and as Accardi does touch on).
This is my brief rundown of my most current thoughts from reading this book. I thought it was a great introduction to understanding feminist pedagogy and how it can be applied to library instruction. Accardi talked about her experience with the ACRL Immersion Program and also talked about issues with ACRL Standards, which I'd like to address in another post.


July 22, 2013

Grading and assessment, water and oil?

As I've been getting ready for ACRL Immersion 2013 Program Track (I leave in 1 week!), I've been finishing up a lot of readings on assessment. I've actually been really glad to read these articles, because as I've better solidified my notion of assessment through applying it to the instruction I am doing, I am finding my ideas are aligning with what I am reading.

The pattern I am finding in these readings is that assessment needs to be more holistic; assessment should be a method for students to learn rather than a focus on evaluation; and assessment should provide ongoing, meaningful feedback for students to practice instead of being judged.

We are wrapping up the summer semester with the badges pilot, and Purdue Passport incorporates assessment within earning a badge. Typically, a badge is given after a skill has been achieved, where assessment is more evaluative and judgmental rather than to provide feedback for improvement. This clashes with how I would prefer to teach and use the badges, so I've been using the feedback/assessment mechanism in Passport differently than it might be intended.

This is good because I think students are getting more out of the class, but also poses some conflicts:
  1. If badges being awarded are not based on more rigid judgement of skill acquisition, how valuable are they?
  2. On this note, how interoperable are they? Can their qualities be translated or compared to other institutions or libraries offering similar badges if desired evidence isn't as clearly enforced?
Because this is a credit class, grades need to be tied to student work. For this, the badges are essentially pass/fail. You either earn the badge or you don't. If a student is late in finishing badge work an exception is made to give them half off, but this is the only partial credit awarded. There are pros and cons to this as well:

Pros: Students can take risks in their responses and have less fear of failure (this positive aspect is rooted in game mechanics); I can focus more on the quality of my feedback rather than what level of good or bad the student's work falls into

Cons: How is good student work differentiated from bad work? Particularly if bad work is due to sloppiness or disinterest. Shouldn't a student who submitted excellent work (or evidence) for a badge be awarded the badge, where less stellar work would not be awarded the badge? Isn't the purpose of awarding badges to demonstrate that a skill was successfully acquired?

I have such mixed feelings on this. But one feature of Passport is to allow students a re-do. I use this often for sloppy work. I will leave feedback explaining exactly what I'm looking for and give the student a second chance (next semester I will be sharing specific rubrics for each badge with students so they have an even better concept of what level of understanding is desired). 

I am not a stickler on lower-level concepts like formatting a citation perfectly or memorizing exact steps on how to find an article when you only have a citation (these are specific assessments in the class to address more basic skills within learning outcomes). If a student has most of a citation right but forgets to italicize the journal title for MLA style, it's really just busy work for them to make them re-do it or for me to take points off. I leave feedback letting them know they mostly got it and to remember to double check these things for formal papers; and then I give them all the points. I love Barbara Fister's 2013 LOEX Keynote (in fact, my team read it as part of our strategic planning for the new fiscal year). I agree so strongly with her whole presentation, and using a specific example here, "very rarely outside of school are citations needed." I care way more about if students are able to understand what the purpose of a citation is and to incorporate this into their new understanding of "research as conversation" than about styles and how to format.

One assigned article that has been part of this class for a long time is a CQ Researcher article on cheating: why students cheat and how they cheat. It's interesting to see what students agree with in their reflections and a number do say that when a student doesn't feel course material has real application in their lives (or when an instructor provides little to no meaningful feedback), a student has no motivation or investment to put in quality work, and so cheating is easy. Focusing less on grades and more on understanding and a conversation between the students and us as instructors creates a richer experience for all. Their reflections resonate well with what we're doing in the course to make it apply to their lives, to attain better work from them, and in turn to provide more meaningful, continuous feedback. This also allows for continuous improvement on our end; the crux of assessment. 


April 28, 2011

Let's talk about SACS, baby

Recently, I’ve been appointed to the Office of Planning, Assessment, and Research during part of my time to assist with accreditation for the college. Texas is in SACS territory (Southern Association of Colleges and Schools), so we are following their guidelines for reaffirmation. I am assisting in collecting, organizing, and creating both a paper and digital library of all accreditation documents. This is something entirely new to me, so it’s really helpful to learn more about the college and I’m getting to interact with more faculty and administrators than I would have been able to otherwise.



Although learning in library school that comprehension of the parent institution’s mission and goals is essential in understanding the library’s connection to the college, that understanding didn’t go too much more in depth on the institution side.


How accreditation works is that there are various compliance numbers to consider, such as -- 


Core Requirement 2.9: The institution, through ownership or formal arrangements or agreements, provides and supports student and faculty access and user privileges to adequate library collections and services and to other learning/information resources consistent with the degrees offered. Collections, resources, and services are sufficient to support all its educational, research, and public service programs. (Learning Resources and Services)


-- for example. This one in particular is geared toward the library, of course, but there are others like...


Comprehensive Standard 3.3.1 The institution identifies expected outcomes, assesses the extent to which it achieves these outcomes, and provides evidence of improvement based on analysis of the results in each of the following areas...


So for each, the college needs to gather evidence and also write a narrative reflecting how the standard has been met and incorporate how the evidence proves this to be true. So as for the library and many other areas of the college, instruction, physical space, staff, and more don’t just have their own assessment to consider, but also assessing an area or a program for accreditation purposes.


The tricky part for what I’m working on is that there are hundreds of pieces of evidence, with more being added as time goes on. On top of that, certain pieces can be used for multiple compliance numbers. Although much of our evidence is housed online, I have learned that SACS prefers to view the materials in an offline format (read: PDF), so simply providing URLs is not an option. It’s also preferable to SACS to be able to easily find cited portions of documents in the evidence (save the time of the user). To improve this capability, I am creating one master copy in a master evidence file, and then in each compliance number file, a document with extracted pages (if necessary) and/or highlighting is saved for easy access. This comes in handy when there is a 100+ page piece of evidence! Likewise, in a born-print format, documents must be digitized. As this is the first year a digital and official paper library is being created, there is a lot of organizing and archiving at the outset.


This is certainly a project I will be reporting on as time goes on!