Measuring Student Work

My provocation builds off one of the many questions from last week’s class–how can we teach “off the template” in a way that still teaches technique? In other words, how can we teach our students to engage critically with the course material without employing convenient but stale “templates”? In teaching writing, for example, are we bound to teaching the five-paragraph essay or paragraph structure, in order to understand the function of claims, evidence, and analysis in written work? Isn’t that template the easiest way?

After this week’s readings, it seems to me that the problem goes deeper than this question of method. It goes to the very assumptions of the course itself, which is tied to specific learning objectives. These learning objectives assume that “learning” occurs when the student can demonstrate her skills for “critical thinking” and “analysis”. For example, I’m including the learning objectives from the English 220 course I teach at Hunter college.

  1. Write thesis-driven analytical essays on all three genres (Poetry, fiction, drama) that incorporate evidence from the literary texts and demonstrates close reading skills.
  2. Write an analytical research paper of at least 6-8 pages that demonstrates close reading skills and the appropriate use of evidence from literary texts; the ability to create a clear thesis statement; and the ability to incorporate and engage scholarly critical sources as part of a well-organized, thesis-driven argument.
  3. Discuss fiction, poetry, and Shakespearean drama verbally through the use of close reading skills and, where appropriate, basic literary terminology.
  4. Demonstrate some familiarity with literary criticism in class discussion or writing, or both.
  5. Demonstrate the ability to compare and/or contrast literary works.

All of these objectives boil down to some basic requirements: demonstrating “close reading skills”, the “appropriate use of evidence”, argumentation, “familiarity with literary criticism” and ‘basic literary terminology”, in the form of “thesis-driven analytical essays” and class discussion. Reading over these requirements, it seems to me that the course is not so much encouraging students to think critically as it is teaching them to mimic a process that has been time-tested in teaching literary analysis. If the student can demonstrate familiarity with literary terms, criticism, and close reading skills, and the proper use of evidence and argumentation, all within thesis-driven essays, then she will have passed the course. But none of these requirements address the student’s personal response to the text, what she brings to the table, and her grappling with the text.

The problem, it seems to me, is that we are measuring students on performance, on the final product, rather than on process. Amelia Abreau writes about the difficulty of quantifying moments of struggle and emotional toil, which often occurs in caregiving. She begins her article by saying that, currently, there is no way to quantify caregiving (such as the work of caring for a young, dependant child), and suggests that we ought to imagine data gathering in ways that empower caregivers and other low-wage laborers, rather than aim for “near-perfect, near-universal metrics”. Abreau questions: “Rather than seeking to perfect measures and standards of that work through statistical working-over, can we envision workers taking their own data to management to improve working conditions?” Abreau’s article encourages us to apply quantification in new ways, in order to measure what has previously been overlooked or has been unmeasurable.

My provocation, then, takes this example from caregiving into the classroom: How can we assess students on their moments of difficulty and struggle, rather than on the final product? What specific ideas do you have for “measuring” student’s challenges with the course material?

And, to take this in another direction—how can we employ the “connectivist” nature of learning with digital tools (a topic touched on by many of our readings) in order to enhance the way that we measure moments of difficulty and struggle? I’m thinking specifically of the opportunities opened up by collaboration and group work across networks. The Femtechnet Manifesto, for example, asserts that “Collaboration is a feminist technology”. How can we make the struggle that students undergo when grappling with new concepts more visible by assigning collaborative work?

Motivation: 3/12 Connectivism: A Learning Theory for the Digital Age

“Connectivism: A Learning Theory for the Digital Age” December 12, 2004 George Siemens

As an educational technologist, I was at first skeptical since this was published in 2004. Sometimes reading articles, research, or theories about technology or our approaches to it, I am skeptical that it could be a bit outdated in 2018. However, I believe that Siemens brings up fundamental concepts concerning our approach to technology and the theoretical frameworks that shape our thinking that is relevant in educational environments. I even think he shares some prophetic truths our students and teachers are facing today. In fact, I think I found my new favorite learning theory!

I spend a lot of my time thinking about the best approaches Schools of Education should take in teaching educational technology for pre-service educators because of my unique positioning as a high school English teacher and Adjunct Professor. In NYCDOE schools, I feel like the conversations Siemens wants us to have are happening within clusters of very passionate educators who understand the way that technology can transform classroom learning. However, this seems to be happening in the K-12 environment since it is absent, or not refined, in the Higher Education sphere.

Ultimately, no matter what the learning environment, there are fundamental similarities about the way that we learn that we must consider when thinking about pedagogy. Siemens writes that “Technology is altering (rewiring) our brains. The tools we use define and shape our thinking.” As a millennial who grew up without smartphones, went to school without interactive whiteboards, and is a teacher where technology is everywhere, I also consider the way that technology has re-wired our approaches to teaching environments.

Another part of the text that struck me is when he writes that “Informal learning is a significant aspect of our learning experience. Formal education no longer comprises the majority of our learning. Learning now occurs in a variety of ways – through communities of practice, personal networks, and through completion of work-related tasks.” This made me question, well, what is formal education anymore?

I enjoyed the concept of Connectivism as a theory since I think it encompasses, or perhaps even perfectly summarizes, my approach to education: “Connectivism is the integration of principles explored by chaos, network, and complexity and self-organization theories. Learning is a process that occurs within nebulous environments of shifting core elements – not entirely under the control of the individual.” To me, this translates to that learning is continuous and not limited to the classroom and that we can use technology to empower us as educators and learners. Technology can bring learning alive and — in its own way — is nebulous too.

____

Provocateur questions:
Siemens closes his essay writing that “The field of education has been slow to recognize both the impact of new learning tools and the environmental changes in what it means to learn.”

1. I am curious as to what ways people think they have seen this statement as True or Not True according to their own experiences in education (K-12 or Higher Ed).
2. When Siemens references nebulous, he says that “learning occurs within nebulous environments.” When looking up nebulous, one of the definitions describes “in the form of a cloud or hazy.” I think it’s ironic (and potentially prophetic) that we now collaborate and operate a significant portion of our technological lives in “the cloud.” How has cloud-based learning (like Dropbox, drive, iCloud) enhanced the meaning of connectivism since 2004?
3. The other day, the company Mursion was brought to my attention by a technologist colleague. They are a VR/AR company that simulates real-life experiences to refine essential skills for practitioners. How can the idea of connectivism play a role in learning with new and innovative technologies that are now emerging like these?

Collaborative Assignment Design Assignment

ITP Core 2, Spring 2018: Collaborative Assignment Design Assignment

You will collaboratively craft, with at least one student from another discipline, the scaffold for a final project in an undergraduate course that engages with one or more of the core ideas explored to this point in your ITP experience. (Your work on this assignment can link to your own final project for our class, or your own field, or a class you actually teach, but none of that is required).

We’ll discuss the details for this assignment in class on March 5th, and the assignment plan is due on March 24th, when you and your partner will post to the course blog the scaffold of a final project with at least three discrete, connected tasks, intended for an undergraduate course. All groups will read all assignments, and we will discuss in the first hour of class on March 26th.  

The post should have the following elements:

  • A brief statement of the context of the course (discipline, level, institution type, instructional mode, is it real or imagined)
  • A statement about the place of the assignment within the larger learning goals of the course; why is it the final?
  • A draft of the assignment, addressed to your students
  • A statement of the technologies used in the assignment, and why
  • The criteria you’d use to evaluate the assignment

Midterm Assignment

Your midterm assignment will be to create a project proposal that has two scope variations: one full, and one reduced version.

Your proposal should follow this structure:

  1. An introductory descriptive paragraph, which should include a problem statement, and say *what* your tool/thing will do.
  2. A set of personas and/or user stories.
  3. A use case scenario (where would someone find your tool/thing and how would they use it). Keep it short.
  4. How you will make the full fledged version. This is your “ideal world” version that fulfills all of your visions and fantasies (what tools you will use, how you will get them, how confident you are that all the moving parts will work together, etc).
  5. Your assessment of how much time the full-fledged version will take, and how much of the skills you currently know and what you would have to learn.
  6. How you will make the stripped-down version. The stripped down version is the minimally viable product. It is the most *bare bones* version to prove that what you are trying to get at is viable. (what tools you will use, how you will get them, how confident you are that all the moving parts will work together, etc)
  7. Your assessment of how much time the stripped-down version will take, and how much of the skills you currently know and what you would have to learn.

You are welcome (but not required) to repeat the last two steps with scope variations in-between the full fledged and bare bones version.

In previous years, this assignment asked you to propose two projects. If you are, indeed, trying to choose between two projects and fleshing them both out would be useful for you, you can fulfill the midterm assignment by offering what’s above for each idea, minus the stripped-down version.

The proposals will be submitted using Social Paper on April 5th prior to class. You will be asked to review and leave substantive comments on at least two classmates’ proposals before class meets on April 9th.

Class that week will be dedicated to workshopping the proposals. The format we will follow will be that each participant will choose one of their two proposals to present orally. You will have 5 minutes to present, and we will have 5 minutes for feedback. Think of this as a pitch. You will want to lay out the project abstract, present very short versions of your personas, give one use case scenario, and then talk about how you would build it, and how long you think it would take.

Motivation: March 5th Readings by Kahdeidra

Hey! This is cool! As some of you may know, I am a former special education  teacher and coordinator of after-school programs. Thus, I have experienced a lot of trial, error, heartache, surprises, and major wins in discovering how to engage learners with diverse interests, skill sets, and goals (PROBLEM).

I have separated this provocation into three prompts, and you can feel free to respond to whichever one speaks to you the most, or try your hand at a combination of the three (CHOICE).

  1. Bean’s chapters on integrating writing and critical thinking in the classroom makes several interesting arguments about the value of writing. Bean’s central argument is that writing is both a process and a product. When the connections between writing and critical thinking are explored, the value of writing as a process can be gleaned. Once writing is imagined as packaging, he argues, devoid of thinking and creating, it loses value among learners (Bean 16). He gives examples of how different European cultures have words to express the concept of writing as a process (ie. ‘brouillon’ < French which means to scramble, to place in disarray). English does not have an equivalent concept. Another example that I can think of that the English word ‘essay’ is derived from the French essayer (to try, attempt) and essai ( a trial). Currently, we retain the meaning of essay as an attempt or endeavor in formal use, but the most common usage is for a structured composition. The dual meanings of ‘essay’ as both a verb and a noun illustrates Beans’ argument of writing as a process and a product. Why and how did we come to emphasize the product over the process in the United States? Is this related to a larger discourse on experimentation and conformity in schools? What do you think?

2. In Chapter 3, Bean addresses cultural assumptions about the centrality of writing in academia, and argument writing being the preferred “academic discourse” over other modalities in particular. Was it satisfying to you? How is his rationale in conversation with UDL principles? Do you agree with his characterization of “three cognitively immature essay structures” as “organizational problems”? Be honest. Does it vary by context, or are these structures universally flawed?

3. The three principles of Universal Design for Learning–multiple representation of content, multiple opportunities for expression and action on new content, and multiple opportunities to engage in learning–have been the most useful for me as an educator. It provides a cognitive basis for addressing diverse learners by presenting difference as the norm, not as a deficit that minoritizes learners. Because cultural and neurodiversity are facts of life, curricula must attend to this diversity. My colleague Luis Oleander, who created the UDL for Teachers website (http://udlforteachers.com/), and I  have collaborated on topic briefs to explain how UDL can be used to support linguistically diverse students. Using the videos on his website, and the video on the SPS Faculty Community site, consider the following questions:

  • How does UDL align with the Composing practices of expert academic writers (Bean 30-31)?
  • How does UDL align with Bean’s conclusion on integrating professional and personal writing? Do you agree with these categorical distinctions in writing? Have you encountered and used expressive writing in your own academic courses? Explain.
  • Review the poster descriptions on “Do’s and Dont’s on Designing for Accessibility.” Is it possible to use the  UDL framework to consolidate the advice given? Why or why not? Are there any commonalities among the suggestions?

How to use technology to teach and learn?

The three readings discusses the use of technology from different and unique perspectives: what is the goal of teaching and learning? Coverage or developing fundamental disciplinary capabilities? How to use technology to achieve this goal? What affordances or characteristics of are conducive to achieving this goal? And how are they achieved? Under what circumstances?

 

Harbinson and Waltzer (2013) point out that the key to teaching history classes for undergraduate students, especially non-history major students, lies in how instructors perceive the goal of teaching. According to this article, the goal of teaching that can engage students and enhance their development is to develop their fundamental historical capabilities required for real historical studies. However, in reality, instructors usually put “coverage” as the main goal of teaching. This is the fundamental reason that they spend a lot of time on covering the basic facts of history.  Therefore introductory level history classes for non-history majors are usually reduced to memorizing historical facts. Students are thus not interested in this class based on the reduced and mechanical teaching model. In order to train students to learn the fundamental abilities of a historian, which are transferable to other disciplines and will be beneficial for their future academic endeavors, technology can play an important role in achieving the shift from “coverage” to “development of historical abilities”. How to do this then? Harbinson and Waltzer (2013)  illustrated the process of teaching history classes at Baruch with the affordances of Blog@Baruch and achieved “active, social, open, media rich, metacognitive, and immersive” teaching and learning experiences. Students are engaged in meaningful dialogues through such learning processes and fall in love with history.

 

Reflecting on my teaching, I think the reason that the shift from coverage to developing fundamental  abilities can be achieved successfully with Blog@Baruch is that the affordances of the technology give students the tools to find and express what they really care in a way that is unique to themselves. This has also provided me with a framework to study the use of educational technology. I could potentially investigate if the use of a certain technology gives students “active, social, open, media rich, metacognitive, and immersive” learning experiences. Are they facilitating active learning and knowledge production? Are they facilitating collaboration and interaction?  Are they open to students and instructors? How are they open?

 

The shift from coverage to ability development also means that students should be allowed to “digress”, using the word from Ugoretz (2005), from a single goal and path of learning, and actively explore their own paths to learning. This article points out that not only digression can not be simply “a distraction or a waste of time,” it can serve the purpose of facilitating “higher order thinking” and improving “student satisfaction”. The author illustrates the benefits of “productive digression” for teaching through the experience of teaching an asynchronous online course. The author finds that students explores their interests through threads on discussion boards of an online asynchronous course. According to Ugoretz (2005), positive digressions are student-centered, allowing them the opportunities to make connections between the course materials and their own experiences, so that they can achieve active and deep learning. Positive digressions are also open and collaborative. They encourage students to engage in deep and meaningful dialogues with each other through their own experiences. They have influence on life in general and expand the scope of education from classroom to real life connections. Students can also build communities through the discovery process of digression, collaborate with each other, and learn from each other.

 

Ugoretz (2005) identifies a problem that I had never thought about critically as a teacher: digression. I used to think like the teachers in the examples provided in the first few paragraphs of the article: there should be no “digression” in the classroom. Ever since I was an elementary school student, “concentration” was an absolute rule that should be obeyed in the classroom. Teachers would criticize students for even the slightest sign that may show that the students were “losing their mind”. In addition, the talk of the students should only be related to the questions that the teachers asked, and other “talks” will be regarded as “irrelevant” and even “disruptive” to classroom teaching. Students who made those talks would be asked to “summon” their parents to school and discuss how to “concentrate” in class.

 

I think “digression” is very useful in designing teaching and learning. In my own teaching, I should make sure that there is space for students to make positive and productive “digressions”, and not be obsessed with coverage. I should take the text book or class materials as a starting point, to really let students explore what they are interested in and engage in dialogues they are passionate about, so they can learn actively and achieve deep learning. I should use the affordances of technology mentioned in Harbinson and Waltzer (2013)  to achieve such goals.  This is also important for doing my project. It tells me that in teaching or using technology in teaching, a teacher should leave space for students to explore and discover their own interests and not fill the precious  learning space with what the teacher thinks should be covered but may not be beneficial to students’ learning and development.

 

Smale and Regalado (2017) analyzes the “affordances and barriers” of educational technology through the “learning space” where they are present. This book analyzes the answers of a survey from undergraduates from several CUNY campuses that aims at investigating the use of educational technology in their daily lives. A key point in this book is that “space” is “how you make use of a place”. For example, the a subway train is a space for transportation, but for some CUNY students, they are also a space for learning. Because they have a busy schedule, so they have to use what little time they have to study, including the long commute on the train. The affordances and barriers of certain educational technologies are studied in such non-conventional learning spaces. For example, it is crowded and noisy in a subway train and the internet access is low there. This environment is also unstable – students cannot have a comfortable space, like a desk or a bed, to study. Therefore laptops may create some barriers for studying in such an environment because it requires a relatively stable environment. Mobile phones may also create some barriers for learning because a lot of its features rely heavily on the access to the internet. This analysis demonstrates the importance of analyzing the use of a technology through the perspectives of “affordances and barriers” in specific time and space, which is inspiring for studying the affordances of my project. The categorization of fixed and mobile technology may also be useful for understanding the use of technology in my project. I can try observing the differences of mobile and fixed educational technology through analyzing articles in related academic journals.

Jing Zhao Project proposal

I am posting the link to my project proposal here https://dh2018.commons.gc.cuny.edu/. This project was conceived during my Digital Praxis Course last semester. During this semester, I have to do a group project for that class, so I decided to keep developing my project in this class. One of the problems that stopped me from continuing with the project was that I didn’t know how to study the use of a technology, such as “wiki”, in second language classrooms through analyzing academic papers on such topics with text analysis tools. In this semester, I found that the concept of “affordance” is potentially useful for solving this problem. In  Seven Affordances of Computer-Supported Collaborative Learning: How to Support Collaborative Learning? How Can Technologies Help? The authors developed a very useful framework for analyzing the use of technology. In this framework, there are seven affordances: establishing a joint task, communication, sharing resources, engaging in productive processes, engaging in co-construction, monitoring and regulation, and finding building groups and communities. I am thinking maybe I can use topic modeling to analyze the academic papers and see if the results of a single technology can fall into these categories. In addition, the book Digital Technology as Affordance and Barrier in Higher Education inspired me. The categories of mobile/fixed technology can be applied to my project when I am categorizing the technologies  discussed in the academic papers that are analyzed through text analysis tools.

Natacha’s Preliminary Project Brief

My project is to build an app for beginners to advanced French language users. The idea of that app emanates from the observation that many of my undergraduate students sometimes lack a platform in which they could broaden their knowledge of French. That is, they are most of the time restricted to what is proposed to them by the curriculum. This app is not then intended for students I usually call ‘class passers’ who are fine with what is offered – and at the time even  find it too much, but rather to those I call ‘Knowledge hunters’, actually willing to expand their learning perspectives

My target users are thus students, but this might be extended to any French culture and language lovers. I intend to provide them with a plate-form, an environment to express themselves through blogging, video, and live chat. In addition,   I will provide a space in which they could have updated news from the French and francophone world, namely from broadcasts as   RFI, or  Africa N 1. Furthermore,  I think of spaces where ‘clients’ could explore possibilities of traveling to   France  or  any others francophone countries(http://www.partirpascher.com)  and have a weekly or daily  playlist  of  French songs, and  connections to French  shopping sites(  fashion industry, museums, bookstores, etc.)

Because most students are ‘glued’ on their i-phones or smartphones, it would be more attractive if the app is deployed on a mobile phone carrier, in such a way that they could carry it along with them everywhere. That proximity and availability of their phone could develop a ‘positive’ addiction to French or francophone-related custom and usage, in such a way as to provide a type of natural-like immersive language environment.

Building such an app is surely a challenging task for someone who is still at his very debut in designing and programming. I know from what I tried to gather here and there that I would have to master the HTLM5  and the Java script languages which I don’t know yet.  However, the good point is that I am a hard-working person and a fast learner.