Category Archives: Ruminations

DML 2014: a Conference Occasionally Practices what it Preaches

Every conference needs a cute canine ambassador - here, Catie Copley
Every conference needs a cute canine ambassador – here, Catie Copley

Another novel experience: last week, I had the pleasure to attend the annual Digital Media & Learning conference, held this year in downtown Boston (luckily for me, as I live nearby). It was a grand feast for thought in an opulent setting (the venerable Fairmont Copley Plaza hotel), and it’s taken me several days to digest it. I went there seeking edification, connections, and the nurturing of my personal mission; I found all three in spades, as I’ll describe further on. But I was also looking for illustrations of the use of digital media (apropos the conference title) and participatory learning (a key theme in many of the sessions); I was a bit disappointed to find little practice of those in the conference itself.

Continue reading DML 2014: a Conference Occasionally Practices what it Preaches

Renovating Education from the Grassroots

In their excellent 2009 book, “Rethinking Education in the Age of Technology”, Collins and Halverson argued for a collaborative, gradualist approach to reform, encouraging schools to be more flexible in adopting new learner-centered models, exhorting technology leaders to persevere in pressing for progress, and urging for continued government oversight to ensure equal opportunity across the socioeconomic spectrum. I applaud Collins and Halverson for advocating a range of technology-based solutions, including game-based learning, and being considerate of the many stakeholders in the picture. However, they also admit that the schooling establishment is extremely conservative, which is not surprising: schooling systems and technologies became optimized for the behaviorist, authoritarian, industrial-era model of education, and they are well-entrenched. The educational-industrial complex is like a battleship, in which even attempts to repaint some decks in brighter colors is treated as sabotage. Witness the formidable opposition to voucher programs, the regulatory efforts to constrain and hamstring charter schools, the burdens faced by homeschoolers, etc. So I’m very skeptical that a top-down gradualist approach would work to accomplish substantive change: school leaders have no incentive to undermine their own authority, tech business leaders don’t see an advantage to their bottom line, and government officials want to get reelected by an adult citizenry that (mostly) was raised to respect authority. At best, we’ll see change at the rate of continental drift.

At the other extreme are some radical cultural leaders, in both likely and unlikely places. For instance, in June 2012 I attended a symposium on digital games in education, at which one of the panelists, the president of a college in Massachusetts, advocated for tearing down the current K-12 education system and replacing it wholesale. However, revolutionary change of this sort is impossible at the moment: millions of decent, law-abiding, tax-paying people are dependent for their livelihood and identity on the current schooling system, and they empower the system to fight for its survival. There is no unified opposition. Most of the potential beneficiaries of the sunset of traditional schooling (kids and their families) don’t see a better alternative. So a high-profile revolution, led from the top, is highly unlikely within our lifetimes.

What approach, then, has a chance of succeeding within a decade or two? Our best bet is a grassroots movement, a velvet evolution, quietly civil disobedience, a leaderless campaign to win hearts and minds. I don’t have a recipe (and frankly would be skeptical of anyone who claims to have the “perfect solution”), but here are some possible elements:

  • promote public awareness and appreciation for modern neuropsych research supporting learner-centered, game-based learning (“it’s good for you!”)
  • promote alternative competency credentialing (e.g. badges, certificates) for entry to meaningful employment
  • develop low-cost, scaleable, learner-centered epistemic game systems and demonstrate their efficacy
  • promote the proliferation of semi-formal learning contexts using game-based learning, like after-school programs (but all-day!), some private, others government-funded
  • provide a migration path for educators to escape the classroom: encourage those willing to grow into new roles (facilitator, mentor …); give early retirement to those who aren’t willing
  • demonstrate the cost-savings of the last two elements to government entities; start with cities that are already bankrupt (or on the verge)

I think this sort of approach might best be described as renovation, not the more commonly-used reform. Reform connotes an attempt to change bad behavior (as in “if you don’t shape up, you’ll be sent to reform school”), and that subliminal image tends to antagonize the stakeholders in the current educational system. Renovation (“making new again”) has a much more positive connotation of taking something worn-out, or dilapidated (furniture, buildings) and transforming it so it is once again useful and desirable.

So let’s stop “waiting for Superman” to reform education with another centralized, one-size-fits-all solution. Let’s instead band together, quietly but purposefully, to renovate education and make it serve the needs of people today.

Putting the Tech Cart before the Theory Horse

I recall learning, in my pre-service teacher-training courses at Harvard, MIT, and Wellesley College, several popular theories of effective pedagogy: constructivism, constructionism, multiple-intelligences, situated learning, authentic assessment, UDL. Though some of these theories perhaps didn’t meet all the stringent criteria propounded by Logical Positivists* (clearly-defined outcomes, construct specificity, propositions that pass absurdity tests, etc), they all appeared to be supported by some research evidence from neuroscience or sociology. Furthermore, most of these theories were not novel, having been promoted and studied for a number of years. So I naturally expected to see at least some of them in prevalent use in schools.

Imagine my disappointment, when I began teaching in large, well-financed public high schools, at finding scant usage of those theories. Instead, I found the same Skinnerian behaviorism (extrinsic rewards and punishments), tabula-rasa pedagogy (pouring knowledge into students’ heads), and factory-model organization (one-size-fits-all, sequential, lockstep, compartmentalized) that I remembered from my own days as a student, decades earlier. Furthermore, I observed that my and other teachers’ efforts to introduce new practices based on progressive theories of learning met with subtle but powerful structural resistance; it was an uphill struggle, leading many idealistic new teachers to disillusionment and burnout. I was bewildered: how could these supposedly good school systems be so out of sync with the educational theory advanced by top-notch universities?

It took me several years to discover and acknowledge the answer: the difference lies in the desired outcomes. As described in recent years by various scholars (Gatto; Collins & Halverson), our traditional system of compulsory K-12 schooling is very conservative in maintaining the goals of its industrial-era roots: conditioning kids to become compliant consumers and factory workers, ensuring conformity, and sorting by easily-quantified abilities (mostly low on Bloom’s Taxonomy). In spite of the lip service that principals and superintendents often give to progressive ideals (deep learning, critical thinking, differentiated instruction, etc), the theories fundamentally at work in schools are those that serve the now-unspoken goals of the industrial era. No wonder that innovative school practices and technologies that would serve progressive goals tend to be hobbled, co-opted, or fail outright.

I think this explains the fate of many school tech fads in recent years: smartboards,  one-to-one laptop programs, lecture videos. They were sold as ways to advance the noble ideals in the cause for “reform”; but in many cases, school leaders have hastily implemented these technologies without first carefully examining the underlying pedagogical theories and structures. In such cases, the new technologies have generally failed to produce the envisioned transformations.

How can game-based learning avoid a similar fate in traditional K-12 schools?

* e.g. Briggs (2006), “On theory-driven design and deployment of collaboration systems”


My Fave Games

Over the years, my favorite games have been multi-player “party” games with creative/expressive mechanics: Charades, Pictionary, Scattergories, Scrabble, … (not necessarily in that order). From the point of view of mechanics, they have some key features in common:

  • The core mechanic is simple and familiar: gesturing in Charades; sketching in Pictionary; thinking of and writing words in Scattergories; forming words from a set of letters in Scrabble.
  • They are turn-based, usually with a time limit (though not always).
  • There are many “right” ways to successfully accomplish the core mechanic: e.g. different gestures or drawings to convey a term in Charades and Pictionary; different words that can match the given category in Scattergories; etc.
  • There is an element of luck (being assigned an easier/harder term, category, or set of letters …), but success primarily depends on the player’s skill, which can be improved with practice.
  • The player’s attempted solution on each turn must be validated/arbitrated by other players: teammates have to guess the correct term in Charades and Pictionary; other players must agree to the validity of words produced in Scattergories & Scrabble; etc. This leads to a lot of interesting (and fun to resolve!) disputes, which require frequent reexamination of the formal constraints.

Game Design as Hypothesis – Research Studies on GBL

When does it make sense to design a learning game to answer a research question, and then test it with rigorous scientific methodology? Let’s consider why that approach worked well for Re-Mission, but not so well for other kinds of serious games (especially those intended for use in a school setting).

Tate1 describes a process, “Rational Game Design,” that worked well to address a research question regarding cancer treatment. This process emphasized iterative product optimization through formative research, as in biomedical targeted-drug development:

“Empirical testing is the best way to resolve conflict: When in doubt, collect data — the right answer is the one that best changes the target behavior in teenaged cancer patients.” (page 31)

“On many occasions, conflicting visions emerged in efforts to synthesize fun game play, cancer biology, and behavioral science. In those cases, player-focused data collection provided the basic recipe for choosing the right answer. Empirical demonstrations that ‘that’s what kids want, and it works’ played a major role in helping health professionals embrace a video game based on shooting, stool softener, and a sassy back-talking protagonist.” (page 33)

That description, along with the research analysis in the accompanying Kato2 paper, makes it clear that the success of such a design process is predicated on measurement: quantitative and qualitative, baseline and outcome. The feasibility of such measurement is determined by the theoretical framework, the intended primary outcome, and the constraints of the research setting. The case of Re-Mission was particularly well-suited for the measurement requirements of this design process: it employs a behaviorist approach; the intended primary outcome is easily measured (performance consistency of self-treatment protocols); the setting allowed for self-paced, occasional gameplay (1 hour or less each week) over a few months with periodic measurement. Furthermore, the informal, low-risk context of the gameplay made it easy to conduct a randomized controlled trial: the study participants had the freedom to spend one hour a week playing (or choosing not to play) a computer game that was entertaining, and possibly therapeutic (in the intervention group).

Contrast that case with studies of other sorts of serious games, especially academic learning games focusing on higher-cognitive or constructivist objectives: the intended outcomes may not be uniform or easily measurable; the setting is often intensive, requiring prolonged and coordinated gameplay over a shorter timespan (perhaps only a few weeks), which is not conducive to measurement of gradually-emergent or long-term effects; formal accountability requirements (e.g. test scores) hamper the ability to randomly place participants, lead to confounding factors, and may even stymie the definition of a “control” group. The difficulties and delays in measurement are also likely to stretch out the product iteration cycle. Little wonder that, in Video Games and Learning (2011), Squire rails against the “gold standard” (randomized controlled trials) for game-based learning studies in schools, considering the theoretical framework and sorts of outcomes that he advocates.

1          Tate, Haritatos, and Cole (2009). Hopelab Approach to Re-Mission. International Journal of Learning and Media, 1, 29 – 35.
2          Kato, Cole, Bradlyn, and Pollock (2008). A Video Game Improves Behavioral Outcomes in Adolescents and Young Adults With Cancer: A Randomized Trial. Pediatrics, 122, e305 – e317.


Meditations on Learning Theories: from Solitary to Collective

Kolb’s Discovery Learning theory* organizes phenomena along two orthogonal axes: the Processing continuum (active experimentation ßà reflective observation), and the Perception continuum (concrete ßà abstract). The perception continuum seems compatible with constructivism, which (as I understand it) holds that concrete experiences are organized and generalized to form abstract concepts, which then can be applied to interpret and act in new concrete experiences. However, the processing continuum as framed in the lecture seems inconsistent with studies I’ve read about game-based learning. While play alternating with reflection is reported to be effective in promoting deep learning, the reflection must be active: merely watching is not enough; the player must articulate and express questions or conclusions drawn from observation.

Following an explanation of Socio-cultural Theory, Professor Carrie Heeter asked students (in the MSU course “Theories of Games and Interaction for Design”) to consider how the social construction of learning can be fostered in game design and in structures surrounding gameplay. In thinking about the real world, it seems to me that not all knowledge requires social construction: for instance, it’s possible for someone to discover natural laws and properties, and even to figure out how to apply them in devising technology, without engaging in any social communication, as plausibly fictionalized in Robinson Crusoe and the movie Cast Away. This is also the case in many excellent single-player puzzle games (e.g. Waker, Acorn Story) that are virtually wordless. However, the use of language and social interaction enable quicker, more complex, and more effective learning, even through asynchronous communication media such as written text and video. Furthermore, human beings are fundamentally social creatures, and our neurological systems are wired to reward social interaction; the emotional payoff motivates us to persevere and helps us remember. I’ve observed first-hand the benefits of in-person and online game-based interactions involving my family members, both in-game (multiplayer role-playing, in-game chat) and around-game (my wife coaching my son from the side, or watching video walk-throughs together). I think it’s important for game designers to consider, for any sort of game, what forms of social interaction would be afforded.

Finally, collective intelligence (or “crowdsourcing”) can be a powerful dynamic: whether used in games by design for problem-solving, as in scientific research (FoldIt) or alternate-reality games (I Love Bees, Vanished); or as an emergent behavior of real-world social systems (bird flocking, the stock market, and the 2011 “Twitter revolution” in Egypt). I think it is important for people to understand this dynamic and how it may play a role in their lives; so that instead of being manipulated by collective processes, they can be empowered to choose whether and how to participate.

 * Kolb, D. A. (1984) Experiential Learning, Englewood Cliffs, NJ.: Prentice Hall