Posts

Sembl, the game of resemblance: presentation to NDF2012

This post is a web translation of my presentation to the National Digital Forum, Wellington, NZ, on 20 November 2012. (Video recording is here.)

Sembl, the game of resemblance

Hello, people. Thank you for having me on this land and at this forum. I’m utterly thrilled to be here – among you all – to talk about this project.

In its first form, Sembl is an iPad game, called The Museum Game, at the National Museum of Australia. We’ve just released it in beta as a program for visiting groups.

This video is a good way to explain how the game works. (It’s a DIY first attempt, so please look past the production quality and focus on the content.)

Feedback

Over the last year and a bit we’ve gathered feedback from children and adults about their experience of playing the game.

Four photographs of a paper playtest of Sembl Museum

In our first tests, we used a paper prototype; these kids used iPads to take photographs, but the board was paper, and they drew and wrote their moves on paper. Between rounds we had an analogue voting process to determine which team’s content made it onto the board. After the game, we prompted them to tell us a few things about their experience.

resemblance – quotations from school children in response to playing Sembl Museum

Several kids homed in on the principle of resemblance.

Quotations from students about the game Sembl Museum – social aspects

Others emphasised the social side of the game.

School children playtesting Sembl Museum in the galleries

Once we had a digital prototype, we invited the same group back. Again, after the game, we asked them for feedback. The next slide shows some of their responses to the question: What interested you about the game?

Quotations from students describing what interested them about the game Sembl Museum

Again, there was general interest in resemblance. But the kids are now also talking about being keen to explore the Museum, how the game used the exhibits, and democratic social curation. 

I find that fascinating. You might imagine that looking at a museum through a tablet computer would detract from the authenticity of the visiting experience. But for these kids, it seems like it actually draws them in.

Education

We also interviewed the teacher of those kids; she’s convinced of the value of the game for education.

(Here’s a longer extract of the interview.)

Play

Sembl provides a new way to connect to cultural heritage. It’s about play, which is not just for kids. It’s actually a powerful mode of thought, that we lose touch with as we grow up.

Makers of meaning – quotation of Derek Robinson

As a smart friend of mine says, we all need to recognise ourselves as a maker of meanings and engage in imaginative play. In this next clip, you’ll see a boy whose first language is not English, and historian Peter Stanley, both moving their bodies and struggling with words as they play.

The game gives visitors permission to let their minds wander, to make new kinds of connections, to think differently.

For the host institution, The Museum Game involves a kind of radical trust, and open authority – recognition that knowledge and understanding is not all about curatorial interpretation, that it also comes from visitors thinking and imagining and sharing ideas with each other. Which remains rare in museums, despite the fact that it makes the experience more compelling for visitors.

Dialogue

Another way of saying this is that the Game provides a structure and impetus for dialogue, between the museum and visitors, between visitors and things, among visitors and between things. And this is not dialogue in the sense of an everyday conversation. It’s deeper than that. It’s a mutual experience of looking both ways, simultaneously.

teachers and students are co-intent on learning – quotation of Paulo Freire

My notion of dialogue comes from the Brazilian educator, Paulo Freire, and his sense of teachers and students as mutually co-intent on creating knowledge.

Quantum physicist David Bohm was also a strong advocate for dialogue.

to hold several points of view in active suspension – quotation of David Bohm

Each of these notions of dialogue is premised on an understanding of consciousness and how thoughts shape reality. For Bohm, dialogue means holding several points of view in active suspension. He regarded this kind of dialogue as critical in order to investigate the crises facing society. He saw it as a way to liberate creativity to find solutions.

Game-based social learning

So the concept of Sembl, in its deepest sense, is social learning – game-based social learning. In its first instantiation, it is game-based social learning in a museum and – if things turn out as I hope they will – from next year it will be playable at any other exhibiting venue that has the infrastructure and the will to host games – galleries, libraries, botanic gardens, zoos and so on.

But The Museum Game is just one form of Sembl. The Museum Game is played in real time, on site, and players take photos of physical objects to create nodes on the board.

The next step is to make a web-based form, that you could play at your own pace, and from your own place. Then, Sembl becomes a game-based social learning network, which amplifies the personal value of the game – it becomes social networking with cognitive benefits.

Personal value aside, it’s the bigger picture – of humans as a community – that I most want to explore: Sembl as an engine of networked ideas, or linked data. First, though, a brief diversion to the genealogy of the game.

Genealogy

I didn’t invent it! The progenitor for Sembl is a vagabond monk called Charles Cameron.

Charles Cameron in front of a stack of books on religious violence

I’ve never met Charles in person but we’ve spoken a lot over the internet, which is how I took this picture. For 15+ years, Charles has been playing what until recently he called Hipbone Games – because the hipbone’s connected to the legbone. He has always played with a static image of a board, through discussion among players, either face-to-face or online.

And Charles crafts whole symphonies of resemblance about war and religion, art and science.

womb–tomb: chambers for entering or leaving the world

Here’s a classic simple move he made, linking the word-concepts ‘womb’ and ‘tomb’. Charles didn’t invent the game either. Well, not really.

Glass Bead Game – quotation from Herman Hesse's novel

He got the idea from a novel Herman Hesse wrote in the 1940s, called The Glass Bead Game, which as you can see, has a fairly grand vision for the game, to create a kind of music from the entire intellectual content of the universe.

I first encountered Hipbone Games about eight years ago and straight away imagined a digital form, where you could see the network of linked nodes assembling as you play. Ever since then, I’ve been waiting for it to come out in digital… Well, I got tired of waiting, so at some point I adopted it as a personal mission.

Kudos to the National Museum of Australia for building the first digital version. The Museum Game is a simple version of what Sembl can be, but it has potential to grow – and actually, it’s already a little more evolved than it appears in the video at the beginning.

Sembl Museum gameboard for four teams of younger players

For example, this is the board you saw in the video. We use that one for younger players. But we have other boards, for groups of three teams, for older groups of four teams, for five teams and six.

Four different Sembl Museum gameboards

And in the true spirit of the Glass Bead Game, there’s also talk of hosting tournaments at the Museum.

Toward a game-based social learning network

But it’s at the point of networking the gameplay and the game content that Sembl will really ‘level up’ and rock the world. Once the games are on the web, and the field of playable content is already digital, good things can happen:

  • We can aggregate game-generated data and build an interface to the ever-evolving web of resemblance. So it’s not just the thought-riffing in your own game you can enjoy, but the whole generative symphony.
  • We can preserve links to the objects’ context in online collections, improving their discoverability – and our knowledge and understanding.
  • And – if we harvest the associations to display on the museum’s or other sites – we can forge new browseways within and between collections.

In short, the game becomes an engine of rich, useful data about collection material, and through that the world.

network thinking – how Sembl network links differ from traditional linked data links

A web-based form of Sembl can generate linked data with a difference. It’s linked link data, and quite different to normal linked data.

  • Instead of connections based on what a thing is – sculpture, or wooden, or red – Sembl generates connections based on a mutual resemblance between two things. Which, amazingly enough, is a great way of gaining a sense of what each thing is. And if your interest is to enable joyful journeying through cultural ideas, or serendipitous discovery, this approach just wins…
  • Instead of compiling logical links, Sembl cultivates the analogical.
  • Instead of building and deploying a structured, consistent set of relationships, Sembl revels in personal, imprecise, one-of-a-kind, free association, however crazy.
  • Instead of attempting to create a comprehensive and stable map of language and culture, Sembl links are perpetually generative, celebrating the organic, dynamic quirks of cognitive and natural processes.

But the most important way that Sembl is distinct from other systems of network links is that those who generate the links learn network thinking. Which is a critical faculty in this complex time between times, as many smart people will tell you.

Understanding relationships is key to understanding the self – quotation of Jack Lohman

21c society is shaped by connectivity – quotation of Rachel Armstrong

life demands dynamic attention – quotation of Flemming Funch

data classification yields to pattern recognition – quotation of Marshall McLuhan

Marshall McLuhan foresaw this shift 50 years ago. Classification is for simple, neat systems. Networks are complex and messy; they demand new forms of literacy. But we have not yet adapted as we need to.

Prior to the 17th century, the primary order of knowledge was resemblance – quotation of Michel Foucault

We’re still largely stuck in the Enlightenment thinking that began 400 years ago to institute the binary order of things. But notice what preceded 17th-century ways of knowing. According to Foucault, the ‘primary form of knowledge’ was … resemblance.

Tell all the truth but tell it slant – poem by Emily Dickinson

Poets have always known the virtues of analogy as a path to the truth.

And my favourite visual artists work in this way, creating in-between spaces for us to explore and discover.

Metalwork, part of Fred Wilson's Mining the Museum, an installation at the Maryland Historical Society

As part of an installation at the Maryland Historical Society, African-American artist Fred Wilson placed a set of slave shackles into a cabinet with fine silverware and called it ‘Metalwork’.

Rosalie Gascoigne, Past Glories

And more subtly, this work is by New Zealand-born artist Rosalie Gascoigne, who lived for a long time in Canberra, where I’m from – so I had to include her… She took discarded signs, disassembled and reassembled them, converting text to textures into which we can read our own messages.

I like the way these artists work; I like how their works induce me to think.

painting of an ape sitting at an easel painting a nude woman

I keep an eye out for opportunities to participate in associative thinking. Last year The Open Museum – a user-generated exhibit site – hosted several rounds of a game where one person would post an initial work, such as this one…

12 moves of an association game at the Open Museum

and then anyone else could come along and a post a visually similar work. After a few days the most up-voted work would win the place as the number 2 image, and so on. You can see here how this game progressed in the first 12 moves.

the final move in the association game – a painting of a large woman looking at herself in a mirror in which is reflected a smaller woman – loops back to the first

It continued until after 26 moves, it looped back to the original work.

Brilliant. I love how there’s no right answer, and that it encourages wide and wild associations – from a satellite image to a Miro, to a photo of a human embryo.

Polyphonic thinking

Sembl promotes dialogic, non-linear thinking, and new forms of coherence.

deliberative thinkers – quotation of Charles Cameron

It’s distinct from deliberative thinking, which is rational and causal and logical and linear.

eccentric thinkers – quotation of Charles Cameron

It’s another kind of thinking, which might be informed by rational thought, but its purpose is not singular.

bridge-builders – quotation of Charles Cameron

You might say its purpose is to create – and cohabit – a state of grace, from which ideas simply emerge.

every move you make is a creative leap

If playing Sembl gives us practice in polyphonic thinking, if it helps cultivate connectivity and our capacity to find solutions to local and global problems, it is good value. As Charles says, every move is a creative leap.

If you’re interested in working with us to supply content, develop strategy or raise capital, we’re keen to talk.

And I can’t tell you how much I’m anticipating being able to invite everyone to play.

thanks

*****

NDF delegates were a truly lovely audience. Having spoken with lots of people about Sembl in the past week – and now that I have a bit of distance from this presentation – I can already see some ways in which I could express Sembl ideas in more pithy, accessible ways. In fact, I plan to rewrite the home page of this site.

In the mean time, know that I would absolutely more-than-welcome further comments, ideas, questions or – of course – resonances with your own context. And if you want to help shape Sembl, you could tell me: in what way are these ideas useful to you, personally and/or professionally? (Or to put this another way: how might you use a tool for network thinking?)

Lines become thought-space

More thoughts on interface design… and fun with animated GIFs :)

Imagine that you’re looking at a large, complex network of connected nodes. As you hover over any line between two nodes, it draws the two nodes together, then splits and expands into a single thought-space enclosing its two seeds, thus:

Perpetual animated GIF showing two connected nodes, where the connecting line transitions into a circular bubble

A thought-space emerges from a line

On click, the single thought-space would enlarge so you could consider the two seed nodes and the descriptive resemblance in the centre.

…..

If you hover instead over a single node – say, one with three connections – you see a trio of connected thought-spaces emerge, like petals on a flower.

Perpetual animated GIF of a node connected to three others, where the connecting lines transition into circular bubbles

A trio of thought-spaces

Again, on click the view would enlarge.

…..

Once I’d animated those hand-drawn sketches, I thought my thinking about interface design would stop – at least until we’re actually building this baby. But no. Neurons kept firing; I developed a strong desire to visualise this thinking space in the simplest way, a line resoloving into a circle – or a circle-like pod thing.

So I fired up Processing and the online reference, and retrieved my neglected Processing textbook. It took me ages of fiddling and wondering why it was looking so skew-if to recall that the y axis starts at the top. Anyway, here it is – for your cognitive pleasure, the first born-digital animation of Sembl think-space – a pod:

A line transforms into a circle-like pod

It’d be way better if it faded gently out and then back to the line; as it is, it’s like a mouth that snaps shut just when you think it’s safe to explore :) But for now I’m spent.*

* Spent and yet, seeing a flip-book in my future…

Sketching data structure & interface

Thinking about how in Sembl, the lines that connect things are not lines but, actually, circuits – because they are always already mutual, originating from and applying equally to both things – I started to imagine how the network of aggregated game data would look, and how you could interact with it to explore both the whole and its parts.

Pencil drawing of four ways of representing a network diagram, with the words 'A line resolves into a circle.'

In Sembl, node-connecting lines are actually circuits.

Lines between things could be spring-like. On hover, they could draw the two things closer and resolve into a circular facet or disc, perpendicular to the connecting line. You could click to enlarge the posited semblance.

In the next sketch I’m wondering if the data structure could really be this simple. Each semblance is linked to (its rating and) two things, which in turn have title/s and persistent identifiers (PIs).

Pencil drawing showing a resemblance and its rating between two things represented by their title/s and a persistent identifier

A resemblance and its rating are at the centre of two items comprising title/s and a link to their location.

The data is generated in the game and editable via a wiki, so we are also likely to capture metadata about who created it (username or IP address), and possibly also when, where etc – but those few fields form the foundation.

A dialogic order of knowledge

This post is a provocation, triggered by Mike Bergman‘s clear and interesting talk on the semantic web in use. It follows some earlier, fuzzier thinking of my own on Sembl and linked data. I now understand where Sembl fits in relation to the semantic web. The answer is that it doesn’t, not really, because Sembl triples are quintessentially different to RDF triples. Different and, I contend, better.

Here’s the problem – just reiterating here, for people who are unfamiliar with ‘the semantic web’. We made a beautiful web, huge and full of knowledge, but it’s too big for humans to use well. We need machines to process the bulk data so we can extract the most relevant gems of knowledge. But for machines to understand the whole web of human knowledge, they need the parts to be arranged in a more orderly way. Is this thing the same as that? If not, what’s the relationship between the two? Machines fail to articulate the parts, and humans are never sure we’ve got the best part of the big picture.

What we need is an authority file for What Each Entity Is and How It Relates to Other Entities; an agreed way to inform machines of the complex variations and dynamics of human knowledge.

Semantic web proponents have succeeded in creating an agreed process for defining and agreeing on What Each Entity Is. Mike Bergman describes the use of URIs to identify data as the semantic web’s ‘crowning achievement’. But the second part of the challenge – How Each Entity Relates to Others – is critical, and tricky. And the current approach – build and/or mash up and apply ontologies, vocabularies, thesauruses, schemas and taxonomies – feels labour-intensive and ineffective.

The web is about as non-linear and dynamic a system of knowledge as you can get, yet we try to describe it in terms of the sum of its components.

What if we’re going the wrong way in our mission to understand things in relation to other things? What if the basic building block of the semantic web structure, the triple, is sub-optimal? At the very least, it is insufficient. Consider:

This entity
[subject]

has this relationship to
[predicate]

that entity
[object].

Let’s face it: triples are reductive and authoritarian. Always starting with the subject and ending with the object, they seek out and cultivate otherness. Whatever the part in the middle is, the subject gets to co-opt the object into a relationship that is always already from the subject’s perspective. Sometimes the subject’s defined relationship to the object is consensual. And sometimes it’s inappropriate. The thing is, even if you carefully pass all your triples through the complex regulatory system they necessitate, you can never be sure you’ve got the relationships right. And if they are validated at one point in time, they may later need updating.

In short: triples are intended to impose order, but they tend to create conflict.

Triples are not evil. Often the predicate is unifying, a form of equivalence, something along the lines of ‘is the same as’. Too often, according to Mike, who lamented the ‘SameAs’ relationship’s overuse. He also showed us a list of various terms for defining the near-identity of different entities – my personal favourite is ‘somewhatSameAs’:

A list of terms for 'almost the same as'

Different ways to describe near-identity

Evidently there is a reconciliatory bent among the seekers of the semantic web, a force resisting the oppositional stretch of the triple :)

And… therein lies an answer to the problem of imposing order without generating disagreement.

Instead of trying to map the complete tangle of relationships, we could focus on crafting resemblance. We could ditch the one-way triple in favour of a mutual one:

This thing
[subject]

shares this resemblance with
[predicate]

This thing
[subject].

Resemblance is by nature imprecise, but because its perspective is mutual, it is never wrong. The spectrum of resemblance runs from fairly uninteresting (eg a glass and a bowl both have a round rim) to the startling, insightful, poetic. And whether humans like the resemblances or not, every single one will help the machines to understand – whether they are written in ‘proper English’, vernacular, or any other language.

Resemblance is a very human approach to structuring knowledge. It is generative rather than reductive, and it is intrinsically attractive – both conceptually, in the sense of drawing two entities closer together, and emotionally, in the sense that it feels better to seek similarity than to define difference. We are naturally dialled-in to similarities and patterns. And this capacity is extremely useful for seeing how the parts relate to the whole. Which is, I recall, the mission of the semantic web.

Obviously, there will still be difference. In fact, it turns out that to identify sameness is to explore difference. As soon as you find a resemblance between two things, a difference pops up. Intriguingly, difference seems to make more sense, and be more palatable, in the context of resemblance. It’s kind of beautiful.

To create an online version of the Sembl game – a Sembl Web – we will need to use stable URIs or to create them if they don’t exist. By default, I’d like to link Sembl entities to Wikimedia. But can we hack the RDF triple and forget the vocabularies and ontologies?

Freed from having to define and structure all the possible relationships in advance, we could invest energy in exploring the territory of relatedness at our leisure, and begin to work out a pattern language for them. We’d be building a knowledge system based on consensus instead of authority.

Wikipedia changed how we create and access shared knowledge. Sembl could change how we create and access shared knowledge of how it all fits together.

The semantic web is big, in theory. There are over 7 billion RDF triples already, though according to Mike ‘very few’ are put to use. Sembl Web doesn’t yet exist, but when it does, it will constitute a humane generator of mutual triples – triples that:

  • are always already in use
  • bring joy to the people that create them
  • fit the dynamic non-linearity of the web

Sembl is poised to create complex, chaotic flow among disparate parts of the web. And that flow is the point. That’s what converts knowledge into understanding.

…..

Disclaimer: I’m no expert on the semantic web. If I have overlooked something critical in the above, I’d appreciate you letting me know. On the other hand, if you see value in this approach, please let me know where and how. Ie, comments appreciated!