76
edits
(Josh Gay blog posts, invu with Phillip Schmidt, Alex Halavais, Badge lab script, session notes) |
(Josh Gay blog posts, invu with Phillip Schmidt, Alex Halavais, Badge lab script, extensive session notes) |
||
| Line 399: | Line 399: | ||
alex@Halavais.net | alex@Halavais.net | ||
------------------------ | |||
his session had 2 tracks: | |||
Badges for digital storytelling | |||
Badges for collectives | |||
Erin's Notes on Badges for Collectives: | |||
SESSION 4: Badges for Collectives | |||
idea: badge organizations | |||
mostly been talking about how to badge people | |||
can we badge collectives and organizations | |||
classify organizations so that I see these icons and I know something about them? | |||
each person would choose the icons that they want | |||
has machine readable code on the background | |||
how to validate? person clicks on the badge to see the information, community can vote to give +/- | |||
what do these badges do - creates visibility for the institutions | |||
for profit/nonprofit | |||
reproducible/exclusive - open/closed? | |||
reinforces the commons: ecology/body/town/digital | |||
representative/grassroots - hierarchical/flat | |||
have only positive? | |||
create community | |||
what do you want to promote | |||
don't push people to make decisions that they don't want to make | |||
let community create new badges? | |||
instead of trying to define all the commons badges, could have community submit or suggest commons badges | |||
for example, I work for a nonprofit that works on open education…would love to have a badge for that | |||
or we do research and release our data openly…so an open data badge | |||
you shouldn't have to define them all - but could let people define (or at least submit ideas on) the ways that they contribute to the commons….this does not exist at all | |||
currently nonprofits are only findable by: ratings/numbers on how much they spend and how they spend it, keyword or geography…if could discover nonprofits by contribution to commons, etc., that would be really powerful | |||
-------------------- | |||
This session was actually about "What's Wrong with Badges" | |||
Not intended to be a complaint session, but for identifying issues and possible solutions or ways to avoid the issues as we move forward... | |||
Session 3: What's Wrong with Badges | |||
badges as a factory system of education - badging | |||
open ed - not | |||
evergreen college - no grades, just recommendation | |||
yes/no == 1/0s | |||
assessment and representation of the assessment | |||
could be badges for no criteria at all - but the assessment portfolio assessment | |||
badges linked to metadata, more information | |||
badges as conversation openers - then keeps them low-stakes | |||
less of a reason to game it ? | |||
badges represent the endorsement | |||
badges as Yes/No | |||
incenting the wrong behaviors, intrinsic/extrinsic motivation | |||
open nature of badges - what happens if commercial gets in the game | |||
make sure our badge system eats theirs | |||
why couldn't we let other peoples badges work? | |||
what if people start making money off of this - derail it by having open operability | |||
we are free and open, we are the standard | |||
what if Bb gets into the game? | |||
equity | |||
revolution in education | |||
infuse our thinking with collective intelligence | |||
replicating our own bias in the system - how do we include marginalized communities | |||
badges heavily focused on getting jobs | |||
what if are about kinship, recognition | |||
building an open framework that has minimized the forced structure | |||
not just decided on by an authority | |||
like twitter as it evolved - the community defined how the system evolved, started very simple and community decided where they wanted it to go | |||
categories of badges / functions | |||
quantifiable/automated - awarded by machine that you passed a certain threshold | |||
community-endorsed (qualitative?) | |||
badge infrastructure should be agnostic about how that decision is made - like internet, no idea what people would do with it, but just enough structure to support innovative use/needs | |||
badge needs an endorser - might be an algorithm, community, self | |||
too many dimensions to categorize? | |||
just need to realize that there are different types of badges - we are trying to make the equivalent of verisign - identity, verification | |||
have to have the identity behind it, 'HUB' in demo | |||
follow link to see where the badge came from | |||
badges have badges? - aggregator or mozilla-approved badges | |||
some might do very heavyweight or very light, there is weight based on the giver (page rank) | |||
need the technorati of badges | |||
creating an open standard for those that want to play … | |||
for it to succeed, we have to seed well executed uses of that platform, and starting points for people that want to use it | |||
the point is, what does "well" or "good" mean? that they have accomplished something, there is some reason to have a badge? | |||
are same hierarchies going to be replicated? | |||
sense of playfulness, instead of just reinforcing the existing divides | |||
good for the open community | |||
what we are talking about is fundamentally more democratic, b/c the credibility of the badge will depend on the authority of that issuer | |||
open structure which is easy to use provides some way of saying that you can trust this badge - it resists reinventing the current system | |||
will it shift the hierarchical nature of education? | |||
if there are individuals with very high endorsement | |||
here its very relevant and important - depending on who you are interacting with, may have a lot of validity and importance | |||
institutions don't go away but there is another path… | |||
if can prove that harvard itself is what is making smart students - if there is that granularity, you could have a harvard endorsed badge without a harvard degree | |||
education isn't just schools | |||
so much informal education - badges are an opportunity to capture that informal learning | |||
badges should be binary - can see the evidence but either you have it or not | |||
issue date at all of them - learning path (when they did it and when it changed) | |||
make history transparent | |||
summary: | |||
there are a lot of issues and concerns about what badges can be - we are agnostic about that | |||
we provide you with a way that makes it more explicit | |||
we keep it as lightweight as possible | |||
we don't have to solve all the issues b/c you use it as it needs to be | |||
lets not over-engineer it from the beginning | |||
next steps | |||
working group that reaches out to these companies and create standards (stackflow, Facebook, 4square) | |||
framework - openness, use case and success stories so that people can look at as a starting place so people can jump in | |||
role of employer? | |||
----------------------------------- | |||
School of Webcraft Badges (Joint session with Webcraft Toolshed | |||
Gunner: Welcome! We're going to do some tinkering around badge design. 3 small breakouts where we'll invite people in those groups to spec out how they would function. | |||
Pippa: symantic html/css - how do we assess and give good feedback. | |||
Christian: Accessability - how do you keep content independent of device etc. | |||
3 questions we're thinking about: who issues and how it is earned. Who values, and how is it ..., 3rd what info is actually available with the badge. | |||
Accessibility group: | |||
=================== | |||
Chris: people want the badge, but what about the official badges from the w3c, which people put on their site, but didn't really do anything very useful. So, instead of applying for a badge, hunt around for really good examples, because there aren't many. | |||
Instead, sites could be *nominated* for accessibility, ... | |||
Also, how to visualise, different countries represent with a wheelchair, but accessibility is not about disability. | |||
Kate, a lot of commercial websites have 'is this website helpful' which could also be used. | |||
Christian, so there has to be a peer review of the reviewers as well. Large font. | |||
We could tie it into a firefox extension, or use a delicios tag for nomination, to enable a bottom up process. Could also have a negative badge | |||
Kate: most people don't know, because they're juts beginners etc., a bit like fashion. | |||
Chris: there's no such thing as accessible, as different disabilities sometimes require opposite approaches. So perhaps a single badge wouldn't work, but perhaps having multiple badges. But I want to broaden the horizon of what accessibility really is (not just disabilities). P2PU could be used with learners searching for exemplar websites etc., | |||
Michael: an accessibility badge for websites that do a good job inadvertently, and another for people who make great resources helping accessibility (ie. tutorial on installing OSS screen readers), or extending existing software (wordpress plugins) making them more accessible. But also a badge for people who do the p2pu course? | |||
Chris: badges for accessibility explainer, accessibility developer. Another interesting thing - a heirarchy of accessibility... accessibility awareness provider, accessibility developer, accessibility solution provider, accessibility guru/explainer? etc. | |||
Daniel: who would be rewarding it. | |||
Kate: just one team, I don't see it becoming viral (reviewing them, that is). I also think they should expire given the rate of change etc. (Daniel, or rust). | |||
Summaries: | |||
How do we do this for p2pu? Explainer, Enabler, Developer (with CC-like easy explanations). | |||
= Semantic HTML / CSS group = | |||
The Badge as a menas to demonstrate skills to interested parties | |||
q: who provides the badge? | |||
a: maybe mozilla / open web education alliance | |||
q: who would you like to show the badge to? | |||
a: employers, clients, students, communities, target audiences (users on the website), readers, other webcraft community members | |||
q: what is being assessed? | |||
a: Best practices, an inclusive way of coding the website, beyond its visual appearance: Semantic HTML/CSS | |||
= steps to *earn* the badge = | |||
1. It validates! | |||
demonstrate a certain level of complexity, existence of metadata, alt tags and | |||
w3c | |||
2. code review | |||
judge actual *content* as well | |||
audience: multiple peers | |||
media: questions/answers, video, documentation | |||
* communicate clearly what you've done | |||
* opportunity for others to learn from this particular project | |||
* commented code | |||
* Annotated CPAN http://www.annocpan.org/ example of justifying design decisions, peers can annotate as well | |||
3. Authority? Deadline, criteria. If you don't meet the criteria, you "flunk out". | |||
* Link to Drupal process | |||
Keep metadata? e.g. reference to actual tecnical artifact, source code, revision. And to the version of the standard you are validating against, and the date? If you've earned this badge, exactly *what* is being evaluated at this point in time? e.g. CSS2/CSS3 | |||
4. Renewal/validity | |||
If I earn the badge on 1999, it might not be equally "valid" on 2003 | |||
Course revision | |||
The peer assessing community will also evolve its evaluation standards | |||
* Maintain a history file as a measure of your achievements | |||
Also acts as a portfolio | |||
* In the process of peer review, is it important to keep track of who have you collaborated with? | |||
You should definitely keep track of people who've donated time to | |||
Replicate Amazon metareview system? "Was this review helpful to you?". It may be possible to game the system in this way. | |||
* Bugzilla parallel - improve learning - file a bug? "These criteria may be out of date". | |||
ERIN's NOTES: BADGE FOR SOFT SKILLS | |||
Session 2: Webcraft + Badges | |||
who issues it/how is it earned | |||
what data does it carry/what does it look like | |||
who values it/how is that value conveyed or passed along | |||
SOFT SKILLS | |||
question/answering | |||
teamwork | |||
active community member | |||
communication | |||
problem solving/critical thinking | |||
talk to normal people | |||
working in decentralized way | |||
presentation/summarize | |||
documentation/communicate to nontechnical community (how is this different in an open environment, need to do the managerial role, gather specifications from a nontech audience) | |||
patience | |||
synthesis | |||
metaphor: journalist, translator | |||
communicate technical things to nontechnical people | |||
the form which this is expressed | |||
title: I Talk Human; Tech Bridge (sounds two ways but that's ok?); Liaison; Bridge Badge | |||
Community Bridger | |||
how is it evaluated? who issues it? | |||
tech and nontech people have to way in | |||
performance based | |||
describe what you have just done to local community; gather their endorsements | |||
submitting a video? have external people evaluate? | |||
non-automatic | |||
submit on the web and invite members of the community, form for submitting correspondence, community members vote based on rubric….all of that becomes the link behind the badge | |||
optional field for self-reflection | |||
how is it earned? | |||
person submits 'proof' | |||
value/signify? | |||
if you come across this badge in wild, what does it signal to you? what can you do with it? | |||
issues? | |||
unintended consequences - don't want to reinvent school | |||
private information | |||
gaming | |||
can this hold people back - young people with motivation and skills, have to get the badge to prove themselves | |||
or…if looking to hire someone and need to explain why to hire someone young or without college education…could use the badges | |||
expiration? | |||
thumbs up/down on the badge after assigned? | |||
if have "like" button - that gives endorsements to both you and the endorsers | |||
does this open us up to gaming? or is that there anyway? | |||
remember... | |||
doesn't have to be the only way to get badges | |||
if you don't feel like this is the way to show your skills, hack the system | |||
create your own badge and see if community adopts it | |||
role of the creator/author of the badge | |||
validator of the badge | |||
badges: | |||
semantic html (lots of metadata, linking back to the source, etc. check out wiki) | |||
accessibility (enable accessibility, help people understand it, developer) | |||
soft skils | |||
anything based on technology will become obsolete so maybe badges expire, fade away, rust | |||
badges need to be validated - link to the profile and write recommendations, etc | |||
building code metaphor - can provide the codes or just say 'solve a problem' | |||
--------------------- | |||
Badge lab | |||
3 sessions | |||
1. pedagogy | |||
2.tech | |||
3. community | |||
\report 2 -3 main points | |||
-anna - how can a badge be linked to a student portfolio, by a community but be able to | |||
show the work and reps the outcome | |||
-teachers , students need a reflection process, does it include a portfolio to represent it | |||
-justify the work to meet the criteria | |||
-viability, credibility matters for community and individual effort | |||
-the group effort, the credibilty of the team effort | |||
Tobias - kabissa connections | |||
-netsquared winner | |||
-org increase trust by revealing their trust with partners, connections and networks. | |||
-can add connections to ngo dashboards, or community boards | |||
-organizations can be grantees, opt into badge on kabissa, grantee from ford foundation (ie) | |||
-builds up trust for organizations | |||
-how do you know which orphanage in kenya to give a scholarship fund, do they have a badge, | |||
have they been vetted' | |||
-could use for conference participation | |||
-in Africa - difficulty of getting trust | |||
-in US - paypal builds trust, 501c, audits etc | |||
-in africa - how do you know that an audit firm is legit | |||
-how to surface communities and organization | |||
-kabissa would offer the badge based on their research | |||
- | |||
crisiscommons-heather | |||
-give badges to individuals or groups | |||
-criteria defined by x number of open source | |||
-group and collaboration - issuer describes, creates icon, they determine who is in, etc | |||
-maybe self-selecting (Kabissa) | |||
-badges are on /off | |||
crisiscommons would have a wiki link to the badge for proof of content, acheivement | |||
1. participation | |||
2. design has to be simple for the badges, clear | |||
3. use it as a trustworthy measure. | |||
4. criteria - set outcome and then back-map it, what are the stages? 5 - 10 outcomes (mini-outcomes | |||
(teacher inputs) | |||
Kabissa - badges are a means, the process, it is a framework to make that outcome possible | |||
Set the outcomes you want to see, then backmap to the outcome. | |||
If you want the badge to represent a credential or an accomplishment, | |||
what are 5 markers of having met that accomplishment? | |||
Also, can you suggest (as a form of education, how they might accomplish | |||
each of those markers? | |||
The 5 markers need to be publicly available--if you have this badge, what does that mean | |||
you can do, what you can accomplish. Is there progress towards a badge you can show? | |||
- be able to search content db and find badge matches for ngos, individuals, by country | |||
Report back -tobias | |||
Community | |||
As communiities are looking for outcomes, change the world, show learned or accomplishments | |||
start with outcomes and back-map it look for proficiencies or credentials to lead to badge | |||
badges not user profiles, be simple, data stored in badge is not complicated - on or off. | |||
can the markers be known - badge dependencies,can what you accomplished be publicly | |||
available | |||
. | |||
Pedagogy | |||
-we are not new | |||
ed, eco,game theory - have great exisiting literature to base these thoughts on | |||
- commited to writing more about it and will be attending an ed conference to present on it- Digital Media Literacy conference - the DML - Alex and another badge lab attendee are already in | |||
tech | |||
-have web dev help | |||
-will make it tell the story better, build kick ass demo | |||
-demo is big show tonight | |||
community | |||
-start with outcomes, backmap with credentials, capacity | |||
-microformat on off format for issuers | |||
-platforms can support issuing | |||
ERIN: PEDAGOGY AND THEORY BEHIND THE BADGE IDEA | |||
take aways: | |||
we aren't making this up, there is a lot of literature and theory that we are working with (not about badges specifically, but feedback, signalling, identity, etc.) | |||
we are committed to continuing this conversation - build a bibliography and write badge stuff together | |||
Session 1: pedagogy/legs | |||
⁃ Signaling theory - how people use credentials to signal what they know, plan to do, done in the past (economics) | |||
⁃ Contracting (econ) - align interests based on those signals | |||
⁃ Stian: prelim article, models for universities, sociological perspective | |||
⁃ Sheep skin theory, gateway theories - sociological theories of education, and role of open education | |||
⁃ Behavioral economics - feedback, incentives, entry into a group | |||
⁃ goffman - presentation of self | |||
⁃ online education research: feedback, immediacy, transparency, | |||
⁃ surprise award, different kinds of motivation | |||
⁃ apprenticeship | |||
⁃ crowding out theory (education, organization) | |||
⁃ structuration theory - how local conversations get translated into higher structures | |||
⁃ gaming literature | |||
⁃ visibility - signs, outward presentation (semiotics theory) | |||
⁃ wikipedia literature (barnstars) | |||
Recognition/Certification | |||
Discoverability | |||
Motivation | |||
Other badges: | |||
wikipedia/barnstars | |||
military | |||
doctors | |||
organ donor | |||
voting | |||
scuba/diving/climbing/etc. | |||
stackoverflow - released their data, just waiting to be mined | |||
literature on this stuff?? | |||
Cynthia - teacher badge for openness | |||
looking for direct teacher access/research | |||
------------------------------- | |||
THURSDAY | |||
OPEN THE FLOOR | |||
surprised that we didn't get the social stuff that people brought earlier | |||
can the employer be involved, valid issues around explicit value labels | |||
soft skills - how do we credit them, and do we want to | |||
mastery in learning vs training - badges may be good for some things and not for other things, don't want to just replicate or replace what we already got | |||
flame war issues - how to mediate them | |||
gaming - high stakes systems can get gamed, social effects | |||
will the delicate ecosystem be upset | |||
badges as identity building, kinship | |||
less aspirational but motivational | |||
how do we evaluate the badges and link them together into one system | |||
don't want to end up overassessing | |||
we have a fundamentally broken system that doesn't work for most people | |||
can we improve the system and give people the recognition they aren't getting | |||
badges aren't the answer for everything | |||
but shouldn't we try? if not, the system stays the same | |||
counterpoint: degrees are still valued but scale issue - not going to hold into the future | |||
degrees/CV are just the ticket to get into the door - can we invent something that does at least as good of a job (evidence who I am and what people think about me is hard to measure) | |||
badges can capture vouching from peers | |||
badges where there is a clear P/F, but that's a small subset - missing the many many other things (softer, transferable skills) | |||
dig ourselves into exactly the same hole that we are trying to get out of | |||
1) badges as alternative to a broken system | |||
2) how do you recognize informal learning | |||
3) participatory, qualitative aspects <-- maybe these aren't badges but something else? | |||
differences in degree, but not in kind | |||
what are the criteria for #3? | |||
be mindful of the communities that we are trying to help | |||
badges: small recognitions for something that is very practical, each institution should be able to give a badge (mozilla ambassador) | |||
challenges to bad behavior | |||
communities we want to help | |||
soft skills v hard skills | |||
THEN DID BREAKOUT GROUPS WITH STICKY PADS AND ORGANIZED ALL THE SUGGESTIONS | |||
----------------------------------- | |||
ntroduction by: | |||
An alternative credential arena might incentivise.... | |||
The goal standard for the value of a badge is the degree to which employers can rely on that badge as an accurate index to the .... If there is an ability to work with organisations to develop badges and certificates that have demonstrable value to the market, even superior to the normaly... | |||
Just reinforce the importance of which we watch your work in Washington. | |||
Phillip - Reframe the question, not "When can badges replace degrees", but "How can badges replace degrees". People will break off into 4 groups to discuss the question. 20minutes, then come back with 2 or 3 points for discussion. | |||
Session 4: What replaces the degree/report card | |||
Hal Plotkin: greetings from Obama, mentioned open education at summit in Paris... | |||
credentials: 2 ways to change HE - transform from a system that weeds people out to a system that lifts people up | |||
1) from the inside | |||
2) from the outside, create an alternate system - professional, technical, etc societies | |||
the gold standard for a value of a badge is the degree to which employers can rely on that badge | |||
if ability to work with expert societies to create badges with demonstrable value | |||
******** | |||
not trying to replicate the grading system | |||
degrees: | |||
proxy | |||
prescribed | |||
seat time | |||
ours: | |||
specific competencies | |||
capture the subject mastery and how - capture the path | |||
subelements - capture that, losing it now | |||
degree by title doesn't always mean something | |||
find out from the employer perspective, what are the criteria | |||
existing system: society values it | |||
badges as validation of skills and experience | |||
not trying to hire directly to the degree, but hiring for specific pieces for the job | |||
institution decides what a credential look like, but separating out from what employer finds valuable | |||
commercial entities involved in what is education - democratize the input | |||
agnostic layer to allow external folks to express what is valuable than them | |||
soft skills vs hard skills - people who are looking to employ graduates - if they have a voice | |||
if allow external communities to contribute to what is value - if we make that explicit…dangerous. | |||
danger: government has eliminated the support for humanities b/c saying doesn't contribute to the economy | |||
capture hard skills, soft skills, 21st century skills, etc. | |||
evidence of that through collection of badges | |||
why are we critiquing university grading….to better capture learner (education is about employment)…better replacements for grades/degree | |||
validation through experience | |||
***making higher education a slave to capitalism | |||
_________________ | |||
group 2: how do badges replace the report card? | |||
what are the assumptions of what a degree is? | |||
who are the audiences... only employers? peers? | |||
disciplines that haven't needed it: what are historical examples | |||
- medicine requires a formal system of skills and expertise | |||
- computer science/programming is more based on what i can do than a degree | |||
how can badges stand for a reliable system of exchange | |||
- this badge = this skill/experience | |||
what level of granularity is important? | |||
- right now: degrees are the badge equivalent | |||
- in the future: are badges equal to degrees v. individual accomplishments? | |||
- granularity can allow more specific expression of skills (not just "i am a doctor" but "i am a doctor who is has very specific expertise" | |||
- importance of aggregated skills to be truly meaningful | |||
- what is the base unit? do granulator experiences get aggregated to mean something specific to me, or do i accumulate lots of badges in the pursuit of a specific aggregation-based badge | |||
soft and hard skills… what are we measuring? | |||
- is there a need for "untagging" - expiration for badges that i haven't practiced lately | |||
- how about character references… but how do you measure 'leadership' | |||
does a new badge system have legs | |||
- what proves the value? | |||
- how to convince employers this system works? | |||
reputation is as important as skills | |||
- what does expertise really mean? who measures it? | |||
- who accredits? | |||
- when it comes to social skills… are trusted sources/recommenders more or less appropriate than "official" signoff? | |||
let's not forget: a better system needs to prevent people from dropping out… not just a solution to reward what's already rewarded | |||
how does the system qualify things that exist outside of formal mechanisms? | |||
- there is an intermediate kind of system in france | |||
- 'validation through experience' is perceived as a way to get "badged" that's equivalent to classical system: vetting through proven professional experience | |||
- seeing proof/portfolio/process is as important as end product skills | |||
- seeing how/what/where can help others | |||
- "knowing" v. explaining v. portfolio: how can the visibility of accumulated experience help others understand what i really know (v. a degree, which is quite opaque) | |||
- aspirational equivalents so people can see what it means | |||
what's the role for current higher ed institutions? | |||
- it can be a new form of business for universities to to bestow badges | |||
- are they still in a position to create/set standards for expertise? | |||
--------------------------------------------d------------------------ | |||
Badge - use cases | |||
There were 4 groups. Phillip may have notes too from his p2pu group | |||
badge system | |||
3 key points relevant for group\ | |||
how to prototype, make it general | |||
Note: Tobias wasn't able to join this chat. | |||
Please consider KABISSA CONNECTIONS as a case study. KC just won the Netsquared Challenge and is described here: http://netsquared.org/projects/kabissa-connections | |||
Kabissa uses CiviCRM currently as our database platform, and we'd love to be able to issue badges along the lines of KC. | |||
Crisis Commons example | |||
-group was very new to the badge conversation | |||
-provided an overview of the morning sessions and a crisiscommons 101. Attempted to widen the conversation to include other volunteer tech community general needs. | |||
- | |||
org needs to id the needs | |||
org can put the call out using the badge system to locate new volunteers - matching | |||
people who have the time and the capacity to volunteer could be notified via the badge system | |||
-so the value of the badge becomes a volunteer service tool in addition to individual recognition | |||
-potential for employers too | |||
sub-note: | |||
Very hard to hear and concentrate in the group. I think was a product of brain exhaustion on my part more than anything. Maybe in groups of 30 you need two note takers and the note takers shouldn't faciliate a subsection. My own lesson learned for how I could have helped better with documentation. | |||
WEBCRAFT USE CASE: | |||
Session 3: Use Cases: Webcraft | |||
web developer, badges as social innovation | |||
distinguish between developers | |||
badges: | |||
most badges Mozilla badges, can put together into bigger Mozilla badges | |||
our badges need badges, certified by X, issued by Y | |||
assessment is handled by P2PU - we are developing the mechanism | |||
automatic assessment, peer assessment, course organizers | |||
community drives the badge development, but front load it enough so that they know what badges look like | |||
webcraft community is developing the skills map - then we create badges to get this started | |||
challenge for a badge? haven't really thought through this one | |||
how granular should the badges be? for html development, don't want tag level badges | |||
goals: | |||
motivation/engagement | |||
share information/skills across courses | |||
share information with the outer world (mozilla backed!!) | |||
badge: | |||
metadata: author, even though its a mozilla badge | |||
external badging authority, spot checks that the badge | |||
what is the ultimate goal - to get people to learn web better, or to play the badge game | |||
peer recommendation system - 'this guy knows html 5.0' - becomes more validated as more people | |||
as soon as there is currency in the badges, people will try to game them | |||
microfinance - grameen bank, 4 other people have to recommend that person | |||
if turns out that it was fake, that person and all recommenders can't get loans | |||
yahoo answers, automated until puts up a red flag to a human | |||
build sophisticated detection, not to detect trolls, but to detect fake karma, etc | |||
need real identity | |||
something like page rank so when endorsed by mozilla | |||
ohloh.net as a model?? | |||
Breakout Group: A badge for digital storytelling | |||
Notes, Cynthia Jimes | |||
Initial question someone asked in our group: where in a process do you get badges? At one point in time? Is it purely an incentive? Is it an award at the end of creating something? Is it a social badge? | |||
What are the qualities of stories that we want to capture? What are the different things we want to get out of the digital storytelling badge? What is it’s value? We may want the badge to, for example: | |||
* Produce an action | |||
* Provide enjoyment | |||
* Support education/knowledge transfer | |||
* Persuade | |||
* Build awareness | |||
* Preservation of culture | |||
* Facilitate communication and engagement | |||
* Support co creation of meaning that translates a whole experience | |||
* Inspires others | |||
Another question that arose in the group: How do you “badge” creativity? Maybe it’s about: | |||
* How much the story gets passed on; how much it’s shared | |||
* How much it’s read, accessed, downloaded | |||
* How much it’s remixed | |||
* How much it’s edited | |||
* How much metadata it generates (user generated metadata from others who read the story) | |||
Other notes from our use case | |||
* Does the badge need an authority role, so the giver has authority. | |||
* What are the levels of endorsement from those assessing the work being done | |||
* Reputational and economic value of the badge | |||
* How to think about data collection from potential badge recipients that helps us to answer the questions in our discussions and design a good badge | |||
* The social aspect of badges—not just for employers. Some things are harder to translate into badges, the softer stuff, like emotional intelligence | |||
--------------------------------------------------------- | |||
Badge Design Slam: Earn Your Virtual Drivers Badge. | |||
Badge part 2: design teams | |||
Heather L | |||
what are the requirements | |||
who gives out the badges | |||
who do you show the badge to. | |||
how do you maintain and renew it. | |||
I joined the "how to Renew group' | |||
how to renew | |||
-how people feel about you | |||
-badges skills | |||
-using black boxes | |||
-issuance date, merge | |||
-issuing authority | |||
-how's my driving | |||
-peer review | |||
-worth measure | |||
boolean-ness of the badge is one of its greatest features- alex halavais | |||
-incentive - mayor of driving | |||
-@kabissa - free technology academy | |||
Philip schmidt | |||
-tie it to how's my driving, my insurance rate | |||
-this is my driving record in badge form - | |||
-authority with badges and acknowledge across. | |||
-i'm above average | |||
-is it peer rewarded - | |||
-anyone can be make them, low-barrier | |||
-bad with names badges | |||
-concrete, not for goal setting, open and idenitifable to | |||
-i someday want to go to mars badge- says you want to achieve. different levels of validity | |||
-can choose to reveal potentially | |||
-can you have negative badges? can you give people badges they don't want to have> do you have control | |||
-credit rating | |||
-issuing - how do they qualify, date of expiration | |||
issusing auth for id | |||
how do you renew and maintain | |||
1. go back to issuer, they control the badge | |||
a. renew in boolean on or off | |||
b. badges over time | |||
2.could be part of goal setting, badges are strongest with a simple mandate | |||
3.has to be id'ed with someone's identity, has to be verifiable | |||
report back ideas | |||
courtesy badge | |||
(i was giving the report back which took my attention from proper note taking of the other reports) | |||
Session 2: Driving badges - what types of badges would exist in this system? (12PM) | |||
1) point of the badge system is to make people drive better | |||
so positive only badges | |||
people can decide which badges to display | |||
indirect is showing people | |||
signals to others | |||
badges referring to skills | |||
badges referring to what type of driver you are | |||
badge holds information about the badge, passes information to other people | |||
basic skills - like license | |||
additional skills | |||
get attention of the one who wants the badge, earning | |||
get attention of others, signalling | |||
1) point of the badge system is to make people drive better | |||
positive only badges, more encouragement, avoid gaming/hiding | |||
courtesy badge | |||
safety | |||
things that you want people to know so that they drive safe around you | |||
warning badges: babies on board | |||
beginner driver | |||
skills | |||
skills that you want to display | |||
automatic/gear shift | |||
driver license | |||
car gathered information | |||
in context: fast, snow, etc. | |||
about yourself / access | |||
things about yourself that get you access to things | |||
handicapped | |||
hybrid | |||
medical | |||
things about driver + car? | |||
environmental impact | |||
alerts within the car | |||
driving: who issues badges? | |||
different kinds of attributes for formal (skills) v. informal (behaviors) badges | |||
- both may have subjective + objective characteristics | |||
what's necessary in a badge system? | |||
- unbiased source | |||
- efficiency - timeliness is critical | |||
- effectiveness | |||
right now "badge" system is: learning permit - go for it | |||
- only two kinds - what other kinds might be important in a badge system | |||
- what's the level of granularity? | |||
what do these measure? | |||
- demonstrated competence | |||
- based on insurance demographics systems | |||
- reflexes: constellation of skills that make you drive-ready | |||
can the car judge your level of competence (staying under the speed limit)? | |||
how might auto-programmed cars shift the focus on badges related to people driving? | |||
will cars become obsolete? the desire to multi-task may make cars go away... | |||
how do we create a system that changes with the culture? | |||
- built-in flexibility | |||
- crowdsourcing as a means to rewards/penalize | |||
- you gain privileges as you get better/more reliable/safer? | |||
- what if social norms change between different communities | |||
how might non-drivers participate in a badge system? | |||
- giving advice | |||
- providing highway traffic control info: where's traffic | |||
- providing info on most direct, shortest route, etc. | |||
driving is not only an individual action: moving from individual to systemic/community-based | |||
- badges given for the benefit of the larger system | |||
- drivers as social critters | |||
- importance of badges is not for self, it's to show others that you're competent | |||
- visibility: i can see you're a good driver or not | |||
monitoring (enforcement ) and renewal: not the same as issuing original "license" badge | |||
- what about sins of commission… are there negative badges? | |||
- can there be aspirational badges? a feedback system from the car and others | |||
- permanent v. transient badges: for knowledge v. behavior | |||
Breakout Group: Creating a Badge System for Driving a Vehicle (Prototyping session). | |||
Notes, Cynthia Jimes | |||
Our group worked on the question of: Whom you show the badge to and how that works | |||
Whom do you show it to? | |||
Show it to multiple people, and could be a lens where it’s meaningful to each group: | |||
* Employers | |||
* Rental car companies | |||
* Friends | |||
* Parents | |||
* Insurance Companies | |||
How does the display of the badge work? | |||
* Displayed in multiple formats, access points, including display card with code to access it online, bar code. Can be an aggregate of levels of different types of driving skills. | |||
* Can be thought of as additional “metadata” about one’s driving skills, that is attached to the official driver’s license. This metadata can be from peers (how they view my driving), from the car (data from the automobile itself about my driving), from other entities. | |||
* Can be open or closed, or selectively shown to specific people, entities | |||
Other notes from breakout | |||
* Is it stored in a central repository? | |||
* How is its authenticity verified? Does it need to be verified? | |||
* Discussion of whether the driver’s badge is an actual think that is measured at one point in time, or it is a path, adaptable, evolving, with changing links to other driving skills, information | |||
* Should the badge be complimentary to other badge systems, so that it’s not all encompassing? | |||
---------------------------------------------- | |||
Welcome to EtherPad! | |||
This pad text is synchronized as you type, so that everyone viewing this page sees the same text. This allows you to collaborate seamlessly on documents! | |||
Badges Intro: | |||
Go-round: | |||
Annie Dashkaart Tornoto interested in creating online Course accreditation | |||
Ruth from Toronto: badges crazy important | |||
Erin from CA and facilitiating and interested in badges to find a way to assess learners in a way that encourages them to participate | |||
Bolivia mgr of Mozilla bolizivia | |||
Nagashka from Mumbai networking learning objects more granular awys | |||
Josh gay : working in rm #19 and we’re gg to be doing some tech implementation whether yr interested in tech part or user interaction | |||
Mathieu Paris : workin educaion field student | |||
Fernando &Miguel Work in a UNI in PESSOA strategic projects director/ entrepreenuer | |||
Mitchell: interested in p2pu web tech learning and how we can authenticate so that it’s a viable alternative t oCISCO and MICROSOFT cert so Mozilla can use for a acreer/job | |||
Ingrid I’m interested in bdges b/c I’m interested in MOBILE , informal , hard to contain modes of learning & new forms of assessment | |||
Dan: identitiy data sharing deeply interested in badging | |||
Anna Providence RI one of our biggest goals is to offer our students recognition for what they already know how to do new things they’re learning | |||
Rodrigo: personal finance emerging markets P2p badge recognition for those who participate in my netowkr related to broker dealer business | |||
Franco Argentina LA popular education informal approach to learning badging interesting addition to that education | |||
JV Chamary, journalist from the BBC - here to understand how future students will gain accreditation or recognition for learning online | |||
Heather Crisis Commons looking for ways for ppll to crowdsource info and software and learn that and make it packable & badgable make it part of their daily live ing | |||
Anna fomr Portugal I cam eas a founder of 1st hackerspace in Portugal related to my profession I work as an interface designer | |||
Im Cynthia Cali and owkring toward the idea of rewarding teachers and so I’m really interested in the idea of badges for teachers that wd recognize teachers sharing reasources creative collaboration | |||
David from Free tech academy online courses recognized officially so we have formal certifici | |||
Alex: diplomas and transcripts have a chokehold on the process im interested in making | |||
Institutions and noninstitutions interoperable | |||
I’m ravi from Indiana’how do we validate informal learning that’s where the best learning is happening what happens when we attach validation b/c the minute we attac someone games it | |||
I’m dale doughtery part int in diy self taught informal learning less for me about badges and more about trying to make visible what’s happening n informal education | |||
I think of it as a set of paths thru various stops | |||
How did you get to be a Welder, how did you learn to do this? Less the accumulation vof Boy scout badges what’s unique in the DIY space is the eccentric paths rhat ppl take | |||
Stian: p2pu how badges can externalize learning w/o motivation | |||
Philip: figure out badges making learning visible is the key compontent that will let us change how education works today | |||
Gunner: P2pu fanboy and a badge newbie super glad to be here | |||
Breakouts: | |||
1) Use cases | |||
2) Cynthia What goes into a badge, data points how do we frame | |||
3) Tech group --yr special go into a dark space where you don't know what time it is and build something bring it back and show it to us. You might not see the | |||
4) Philip badges 101 for the ppl whohave no clue what we’re talign about here but also we cd go in the direction of talking about are we really tralking about badges the wa we’re using it is very generic so badges 101 | |||
15-20 min | |||
8 ppl | |||
what’s important / 3 key parts | |||
what is a badge | |||
im by no means answering questions | |||
Fernando: Form of validation. It must be structured in a way that can be shared and standard | |||
Sarah: in the Girl Scouts’/ Boy scouts gateway to next step | |||
Sometimes ppl get so obsessed the lose track of what the point is | |||
David Javokis fI thin kthe main danger : ppl walking around can you stamp my passport | |||
I have no idea about previous resrch but I thnk of it as some standardized form of peer recogniztion reputation system | |||
Personal evaluation the person who is learning understands that he has reached a point where he can go onto the next step | |||
Consider it’s not justd for the peers but also self satisfaction that I can reach this point and go on to the next step | |||
Incentive ppl to learn and bleive dimension of ego when we are learning there is a way to show ppl I know that | |||
Group # 2 Use cases | |||
Barnstars | |||
Rafi | |||
Conditions you have done something | |||
What counts as contributing is always a moving trget | |||
Mitchell: identity of the person the source, the rationale which cd be community norms individual decisions or something more formal p2p | |||
Ingrid lis aand I identities who the audience is if it’s Mozilla how yr b/c to a crtain extent a social element here assessment it’s mea nd my skills a lot of ppl are showing to the community that social dynamic allows for potential to go further | |||
The hanging out w/ peers motivator for pushing you forward experesss yrself as interested and having skills | |||
Audience | |||
ALEX Bald White shirt fguy ipad | |||
But ther’s also the source and there might be a concern w/ single soure | |||
Yr assessment if you don’t think that’s true go see the ppl who hve signed on | |||
Rafi: recommendation audience you’ve got an audience within the ocmmunti that the identity is meaning ful and potentially out side that you can show it to | |||
The diploma that is the signifier to somebody else that your’e good at this | |||
External audience | |||
Alex : Breaks down Potnetial barriers between communities | |||
If you want to invite ppl from outside the community | |||
Ingrid: P2p exemplifies norms /stds/ values put together w/ my learning network badges | |||
Meta level present in every badge | |||
Portuguese woman: sticker album give them something b/c of what they’ve done share these badges give something to yr friend | |||
Part of peer review if you’re given a badge you then share | |||
ALEX: WE talk about source identity and person identity | |||
I guess the uni wd need an artifical personhood the basics might be shard across the 2 id like to break down those ideas of an authority | |||
If you cd say that | |||
Anybody involvedi n the ststme at all can create own badges | |||
Rafi: youth comms wehre interest driven learning is happening fan fiction site validate that and put it on a 2nd resume –resume B | |||
Alex—badge giving badge? | |||
Mithcell: If it succeeds there will be badge aggregators some will be meaning ful | |||
What sounds really bad at first if done well can help small communities who otherwise it’s not gg to mean anything | |||
Anna I wonder if just coming from our experience as educators | |||
reocgnize badge b/c you can meet outcomes see the work behind them | |||
our students i call them apprentices | |||
Heather Leson's rough notes: | |||
Badge Lab | |||
who attended: educators, entrepreneurs, techs, knowledge lab, academics, learning scientists | |||
-mitchell baker - p2pu -web tech learning and auth it. beyond microsoft certs. | |||
-new ways global learning, how to contain and assess. accrediation, informal and formal | |||
-offer recogn for new things that folks are learning, | |||
-world attendance; mexico, argentina, us, canada, portugal, spain, india and more | |||
-make mag dale doughtery - diy self taught, make visible what is happening in informal ed | |||
make the paths visible | |||
figure out the recognition, make learning visible, | |||
groups | |||
1,erin - use cases for badges - what are places that it is applicable, make it meaningful | |||
2. data points that go into a badge, pathway or concrete | |||
3. techs= will be working on deliverables, lay the groundwork for sharing the badges | |||
4.philip - badges 101 no clue and what they | |||
The Tech team notes: | |||
Each of the 5 participants provided the known examples of badge prototypes. | |||
-Dan Mills | |||
id and data sharing: port your data from site to site- federation | |||
-create data standards | |||
-define the basic badge pieces | |||
some identity component, an identifier | |||
-key to determine how the data will flow from apps and how it is verified | |||
-ties into web app framework for open web with local storage aspect | |||
-josh - federation | |||
-assess stack overview model | |||
-create use cases across sites | |||
- addto digital backpack | |||
report backs: | |||
Badges 101 | |||
who auth, indiv, group, etc | |||
outcome traction - hacking | |||
use case | |||
highlights | |||
depend on the content and audience | |||
signaling your achieivements, help learners, hackab | |||
techs | |||
badge program, past examples, big ask; mockup what do you want visualized or id'ed let the | |||
techs know. | |||
badge content dialogue | |||
badge can verify success, rational, identity, verification | |||
Use Cases for Badges Group (with Erin) | |||
people's background/interests: | |||
security trading broker dealer in mexico - regulation is very tough | |||
out of school learning in europe | |||
maker faire | |||
depends on the context (p2pu, informal learning) | |||
depends on the audience….easy way to remix or present yourself: | |||
signal achievements/skills | |||
student engagement / retention | |||
access to more stuff (level up) | |||
recognition for informal learning - way to formalize things that have been learned informally | |||
help learners figure out what they have learned | |||
where and how people learn, learning path - make that visible so other people can learn | |||
link to a portfolio of work - link to some accomplishment (portfolio) | |||
hard vs soft skills - add value to the soft | |||
performance or demonstration - open CV format | |||
not just the thing itself, but what it links to, or the group of things | |||
informal learning is for the experience, intrinsic/extrinsic | |||
Breakout Group: What Should Go Into a Badge? | |||
Notes, Cynthia Jimes | |||
Discussion set in the context of the group’s question of: What is a badge for? To motivate you? To show other’s something you’ve done? Could be both a recognition for achievement but also a motivating factor. Also, in the context of defining a badge as: | |||
* Verification/accreditation of someone’s accomplishment of a specific learning goal or other thing | |||
* A trajectory—things you are doing along the way, the different paths you take | |||
* Badges are more than a representation of some accomplishment or a trajectory of learning, they are a learning instrument themselves | |||
In answering what should go into a badge, the group tried to consider what “data points” would cross the three items above. These data points include: | |||
* An identity. Is this a self identification badge/ badge of self expression? Is it about me and my work? Is it about how my peers view my work? | |||
* An identity of the issuing authority. It might be an institute, a group of peers, etc. | |||
* A rationale or set of norms/standards. Eg, community norms, accreditation rationale | |||
* The audience is identified, and the badge has meaning to the audience (whether they are outside the community or inside it) | |||
* Having the badge link to the work that proves it, showing the learning trajectory , the evidence | |||
Other notes from breakout | |||
* Go to tinyrul.com/mmporfolio for example of a learning portfolio trajectory that was developed by one of the breakout session participants [Not sure if I captured this right] | |||
* Badges might be organized at a metalevel at some point, so that those giving badges are certified, evaluated | |||
edits