Drumbeat/p2pu/Assessment and Accreditation/Webcraft Assessments - detailed/Methodology v1: Difference between revisions

 
Line 1: Line 1:
== Determining competencies of interest – a methodology ==
== Determining skills of interest – a methodology ==


''Background''
''Background''


For the P2PU/Mozilla School of Webcraft project, we need to identify a suite of competencies (skills, habits, knowledge, etc) that are of particular interest to employers and collaborators who need to evaluate the potential for someone to be a good professional fit for their needs. In actuality, this problem is ubiquitous for most disciplines, especially when it comes to non-knowledge-based abilities, but we are focused on the School of Webcraft here.
For the P2PU/Mozilla School of Webcraft project, we need to identify a suite of skills (competencies, habits, knowledge, etc) that are of particular interest to employers and collaborators who need to evaluate the potential for someone to be a good professional fit for their needs. In actuality, this problem is ubiquitous for most disciplines, especially when it comes to non-knowledge-based abilities, but we are focused on the School of Webcraft here.


We have talked to experts in the field, and we plan to continue doing so. But there is a need for a more comprehensive, replicable methodology for determining the "desirable qualities" of someone in an open-source programming environment. The following approach has not been tested, to our knowledge, but seems worthwhile, and may prove to be generally applicable.
We have talked to experts in the field, and we plan to continue doing so. But there is a need for a more comprehensive, replicable methodology for determining the "desirable qualities" of someone in an open-source programming environment. The following approach has not been tested, to our knowledge, but seems worthwhile, and may prove to be generally applicable.
Line 28: Line 28:


If we really want to demonstrate the potential for this approach, we should recruit several different people to perform parallel analyses (i.e., pursue the same questions on the same system, but independently) so that we can evaluate the extent to which the resulting conclusions differ from each other. Some diversity is fine, but if this methodology is sufficiently objective, we should see broadly similar results for each of the efforts.
If we really want to demonstrate the potential for this approach, we should recruit several different people to perform parallel analyses (i.e., pursue the same questions on the same system, but independently) so that we can evaluate the extent to which the resulting conclusions differ from each other. Some diversity is fine, but if this methodology is sufficiently objective, we should see broadly similar results for each of the efforts.


== Data ==
== Data ==
191

edits