This task entails designing a methodology used to assess:
- the main values of the data-labeller;
- industry/ sector-specific values;
- particular values the data-labeller has.
Steps:
-
define the set of main values (top5) for the data-labeller (such as: integrity, trustworthiness, diversity…)
-
create the "tricky" questions /scenarios / an implicit value-test (similar to implicit.harvard.edu/implicit), to see if main values are present and to what extent
-
create hierarchy questions to see what how the main values are prioritized by the data-labeller]
-
design a scoring model (to assign a score to each of the top 5 values based on the assessment)
-
create open questions for identifying other values (industry/sector specific & other particular values)
This value-assessment methodology will be later integrated in the data-labeller platform, for the data-labeller to be able to take the assessment & finish setting up their profile.