Knowledge base Rise Up

How to create an evaluation theme?

  • Updated

The Designer role allows you to create your themes (i.e. a theme is a set of skills, assessment questions and learning resources).

Find out here how to create an assessment theme.

This article covers the following topics:

Step 1 : Information

> Elements to fill in to create a theme

  • Name of your theme
  • Brief description : This will be visible to your learners when they start their positioning on the relevant theme
  • Cover image: this image will be visible to other designers in the Designer index and to learners who follow the theme - Recommended format: ratio 1:1; PNG or JPEG
  • Positioning choice (here "evaluation questions")

Capture d’écran 2024-03-07 à 17.56.24.png

Step 2: Scale

You can define a custom scale of levels, reuse a scale created in a previous theme or choose the standard scale with 5 levels.

> Create a new scale

  • Give a title to your scale (this title will be visible only to the designers)
  • Select the desired number of levels: the custom scale can have from 3 to 5 levels and the label of each level is customizable.
  • Customize the label for each level (optional)

Capture d’écran 2024-03-07 à 17.58.29.png

> Use an existing scale

  • Choose an existing scale
  • Preview it
  • Confirm your choice

> Modify or delete an existing scale

  • Once created, a scale can no longer be modified or deleted from the interface. 
  • After your skills are created in step 3, you won't be able to change the scale anymore.

Step 3: Skills

> Add skills

You have two options to add skills to your theme:

1. Click on "create a skill" to add a new skill manually.
2. Click on "from an existing skill" to add a skill already created in another theme.
Capture d’écran 2024-03-07 à 18.01.32.png

> Delete skills

You can delete skills as long as the theme is not published.

> Add and edit an existing skill in another theme

You can use an existing skill in another theme if and only if the level scale is identical in the different themes.

If one or more skills are created in another theme from an existing skill, any change in one of them will affect the others, as they are assumed to be identical.

> The impact of using the same skill in several themes

Domoscio keeps track of your learners' data history.

This means that the theoretical mastery of a skill will be shared. If your learners have already been assessed on skill once and are assessed again on the same skill later on, Domoscio will only suggest the remaining learning material that are not yet recommended in order to enable the trainee to reach the expected level of proficiency.

> Number of skills to create in a theme

Domoscio recommends that you create 3 to 10 skills per theme

Step 4 : Captions

> Use the captions

You can add additional information to the learners about the meaning of the levels for each skill.

You can use this option to give illustrative examples. For example, the skill "English" at the "Beginner" level can have the caption "I can construct a verbal sentence". This way, learners will better understand the diagnosis given to them. This step is optional, you can easily skip it.

> Create captions

You have two options for creating captions:

1. Add your captions manually from the authoring tool

  • Select the desired skill
  • Add a description for each level of your scale

2. Integrate your captions in mass via the import of an Excel file by clicking on the "import from a file" button

> Use cases of captions

Within the framework of an evaluation theme, the captions are not visible to the learners (mandatory functionality within the framework of the creation of a self-positioning theme).

Step 5: Content

1. Evaluation questions

> Types of content to be integrated

  • Evaluation questions
  • Educational resources

> Integrating content

You have two options for integrating your content:

1. Manual creation from the authoring tool
2. Import your content via an Excel import template
Capture d’écran 2024-03-26 à 09.11.57.png

> Number of questions to create per skill

It is necessary to create at least one question per level of your scale.

For optimum use of the tool, Domoscio recommends that you create at least 3 or 4 questions per level of your scale.

> Types of questions and associated character constraints

  • Multiple choice question: includes Multiple Choice Questions (MCQ) and Single Choice Questions (SCQ). The associated answer suggestions will be displayed in a random order to the learners. The MCQs will have a round checkbox, the MCQs a square checkbox. You can add a maximum of 6 answer choices per question.

Character constraints (including spaces):

  • Title: maximum 50 characters
  • Statement: maximum 300 characters
  • Proposals: maximum 300 characters
  • Feedback : maximum 500 characters

Capture d’écran 2024-03-26 à 09.13.56.png

Capture d’écran 2024-03-26 à 09.14.26.png

  • Open question : You can ask an open question to the learners. We advise you to provide a short answer for this type of question. The tool gives the learner a margin of error for spelling mistakes or plurals, but the longer the expected answer, the higher the risk that the learner's answer will differ from the initial text.

Character constraints (including spaces):

  • Title: maximum 50 characters
  • Statement: maximum 300 characters
  • Answer: maximum 120 characters
  • Feedback : maximum 500 characters

Capture d’écran 2024-03-26 à 09.20.17.png

  • Matching questions: These questions allow you to match two categories of items. You can add a maximum of 6 answer proposals per question.

Character constraints (including spaces):

  • Title: maximum 50 characters
  • Statement: maximum 300 characters
  • Proposals: maximum 170 characters
  • Feedback : maximum 500 characters

Capture d’écran 2024-03-26 à 09.18.26.png

  • Fill-in-the-blank question: These questions allow you to construct sentences containing gaps to be filled in. These gaps can be a free field or a list of possible answers. You can add a maximum of 6 answer proposals per question.

Character constraints (including spaces):

  • Title: maximum 50 characters
  • Statement: maximum 500 characters
  • Proposals: maximum 46 characters
  • Feedback : maximum 500 characters

Capture d’écran 2024-03-26 à 09.17.17.png

> Media that can be integrated in a question

It is possible to add media in the statement of your questions, in the proposals of answers or in the feedbacks proposed to the users. Below is the list of media that can be used in Domoscio Hub:

  • Visuals : you can add images in JPG or PNG format.
  • Videos : you can add a video using an embed link. The video must first be uploaded to a video hosting site.
  • The authoring tool also allows you to add hyperlinks, quotes, mathematical formulas or html formatted text.

> Create a question manually from the authoring tool

Select the level of difficulty corresponding to the question.
1. Add a title that will allow you to find it easily. This title will not be visible to the learners.
2. Create the statement and the proposals according to the chosen type
3. Add an explanation in case of a right/wrong answer or a default explanation that will be displayed in all cases (optional)
4. Once this form is completed, you can save the question. The newly created question is then added to the left column.

The question miniature allows you to edit, delete, preview your question (you can preview a question only after saving your changes). You can also change the difficulty level attached to your question.

NB: on this page, you will also find indications of actions to be performed/underway (orange color code) and completed actions (green color code).

> Integrate questions from the import template

To do this, please refer to the import instructions. You will find it on your platform: theme > step 5 contents > import a file > download the import instructions (integrate PDF file here)

2. Learning Materials

Once you have created your questions, you can add the learnning materials associated with each skill.

> The types of resources to be integrated

  • Internal resources: to host a resource from our editor (example: PDF)
  • External resources: to add an existing resource via a URL (example: e-learning hosted on your LMS)
  • Add an existing resource: to retrieve a resource used in an existing theme

Capture d’écran 2024-03-26 à 09.21.40.png

> Number of resources to create per skill

It is necessary to create at least one resource per skill.

For an optimal user experience, Domoscio recommends that you index one learning material per level of your scale.

Make sure that you index a learning material that is at least at the same level as the level of proficiency to be achieved in the skill.

> Index multiple resources per level

When you index several resources for the same level of your scale, Domoscio will randomly suggest a resource to the user.

> Integrate your resources

You have two options for adding your learning materials:

  • Manual addition from the authoring tool
  • Import your external resources via an Excel import template

> Add a resource manually from the authoring tool

1. Select the level of difficulty corresponding to the resource (i.e. the level of proficiency of the skill that can be achieved by this training action)
2. Add a title that will allow you to find it easily
3. Add a photo (optional)
4. Add the corresponding URL (external resource) or upload the desired file (internal resource)
5. Add a description (visible only for internal resources)
The question miniature allows you to edit or delete your resource. You can also change the difficulty level attached to your resource.

NB: on this page, you will also find indications on the actions to be performed/underway (orange color code) and the completed actions (green color code).

> Add specific URLs for one or more entities

When adding external resources, you have the possibility to add specific URLs for one or more entities.

In this case, the learners of a specific entity will access the resource associated with their group through the specific URL indicated.

Warning: it is necessary to fill in a default URL to fill in specific URLs. This will allow learners who do not have entities to be offered a resource adapted to their context.

Capture d’écran 2024-03-26 à 09.22.36.png

> The impact of using the same resource for several skills

When you update a resource, the changes will be taken into account in all the themes using the resource.

Learners will only be offered the resource once for all the skills that are associated with this single resource.

Step 6: Publication

> Save a theme being created

Modifications to your theme are automatically saved. However, a theme cannot be used by the Training Manager in an experience as long as it has not been published (i.e. theme remains in the draft state).

> Publish a theme

Publication should only take place once your theme is ready and does not require any further modifications.

Was this article helpful?

0 out of 0 found this helpful

Have more questions? Submit a request