-
Notifications
You must be signed in to change notification settings - Fork 1
/
Copy pathconfig.json
41 lines (39 loc) · 4.9 KB
/
config.json
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
{
"meta": {
"title": "Annotate the most important regions on graphic designs",
"description": "Manually highlight the important parts of a graphic design. You will be shown a set of 10 to 15 images, and you will have to indicate which parts feel important to you.",
"numSubtasks": 1,
"disclaimer": "This is a disclaimer. You are participating in this experiment voluntarily.",
"aggregate": false
},
"instructions": {
"simple": "Your task is to highlight the most important regions (either graphics or text) in a sequence of 10 to 15 images. Important regions are regions that help you understand what the image is about. You can select multiple regions per image. Try to be precise. You will have 1 minute per image, so focus on the most important elements first. You might be shown images with or without text. <b>Please ignore watermarks</b> (they will have a diamond pattern and have text in the middle. Act as if they weren't there).<br><br>You have 3 tools you can use to annotate images (in the menu bar on the right-side of the image). Please pick whichever you prefer. You can try out different options.<br><br><b>To annotate using the Stroke Fill (default):</b><br>(1) Click on the edge of the element you would like to trace around.<br>(2) While holding the mouse down, trace around the element until you reach your approximate starting point.<br>(3) A nice outline will be automatically created. If you are unsatisfied with it, you can click 'Undo'.<br><br>A demonstration of Stroke Fill can be seen in the sample video below.<br><br><b>To annotate using the Polygon Fill:</b><br>(1) Click on the Polygon Fill button on the right menu.<br>(2) Click on the edge of the element you want to annotate.<br>(3) Let go of the mouse and move it towards a new edge. A straight line between the starting point and your mouse position will be automatically created.<br>(3) Click again to generate a new point.<br>(4) Continue outlining the object until you reach your starting point, indicated by a blue circle. Clicking on the blue circle completes the annotation.<br><br><b>To annotate using the Regular Stroke:</b><br>(1) Click on the Regular Stroke button on the right menu.<br>(2) Pick a Brush Size (or go with the default).<br>(3) Paint over the whole image region you want to select as important.<br>If possible, try to avoid this method, as it produces noisy boundaries.<br><br>When you are done annotating all 10 images, you will see a completion screen, at which point you will be able to submit the HIT.<br><br>Note: this task should not take long. This is why there is a 1 minute time limit on each image. You do not need to use the full minute. Click 'Next' when you are done annotating an image.<br><br><b>WARNING: we will be measuring your input on each image. If your highlighted region is low effort or inaccurate, you will be blocked. Make sure that you label something in each image.</b><br><br><b>Please use Chrome or Firefox to complete this task.</b><br><br><br><br><i>Disclaimer: This HIT is part of a MIT scientific research project. Your decision to complete this HIT is voluntary. There is no way for us to identify you. The only information we will have, in addition to your responses, is the time at which you completed the survey. The results of the research may be presented at scientific meetings or published in scientific journals. Clicking on the 'SUBMIT' button on the bottom of this page indicates that you are at least 18 years of age and agree to complete this HIT voluntarily.</i>",
"steps": [
"An image will be shown. Analyze it and identify the most important parts.",
"Label those parts with one of the 3 available tools: Regular Stroke, Stroke Fill or Polygon Fill.",
"Once you are done, click Next to go to the next image.",
"Repeat the process until all images are annotated. At that point, you can click submit to finish the task."
],
"images": ["img/example1_importance_labeling.gif","img/imp_labeling_gif_1.gif","img/imp_labeling_gif_2.gif","img/imp_labeling_gif_3.gif"]
},
"hitCreation": {
"title": "Annotate the most important regions on graphic designs",
"description": "Manually highlight the important parts of a graphic design. You will be shown a set of 10 to 15 images, and you will have to indicate which parts feel important to you.",
"numTasks": 1,
"numAssignments": 1,
"rewardAmount": "0.85",
"keywords": "labeling, importance, highlighting, graphic, designs, images",
"duration": 1200,
"lifetime": 186400,
"taskUrl": "https://turkeyes.github.io/importannots/",
"fold": "sentinel_short.txt",
"production": false
},
"advanced": {
"includeDemographicSurvey": false,
"hideIfNotAccepted": false,
"externalSubmit": false,
"externalSubmitUrl": "",
"downloadDataOnSubmit": false
}
}