1
00:00:00,764 --> 00:00:02,990
<font color="green">My name is David and I am a researcher here at the University of California Berkeley.</font>

2
00:00:04,076 --> 00:00:06,610
<font color="green">I have been asked by others to help improve a piece of software for people like you.</font>

3
00:00:07,339 --> 00:00:11,319
<font color="green">Um, I'm not the one who is responsible for the software, so don't worry about offending me.</font>

4
00:00:12,089 --> 00:00:15,092
<font color="green">We're here to to try and make this software as usable as possible.</font>

5
00:00:15,465 --> 00:00:19,067
<font color="green">We would especially like your help in finding any parts which are difficult or confusing.</font>

6
00:00:19,710 --> 00:00:23,312
<font color="green">To this end, we are asking you to perform a "cognitive walkthrough".</font>

7
00:00:23,312 --> 00:00:27,457
<font color="green">This involves talking out loud while you perform the tasks that we ask you to complete.</font>

8
00:00:27,457 --> 00:00:30,115
<font color="green">I am going to be here simply to observe.</font>

9
00:00:30,115 --> 00:00:31,763
<font color="green">Don't wait for my feedback.</font>

10
00:00:31,763 --> 00:00:34,463
<font color="green">And I will try to not interact as much as possible.</font>

11
00:00:37,645 --> 00:00:40,277
<font color="green">So I'm going to give you a short example of what I mean by cognitive walkthrough,</font>

12
00:00:41,240 --> 00:00:48,527
<font color="green">um, so I am going to give myself a task and then do it and while I am doing it I am going to explain what I see.</font>

13
00:00:49,064 --> 00:00:52,939
<font color="green">Why I am clicking on things, what I expect to happen, if something happens that is surprising.</font>

14
00:00:53,581 --> 00:00:54,582
<font color="green">I will just say that out loud.</font>

15
00:00:55,195 --> 00:01:00,015
<font color="green">So, the task I am going to give is I need to open a paint program and I need to draw a red hexagon.</font>

16
00:01:01,335 --> 00:01:05,876
<font color="green">So I am here at the desktop, and I see there's some applications at the bottom</font>

17
00:01:06,331 --> 00:01:08,600
<font color="green">but none of them looks like it is a drawing program.</font>

18
00:01:09,390 --> 00:01:11,929
<font color="green">So, I am going to search for drawing.</font>

19
00:01:12,373 --> 00:01:15,435
<font color="green">And there is a magnifying glass and I know that that means search.</font>

20
00:01:15,844 --> 00:01:20,108
<font color="green">I will click that and see if we have have something... "paintbrush".</font>

21
00:01:21,215 --> 00:01:23,445
<font color="green">Okay, Paintbrush looks good, like it will work.</font>

22
00:01:24,674 --> 00:01:26,512
<font color="green">So I click on that, that's the first link.</font>

23
00:01:27,918 --> 00:01:31,641
<font color="green">Now, it looks like it is asking me for how big the image should be.</font>

24
00:01:32,055 --> 00:01:36,054
<font color="green">And I wonder if I'll be able to change this later or if I have to decide now.</font>

25
00:01:36,912 --> 00:01:40,762
<font color="green">But uh I am not going to worry about it too much and I am just going to go with the default.</font>

26
00:01:42,989 --> 00:01:47,914
<font color="green">Okay, the window resized and that I think that means that it resized to the numbers that were there.</font>

27
00:01:48,620 --> 00:01:52,575
<font color="green">So now, uh, I need to switch to red color.</font>

28
00:01:53,150 --> 00:01:57,971
<font color="green">Um, so I click here and it gave me something red.</font>

29
00:01:58,745 --> 00:02:01,421
<font color="green">And now I wonder if there is a tool to draw a hexagon.</font>

30
00:02:02,209 --> 00:02:05,802
<font color="green">There's this, this only says "Rectangle". That doesn't look right.</font>

31
00:02:08,658 --> 00:02:10,935
<font color="green">I don't think these do it, so I might have to draw it myself.</font>

32
00:02:11,546 --> 00:02:16,449
<font color="green">Uh, I will do the line tool and try to draw a line.</font>

33
00:02:18,399 --> 00:02:22,206
<font color="green">Uh, something is wrong because the line is black even though I picked red.</font>

34
00:02:23,141 --> 00:02:27,354
<font color="green">So, I am going to try and undo that. "Edit", "Undo".</font>

35
00:02:28,733 --> 00:02:32,381
<font color="green">Um, click the red, it doesn't work.</font>

36
00:02:34,557 --> 00:02:37,264
<font color="green">This is color selection, let me try this.</font>

37
00:02:38,116 --> 00:02:41,902
<font color="green">Okay, now that changed down here. So that's a little strange. Let me try red again.</font>

38
00:02:43,076 --> 00:02:44,943
<font color="green">Okay, so now it's actually red.</font>

39
00:02:45,759 --> 00:02:48,647
<font color="green">Now let me try drawing the shape.</font>

40
00:02:54,774 --> 00:02:57,496
<font color="green">I wonder if there is like a tool to automatically close this shape,</font>

41
00:02:58,046 --> 00:03:02,445
<font color="green">but I am not actually going to try because I wouldn't know where to find it, so I am just going to close it.</font>

42
00:03:04,157 --> 00:03:10,824
<font color="green">And now, I know from other paint programs that this paint bucket will fill it in and I click and that's exactly what I expected to happen.</font>

43
00:03:11,800 --> 00:03:13,544
<font color="green">So that's the example cognitive walkthrough.</font>

44
00:03:13,925 --> 00:03:16,947
<font color="green">Now I am going to give you another simple example where I want you to practice doing this technique.</font>

45
00:03:17,507 --> 00:03:18,062
Sure.

46
00:03:18,582 --> 00:03:22,561
<font color="green">So, I want you to open a web browser and find the population of Zimbabwe.</font>

47
00:03:32,165 --> 00:03:37,288
<font color="green">Okay, good. Now I need you explain what you are doing as you, um, take each step of the process.</font>

48
00:03:39,361 --> 00:03:39,762
Oh, okay.

49
00:03:40,143 --> 00:03:43,568
<font color="green">So run through that again and explain like each step you took, starting from opening the browser.</font>

50
00:03:44,058 --> 00:03:47,836
So now I'm opening Safari, that's what I usually use.

51
00:03:48,230 --> 00:03:48,682
<font color="green">Mmhmm.</font>

52
00:03:49,235 --> 00:03:57,453
Now I type in "population in"... "population in zimbabwe".

53
00:03:58,685 --> 00:04:00,622
The thing is that I don't know how to spell it but there is... [Laughter.]

54
00:04:01,925 --> 00:04:06,638
There it is in the search history so I click enter and there it is.

55
00:04:07,182 --> 00:04:07,824
<font color="green">Okay.</font>

56
00:04:08,317 --> 00:04:15,311
According to numbers in 2013, the population is uh 14.15 million population in Zimbabwe.

57
00:04:16,240 --> 00:04:21,771
<font color="green">Okay great, good. So now we'll move on to the real experiment.</font>

58
00:04:22,324 --> 00:04:25,033
<font color="green">So today, it's going to be a test of a web browser that is called Tor Browser.</font>

59
00:04:25,562 --> 00:04:25,975
Okay.

60
00:04:26,504 --> 00:04:26,932
<font color="green">Have you heard of it before?</font>

61
00:04:27,478 --> 00:04:27,877
No.

62
00:04:28,372 --> 00:04:31,089
<font color="green">Okay. And uh these are the instructions I want you to follow.</font>

63
00:04:31,524 --> 00:04:31,925
Mmhmm.

64
00:04:32,386 --> 00:04:34,081
<font color="green">As much as possible, I want you to figure it out on your own.</font>

65
00:04:34,389 --> 00:04:38,725
<font color="green">But if we get really stuck, then we'll, we'll find a way to solve it. Do you have any questions before we start?</font>

66
00:04:40,278 --> 00:04:41,858
I need to see if I can find Tor.

67
00:04:42,365 --> 00:04:42,764
<font color="green">Okay.</font>

68
00:04:43,331 --> 00:04:43,730
Okay.

69
00:04:44,146 --> 00:04:44,547
<font color="green">Yeah, that is part of it.</font>

70
00:04:45,021 --> 00:04:45,422
Okay.

71
00:04:45,891 --> 00:04:50,028
<font color="green">So, uh just start now and then do whatever you would do at home if you had to...</font>

72
00:04:50,576 --> 00:04:53,271
Do I need to close the web browser and open it again or I just...

73
00:04:53,952 --> 00:04:55,041
<font color="green">If you would use this browser, you can leave it open.</font>

74
00:04:55,572 --> 00:05:03,446
Okay. So I just would type in "tor" in the uh search engine and "Tor Project"...

75
00:05:04,708 --> 00:05:08,814
"Anonymity Online", I guess this is it.

76
00:05:09,396 --> 00:05:11,199
And I click.

77
00:05:12,586 --> 00:05:17,101
And the there is a "Download Tor", so I am going to click this.

78
00:05:18,245 --> 00:05:21,822
It's for Mac. So I will click download.

79
00:05:23,206 --> 00:05:24,134
Okay. It's downloading.

80
00:05:25,120 --> 00:05:27,517
<font color="green">Uh, so during the download time, it will take a few minutes.</font>

81
00:05:27,975 --> 00:05:28,375
Okay.

82
00:05:28,925 --> 00:05:34,357
<font color="green">Go ahead and just describe anything that you see or you observe about this page or this download task.</font>

83
00:05:36,939 --> 00:05:38,187
"Want Tor to really work"...

84
00:05:39,144 --> 00:05:50,064
Um... "Full list of warnings"... Okay. I am going to read the "want Tor to really work".

85
00:05:50,064 --> 00:05:50,786
Do I need to read this aloud?

86
00:05:52,384 --> 00:05:54,901
<font color="green">No, but just say what it makes you think about as you're reading it.</font>

87
00:05:55,338 --> 00:05:57,990
<font color="green">Or if anything looks really important to you that you would normally notice.</font>

88
00:06:00,677 --> 00:06:08,105
Uh... "Don't torrent over Tor". "Torrent file-sharing applications have been

89
00:06:08,105 --> 00:06:12,531
observed to ignored proxy settings and make direct connections even when they are told to use Tor."

90
00:06:13,913 --> 00:06:19,290
Okay, it seems I cannot use torrent while on Tor.

91
00:06:20,869 --> 00:06:25,286
That's important to know. Okay. Um,

92
00:06:25,975 --> 00:06:29,394
"Don't enable or install browser plugins".

93
00:06:30,293 --> 00:06:32,468
Oh, okay. That's good to know.

94
00:06:32,468 --> 00:06:41,495
Um. So, I guess that means when I use Tor I cannot watch videos?

95
00:06:41,495 --> 00:06:46,307
That's a little bit concerning for me. Um.

96
00:06:47,877 --> 00:06:53,939
And... Oh, "Don't open documents downloaded through Tor while online".

97
00:06:59,821 --> 00:07:01,564
Um.

98
00:07:04,795 --> 00:07:06,966
Okay. I think I understand.

99
00:07:09,300 --> 00:07:18,435
But I am wondering since you are browsing Internet if you cannot read the documents online or watch videos while you are on Tor.

100
00:07:18,898 --> 00:07:19,836
That's a little bit inconvenient.

101
00:07:20,283 --> 00:07:20,682
<font color="green">Mm.</font>

102
00:07:24,718 --> 00:07:26,351
Okay. It's almost finished downloading.

103
00:07:26,766 --> 00:07:27,166
<font color="green">Okay.</font>

104
00:07:48,059 --> 00:07:49,531
Okay. Almost.

105
00:07:57,533 --> 00:08:00,202
I am just... It's finished downloading, I am going to install it.

106
00:08:19,644 --> 00:08:20,692
Wait. Is it...

107
00:08:23,636 --> 00:08:25,740
Okay. "Torrent Browser".

108
00:08:26,247 --> 00:08:29,125
"'TorBrowser' can't be opened because it's from..."

109
00:08:31,961 --> 00:08:34,486
Uh, do I need to change the system preferences?

110
00:08:35,240 --> 00:08:37,399
<font color="green">So do whatever you would normally do in this situation.</font>

111
00:08:37,799 --> 00:08:38,200
Okay.

112
00:08:38,649 --> 00:08:39,049
<font color="green">If you saw that.</font>

113
00:08:39,860 --> 00:08:42,037
Uh, umm.

114
00:08:46,096 --> 00:08:47,601
<font color="green">The password here is just "password".</font>

115
00:08:48,340 --> 00:08:51,004
Okay. Okay. Ahh.

116
00:09:00,970 --> 00:09:06,600
I think this will work. Since I changed the security settings... yes.

117
00:09:09,048 --> 00:09:12,980
Okay. So here comes the "Tor Network Settings".

118
00:09:13,333 --> 00:09:18,548
"Which of the following best describes your situation?" "Connect directly to the Tor network, this will work in most situations".

119
00:09:19,086 --> 00:09:22,313
Okay. I will just click "Connect".

120
00:09:35,407 --> 00:09:37,222
Okay. Here, it says congratulations. [Laughter.]

121
00:09:40,245 --> 00:09:43,259
<font color="green">Okay, so you got, you've got 1 and 3 here and now you are on...</font>

122
00:09:43,885 --> 00:09:44,285
Yep.

123
00:09:44,625 --> 00:09:45,053
<font color="green">3.</font>

124
00:09:45,624 --> 00:09:46,634
"Do a web search for 'onions'."

125
00:09:47,179 --> 00:09:50,111
<font color="green">Oh, here, try this one. If you know how to do this, check that Tor is working.</font>

126
00:09:50,591 --> 00:09:51,794
Check? Okay. I will just go to Google.

127
00:09:52,238 --> 00:09:52,638
<font color="green">Okay.</font>

128
00:10:00,940 --> 00:10:05,365
Okay, I think it works. So I checked it's working.

129
00:10:05,822 --> 00:10:06,221
<font color="green">Okay.</font>

130
00:10:07,011 --> 00:10:13,381
And I'm now doing web search for "onions". Yes.

131
00:10:14,052 --> 00:10:16,785
<font color="green">Okay, good. You don't have to click on any of those. Just we wanted to see the search.</font>

132
00:10:17,687 --> 00:10:22,298
And "Find a YouTube video for 'Ode to Joy'".

133
00:10:23,221 --> 00:10:25,701
Should I go to YouTube or should I just go to...

134
00:10:27,490 --> 00:10:29,335
<font color="green">However you would normally search for a YouTube video.</font>

135
00:10:29,857 --> 00:10:30,395
Okay.

136
00:10:34,304 --> 00:10:38,398
<font color="green">I am typing in "ode to joy", search video, and...</font>

137
00:10:40,008 --> 00:10:41,232
<font color="green">There is a YouTube video. I am clicking.</font>

138
00:10:41,921 --> 00:10:42,321
Okay.

139
00:10:47,649 --> 00:10:49,304
<font color="green">"A plugin is need to display".</font>

140
00:10:49,774 --> 00:10:53,769
<font color="green">I remembered, it says the plugin is not working on onion, so.</font>

141
00:10:54,380 --> 00:10:57,062
<font color="green">I'm sorry, on Tor. [Laughter.]</font>

142
00:10:58,364 --> 00:11:00,292
Okay, I think I finished this. Number 5.

143
00:11:00,797 --> 00:11:05,381
<font color="green">Uh, yeah, we actually should let it... Wait here for a moment.</font>

144
00:11:06,039 --> 00:11:06,561
Okay.

145
00:11:12,014 --> 00:11:18,251
<font color="green">Uh, this is not exactly what I expected to happen so I just want to make sure that this isn't an error.</font>

146
00:11:26,231 --> 00:11:27,168
<font color="green">Oh, yeah, it seems to be...</font>

147
00:11:27,931 --> 00:11:28,633
Should I try another one?

148
00:11:29,313 --> 00:11:30,846
<font color="green">...the way it is. Yeah. You can try another one.</font>

149
00:11:31,504 --> 00:11:31,903
Okay.

150
00:11:32,312 --> 00:11:32,712
<font color="green">That's maybe, that's a good idea.</font>

151
00:11:33,197 --> 00:11:37,875
I just backward and there seems there is another video. I am clicking on the second video.

152
00:11:38,677 --> 00:11:39,076
<font color="green">Okay</font>

153
00:11:39,587 --> 00:11:42,144
On web browser, hope it works.

154
00:11:43,360 --> 00:11:43,759
Oh.

155
00:11:44,188 --> 00:11:44,589
<font color="green">Same thing.</font>

156
00:11:45,208 --> 00:11:48,692
It says... Oh?! Okay. No?

157
00:11:49,239 --> 00:11:50,678
Oh! It worked. It works. [Laughter.]

158
00:11:56,605 --> 00:11:57,750
Okay, it's playing. That's good sign.

159
00:11:59,461 --> 00:12:02,826
Hm. Okay it's working.

160
00:12:03,850 --> 00:12:04,250
<font color="green">Okay.</font>

161
00:12:04,688 --> 00:12:05,089
Good.

162
00:12:05,613 --> 00:12:06,051
<font color="green">Good. All right.</font>

163
00:12:06,647 --> 00:12:07,047
I will click...

164
00:12:09,832 --> 00:12:10,232
<font color="green">So you can...</font>

165
00:12:10,831 --> 00:12:11,230
That's the other way around. Okay.

166
00:12:11,796 --> 00:12:12,196
<font color="green">Okay.</font>

167
00:12:12,769 --> 00:12:14,049
So, uh, I finished number 5.

168
00:12:14,613 --> 00:12:15,013
<font color="green">You're on 6.</font>

169
00:12:15,639 --> 00:12:21,864
"Use 'New Identity' under the onion menu". Onion, I guess this is. "New Identity".

170
00:12:24,496 --> 00:12:29,773
<font color="green">Now, can you... can you describe what just happened, and what do you think?</font>

171
00:12:30,600 --> 00:12:40,527
Okay, I click on the onion and the New Identity bar and then it's uh, changed, it go back to the webpage

172
00:12:41,129 --> 00:12:45,381
that says "Congratulations" like the one I just installed Tor. So.

173
00:12:46,004 --> 00:12:46,403
<font color="green">Okay</font>

174
00:12:47,066 --> 00:12:47,533
So I am not sure what is happening next, but yeah.

175
00:12:48,894 --> 00:12:49,293
<font color="green">Okay.</font>

176
00:12:50,496 --> 00:12:57,018
<font color="green">All right, so now the top of the window here. I want you to find all these little icons and explain what you think each one of them means.</font>

177
00:13:00,600 --> 00:13:01,748
Okay, okay. I'm going to start with the first one.

178
00:13:03,273 --> 00:13:05,720
<font color="green">Okay, you can go ahead and explore them if you need to.</font>

179
00:13:07,556 --> 00:13:12,352
Okay. "Forbid Scripts Globally (advised)". I am not sure what it means.

180
00:13:12,967 --> 00:13:13,379
<font color="green">Mmhmm.</font>

181
00:13:15,716 --> 00:13:16,658
I click, nothing happens.

182
00:13:17,645 --> 00:13:21,351
And uh, oh, here's the, under the onion

183
00:13:21,756 --> 00:13:28,977
I think it is all settings and information about the Tor webpage. Uh.

184
00:13:29,585 --> 00:13:31,474
I will click on "Preference".

185
00:13:35,818 --> 00:13:40,296
"Use the recommended proxy settings for my version of Firefox".

186
00:13:40,739 --> 00:13:43,947
I am on Firefox? I thought I am on Safar— Wait. what?

187
00:13:44,943 --> 00:13:45,931
<font color="green">Okay, so if that's surprising, just...</font>

188
00:13:46,826 --> 00:13:51,711
Okay. So it says "Use the recommended proxy settings for my version of Firefox".

189
00:13:52,232 --> 00:13:55,971
So, I guess when I click "New Identity" it opens Firefox?

190
00:13:57,100 --> 00:13:59,993
No. Wait—Sorry, I am a little bit confused now. [Laughter.]

191
00:14:00,816 --> 00:14:06,692
<font color="green">That's fine. I can explain some things afterward. But just now, just explain that you are confused.</font>

192
00:14:07,365 --> 00:14:08,904
Okay, I am confused now.

193
00:14:09,432 --> 00:14:12,078
The "Proxy Settings", so I am going to the security settings.

194
00:14:14,419 --> 00:14:19,782
Oh, it says "Don't record browsing history or website data".

195
00:14:21,130 --> 00:14:25,778
"Disable browser plugins, (such as Flash)".

196
00:14:26,166 --> 00:14:29,267
"Restrict third-party cookies and other tracking"... Okay, good to know.

197
00:14:30,490 --> 00:14:37,379
Um, and on the right of the onion tab it's the search engine.

198
00:14:38,908 --> 00:14:43,772
And so what is this? Okay.

199
00:14:44,900 --> 00:14:47,355
So it's the default webpage set on the browser.

200
00:14:48,748 --> 00:14:51,679
How about the bar here? Oh, okay.

201
00:14:52,975 --> 00:14:59,438
Here is the history, "Save Page", "Bookmarks", like normal web browser has.

202
00:15:00,667 --> 00:15:04,504
Okay. Uh, "Sign in to Sync". Oh, okay.

203
00:15:05,222 --> 00:15:11,168
So I can use this on one laptop and I will see my history and bookmarks on the other.

204
00:15:11,650 --> 00:15:12,197
<font color="green">Mmhmm.</font>

205
00:15:14,258 --> 00:15:16,655
Okay, good to know. Um. Is it?

206
00:15:17,187 --> 00:15:18,889
<font color="green">Great. That's it. Great, fantastic.</font>