1
00:00:00,377 --> 00:00:03,079
So... My name is David and I am a researcher here at the University of California Berkeley.
2
00:00:03,978 --> 00:00:06,583
I have been asked by others to help improve a piece of software for people like you.
3
00:00:07,153 --> 00:00:11,929
Um, I'm not responsible for the software, even though I do Tor development, I don't really do Tor Browser.
4
00:00:12,833 --> 00:00:14,480
So don't worry about offending me.
5
00:00:14,846 --> 00:00:17,554
We're really looking for... we're trying to make the software as usable as possible,
6
00:00:18,117 --> 00:00:21,144
so we would especially like your help in identifying any parts that are difficult or confusing.
7
00:00:22,968 --> 00:00:25,341
To this end, we're asking you to perform a "cognitive walkthrough".
8
00:00:26,033 --> 00:00:28,900
This involves talking out loud while you perform the tasks that we ask you to complete.
9
00:00:29,670 --> 00:00:32,573
As far as possible, I am going to be here to simply to observe.
10
00:00:33,487 --> 00:00:35,804
I am going to try not to interfere. Don't wait for feedback from me,
11
00:00:37,133 --> 00:00:44,460
and try to only interact is something is unclear, if you need further instructions.
12
00:00:45,780 --> 00:00:50,912
So I am going to give a short example of cognitive walkthrough. And then you are going to do a demonstration cognitive walkthrough.
13
00:00:54,316 --> 00:00:55,683
To give you an idea of what I am looking for.
14
00:00:57,490 --> 00:00:59,067
So I am going to assign myself a task.
15
00:01:00,595 --> 00:01:05,298
And this task is to find a paint program and draw a red hexagon.
16
00:01:06,540 --> 00:01:10,533
So, I am looking at a desktop here. There's nothing on the desktop.
17
00:01:11,287 --> 00:01:14,426
I am looking for something that will draw a paint program for me.
18
00:01:15,484 --> 00:01:18,400
Down in the bottom it doesn't look like anything does that.
19
00:01:18,980 --> 00:01:24,528
So I think I'm going to have to look for it. And to do that, I know I can find files by looking at Finder.
20
00:01:26,932 --> 00:01:35,424
I am going to click on "Applications" and then see what... see what I can find.
21
00:01:37,766 --> 00:01:40,076
This one is called "Paintbrush". So I am going to try that one.
22
00:01:43,516 --> 00:01:44,956
All right, so it starts up and it is asking me a question.
23
00:01:45,343 --> 00:01:47,632
I see it is asking me for width and height of the image.
24
00:01:48,275 --> 00:01:55,492
Now I'm not sure if I will be able to change this later. It's not clear to me if this is an irrevocable decision,
25
00:01:56,406 --> 00:01:58,609
but I don't know what to do about it so I am going to just click okay.
26
00:01:59,612 --> 00:02:02,543
It looks like it changed size to match what I just typed in, that kind of makes sense.
27
00:02:04,087 --> 00:02:08,790
And it looks like there is already a color thing opened up, so I'll pick a red color.
28
00:02:10,382 --> 00:02:15,013
And I want to draw a hexagon so I am looking for a shape tool.
29
00:02:15,766 --> 00:02:20,295
This one... looks like it's only rectangles.
30
00:02:21,179 --> 00:02:23,013
This is ellipse.
31
00:02:24,211 --> 00:02:29,653
Okay, so I don't have a hexagon tool, I don't think, so I'll try and just draw it with lines.
32
00:02:31,420 --> 00:02:36,322
Now I am going to click here. And draw a line.
33
00:02:37,387 --> 00:02:38,770
It's not what I expected.
34
00:02:39,493 --> 00:02:41,262
I wanted it to connect those and that didn't happen.
35
00:02:41,794 --> 00:02:43,290
So I am going to say "Undo".
36
00:02:45,554 --> 00:02:48,622
And this time I am going to try to try just dragging.
37
00:02:49,569 --> 00:02:51,250
Okay, that's what I wanted to happen.
38
00:02:51,718 --> 00:02:53,140
But it is the wrong color. It's not what I expected.
39
00:02:53,616 --> 00:02:57,425
I picked red here, and it surprised me that it didn't actually make the line red.
40
00:02:58,627 --> 00:03:04,963
So I guess maybe if I click here, when I clicked that, this turned into black.
41
00:03:05,329 --> 00:03:09,418
So this is really confusing. I don't know what this color meant.
42
00:03:09,931 --> 00:03:11,644
Anyway, now it's turned red. So now we can continue.
43
00:03:12,621 --> 00:03:14,388
I'll just redraw this line.
44
00:03:17,640 --> 00:03:19,376
And I guess I kind of have to freehand this.
45
00:03:24,479 --> 00:03:26,199
That was no good. Undo that.
46
00:03:30,192 --> 00:03:35,514
I wonder if there is a way to automatically like close this shape, but I don't see that so I am just going to do it manually.
47
00:03:37,218 --> 00:03:41,026
And now to fill it in, I know from other paint programs that this paint bucket will do that.
48
00:03:41,829 --> 00:03:44,728
I click on it... yeah. And that's exactly what I expected to happen.
49
00:03:46,549 --> 00:03:48,740
So that's the cognitive walkthrough. Explain what you see. Anything that is surprising. Yes.
50
00:03:49,330 --> 00:03:49,894
Think out loud, basically.
51
00:03:51,205 --> 00:03:52,834
Yeah. Exactly.
52
00:03:58,937 --> 00:04:02,917
Alright, uh let me close this. Now, I am going to give you a demo task to practice the cognitive walkthrough.
53
00:04:03,514 --> 00:04:03,926
Okay.
54
00:04:04,465 --> 00:04:08,371
So I want you to open up a web browser and then find out the population of Zimbabwe.
55
00:04:08,915 --> 00:04:12,467
Okay. I recognize Chrome.
56
00:04:13,125 --> 00:04:13,525
Mmhmm.
57
00:04:13,931 --> 00:04:15,290
Which is what I use, so I'm going to open that up.
58
00:04:18,607 --> 00:04:21,196
I am just going to type in the search bar up here, which I know is just a Google search.
59
00:04:22,714 --> 00:04:24,555
Population of Zimbabwe, did you say?
60
00:04:25,012 --> 00:04:25,413
Yeah.
61
00:04:25,874 --> 00:04:26,783
Zimbabwe.
62
00:04:27,192 --> 00:04:30,076
And then let's just see what we get if we just type it in there.
63
00:04:30,951 --> 00:04:37,985
Google's telling me that in 2013 it was 14.15 million but I... Their source is the World Bank.
64
00:04:38,586 --> 00:04:41,997
I trust that a lot but I would probably...
65
00:04:43,093 --> 00:04:47,822
want to look at the CIA factbook. Which is the third result. Just to...
66
00:04:48,502 --> 00:04:49,064
Sure.
67
00:04:49,617 --> 00:04:51,011
...double-check that.
68
00:04:56,750 --> 00:05:00,146
And it looks like something's going on with these images that aren't loading.
69
00:05:02,232 --> 00:05:09,281
But I see it says "People and Society". Which may give me population.
70
00:05:10,639 --> 00:05:12,064
And then there I have a population mark.
71
00:05:13,083 --> 00:05:16,341
13.7... But do we have a year? Oh, July 2014.
72
00:05:16,800 --> 00:05:20,872
So this actually probably would be the most recent, most accurate one I can get.
73
00:05:21,464 --> 00:05:27,892
Okay. Great, yeah. Good job! So it's good... yes. To explain when something is familiar. You've seen it before, so you recognize it.
74
00:05:27,892 --> 00:05:30,490
Or when anything is—appears broken. You know.
75
00:05:30,949 --> 00:05:31,348
Mmhmm.
76
00:05:31,944 --> 00:05:36,658
And there may be some downtime that you're going to have to do a download. And so, while that is happening, just, you know,
77
00:05:36,658 --> 00:05:39,375
see what you can see on the screen and explain what is going on.
78
00:05:40,108 --> 00:05:40,507
Okay.
79
00:05:40,850 --> 00:05:44,920
Go ahead and close this and I will give you your list of tasks.
80
00:05:45,660 --> 00:05:46,060
Okay.
81
00:05:47,141 --> 00:05:48,961
So here they are, seven things.
82
00:05:49,865 --> 00:05:50,266
Okay.
83
00:05:51,182 --> 00:05:55,706
You are going to be... downloading, using Tor Browser for some web browsing tasks.
84
00:05:56,322 --> 00:05:56,901
Okay.
85
00:05:59,026 --> 00:06:03,601
And I will just be observing. Just kind of do this the way you would do it if you were if you were going to do this at home, and do it from scratch.
86
00:06:04,735 --> 00:06:06,079
Do you have any questions before we start?
87
00:06:06,952 --> 00:06:07,610
No.
88
00:06:08,134 --> 00:06:09,382
Okay. Alright, go to it!
89
00:06:10,574 --> 00:06:13,170
So, I am going to download Tor. I am going to reopen Chrome.
90
00:06:15,153 --> 00:06:19,536
And I am just going to search "tor browser".
91
00:06:20,146 --> 00:06:24,218
Which, if I am going to be completely transparent, isn't something I probably would do.
92
00:06:24,805 --> 00:06:32,230
Or have a source do in a real situation, just in their Chrome browser.
93
00:06:32,230 --> 00:06:33,584
Especially if they were at an institution, like on an enterprise network or something.
94
00:06:34,050 --> 00:06:34,449
Sure, okay.
95
00:06:35,987 --> 00:06:40,156
Okay, I am going to... "torproject.org"...
96
00:06:41,613 --> 00:06:42,949
There's even...
97
00:06:42,949 --> 00:06:46,742
I am seeing the second result is "Download Tor".
98
00:06:46,742 --> 00:06:48,884
That might save a few steps, I will click on that.
99
00:06:48,884 --> 00:06:55,762
And I am going to download Tor Browser for Mac.
100
00:06:58,137 --> 00:06:59,132
Okay.
101
00:07:02,124 --> 00:07:05,240
Um, this is a little... weird-looking here.
102
00:07:07,725 --> 00:07:09,797
I see a... this is good though.
103
00:07:10,305 --> 00:07:14,064
This is telling people that they shouldn't totally rely just on Tor, or on this program.
104
00:07:16,470 --> 00:07:18,189
"You need to change some of your habits".
105
00:07:18,567 --> 00:07:22,781
I am assuming that's like, kind of like threat modeling and that sort of thing.
106
00:07:23,841 --> 00:07:26,557
So that could be good, although I think maybe that would be better...
107
00:07:28,605 --> 00:07:33,497
I don't know. I look at that and that almost looks like an ad or something.
108
00:07:33,497 --> 00:07:41,600
The way that's set up, it seems like, like I almost, like, my first instinct was to just kind of look past it.
109
00:07:41,600 --> 00:07:43,591
But it is something that is probably important.
110
00:07:43,591 --> 00:07:45,223
And then it's repeated down here.
111
00:07:48,011 --> 00:07:49,634
I am just reading through these.
112
00:07:59,339 --> 00:08:00,581
Okay.
113
00:08:06,824 --> 00:08:10,226
So these all make sense. This is all good info.
114
00:08:13,100 --> 00:08:16,862
"Don't open documents downloaded through Tor while online".
115
00:08:21,896 --> 00:08:25,124
So that is something that I don't fully understand?
116
00:08:29,862 --> 00:08:31,093
Oh I see.
117
00:08:31,576 --> 00:08:37,297
So I guess basically if you were to download like a PDF...
118
00:08:38,028 --> 00:08:43,889
and then open it, some of that traffic might not be as private as you want it is my basic understanding.
119
00:08:44,395 --> 00:08:44,831
Mm.
120
00:08:47,626 --> 00:08:49,880
Yeah "This will reveal your non-Tor IP address".
121
00:08:50,453 --> 00:08:51,668
I guess, yeah that makes sense.
122
00:08:51,668 --> 00:08:57,881
I mean, that's not something that intuitively I would know though, I don't think, so I am glad that's there.
123
00:09:03,056 --> 00:09:04,288
"Use bridges and/or..."
124
00:09:12,761 --> 00:09:16,381
I am reading this last section, "Use bridges and/or find company".
125
00:09:17,583 --> 00:09:20,486
And it almost seems like it's a little out of my league as far as my understanding of networking.
126
00:09:28,274 --> 00:09:33,014
I guess they're just saying... Get your friends to use Tor and set up Tor bridges?
127
00:09:33,600 --> 00:09:37,504
I don't really, I don't totally grasp what that last point is going for.
128
00:09:38,028 --> 00:09:40,330
Okay, this is finished!
129
00:09:40,878 --> 00:09:44,745
I am going to click on it. And install.
130
00:09:50,639 --> 00:09:54,865
I am going to drag this into the Applications folder... There is already one there!
131
00:09:55,671 --> 00:10:00,162
Yes, this is my fault. This is left from a previous experiment. Why don't you just say "Replace"?
132
00:10:00,864 --> 00:10:02,471
Yes. This is what I would normally do if this happened, at least.
133
00:10:02,964 --> 00:10:03,364
Sure.
134
00:10:12,553 --> 00:10:17,298
Okay, so I am going to now close out of Chrome.
135
00:10:19,631 --> 00:10:22,653
Close, actually, I think now I can just open it right from here.
136
00:10:29,231 --> 00:10:33,008
"Can't be opened because it's from an unidentified developer".
137
00:10:34,609 --> 00:10:36,114
Oh, this is annoying.
138
00:10:36,114 --> 00:10:38,729
I have had to deal with this before.
139
00:10:39,365 --> 00:10:41,547
I am going to go to System Preferences.
140
00:10:42,014 --> 00:10:49,013
And I think it's "Security & Privacy". There's like a box you uncheck or something.
141
00:10:49,013 --> 00:10:51,830
Oh, right here. Hopefully I won't need... Oh, I don't, I don't know...
142
00:10:52,424 --> 00:10:52,908
It's "password".
143
00:10:54,101 --> 00:10:55,049
"password".
144
00:10:56,658 --> 00:11:01,719
Okay, I am going to say "Allow apps downloaded from anywhere". "Allow From Anywhere".
145
00:11:03,369 --> 00:11:06,794
Close that. And then try this again.
146
00:11:08,571 --> 00:11:10,219
Yes. I want to open this.
147
00:11:18,082 --> 00:11:22,634
"A copy of Firefox is already open. Only one copy of Firefox can be open at a time."
148
00:11:23,317 --> 00:11:36,725
Um, there must be something running in the background because I am looking at Firefox and it doesn't say it's open.
149
00:11:36,725 --> 00:11:43,852
So I think what I am going to do now is look at the processes and see if there's any... which, what is it called on...
150
00:11:45,642 --> 00:11:46,745
I just did the gesture to pull up the...
151
00:11:47,259 --> 00:11:47,658
Mmhmm.
152
00:11:51,735 --> 00:11:58,956
Dashboard maybe? No. This must be painful for you. [Laughter.]
153
00:11:59,864 --> 00:12:03,149
Uh... Here we go.
154
00:12:03,799 --> 00:12:08,717
"Activity Monitor", that's what it's called. And then I am just going to look through here and see if there's anything that says "Firefox" or maybe "Tor".
155
00:12:09,500 --> 00:12:12,042
Maybe like there's like an old one open?
156
00:12:20,783 --> 00:12:24,671
There is nothing called Firefox.
157
00:12:28,115 --> 00:12:30,960
I don't see anything called Tor.
158
00:12:31,587 --> 00:12:34,639
So at this point, I would probably become a little bit frustrated. [Laughter.]
159
00:12:35,678 --> 00:12:39,967
Let me see. I might at this point, probably just restart.
160
00:12:40,514 --> 00:12:41,028
Mmhmm.
161
00:12:42,889 --> 00:12:46,409
But I am just going to try this one more time.
162
00:12:50,499 --> 00:12:52,289
It's taking longer than I expect... So yeah, okay.
163
00:12:52,956 --> 00:12:57,860
I think I am just going to... Just make sure... Yeah, I am just going to restart.
164
00:12:58,509 --> 00:13:01,041
Here, don't restart it, because it will mess up the video screen.
165
00:13:01,674 --> 00:13:04,352
Okay, well then I think this is probably where I'm going to need your intervention.
166
00:13:04,960 --> 00:13:06,729
So here, open up the Applications folder, and open it from here.
167
00:13:08,168 --> 00:13:08,619
Oh.
168
00:13:09,707 --> 00:13:13,076
You actually found a known bug, but a pretty bad one.
169
00:13:13,894 --> 00:13:19,585
Right. Just because that stays open, I think. It's a little... okay.
170
00:13:21,687 --> 00:13:25,746
I am trying this again! Okay, and now I have a box.
171
00:13:27,349 --> 00:13:32,648
"Before you connect to the Tor network, you need to provide..." "Which of the following best describes..."
172
00:13:38,706 --> 00:13:44,581
I think I can just connect directly to the Tor network. I don't know if there is some weird, like Cal wi-fi thing that would...
173
00:13:45,618 --> 00:13:47,312
Yeah, this network, there's none of the...
174
00:13:47,961 --> 00:13:49,849
Okay.
175
00:13:53,868 --> 00:13:59,043
It's loading and I have seen this before. A number of times I have used Tor...
176
00:14:01,984 --> 00:14:08,066
Okay! I've got the Tor Browser open. And now I am going to check that Tor is working.
177
00:14:09,051 --> 00:14:16,292
Basically, I am just going to go "what the fuck is my IP" [Laughter.] "dot com".
178
00:14:18,917 --> 00:14:21,568
And see where it thinks we're located.
179
00:14:25,434 --> 00:14:27,664
Do I need "www" there?
180
00:14:31,847 --> 00:14:36,995
Oh, no, it just took a while. Oh, so it thinks we're in the Netherlands. So I assume it's working.
181
00:14:37,804 --> 00:14:44,629
I don't know if there are other steps you can take to ensure that. But usually, this the check that I do to see if my VPN's working or whatever.
182
00:14:45,251 --> 00:14:45,816
Okay.
183
00:14:47,971 --> 00:14:50,154
"Do a web search for 'onions'."
184
00:14:51,613 --> 00:15:04,099
I am going to back and use their search bar. "onions". Okay.
185
00:15:05,643 --> 00:15:06,792
Cool, yeah. You don't need to go down any farther. We just wanted to see the search.
186
00:15:07,475 --> 00:15:11,889
Great. And now, I go to YouTube...
187
00:15:21,601 --> 00:15:24,500
And search for "ode to joy".
188
00:15:31,298 --> 00:15:35,650
Okay, so I guess I don't have to open anything, so I'm just going to...
189
00:15:36,340 --> 00:15:37,349
Go ahead and click on whatever you would...
190
00:15:37,990 --> 00:15:42,697
Oh, okay. I'm going to let this video load.
191
00:15:45,019 --> 00:15:49,347
I see this bar up here. "Cookies help us deliver our services".
192
00:15:50,125 --> 00:15:52,427
I am think just going to let that be and not deal with it.
193
00:15:54,130 --> 00:15:59,581
This video is loading kind of slow.
194
00:16:10,187 --> 00:16:10,845
Should I New Identity it?
195
00:16:11,486 --> 00:16:15,836
No, we just wanted, like, however much you need to get the experience of, you know, the YouTube thing.
196
00:16:16,369 --> 00:16:17,984
And any other comments you want to make on it.
197
00:16:18,532 --> 00:16:19,995
This is being really slow.
198
00:16:24,298 --> 00:16:31,376
It seems like it is flickering, which I don't know if that is part of the video or not.
199
00:16:31,376 --> 00:16:32,609
I almost think it's not.
200
00:16:34,153 --> 00:16:36,464
That's weird. I haven't seen that before.
201
00:16:39,787 --> 00:16:42,416
I don't think that is part of the video. I think that is an issue.
202
00:16:44,500 --> 00:16:46,634
Having to do with this ad, maybe, or something? I don't know.
203
00:16:48,054 --> 00:16:48,721
Okay, that is good for the YouTube.
204
00:16:50,815 --> 00:16:53,678
Okay, so now I am going to "New Identity".
205
00:16:54,465 --> 00:16:57,947
Which I know you can go and click on the onion and it's the first option.
206
00:17:00,823 --> 00:17:02,241
So I am going to hit that.
207
00:17:05,156 --> 00:17:10,521
Is that what you expect to happen, when you? What's your understanding of what happened, and what do you expect?
208
00:17:11,185 --> 00:17:14,967
My understanding, so like, say, so I'm on YouTube, and I just had searched for that video.
209
00:17:15,641 --> 00:17:24,553
And now, hitting a new identity, if I were to go back to YouTube, it wouldn't like suggest anything about Ode to Joy because any info
210
00:17:24,553 --> 00:17:31,851
that the browser, the connection, was keeping on my search for that would be now totally divorced from me, is my understanding.
211
00:17:31,851 --> 00:17:36,670
And as far as the behavior of the new window popping up, I think that's fine, but I almost...
212
00:17:36,670 --> 00:17:42,133
I don't know... I don't know if that is like crucial, but...
213
00:17:42,133 --> 00:17:46,355
I almost might be worried if I was on something that I cared about, like some page,
214
00:17:46,355 --> 00:17:49,079
that I'd like lose that and be kind of freaked out.
215
00:17:49,079 --> 00:17:52,664
Because, like the back button's grayed out.
216
00:17:52,664 --> 00:17:54,217
So I know, whatever I was just on is kind of lost.
217
00:17:54,707 --> 00:17:55,166
Okay.
218
00:17:57,015 --> 00:18:00,361
Which would be a little concern— I mean, now that I know that,
219
00:18:01,298 --> 00:18:06,916
maybe I would just make sure to like save that link or do something...
220
00:18:06,916 --> 00:18:08,960
But I could see how that might be an issue
221
00:18:08,960 --> 00:18:12,055
for some users who would want to like, bookmark that or something.
222
00:18:12,652 --> 00:18:16,221
And I actually don't know how bookmarks work on Tor. But I assume... Yes, it's just the same as Firefox.
223
00:18:17,269 --> 00:18:23,019
Okay. Alright, so the last one, just go through the toolbar at the top part here, and explain what you think each part of it means.
224
00:18:24,109 --> 00:18:27,259
Okay. This... oh.
225
00:18:33,173 --> 00:18:34,327
So I haven't really messed with this before.
226
00:18:34,859 --> 00:18:37,608
But I'm... "Forbid Scripts Globally".
227
00:18:42,576 --> 00:18:50,079
I mean, I am guessing that this is just another like layer of protection for, like, not revealing your IP address?
228
00:18:51,310 --> 00:18:56,484
But there might be some situations where you'd have to like allow, to like make something work on certain pages.
229
00:18:57,492 --> 00:18:59,005
But I don't know.
230
00:18:59,005 --> 00:19:01,147
I'd probably just leave that on its default settings.
231
00:19:01,654 --> 00:19:03,717
Which I guess...
232
00:19:04,510 --> 00:19:09,461
It's saying, the one that is advised isn't the default?
233
00:19:10,557 --> 00:19:13,451
Which is a bit confusing.
234
00:19:13,926 --> 00:19:16,612
And now, I am on the one that is advised.
235
00:19:18,349 --> 00:19:24,257
And the one that it was defaulted on, it is telling me is dangerous!
236
00:19:24,961 --> 00:19:31,066
Which... I don't know... that's kind of weird to me. [Laughter.]
237
00:19:31,066 --> 00:19:36,990
But. Okay. I think I don't understand enough.
238
00:19:36,990 --> 00:19:40,915
I mean, I am guessing, is this maybe, like my thought process, are these scripts,
239
00:19:40,915 --> 00:19:45,035
does that mean like, allowing webpages to run scripts like on your computer, or something?
240
00:19:45,035 --> 00:19:47,067
I don't really understand that.
241
00:19:47,067 --> 00:19:51,695
But this whole "dangerous"/"recommended" thing and the dangerous one is the one that defaults is weird to me.
242
00:19:52,154 --> 00:19:52,718
Okay.
243
00:19:54,243 --> 00:19:57,957
This I know is New Identity.
244
00:19:58,601 --> 00:20:04,260
But then I have toyed around before with like preferences and looking around and usually it's out of my understanding.
245
00:20:07,894 --> 00:20:09,630
Yeah. So I will just close that.
246
00:20:13,431 --> 00:20:14,496
I get the back button.
247
00:20:15,986 --> 00:20:20,362
The search bar is intuitive, I mean, it just looks like Firefox.
248
00:20:21,477 --> 00:20:28,373
Um, this is familiar. I can choose which search engine I want.
249
00:20:29,566 --> 00:20:36,125
And then this is also familiar.
250
00:20:36,125 --> 00:20:40,279
And I see HTTPS Always is running, so that's cool.
251
00:20:42,779 --> 00:20:43,180
Alright, great.