1 00:00:00,377 --> 00:00:03,079 So... My name is David and I am a researcher here at the University of California Berkeley. 2 00:00:03,978 --> 00:00:06,583 I have been asked by others to help improve a piece of software for people like you. 3 00:00:07,153 --> 00:00:11,929 Um, I'm not responsible for the software, even though I do Tor development, I don't really do Tor Browser. 4 00:00:12,833 --> 00:00:14,480 So don't worry about offending me. 5 00:00:14,846 --> 00:00:17,554 We're really looking for... we're trying to make the software as usable as possible, 6 00:00:18,117 --> 00:00:21,144 so we would especially like your help in identifying any parts that are difficult or confusing. 7 00:00:22,968 --> 00:00:25,341 To this end, we're asking you to perform a "cognitive walkthrough". 8 00:00:26,033 --> 00:00:28,900 This involves talking out loud while you perform the tasks that we ask you to complete. 9 00:00:29,670 --> 00:00:32,573 As far as possible, I am going to be here to simply to observe. 10 00:00:33,487 --> 00:00:35,804 I am going to try not to interfere. Don't wait for feedback from me, 11 00:00:37,133 --> 00:00:44,460 and try to only interact is something is unclear, if you need further instructions. 12 00:00:45,780 --> 00:00:50,912 So I am going to give a short example of cognitive walkthrough. And then you are going to do a demonstration cognitive walkthrough. 13 00:00:54,316 --> 00:00:55,683 To give you an idea of what I am looking for. 14 00:00:57,490 --> 00:00:59,067 So I am going to assign myself a task. 15 00:01:00,595 --> 00:01:05,298 And this task is to find a paint program and draw a red hexagon. 16 00:01:06,540 --> 00:01:10,533 So, I am looking at a desktop here. There's nothing on the desktop. 17 00:01:11,287 --> 00:01:14,426 I am looking for something that will draw a paint program for me. 18 00:01:15,484 --> 00:01:18,400 Down in the bottom it doesn't look like anything does that. 19 00:01:18,980 --> 00:01:24,528 So I think I'm going to have to look for it. And to do that, I know I can find files by looking at Finder. 20 00:01:26,932 --> 00:01:35,424 I am going to click on "Applications" and then see what... see what I can find. 21 00:01:37,766 --> 00:01:40,076 This one is called "Paintbrush". So I am going to try that one. 22 00:01:43,516 --> 00:01:44,956 All right, so it starts up and it is asking me a question. 23 00:01:45,343 --> 00:01:47,632 I see it is asking me for width and height of the image. 24 00:01:48,275 --> 00:01:55,492 Now I'm not sure if I will be able to change this later. It's not clear to me if this is an irrevocable decision, 25 00:01:56,406 --> 00:01:58,609 but I don't know what to do about it so I am going to just click okay. 26 00:01:59,612 --> 00:02:02,543 It looks like it changed size to match what I just typed in, that kind of makes sense. 27 00:02:04,087 --> 00:02:08,790 And it looks like there is already a color thing opened up, so I'll pick a red color. 28 00:02:10,382 --> 00:02:15,013 And I want to draw a hexagon so I am looking for a shape tool. 29 00:02:15,766 --> 00:02:20,295 This one... looks like it's only rectangles. 30 00:02:21,179 --> 00:02:23,013 This is ellipse. 31 00:02:24,211 --> 00:02:29,653 Okay, so I don't have a hexagon tool, I don't think, so I'll try and just draw it with lines. 32 00:02:31,420 --> 00:02:36,322 Now I am going to click here. And draw a line. 33 00:02:37,387 --> 00:02:38,770 It's not what I expected. 34 00:02:39,493 --> 00:02:41,262 I wanted it to connect those and that didn't happen. 35 00:02:41,794 --> 00:02:43,290 So I am going to say "Undo". 36 00:02:45,554 --> 00:02:48,622 And this time I am going to try to try just dragging. 37 00:02:49,569 --> 00:02:51,250 Okay, that's what I wanted to happen. 38 00:02:51,718 --> 00:02:53,140 But it is the wrong color. It's not what I expected. 39 00:02:53,616 --> 00:02:57,425 I picked red here, and it surprised me that it didn't actually make the line red. 40 00:02:58,627 --> 00:03:04,963 So I guess maybe if I click here, when I clicked that, this turned into black. 41 00:03:05,329 --> 00:03:09,418 So this is really confusing. I don't know what this color meant. 42 00:03:09,931 --> 00:03:11,644 Anyway, now it's turned red. So now we can continue. 43 00:03:12,621 --> 00:03:14,388 I'll just redraw this line. 44 00:03:17,640 --> 00:03:19,376 And I guess I kind of have to freehand this. 45 00:03:24,479 --> 00:03:26,199 That was no good. Undo that. 46 00:03:30,192 --> 00:03:35,514 I wonder if there is a way to automatically like close this shape, but I don't see that so I am just going to do it manually. 47 00:03:37,218 --> 00:03:41,026 And now to fill it in, I know from other paint programs that this paint bucket will do that. 48 00:03:41,829 --> 00:03:44,728 I click on it... yeah. And that's exactly what I expected to happen. 49 00:03:46,549 --> 00:03:48,740 So that's the cognitive walkthrough. Explain what you see. Anything that is surprising. Yes. 50 00:03:49,330 --> 00:03:49,894 Think out loud, basically. 51 00:03:51,205 --> 00:03:52,834 Yeah. Exactly. 52 00:03:58,937 --> 00:04:02,917 Alright, uh let me close this. Now, I am going to give you a demo task to practice the cognitive walkthrough. 53 00:04:03,514 --> 00:04:03,926 Okay. 54 00:04:04,465 --> 00:04:08,371 So I want you to open up a web browser and then find out the population of Zimbabwe. 55 00:04:08,915 --> 00:04:12,467 Okay. I recognize Chrome. 56 00:04:13,125 --> 00:04:13,525 Mmhmm. 57 00:04:13,931 --> 00:04:15,290 Which is what I use, so I'm going to open that up. 58 00:04:18,607 --> 00:04:21,196 I am just going to type in the search bar up here, which I know is just a Google search. 59 00:04:22,714 --> 00:04:24,555 Population of Zimbabwe, did you say? 60 00:04:25,012 --> 00:04:25,413 Yeah. 61 00:04:25,874 --> 00:04:26,783 Zimbabwe. 62 00:04:27,192 --> 00:04:30,076 And then let's just see what we get if we just type it in there. 63 00:04:30,951 --> 00:04:37,985 Google's telling me that in 2013 it was 14.15 million but I... Their source is the World Bank. 64 00:04:38,586 --> 00:04:41,997 I trust that a lot but I would probably... 65 00:04:43,093 --> 00:04:47,822 want to look at the CIA factbook. Which is the third result. Just to... 66 00:04:48,502 --> 00:04:49,064 Sure. 67 00:04:49,617 --> 00:04:51,011 ...double-check that. 68 00:04:56,750 --> 00:05:00,146 And it looks like something's going on with these images that aren't loading. 69 00:05:02,232 --> 00:05:09,281 But I see it says "People and Society". Which may give me population. 70 00:05:10,639 --> 00:05:12,064 And then there I have a population mark. 71 00:05:13,083 --> 00:05:16,341 13.7... But do we have a year? Oh, July 2014. 72 00:05:16,800 --> 00:05:20,872 So this actually probably would be the most recent, most accurate one I can get. 73 00:05:21,464 --> 00:05:27,892 Okay. Great, yeah. Good job! So it's good... yes. To explain when something is familiar. You've seen it before, so you recognize it. 74 00:05:27,892 --> 00:05:30,490 Or when anything is—appears broken. You know. 75 00:05:30,949 --> 00:05:31,348 Mmhmm. 76 00:05:31,944 --> 00:05:36,658 And there may be some downtime that you're going to have to do a download. And so, while that is happening, just, you know, 77 00:05:36,658 --> 00:05:39,375 see what you can see on the screen and explain what is going on. 78 00:05:40,108 --> 00:05:40,507 Okay. 79 00:05:40,850 --> 00:05:44,920 Go ahead and close this and I will give you your list of tasks. 80 00:05:45,660 --> 00:05:46,060 Okay. 81 00:05:47,141 --> 00:05:48,961 So here they are, seven things. 82 00:05:49,865 --> 00:05:50,266 Okay. 83 00:05:51,182 --> 00:05:55,706 You are going to be... downloading, using Tor Browser for some web browsing tasks. 84 00:05:56,322 --> 00:05:56,901 Okay. 85 00:05:59,026 --> 00:06:03,601 And I will just be observing. Just kind of do this the way you would do it if you were if you were going to do this at home, and do it from scratch. 86 00:06:04,735 --> 00:06:06,079 Do you have any questions before we start? 87 00:06:06,952 --> 00:06:07,610 No. 88 00:06:08,134 --> 00:06:09,382 Okay. Alright, go to it! 89 00:06:10,574 --> 00:06:13,170 So, I am going to download Tor. I am going to reopen Chrome. 90 00:06:15,153 --> 00:06:19,536 And I am just going to search "tor browser". 91 00:06:20,146 --> 00:06:24,218 Which, if I am going to be completely transparent, isn't something I probably would do. 92 00:06:24,805 --> 00:06:32,230 Or have a source do in a real situation, just in their Chrome browser. 93 00:06:32,230 --> 00:06:33,584 Especially if they were at an institution, like on an enterprise network or something. 94 00:06:34,050 --> 00:06:34,449 Sure, okay. 95 00:06:35,987 --> 00:06:40,156 Okay, I am going to... "torproject.org"... 96 00:06:41,613 --> 00:06:42,949 There's even... 97 00:06:42,949 --> 00:06:46,742 I am seeing the second result is "Download Tor". 98 00:06:46,742 --> 00:06:48,884 That might save a few steps, I will click on that. 99 00:06:48,884 --> 00:06:55,762 And I am going to download Tor Browser for Mac. 100 00:06:58,137 --> 00:06:59,132 Okay. 101 00:07:02,124 --> 00:07:05,240 Um, this is a little... weird-looking here. 102 00:07:07,725 --> 00:07:09,797 I see a... this is good though. 103 00:07:10,305 --> 00:07:14,064 This is telling people that they shouldn't totally rely just on Tor, or on this program. 104 00:07:16,470 --> 00:07:18,189 "You need to change some of your habits". 105 00:07:18,567 --> 00:07:22,781 I am assuming that's like, kind of like threat modeling and that sort of thing. 106 00:07:23,841 --> 00:07:26,557 So that could be good, although I think maybe that would be better... 107 00:07:28,605 --> 00:07:33,497 I don't know. I look at that and that almost looks like an ad or something. 108 00:07:33,497 --> 00:07:41,600 The way that's set up, it seems like, like I almost, like, my first instinct was to just kind of look past it. 109 00:07:41,600 --> 00:07:43,591 But it is something that is probably important. 110 00:07:43,591 --> 00:07:45,223 And then it's repeated down here. 111 00:07:48,011 --> 00:07:49,634 I am just reading through these. 112 00:07:59,339 --> 00:08:00,581 Okay. 113 00:08:06,824 --> 00:08:10,226 So these all make sense. This is all good info. 114 00:08:13,100 --> 00:08:16,862 "Don't open documents downloaded through Tor while online". 115 00:08:21,896 --> 00:08:25,124 So that is something that I don't fully understand? 116 00:08:29,862 --> 00:08:31,093 Oh I see. 117 00:08:31,576 --> 00:08:37,297 So I guess basically if you were to download like a PDF... 118 00:08:38,028 --> 00:08:43,889 and then open it, some of that traffic might not be as private as you want it is my basic understanding. 119 00:08:44,395 --> 00:08:44,831 Mm. 120 00:08:47,626 --> 00:08:49,880 Yeah "This will reveal your non-Tor IP address". 121 00:08:50,453 --> 00:08:51,668 I guess, yeah that makes sense. 122 00:08:51,668 --> 00:08:57,881 I mean, that's not something that intuitively I would know though, I don't think, so I am glad that's there. 123 00:09:03,056 --> 00:09:04,288 "Use bridges and/or..." 124 00:09:12,761 --> 00:09:16,381 I am reading this last section, "Use bridges and/or find company". 125 00:09:17,583 --> 00:09:20,486 And it almost seems like it's a little out of my league as far as my understanding of networking. 126 00:09:28,274 --> 00:09:33,014 I guess they're just saying... Get your friends to use Tor and set up Tor bridges? 127 00:09:33,600 --> 00:09:37,504 I don't really, I don't totally grasp what that last point is going for. 128 00:09:38,028 --> 00:09:40,330 Okay, this is finished! 129 00:09:40,878 --> 00:09:44,745 I am going to click on it. And install. 130 00:09:50,639 --> 00:09:54,865 I am going to drag this into the Applications folder... There is already one there! 131 00:09:55,671 --> 00:10:00,162 Yes, this is my fault. This is left from a previous experiment. Why don't you just say "Replace"? 132 00:10:00,864 --> 00:10:02,471 Yes. This is what I would normally do if this happened, at least. 133 00:10:02,964 --> 00:10:03,364 Sure. 134 00:10:12,553 --> 00:10:17,298 Okay, so I am going to now close out of Chrome. 135 00:10:19,631 --> 00:10:22,653 Close, actually, I think now I can just open it right from here. 136 00:10:29,231 --> 00:10:33,008 "Can't be opened because it's from an unidentified developer". 137 00:10:34,609 --> 00:10:36,114 Oh, this is annoying. 138 00:10:36,114 --> 00:10:38,729 I have had to deal with this before. 139 00:10:39,365 --> 00:10:41,547 I am going to go to System Preferences. 140 00:10:42,014 --> 00:10:49,013 And I think it's "Security & Privacy". There's like a box you uncheck or something. 141 00:10:49,013 --> 00:10:51,830 Oh, right here. Hopefully I won't need... Oh, I don't, I don't know... 142 00:10:52,424 --> 00:10:52,908 It's "password". 143 00:10:54,101 --> 00:10:55,049 "password". 144 00:10:56,658 --> 00:11:01,719 Okay, I am going to say "Allow apps downloaded from anywhere". "Allow From Anywhere". 145 00:11:03,369 --> 00:11:06,794 Close that. And then try this again. 146 00:11:08,571 --> 00:11:10,219 Yes. I want to open this. 147 00:11:18,082 --> 00:11:22,634 "A copy of Firefox is already open. Only one copy of Firefox can be open at a time." 148 00:11:23,317 --> 00:11:36,725 Um, there must be something running in the background because I am looking at Firefox and it doesn't say it's open. 149 00:11:36,725 --> 00:11:43,852 So I think what I am going to do now is look at the processes and see if there's any... which, what is it called on... 150 00:11:45,642 --> 00:11:46,745 I just did the gesture to pull up the... 151 00:11:47,259 --> 00:11:47,658 Mmhmm. 152 00:11:51,735 --> 00:11:58,956 Dashboard maybe? No. This must be painful for you. [Laughter.] 153 00:11:59,864 --> 00:12:03,149 Uh... Here we go. 154 00:12:03,799 --> 00:12:08,717 "Activity Monitor", that's what it's called. And then I am just going to look through here and see if there's anything that says "Firefox" or maybe "Tor". 155 00:12:09,500 --> 00:12:12,042 Maybe like there's like an old one open? 156 00:12:20,783 --> 00:12:24,671 There is nothing called Firefox. 157 00:12:28,115 --> 00:12:30,960 I don't see anything called Tor. 158 00:12:31,587 --> 00:12:34,639 So at this point, I would probably become a little bit frustrated. [Laughter.] 159 00:12:35,678 --> 00:12:39,967 Let me see. I might at this point, probably just restart. 160 00:12:40,514 --> 00:12:41,028 Mmhmm. 161 00:12:42,889 --> 00:12:46,409 But I am just going to try this one more time. 162 00:12:50,499 --> 00:12:52,289 It's taking longer than I expect... So yeah, okay. 163 00:12:52,956 --> 00:12:57,860 I think I am just going to... Just make sure... Yeah, I am just going to restart. 164 00:12:58,509 --> 00:13:01,041 Here, don't restart it, because it will mess up the video screen. 165 00:13:01,674 --> 00:13:04,352 Okay, well then I think this is probably where I'm going to need your intervention. 166 00:13:04,960 --> 00:13:06,729 So here, open up the Applications folder, and open it from here. 167 00:13:08,168 --> 00:13:08,619 Oh. 168 00:13:09,707 --> 00:13:13,076 You actually found a known bug, but a pretty bad one. 169 00:13:13,894 --> 00:13:19,585 Right. Just because that stays open, I think. It's a little... okay. 170 00:13:21,687 --> 00:13:25,746 I am trying this again! Okay, and now I have a box. 171 00:13:27,349 --> 00:13:32,648 "Before you connect to the Tor network, you need to provide..." "Which of the following best describes..." 172 00:13:38,706 --> 00:13:44,581 I think I can just connect directly to the Tor network. I don't know if there is some weird, like Cal wi-fi thing that would... 173 00:13:45,618 --> 00:13:47,312 Yeah, this network, there's none of the... 174 00:13:47,961 --> 00:13:49,849 Okay. 175 00:13:53,868 --> 00:13:59,043 It's loading and I have seen this before. A number of times I have used Tor... 176 00:14:01,984 --> 00:14:08,066 Okay! I've got the Tor Browser open. And now I am going to check that Tor is working. 177 00:14:09,051 --> 00:14:16,292 Basically, I am just going to go "what the fuck is my IP" [Laughter.] "dot com". 178 00:14:18,917 --> 00:14:21,568 And see where it thinks we're located. 179 00:14:25,434 --> 00:14:27,664 Do I need "www" there? 180 00:14:31,847 --> 00:14:36,995 Oh, no, it just took a while. Oh, so it thinks we're in the Netherlands. So I assume it's working. 181 00:14:37,804 --> 00:14:44,629 I don't know if there are other steps you can take to ensure that. But usually, this the check that I do to see if my VPN's working or whatever. 182 00:14:45,251 --> 00:14:45,816 Okay. 183 00:14:47,971 --> 00:14:50,154 "Do a web search for 'onions'." 184 00:14:51,613 --> 00:15:04,099 I am going to back and use their search bar. "onions". Okay. 185 00:15:05,643 --> 00:15:06,792 Cool, yeah. You don't need to go down any farther. We just wanted to see the search. 186 00:15:07,475 --> 00:15:11,889 Great. And now, I go to YouTube... 187 00:15:21,601 --> 00:15:24,500 And search for "ode to joy". 188 00:15:31,298 --> 00:15:35,650 Okay, so I guess I don't have to open anything, so I'm just going to... 189 00:15:36,340 --> 00:15:37,349 Go ahead and click on whatever you would... 190 00:15:37,990 --> 00:15:42,697 Oh, okay. I'm going to let this video load. 191 00:15:45,019 --> 00:15:49,347 I see this bar up here. "Cookies help us deliver our services". 192 00:15:50,125 --> 00:15:52,427 I am think just going to let that be and not deal with it. 193 00:15:54,130 --> 00:15:59,581 This video is loading kind of slow. 194 00:16:10,187 --> 00:16:10,845 Should I New Identity it? 195 00:16:11,486 --> 00:16:15,836 No, we just wanted, like, however much you need to get the experience of, you know, the YouTube thing. 196 00:16:16,369 --> 00:16:17,984 And any other comments you want to make on it. 197 00:16:18,532 --> 00:16:19,995 This is being really slow. 198 00:16:24,298 --> 00:16:31,376 It seems like it is flickering, which I don't know if that is part of the video or not. 199 00:16:31,376 --> 00:16:32,609 I almost think it's not. 200 00:16:34,153 --> 00:16:36,464 That's weird. I haven't seen that before. 201 00:16:39,787 --> 00:16:42,416 I don't think that is part of the video. I think that is an issue. 202 00:16:44,500 --> 00:16:46,634 Having to do with this ad, maybe, or something? I don't know. 203 00:16:48,054 --> 00:16:48,721 Okay, that is good for the YouTube. 204 00:16:50,815 --> 00:16:53,678 Okay, so now I am going to "New Identity". 205 00:16:54,465 --> 00:16:57,947 Which I know you can go and click on the onion and it's the first option. 206 00:17:00,823 --> 00:17:02,241 So I am going to hit that. 207 00:17:05,156 --> 00:17:10,521 Is that what you expect to happen, when you? What's your understanding of what happened, and what do you expect? 208 00:17:11,185 --> 00:17:14,967 My understanding, so like, say, so I'm on YouTube, and I just had searched for that video. 209 00:17:15,641 --> 00:17:24,553 And now, hitting a new identity, if I were to go back to YouTube, it wouldn't like suggest anything about Ode to Joy because any info 210 00:17:24,553 --> 00:17:31,851 that the browser, the connection, was keeping on my search for that would be now totally divorced from me, is my understanding. 211 00:17:31,851 --> 00:17:36,670 And as far as the behavior of the new window popping up, I think that's fine, but I almost... 212 00:17:36,670 --> 00:17:42,133 I don't know... I don't know if that is like crucial, but... 213 00:17:42,133 --> 00:17:46,355 I almost might be worried if I was on something that I cared about, like some page, 214 00:17:46,355 --> 00:17:49,079 that I'd like lose that and be kind of freaked out. 215 00:17:49,079 --> 00:17:52,664 Because, like the back button's grayed out. 216 00:17:52,664 --> 00:17:54,217 So I know, whatever I was just on is kind of lost. 217 00:17:54,707 --> 00:17:55,166 Okay. 218 00:17:57,015 --> 00:18:00,361 Which would be a little concern— I mean, now that I know that, 219 00:18:01,298 --> 00:18:06,916 maybe I would just make sure to like save that link or do something... 220 00:18:06,916 --> 00:18:08,960 But I could see how that might be an issue 221 00:18:08,960 --> 00:18:12,055 for some users who would want to like, bookmark that or something. 222 00:18:12,652 --> 00:18:16,221 And I actually don't know how bookmarks work on Tor. But I assume... Yes, it's just the same as Firefox. 223 00:18:17,269 --> 00:18:23,019 Okay. Alright, so the last one, just go through the toolbar at the top part here, and explain what you think each part of it means. 224 00:18:24,109 --> 00:18:27,259 Okay. This... oh. 225 00:18:33,173 --> 00:18:34,327 So I haven't really messed with this before. 226 00:18:34,859 --> 00:18:37,608 But I'm... "Forbid Scripts Globally". 227 00:18:42,576 --> 00:18:50,079 I mean, I am guessing that this is just another like layer of protection for, like, not revealing your IP address? 228 00:18:51,310 --> 00:18:56,484 But there might be some situations where you'd have to like allow, to like make something work on certain pages. 229 00:18:57,492 --> 00:18:59,005 But I don't know. 230 00:18:59,005 --> 00:19:01,147 I'd probably just leave that on its default settings. 231 00:19:01,654 --> 00:19:03,717 Which I guess... 232 00:19:04,510 --> 00:19:09,461 It's saying, the one that is advised isn't the default? 233 00:19:10,557 --> 00:19:13,451 Which is a bit confusing. 234 00:19:13,926 --> 00:19:16,612 And now, I am on the one that is advised. 235 00:19:18,349 --> 00:19:24,257 And the one that it was defaulted on, it is telling me is dangerous! 236 00:19:24,961 --> 00:19:31,066 Which... I don't know... that's kind of weird to me. [Laughter.] 237 00:19:31,066 --> 00:19:36,990 But. Okay. I think I don't understand enough. 238 00:19:36,990 --> 00:19:40,915 I mean, I am guessing, is this maybe, like my thought process, are these scripts, 239 00:19:40,915 --> 00:19:45,035 does that mean like, allowing webpages to run scripts like on your computer, or something? 240 00:19:45,035 --> 00:19:47,067 I don't really understand that. 241 00:19:47,067 --> 00:19:51,695 But this whole "dangerous"/"recommended" thing and the dangerous one is the one that defaults is weird to me. 242 00:19:52,154 --> 00:19:52,718 Okay. 243 00:19:54,243 --> 00:19:57,957 This I know is New Identity. 244 00:19:58,601 --> 00:20:04,260 But then I have toyed around before with like preferences and looking around and usually it's out of my understanding. 245 00:20:07,894 --> 00:20:09,630 Yeah. So I will just close that. 246 00:20:13,431 --> 00:20:14,496 I get the back button. 247 00:20:15,986 --> 00:20:20,362 The search bar is intuitive, I mean, it just looks like Firefox. 248 00:20:21,477 --> 00:20:28,373 Um, this is familiar. I can choose which search engine I want. 249 00:20:29,566 --> 00:20:36,125 And then this is also familiar. 250 00:20:36,125 --> 00:20:40,279 And I see HTTPS Always is running, so that's cool. 251 00:20:42,779 --> 00:20:43,180 Alright, great.