And for my task of cognitive walkthrough,
I am going to try to show you how to draw a hexagon in Paint.
Or just to draw anything in Paint.
So, the point of the cognitive walkthrough is to go though my mind process,
so if you were the researcher I would be trying to tell you,
"Well, I really don't see where the Paint icon is, or what I would use to draw it with."
But I'm assuming it's on this computer, so I'm going to try to go find it through the applications.
This is the general thing, Finder, that people use to navigate through their Mac OS,
so I'm going to go to the applications and see if there's anything that seems to do the job that I want.
And Paintbrush is here.
I personally know that I've used Paintbrush before, and it's basically the Paint equivalent, but, for Macs.
So I'm going to click that icon here.
Now as soon as I click this, I see that this message window pops up.
I don't really know why it's here, and it's kind of annoying,
and I wish it just gave me the option to just go draw right away.
But, it asks me to specify a width and a height. And I don't know what "pixels" necessarily mean,
but I'm just going to click OK and see how it goes.
So my aim is just to draw a hexagon,
and I first look at this toolbox here,
and see that there's a paintbrush, eraser, whatever that is, "Selection", it says, cans, and things like that.
I am going to try to use "Shapes" to draw...
It doesn't really give me any other other options, and it gave me a square by default.
I'm going to try to undo this by using Control-Z.
That happened to work.
Instead I guess I'm going to choose this line icon, because a hexagon's made out of lines I suppose, and begin to draw.
Oh, that's not what I expected, it's a little bit weird looking.
Well, here I go.
I wish there was actually a tool that could be used to do this, or a way that I could make all my lines even.
But here, I drew a hexagon, but I actually wanted it to be red,
so I'm going to try to fill it in using this paint bucket here,
choosing a color, this looks like a red, and
that's my little cognitive walkthrough.
I don't know if you saw the point of doing it, and I think I was a little bit verbose in saying it,
even though it seemed kind of silly, but, I think,
it's not helpful at all if you knew what you were doing, but, I guess I wasn't completely confused on this specific task.
But if you were working with something that was new,
OK.
and, if you were confused, I think that this kind of would help. So, I am going to exit out of this dialog
and ask you to find me the population of Zimbabwe.
Of Zimbabwe?
Yes.
OK.
And I'm going to ask you to do it in a cognitive walkthrough style manner,
OK.
And I'll just give you feedback on how you do. Don't really worry about it, it's not very difficult.
OK. So, on my Mac, I usually use the application called Google Chrome,
so I see it here, so I'm going to click on it, because I'm used to doing that.
And, for the population of Zimbabwe, I'm just going to just type in "population zimbabwe" in the Google search thing.
Oh, I didn't know that that was how you were supposed to pronounce it. I was wrong.
Oh I don't know. Maybe not.
Oh, no.
This is, it's asking for my email. So I don't, I don't care about that.
I'm going to try to just put in the search engine
what I'm looking for, which is "population" and "zimbabwe".
And then, return.
And here it tells me that it's 14.15 million people living in Zimbabwe.
So it's right there, I don't even have to click on anything.
That's really convenient.
Yes, it is.
Yes. OK. That was pretty good. You talked out loud through it, and I really liked how you said you were going to use Chrome because that's what you always do,
because I feel like that's something that we can't tell if we just had a video of you,
which is the point of doing this, because we don't know why you chose that over other things,
or why you decided to use the search bar instead of going to google.com,
or just because you said you knew it would work or you've done this before.
So those are all helpful things to know.
I guess, other helpful things to know, if you won't think of this in a normal situation,
you don't have to exaggerate it for me,
but obviously, you're a journalist, like, would you
trust the fact that Google told you that,
or, was that what you would normally do or, do you like the fact that is just shows up right away?
I don't know. You can tell us if you like something, if you don't like something, if you trust something,
or if you think this is too hard to use, too easy to use.
But like I said, if you don't think you'll do that in the first place, don't feel necessarily compelled to do so.
But, yeah. You did a really good job.
Because some people, they just kind of, "I'm clicking this, I'm typing this."
And the answer's that, and I'm like...
It's a little weird when you're talking to yourself the entire time, but,
I think that is what you're going to have to do.
So now comes the part where I ask you to do the official experiment, and I'm going to give you eight tasks to do,
and I am going to try to not interfere as much as possible, so I'm going to ask you to look at them,
and then ask me if you have any questions on any of them.
Of course, I don't think you can, you know, necessarily know what this means if you don't do the first thing,
but maybe if anything's unclear, or for example, what does it mean to explain, how much do I need to explain.
So, a caveat I'm going to talk to you about is you need to search for "onions", you
can tell us anything that you would normally think, like "I like using this, this is enough, this is not enough, this is enough for normal life."
For the YouTube video, you don't have to watch the whole thing, it's eight minutes long.
But it's just a task for you to go find it.
And, for 8 you can try your best, and if you don't know, you can just say you don't know.
And anything that has to do with the interface, like "This is complicated, why are these things here, these buttons shouldn't be here,
I'm confused." That would all be very helpful.
And, you can explain it as much or as little as you want.
If people don't care, that's actually something that would be interesting to know because you don't want to
have all of these things cluttering up the space for the user interaction model. So,
OK. So, it's asking me to download Tor, the web browser, so I don't know Tor,
and first thing I didn't think that Tor was a web browser,
I thought it was like an indication that I have to go into a web browser to download Tor, which is some kind of other software.
So I've never downloaded a web browser, I think, before.
I think it was always already there, or someone installed it for me.
But here, I see the Google Chrome application on my screen, and that's what I usually use,
so I'm going to type in "tor" in the search engine once I've opened the app to see if I can find it.
So, I'm just going to type,
maybe I should type "download tor" and not just "Tor".
But let's try "tor" first, to know what this is.
OK, it says here, "Tor Browser".
There's, like, the first thing on the page is called the Tor Project, and I wouldn't figure out what that is,
but then it says "Tor Browser" just a little bit underneath, so I get, I put two and two together and I figure this is probably what I have to download.
And there's a direct word on the browser, it says "Download", so I might as well click that.
And it is...
There's this big purple icon on the left side of the screen that says "Download Tor Browser",
so I'm going to click on that because it seems like the most obvious thing
there are a couple of other small words on the screen that I'm not going to look at, because this seems like the most obvious thing to do,
because it's big and purple.
So, it says I have two minutes left for it to download. It's kind of a big file, I can tell, so...
I guess, I should just wait.
[Laughter.] Yeah, this part's kind of awkward.
Are you used to things taking this long?
Are you like, slightly upset by that?
Yeah, super upset. But, [Laughter.]
once I had to download the entire Adobe thing, so that took a while too.
Oh my gosh.
But I was doing other stuff at the same time, so it's okay.
OK. So would you do other stuff at the same time if I wasn't like watching over you?
Yes, I would not be waiting...
OK. What would you typically be doing?
I would open a new, I would say Command-T, open a new page,
You don't need to actually do anything, especially if you feel uncomfortable or if it's identifying.
so like, don't log into your actual Gmail account, or go to your Facebook or things like that.
But yeah.
So yeah, those are the two things I would do.
OK.
So there's no, it's not..
This is an old Mac.
Yes. This is the part of the study that we were trying to... I think, before the study
I asked, "did you change anything?" to which he said "no".
We were trying to figure out what to do with all of our time while it was downloading.
But, after this, it shouldn't take that long to do the other things.
All right, so, it's downloaded, so I'm going to click on it.
On that small little thing, at the bottom of the Chrome page.
And here it says that there's a sign,
seems to be saying that it's in my applications now.
So I'm going to, I'm trying to click on it, just to figure out what's going on.
Oh. I can click on the application file, it seems, so I'm going to do that directly
instead of going in the Finder, which is helpful.
And then I'm going to look for "Tor", which starts with a "T",
so it should be around here,
but it seems maybe it's not the right order.
So then I'm looking for,
I can't see it right now.
So, I'm going to close that,
and go in the Finder,
and see if I can see it in the Finder.
Oh. No... Let's see.
I'm clicking on Tor Browser now.
It's opening Tor Browser.
And it says, it can't be opened because it is from an unidentified developer.
"Your security preferences allow installation of only apps from the Mac App Store."
Well that's going to be a problem.
So, so I don't really know what to do.
Let's see, in the Finder, I want to see if it's in the Finder.
I want to see where it is. I have, I think I have installed things before,
software, but it's been, I always have difficulty with that part, I guess.
So I'm clicking on everything that it's showing me.
And also I've downloaded two, so I'm going to try opening the other one.
It's showing me the same page with that little purple and green icon and application thing.
So I'm trying to open it again.
I'm guessing it's going to be the same problem, but... Yeah.
So, it says, I'm reading what it says, it says "Google Chrome downloaded this disk image today."
OK. So I'm going to go back to the Chrome page to see if there's any indication on what I should do.
"Use the Tor Browser", "Don't torrent over...", "Don't" I don't know, I'm trying to see on that page how to do this.
So I have to go to my security preferences and change them to allow for things that are not from the Mac App Store.
I think, because that's what it says in the little box.
So I have to go to my security preferences. So usually, to go to my...
Oh, here I see the icon of System Preferences so I'm going to go and open that,
but usually I see that little icon for search on the screen of the Mac,
so usually I would type in what I'm looking for directly. "Security Preferences" instead of, I don't have that icon on my computer.
So that's what I would do.
But here, it's right here, so I open it, and I'm looking for "Security & Privacy",
and I open that,
and "Allow apps downloaded from"...
OK, and here it says something about Tor Browser so I'm going to do "Open Anyway",
because it seems, that that works.
Oh. And now the icon is going to open.
It says it's downloaded from the Internet, so it says that a bunch of times, like, usually, I'm used to seeing that, and just say "OK".
Me too. [Laughter.]
OK, "A copy of Firefox is already open. Only one copy can be open at a time."
So, it shouldn't be open, because it seems like here that it's supposed to be closed. But let's say "Quit" and try that again, maybe.
So it's saying, "A copy of Firefox is already open. Only one copy can be open at a time."
So, Firefox, there's nothing open there, but maybe, I don't know what I can do.
I'm thinking I should have to delete that one Firefox, but I don't think I can do that.
I'm doing Control and click to see, on Firefox to see, what I can do.
I can move it to the trash, or I can burn it to disc,
I don't know what that means.
I don't know if that's going to work.
Maybe it's just because there's two here open. Two Tor Browsers open.
Maybe only one should be open.
So maybe I should delete one of the two.
I don't know.
Here there are two. There's "Tor Browser", and "Tor Browser 1", as if I had downloaded two of them, which is odd.
So I'm going to just try to open one, see if that makes a difference.
I ejected the second one.
I don't really know what that means. It looks like it's, like you have a USB key
when you're downloading new software before you install it
and I never really understood what that means, how that works.
Usually, I download things and then I forget to open them and install them, so OK. So it's asking me that again.
This is why we need to do the study. It's actually pretty hard and horrible.
OK.
I actually had trouble with it too.
I don't know. I'm going to try to do something on...
I think, technically, like after two more minutes, if you don't still get it, then I should just help you or something.
OK.
Yeah. Do you want to try any other things, or are you pretty much done?
No, please, tell me what should I do.
OK. I think, in case that this happens, we actually have a version of Tor installed already.
So,
OK.
Yeah, it's in a hidden file that you can't really get to unless you knew where it was. But, sure, OK.
That was legitimately horrible. But that's why we're doing this study.
I couldn't download it either. And if it was easy to download, we wouldn't be doing this study.
So don't feel bad. It's supposed to be hard and there are people trying to fix it right now.
And if you have any questions about it, I can tell you after the study why certain things happen.
Because there's a reason why certain things happen.
So you downloaded Tor, and you already installed it, and since this is this copy, you've already configured it.
And if you wanted me to tell you, the reason why it says that it's not signed by an app developer,
is just because the Tor browsing company, they refuse to be affiliated with the Mac store,
because they need to provide all their code, and they need to let people know how they work,
what people are working on, and they need to follow...
You know how Apple looks nice, and everything needs to look the same?
They just don't necessarily want to be under that. But if you don't do that,
obviously if you download bad things from the Internet, you can get bad things with viruses inside,
or bad guys who are trying to give you Candy Crush,
but it's Candy Crush plus I'm going to just make your phone do bad things for you.
So that's why it says, you should download from the App Store because it's safe, but they're not in the App Store
because it makes things difficult for them and even slower, but it causes all of these issues
like, you can't open it right away, and all this kind of stuff.
So we're actually trying to look into it.
So that's why that happens.
So I want you to start at number 4, the rest of this should be pretty easy,
and, anytime you want to start, that's when you can start.
OK, number 4 is "Check that Tor is working".
So if it's a browser, I guess it works like Chrome or any other browser.
So I'm already in this, clicked in the search thing,
so I should just type anything.
I'm going to type "france" because it's a word that's in my head right now,
and wait and see if it works.
So, yeah, so here I have a bunch of results for "france".
"The official web site of France". OK.
And Wikipedia entry, factbook, and...
So it seems to be working, it's a little slow, maybe the connection's not great, but it's working.
"Do a web search..."
Do you like using this thing? Or, you said you used it because you were clicked into it, right?
What do you mean? This one? Oh, yeah, I guess I could do this.
No, I mean, I was just wondering.
I saw that I was already inside the...
OK.
"Do a web search for 'onions'."
So maybe this time I'll do it here, in the thing.
I don't know how it's called.
But I type in "onions" in that little...
OK, and uh... OK, it's not working.
So I'm going to try this, maybe it makes a difference,
as typing it in the search, like I did with "france".
And this time it works.
So I guess that's the difference between Chrome and Tor, which is that when you type it here,
inside the page, it works, but if you type it here, it doesn't, outside.
It's actually Google's thing if you just type in the address bar they Google search it for you,
and since they're not Google, they can't do that, without stealing them. So, yeah, it's not nice.
So, I'm doing a web search for "onions".
I don't know why there's an "s". You know?
Maybe it's a group, maybe it's a band. I don't think so.
But if I was looking just for an onion,
I'd go to the Wikipedia, I'd open the Wikipedia page,
to see, I don't know
what I'm looking for. The history, history of the onion.
I think the main idea was to like see which one you would use to search it with.
But you can read all the interesting facts about onions if you wish. [Laughter.]
It's fine.
OK. So, "Find a YouTube video for 'Ode to Joy'."
So see, what I'm, I guess what I was looking for was what I found just now, which is "Web", "Images", and "Videos".
In Google, it's underneath the search thing, So I can click on that, or it's right up...
But here it's different.
But anyway, now that I know that, I can just type in the search thing, "Ode to Joy".
So I said, I clicked return, just because I'm used to doing that.
I used to, I usually type in the thing I'm looking for before I change to images or videos.
So now, because we're looking for a video I'm going to type in "video",
and I'm looking for a YouTube video, so that would be maybe
number 4, because they're all, "Viral", "DailyMotion", so here it's...
"Xbox gameplay".
And then, I don't know.
I'll just tap on one of them, and then once I'm inside YouTube maybe I can find a better version.
So it's opening into a new page which is weird, I guess,
I'm not used to that.
And it says it needs a plugin, so that's not great.
So I can't see the video. So maybe if I go to YouTube, because here I'm on "Blink", I don't know why.
Weird.
Yeah. So I'm just going to type in "youtube.com" in the little thing,
and that should work better. And then type in "Ode to Joy".
Return.
YouTube. So there's a flash mob.
And then, I would go with number 3, just because the picture looks better.
Oh, there's a bunch of ads, but, yeah, I would just click on that.
And then check that my sound is on,
and listen to the Ode to Joy.
OK. That's weird. I'm sure it works.
Yeah, so it's kind of super slow though.
Yeah.
See the YouTube screen is also kind of, you know, turning black like that. Bugging a little.
OK. So, can I go to number 7?
Yeah.
"Use 'New Identity' under the onion menu."
So I'm guessing it's something of the Tor Browser.
So, "under the onion menu", OK no, it's about the onion.
Oh no, I don't think so, I think it's about Tor, because Tor looks like an onion.
OK, OK so the onion menu, maybe that's the Tor Browser menu, is what they mean.
I don't know.
And there should be something called "New Identity".
So, I'm looking at the browser, like the page that's open, just in case I can see like, if it's obviously there. But...
Oh! Here there's a little onion, maybe that's it.
"New Identity". Yay!
So yeah, there was an onion. Small green onion.
And yeah, I guess, it's new identity.
So I'm guessing it's the same thing as with Google, when you open a page and you don't want the history to show up or something.
And then you can, it's like you're disconnected from your Gmail account and everything,
you can type that as a different user.
"Explain your best understanding of all the items in the toolbar."
And by "the toolbar", we mean this. Not all of this. That would be atrocious. Just...
This.
Yeah. And you can say as much or as little as you want to. Like "I would never use this" or just like "I don't care" or like "What do you do there", something like that.
So, I tried before to type in in that small, in that search engine directly what I'm looking for, which is what Google does, but here it doesn't work, so I guess
unless I type in a direct web site, I would only use it for that.
And then I'm guessing that this Startpage is kind of the same thing as what's inside the page,
which is, you type in what you're looking for.
Would I use it? I guess so.
I don't know, maybe I'd rather use the big one because it's bigger, so it's easier to click on it.
But I don't even know if that's what it does. I'd have to check.
And type in "onion" and see if that's what I'm getting.
Yeah. So yeah.
I think I would use the big one, just because this is small.
I think, same thing happened to me with Safari, is that, I find it really small, all the icons and everything
so that it's harder to click on or navigate.
Then there's a little plus here to open a new file.
I tend to use Command-T for new tab instead of the little plus.
Same reason, just because, it's less, you need to be less precise to just type Command-T
rather than look with your mouse for the small plus.
Then there's that onion.
So yeah, none of those two things on the left I would take a look at.
OK. That's fair.
I'm also a little confused as to...
I guess "Sp" means "Startpage" but I don't know if I'm on Tor Browser,
or what is Startpage, I don't know what that is,
I guess it's, I don't really know. But yeah.
So if I take a look at the onion, I guess it's about preferences and network settings,
"New Identity". So that's cool.
I think if it's in the toolbar up above, it's good enough.
But, I don't know.
And this is about... "Forbid scripts globally". "Permanent 'Allow' commands".
So I don't know what that means.
But I guess may it could be an ad block or something like that. If I'm guessing.
All right. Do you have anything else to say?
Um...
Oh no, this isn't like a trick question. Like, I'm supposed to let you talk as much as you want to talk and not cut you off,
but I don't necessarily want to you like talk more if you're done talking.
Just, I guess, generally, because when you're used to one specific browser, it's kind of hard to switch.
Also, I feel like I've seen just like Startpage, other things, pages like this,
where it's blue here,
and then it's just a list of things. It's kind of small,
it's not really easy. Kind of like Craigslist or Yahoo.com.
Yeah, Craigslist, it looks so bad.
It's kind of, it's kind of hard to navigate when it's small.
All right.