Okay, so let's wrap up the verification and validation section of the class. We talked about the nature of verification and validation testing, how those things differ, how we have to consider the priority and timing of changes that we find from testing. We talked about the test side of the V, and how it relates to verifying the requirements on the other side. We talked about some general testing guidelines, how it makes more sense to do multiple tests with small numbers of users. We also presented a really good checklist of ways to strengthen UX tests, and a link to a good list of suggestions for getting users to think aloud. I'd encourage you to refer back to both of those. I think those are both good ways to make your testing better, both in setting up the test and in the actually running the test. We talked about some specific methods for verification and validation, depending on what types of result we were trying to gather, quantitative or qualitative. Hallway usability testing is probably the most common one, we also added in black hat and first click testing. UX health checks to keep track of our usability improvements. A/B testing to make comparative tests. Heuristic evaluation to make sure that we haven't broken any of the guidelines that we set up for our interfaces. And then we talked a bit about formal usability testing, which again is its own animal. There's some good resources there, some things to consider, when it's appropriate. If you go that route, if you're looking at doing formal testing, you might want to consider having professional usability folks dig in, maybe consultants, maybe a usability test house. If you're in a large enough company, you may have a usability department that handles that kind of thing. But formal usability testing is really a very different animal. Then we got into surveys and statistics a bit, in case we needed to find ways to get some quantitative data from satisfaction surveys. Surveys are really a great tool at any stage, depending on what it is that you're looking for. And again, if you weren't aware, those standardized pre-validated surveys are really easy to use and very valuable. Some tips and expectations around surveys and some examples of some of the pre-validated surveys that you might want to apply. The SUS is probably the one that's applied most commonly. And that's probably the first place I would go if I was looking to get some measure of satisfaction of usability for a system. Statistics and measures, again, a lot of it came from a couple of good references, Tullis and Albert, and Sauro and Lewis. You can, if necessary, start to gather enough data on different measures to build up statistical strength. You have to decide whether that's important to you. If it is, you need to consider how you're going to analyze the data, how you're going to gather the data, and how you're going to present the data. And again to Tufte's comments in that section, you have to make sure that what you're presenting has validity, has support behind it. And that you're disclosing your sources and the way that you've done your analysis. Also there was a little section in there about data visualization errors. Some things to think about when you're doing bar charts, pie charts, maybe using a stacked bar chart. So for project 4, although I'd love to give you some statistical problems, what we need to do at this point is some peer review of the projects that were done in the earlier sections. So you're going to be looking at the input from other students for projects 1 through 3 and grading them. Hopefully this will give you some insight as to how other people approach using some of these methods. I think for the statistical methods in this section, if you need to use them and you use one of those resources or their websites, you'll probably be able to get through that pretty easily. So, again, there is a quiz, you have this project for the peer review. This is the last module for the course. We'll have a wrap up discussion for the course. Again, please shout out if you need help, don't be afraid to ask, thank you very much.
