In this project, a comparison was made between conducting user evaluations in a laboratory setting and a newly developed online tool. This tool, Simplicity Labs, is a digital experimental platform which aims to test new functionality of products and services and their usability. It supports iterative design processes by providing timely qualitative feedback from users to designers. This user-feedback can be acquired from different groups of people with regard to their demographic and cultural background and hence provide important user insights.
The comparison between the evaluations in the laboratory setting and the online tool consisted of four standardized questionnaires. No significant differences were found between the two methods, except for favoring the use of the online tool for online simple applications. To expand on the effective use of the tool, an application was tested in which a photo book is generated from a photo collection, submitted by the user. Using the online tool in this manner demonstrated how it could be used to test and compare the effectiveness of different photo-processing algorithms with regard to user appreciation.
For testing purposes, an innovative video editing application named Edit While Watching was used. Also, another application was improved for testing photo algorithms for the use of creating automated photo albums. These software developments were carried out by developers in C#(.NET) in an agile way.