13/05/2012 - Progress: Testing underway

The project is progressing well. Bar some expected changes as a result of testing, the program (now called Kin-educate) is complete.

The program underwent the first round of testing this week. This first stage of testing was primarily planned to work out any major usability issues, bugs and errors. Whilst this was achieved during the testing, questionnaires were completed thus initiating the data collection stage a week ahead of schedule.

The application performed reasonably well under testing. BSc Computing colleagues tested it and provided some very useful feedback: It was noted the responsiveness of the on-screen hands were sluggish and felt slightly delayed or slowed down. This was actually intentional. Smoothing, jitter reduction and several other methods have been implemented in the code to ensure the interface feels fluid and controllable - if the on-screen images were to match the users every move identically (which it can) they would be shaky and difficult to manipulate. However, these controls can easily be altered. The smoothing factor has been reduced by approximately 30% and tested. It is now much more responsive whilst still being very fluid.

Some second year FdSc computing students also watched and played the game. This was an excellent opportunity to observe someone with no knowledge of the game attempt it. If the HCI principles applied were done so correctly then the user should be able to use the application with no difficulty. It was interesting to note that first-time users were nervous and hesitant with the interface. Once they had experienced moving objects around and placing them they became more confident and their moves more precise. It was also clear to see they began to enjoy the experience more. The initial hesitation is seen as an unavoidable consequence of using a still very new piece of technology with which the vast majority of people have had little or no previous experience in.

The project sponsor observed the game being played and also tested the application themselves. Whilst admitting they are not particularly interested in games and gaming in general they did remark favourably on the technical capabilities it took to produce the application. They also completed a questionnaire designed to capture expert opinions which will be helpful in the final data analysis phase.

The project is still currently just over one week over the schedule. This is not a major concern at the moment. The two teachers who agreed to test the application have been provided a copy and a set of questionnaires - for them and for the students. I explained I would need to start compiling the data in the next week (week commencing 14th May) and offered any assistance if required. As of yet I have not heard back from either of them. This is a little disconcerting but one must also recognise it is a busy time in the academic calendar and they have other duties that will take priority.

The risk assessment conducted as part of the project management documentation has recognised this potential risk and contingency plans are in place. If no data is returned by Friday the 18th May the possibility of conducting further testing in the City of Bath College will be explored. It is hoped a second round of testing with colleagues and other computing students will provide enough data from which to draw meaningful and valid conclusions.