I've answered my own question with a bit of searching, sorry!
%output classifications
for i = 1:length(testSet.Files)
[idx,score] = predict(categoryClassifier,readimage(testSet,i));
if (testSet.Labels(i) ~= categoryClassifier.Labels(idx))
i %just output the index, do interesting things with it later
end
end