Confusionmatrix

Purpose

Create a confusion matrix showing classification rates from a classification model or from a list of actual classes and a list of predicted classes.

Synopsis

[misclassed, classids, texttable] = confusionmatrix(model);  % create confusion matrix from classifier model

[misclassed, classids, texttable] = confusionmatrix(model, usecv);  % create confusion matrix from model using CV results

[misclassed, classids, texttable] = confusionmatrix(trueClass, predClass); % create confusion matrix from vectors of true and pred classes

Description

Confusionmatrix creates a table of results showing True Positive, False Postive, True Negative and False Negative rates (TPR FPR TNR FNR) as a matrix for each class modeled in an input model. The 'most probable' predicted class is used when a model is input. Input models must be of type PLSDA, SVMDA, KNN, or SIMCA.

Optional second parameter "usecv" specifies use of the cross-validation based "model.detail.cvmisclassification" instead of the default self-prediction classifications "model.classification".

Input can consist of vectors of true class and predicted class instead of a model.

Classification rates are defined as:

TPR: proportion of positive cases that were correctly identified
FPR: proportion of negatives cases that were incorrectly classified as positive
TNR: proportion of negatives cases that were classified correctly
FNR: proportion of positive cases that were incorrectly classified as negative

Four additional fields are also shown for each class:

N: Number of samples belonging to each class
Err: Misclassification error = proportion of samples which were incorrectly classified
P: Precision, = TP/(TP+FP)
F1: F1 Score, = 2*TP/(2*TP+FP+FN)

Inputs

• model = previously generated classifier model or pred structure,
• usecv = 0 or 1. 0 indicates confusion matrix should be based on self-prediction results, 1 indicates it is based on using cross-validation results (assuming they are available in the model),
• trueClass = vector of numeric values indicating the true sample classes,
• predClass = vector of numeric values indicating the predicted sample classes.

Outputs

• misclassed = confusion matrix, nclasses x 4 array, one row per class, columns are True/False Postive/Negative rates (TP FP TN FN),
• classids = class names (identifiers),
• texttable = cell array containing a text representation of the confusion matrix. The i-th element of the cell array, texttable{i}, is the i-th line of the texttable. If there are only two classes then the Matthew's Correlation Coefficient value is included as the last line. Note that this text representation of the confusion matrix is displayed if the function is called with no output assignment.

Example

Calling confusionmatrix with no output variables assigned: 'confusionmatrix(model)' displays the output:

>> confusionmatrix(model)
Confusion Matrix:                                         
   Class:      TP          FP          TN          FN    
        K      1.00000     0.03774     0.96226     0.00000
       BL      0.77778     0.00000     1.00000     0.22222
       SH      1.00000     0.00000     1.00000     0.00000
       AN      1.00000     0.00000     1.00000     0.00000

See Also

confusiontable, plsda, svmda, knn, simca