How do you work out match ratio?

Answer 1

The Match Ratio (MR) is a quantitative evaluation of a statistical result generated by an individual who works with subjective data. Hence, the match ratio compares the closeness of an individual's result to a consensus. The MR is expressed as a percentage, the closer to the consensus, the higher the percentage. This is a metric used in flow cytometry, but in principle, can be used for any data set where the end result is determined by expert knowledge of the system in question and data that is not strictly objective.

Three sets of calculations must first be done prior to getting the MR:

First, the probability of inclusion for each event (cell) in the result must be found. P = T/H where P = probability of inclusion, T = number of times the event was included, and H = the number of human experts.

Next, we need to adjust the weights of the probabilities of each event where W= (P-1/2)^2. W= the weighted probability, P is from the first calculation.

Third, we need to find a value, S, which is basically the sum of the weights, with some skewing to the consensus. The equation for S is: S= Σ W* f(E*P) where E = the experts method for inclusion or exclusion of the event. If P >= 1/2 for INCLUSION, the value f(E*P) = 1. If P<1/2 for EXCLUSION the value f(E*P) =1. Otherwise f(E*P) returns 0 (e.g. <1/2 for Inclusion).

Once we have S, the MR = S / ΣW.