MA-LR is a Python implementation of the multiple-annotator logistic regression model proposed in:

Rodrigues, F. and Pereira, F.C. and Ribeiro, B. , Learning from Multiple Annotators: Distinguishing Good from Random Labelers, Pattern Recognition Letters, 2013.

Download here.