TY - CPAPER TI - User's Choice of Precision and Recall in Named Entity Recognition AU - Klinger, Roman AU - Friedrich, Christoph M. PY - 2009 T2 - Proceedings of the International Conference RANLP-2009 SP - 192-196 PB - Association for Computational Linguistics CY - Borovets, Bulgaria UR - https://fis.uni-bamberg.de/handle/uniba/94005 LA - eng AB - Conditional Random Fields are commonly trained to maximize likelihood. The corresponding Fβ measure, the weighted harmonic mean of preci-sion and recall, which is established for evaluation in information retrieval and text mining, is not necessarily the optimal result for the user’s choice of β. Some approaches have been published to optimize multivariate measures like Fβ to overcome this inconsistency. The limitation is that constraints like the value of β have to be known at training time. This publication proposes a method of multiobjective optimization of both precision and recall based on a preceding likelihood training. The output is an estimation of pareto-optimal solutions from which the user can select the best for the actual application. Evaluated on two publicly available data sets in the field of named entity recognition, nearly all Fβ values are superior to those resulting from log-likelihood training KW - Named Entity Recognition KW - Conditional Random Fields KW - Multi-Objective Optimization KW - NSGA-II KW - Fβ measure KW - Recall KW - Precision ER -