TY - JOUR TI - Characterizing facial expressions by grammars of action unit sequences - A first investigation using ABL AU - Siebers, Michael AU - Schmid, Ute AU - Seuß, Dominik AU - Kunz, Miriam AU - Lautenbacher, Stefan PY - 2016 JO - Information sciences : an international journal IS - 329 Special Issue on Discovery Science SP - 866-875 PB - Elsevier Science Inc. CY - New York, NY SN - 0020-0255 DO - 10.1016/j.ins.2015.10.007 UR - https://fis.uni-bamberg.de/handle/uniba/39900 LA - eng AB - We investigate the application of grammar inference to the analysis of facial expressions to discover underlying sequential regularities characteristic for a specific mental state. The input consists of sequences of action units (AUs), which represent basic facial signals. The typical classification task for facial expression analysis is to assign a set of AUs its corresponding mental state, e.g., an emotion. To our knowledge, there is no research investigating whether there is diagnostic information in the sequence in which the AUs occur in a given time interval. Our study is based on data of facial expressions of pain obtained in a psychological experiment with 347 pain episodes of 86 subjects represented as sequences of AUs. We applied the Alignment-Based Learning (ABL) approach to infer the underlying grammar for the set of all AUs which occurred in the sequences and for a reduced alphabet of the relevant AUs only. We used 10-fold cross-validation to estimate performance and we extended ABL with a frequency-based heuristics to reduce the number of grammar rules by eliminating such rules which do not contribute significantly to performance. The resulting grammar for the reduced AU alphabet provides a first approximation for a “grammar of pain”. KW - Grammar of pain KW - Alignment-Based Learning KW - Heuristic rule extraction KW - Facial expression analysis ER -