Facial Coding in Advertising Research

Facial coding measures consumers' emotional responses to advertising by analyzing the movements of their faces while they watch. It rests on Paul Ekman and Wallace Friesen's Facial Action Coding System (FACS), which decomposes any expression into elemental action units, the contractions of individual facial muscles such as the lip-corner pull of a smile or the brow lowering of a frown. Manual FACS coding is precise but slow, so the field has shifted to automated facial coding, in which computer-vision models detect landmarks and action units frame by frame and map them to emotions and to continuous valence and arousal. Daniel McDuff, Rana el Kaliouby, and colleagues showed at scale that these automatically measured facial responses to ads predict ad liking and even changes in purchase intent. Aggregated across viewers, the result is a second-by-second emotional response curve over the ad, revealing where it amuses, surprises, bores, or repels. Facial coding thus turns spontaneous, fleeting expressions into a quantitative, time-resolved index of how an ad makes people feel.