In science and society, there are concerns about the welfare of farm animals, including pigs. To improve their welfare and enhance the sustainability of livestock production, it is thus essential to properly measure welfare. One part of good welfare is that animals experience more positive than negative emotions. An accurate assessment of the emotions of animals is thus essential.
Emotions in animals can be represented along the dimensions of valence and arousal. The valence dimension is about whether the animal considers the emotion positive or negative. The arousal dimension is about how activated the animal is or the intensity of the emotion.
One can use the components associated with emotion to measure emotions in animals: behavior, physiology, cognition, and feelings. For instance, when faced with a predator, an animal may decide the best option (cognitive) is to flee from the predator (behavior). At the same time, it has an increased heart rate (physiology) and likely feels frightened (subjective). The latter is a component that cannot be measured in animals as animals cannot verbally report how they are feeling, but the other three can be measured.
Facial skin temperature has recently been suggested to be a promising physiological component for measuring emotional arousal and valence. When aroused by, for instance, the presence of a predator or other stimuli, the sympathetic branch of the autonomic nervous system causes peripheral blood vessels to constrict to direct blood and, thereby, energy and oxygen to the core of the body where it is needed. This leads to an initial drop and subsequently an increase in temperature in the periphery of the body, such as (parts of) the face.
The valence state of emotions may also be indicated by facial skin temperature. The emotional valence lateralization hypothesis proposes that left brain hemisphere activity is associated with positive emotion and the right hemisphere with negative emotion. Asymmetry in facial skin temperature (difference in temperature dynamics between, for example, left vs right ear) in response to an emotional stimulus may thus reflect lateralized brain activity and hence be a marker of valence.
Facial skin temperature can be measured non-invasively with a thermal imaging camera, but doing this manually is time and labor-intensive. Furthermore, any change in the requirements means that the measurements should be started over from scratch. Therefore, this project aims to develop a neural network to automatically measure facial skin temperature.
Progress
As a starting point for this project, the ear base of pigs was chosen as an area of interest to extract the maximum temperature. This is an interesting area for emotion research and relatively easy to define. The model is able to detect the area of interest (ear base) whenever it is quite visible in the thermal frame, and measure the maximum temperatures of both sides; left and right. A published paper on the model development is coming soon. For future research, the researchers are going to detect facial features in pigs to study the emotion of pigs.
Outlook
Ultimately, the researchers would like to (automatically) measure and integrate more measurable components to study emotions in pigs, looking not just at facial skin temperature but also heart rate variability, EEG measurements, tail posture and motion, play behavior, and vocalizations.