Psi Chi Journal Volume 29.3 | FAll 2024

Page 1


FALL 2024 | VOLUME 29 | ISSUE 3

ISSN: 2325-7342

Published by Psi Chi, The International Honor Society in Psychology ®

PSI CHI JOURNAL OF PSYCHOLOGICAL RESEARCH FALL 2024 | VOLUME 29, NUMBER 3

EDITOR

STEVEN V. ROUSE, PhD

Pepperdine University

Telephone: (310) 506-7959

Email: steve.rouse@psichi.org

ASSOCIATE EDITORS

JENNIFER L. HUGHES, PhD Agnes Scott College

STELLA LOPEZ, PhD University of Texas at San Antonio

TAMMY LOWERY ZACCHILLI, PhD Saint Leo University

ALBEE MENDOZA, PhD Delaware State University

KIMBERLI R. H. TREADWELL, PhD University of Connecticut

ROBERT R. WRIGHT, PhD Brigham Young University-Idaho

EDITOR EMERITUS

DEBI BRANNAN, PhD Western Oregon University

MANAGING EDITOR

BRADLEY CANNON

DESIGNER

JANET REISS

EDITORIAL ASSISTANTS

EMMA SULLIVAN

ADVISORY EDITORIAL BOARD

GLENA ANDREWS, PhD RAF Lakenheath USAF Medical Center

AZENETT A. GARZA CABALLERO, PhD Weber State University

MARTIN DOWNING, PhD Lehman College

HEATHER HAAS, PhD University of Montana Western

ALLEN H. KENISTON, PhD University of Wisconsin–Eau Claire

MARIANNE E. LLOYD, PhD Seton Hall University

DONELLE C. POSEY, PhD Washington State University

LISA ROSEN, PhD Texas Women's University

CHRISTINA SINISI, PhD Charleston Southern University

PAUL SMITH, PhD Alverno College

ABOUT PSI CHI

Psi Chi is the International Honor Society in Psychology, founded in 1929. Its mission: "recognizing and promoting excellence in the science and application of psychology." Membership is open to undergraduates, graduate students, faculty, and alumni making the study of psychology one of their major interests and who meet Psi Chi’s minimum qualifications. Psi Chi is a member of the Association of College Honor Societies (ACHS), and is an affiliate of the American Psychological Association (APA) and the Association for Psychological Science (APS). Psi Chi’s sister honor society is Psi Beta, the national honor society in psychology for community and junior colleges.

Psi Chi functions as a federation of chapters located at senior colleges and universities around the world. The Psi Chi Headquarters is located in Chattanooga, Tennessee. A Board of Directors, composed of psychology faculty who are Psi Chi members and who are elected by the chapters, guides the affairs of the Organization and sets policy with the approval of the chapters.

Psi Chi membership provides two major opportunities. The first of these is academic recognition to all inductees by the mere fact of membership. The second is the opportunity of each of the Society’s local chapters to nourish and stimulate the professional growth of all members through fellowship and activities designed to augment and enhance the regular curriculum. In addition, the Organization provides programs to help achieve these goals including conventions, research awards and grants competitions, and publication opportunities.

JOURNAL PURPOSE STATEMENT

The twofold purpose of the Psi Chi Journal of Psychological Research is to foster and reward the scholarly efforts of Psi Chi members, whether students or faculty, as well as to provide them with a valuable learning experience. The articles published in the Journal represent the work of undergraduates, graduate students, and faculty; the Journal is dedicated to increasing its scope and relevance by accepting and involving diverse people of varied racial, ethnic, gender identity, sexual orientation, religious, and social class backgrounds, among many others. To further support authors and enhance Journal visibility, articles are now available in the PsycINFO®, EBSCO®, Crossref®, and Google Scholar databases. In 2016, the Journal also became open access (i.e., free online to all readers and authors) to broaden the dissemination of research across the psychological science community.

JOURNAL INFORMATION

The Psi Chi Journal of Psychological Research (ISSN 2325­7342) is published quarterly in one volume per year by Psi Chi, Inc., The International Honor Society in Psychology. For more information, contact Psi Chi Headquarters, Publication and Subscriptions, 651 East 4th Street, Suite 600, Chattanooga, TN 37403, (423) 756­2044. www.psichi.org; psichijournal@psichi.org

Statements of fact or opinion are the responsibility of the authors alone and do not imply an opinion on the part of the officers or members of Psi Chi.

Advertisements that appear in Psi Chi Journal do not represent endorsement by Psi Chi of the advertiser or the product. Psi Chi neither endorses nor is responsible for the content of third­party promotions. Learn about advertising with Psi Chi at http://www.psichi.org/Advertise

COPYRIGHT

Permission must be obtained from Psi Chi to reprint or adapt a table or figure; to reprint quotations exceeding the limits of fair use from one source, and/or to reprint any portion of poetry, prose, or song lyrics. All persons wishing to utilize any of the above materials must write to the publisher to request nonexclusive world rights in all languages to use copyrighted material in the present article and in future print and nonprint editions. All persons wishing to utilize any of the above materials are responsible for obtaining proper permission from copyright owners and are liable for any and all licensing fees required. All persons wishing to utilize any of the above materials must include copies of all permissions and credit lines with the article submission.

169 Effects of Color and Lighting Temperature on Mood and Cognitive Performance

Megan B. Afifi, Elizabeth J. Krumrei-Mancuso*, and Janet Trammell* Department of Psychology, Seaver College, Pepperdine University

181 Mental Health and Religiosity Among Sexual Minority Students at a Christian University

Danica P. Christy, Steven V. Rouse*, and Elizabeth J. Krumrei-Mancuso* Department of Psychology, Pepperdine University

191 Internalized Stigma and Substance Use: Does Race Matter?

Anne Ferrari* and Mikaela Burch

Division of Social Sciences, Mount Saint Mary College

197 The Ideal Affect of Filipinx Americans

Audrienne Casidsid, William Peruel, Jonna-Lynn Alonso, and Christie Napa Scollon* Department of Psychology, Western Washington Universityn

205 Loneliness Rates Among Undergraduates According to the National College Health Assessment From 2008 to 2019

Eunji Shin1, Khanh Bui*1, and Joshua H. Park2

1Social Science Division, Pepperdine University

2Natural Science Division, Pepperdine University

213 Quality Dating and Wellness Among a Religious College Student Population: A Mixed-Methods Approach

Robert R. Wright*1, Melissa Wilson1, Christian Nienstedt2, Carson Ewing3, Andres Rodriguez1, Cade Anderson1, Natalie Johnson1, and Lindsay Johnson1

1Department of Psychology, Brigham Young University–Idaho

2 Department of Psychology, Alliant International University, Fresno

3Department of Educational Psychology, University of Utah

227 Race Differences in Stressor-Related Negative Affect and Daily Rumination

Jessica M. Blaxton* and Sydney Dobrzynski

Department of Psychology, Metropolitan State University

Effects of Color and Lighting Temperature on Mood and Cognitive Performance

ABSTRACT. Research on the psychological effects of different design elements is important to interior designers and any individuals designing a space. No previous research has analyzed the interaction effects of color and lighting temperatures on mood, heart rate, and cognitive performance. The current study was conducted at Pepperdine University in a 2 x 2 randomized experiment. There were 78 participants aged 18–24 with a mean age of 18.85 ( SD = 1.20), including 53 women, 24 men, and 1 who did not indicate their gender. The study evaluated self­reported mood (Positive and Negative Affect Schedule), accuracy and reaction times (Stroop task), creative intelligence (Remote Associates Test), and heart rates (heart rate monitor). Participants completed these tasks in a room with either a warm (red) or cool (blue) background color and completed tasks once in warm lighting and once in cool lighting. We found that color and lighting temperatures had different effects on affect, creative intelligence, reaction times, and accuracy. Negative affect was lower in Warm Lighting x Cool Color and Cool Lighting x Warm Color conditions (p = .046). Accuracy was higher in the Cool Color condition (p = .01) and in the Cool Color x Warm Lighting condition (p = .047). Creative intelligence scores approached significance in being higher in cool than warm lighting (p = .05). No effects were found on heart rates (p = .62). These results can inform designers on how to use the design elements of color and lighting temperatures to promote certain desired psychological effects in a space.

Keywords: environmental psychology, interior design psychology, color and lighting temperature, mood, cognitive performance

Environmental psychology is a constantly evolving field of study that considers the relationships between design elements and psychological areas of functioning such as mood, arousal, and cognitive performance. Two primary elements of interior spaces are background color and lighting, and the way the two interact is of interest to designers to achieve the desired effect of a space. Often, the goal of the designer of an interior space is to create some ambient effect

Preregistration badge earned for transparent research practices. The preregistration can be viewed at https://osf.io/wb9dk

on a person’s emotional and cognitive state. However, design education programs often do not teach about the interactions between color and lighting in classes. This is a missed opportunity to explore the psychological and physiological effects that color and lighting interactions have on people in any given space.

The current study analyzed the relationship between warm (red) and cool (blue) background colors and warm (orange­white) and cool (blue­white) source lighting

temperatures, and how the interactions between these environmental elements affect people’s mood, cognitive performance, and heart rate. In this study, cognitive functioning refers to one’s mental abilities in areas such as learning, memory, problem­solving, and reasoning. Colors are described here as warm or cool based on hue and wavelength: cool colors like blue have a shorter wavelength, and warm colors like red are longer in wavelength. Similarly, cool lighting is described here as more blue­white light, and warm lighting is described as orange­white light.

Often, interior design programs teach color and lighting as separate design foundations, causing interior designers to be underprepared to understand how color and light intersect. In this paper, we rely on a phenomenological approach to color and lighting in which color and light intersect actively within the subjective experience of a person who inhabits a space (Poldma, 2009). As Poldma (2009) pointed out, when color and light act well together, this creates a positive spatial experience and an emotional resonance within the user of a space. Yet, given that it is within a person’s subjective experience that color and lighting interact to create a particular effect, it is necessary to study color and lighting together to understand how people experience color and light as interrelated concepts within a space. In agreement with Poldma (2009), unless designers can predict the color and lighting interaction effects that interior spaces will have on people, they will be partially blind to the ideal combinations that should be employed to achieve the intended effects of the design. The current study aims to contribute knowledge in this area.

The empirical framework of the current study focuses on how color hue and lighting temperature interact. Given that this has rarely been examined, we begin with a review of what is known about how color hue and lighting temperature individually influence people. Warm colors like red and yellow are generally understood to be more stimulating and arousing than cool colors like blue and green, and cool colors are generally more relaxing and calming than warm colors (Elliot, 2019; Roy et al. 2021; Wilms & Oberfeld, 2017). Similarly, in academic study environments, warm colors are generally found to be too stimulating and distracting; cool colors tend to work well as they are more calming and promote focus (Costa et al., 2018). On a simple proofreading exercise, however, red and white color conditions had enough of an arousing effect to promote performance more than the cool conditions did (Cha et al., 2020). In terms of lighting temperature, generally, people tend to prefer warmer and dimmer lighting, but although warmer, dimmer lighting may positively influence mood, it may also hinder performance on cognitive tasks (Knez & Kers, 2000).

The current study built on these previous findings to examine how the interaction of color and lighting

temperatures influences people. We evaluated the impact of various color and lighting temperature combinations on self­reported mood, task performance, and the physiological measure of heart rate. Previous studies have analyzed these components separately, but to our knowledge, none have analyzed the specific effects of these elements in tandem with each other. It is important to understand how color and lighting elements act together to affect mood and cognitive performance in people. Given the interaction between color and lighting that takes place within a person using a space, studying color and lighting together is imperative to understand their effects on people’s moods, physiology, creativity, task performance, and other experiences, within given spatial designs. With such knowledge, people—especially designers— can be more intentional in creating their desired experiences within given spaces.

Color

Color and Mood

A general trend seen with color temperature is that cool colors are preferable to spend time in, and incite feelings of calm more than warm colors (Costa et al., 2018). Stone (2001) found that positive mood was higher in participants who were in a blue room rather than a red room, but that mood did not differ significantly between those in a blue vs. a white room. Furthermore, blue was rated as more pleasant than either red or yellow in another study (AL­Ayash et al., 2015). Blue has also been rated as calmer and more interesting than warmer colors (Kaya & Epps, 2004). In agreement with these findings, people rated feelings of calmness (vs. restlessness) and peacefulness (vs. agitation) from highest to lowest in the order of cool, then achromatic, then warm colors (Yildirim et al., 2011). In addition, warm­colored interiors have the most positive effect on mood, followed by cool, then achromatic colors, and warm color interiors ranked higher in feelings of happiness and vividness than cool or achromatic colors (Yildirim et al., 2011). Warm color, then cool color, then achromatic color interiors were rated by participants in that order from most positive to most negative concerning high arousal, stimulation, and excitement (Yildirim et al., 2011).

Red was associated with higher anxiety and stress levels for participants who remained in a red­colored room; reports of symptoms of depression were more prominent in those who remained in a blue ­ colored room for the duration of a task (Kwallek et al., 1988). This illustrates the arousing and non­arousing effects of different colors. In recent research, however, there have been contradictions, such as that cool colors are more arousing than warm colors, and that vivid blue is reported as having an awakening and activating effect on participants (AL­Ayash et al., 2015; Roy et al, 2021).

Color and Cognitive Performance

In terms of cognitive performance, previous literature has indicated that warm colors enhance arousal and stimulation, and therefore can be more distracting than helpful on cognitive tasks (Elliot, 2019; Stone, 2001; Xia et al., 2016). Cool colors are more calming; therefore, they promote greater focus during cognitive tasks. Background colors (the color of the surrounding area in which the participant engaged in a task) either had a facilitating effect or no effect on cognitive task performance in a study by Xia et al. (2016). Accuracy was reported as higher in a blue background condition than in a red background condition, and the blue condition also enhanced simple creativity task performance more than red, which had little effect compared to the neutral (gray) color condition.

In a study where performance on a reportedly difficult reading task and a less difficult mathematics task were measured, Stone (2001) found that performance on the reading task was worse in a red environment than in a white environment, but performance on the reading task in a blue environment did not differ significantly from the red and white environments used in the study. Color did not significantly affect performance on the math task, but reading task performance was worst in the red environment. This illustrates the task­dependent nature of the relationship between color and cognitive performance and suggests that warm colors may inhibit performance on difficult tasks more so than less difficult tasks. Interestingly, some studies have reported that on easier, low­load cognitive tasks, cool colors are too relaxing and therefore do not assist in maintaining focus and concentration, causing worse performance (Elliot, 2019; Xia et al., 2016). This suggests, in congruence with other findings, that on a low cognitive load task, stimulation from warm colors does not hinder performance because not as much attention is required for the task. On higher cognitive load tasks, however, warm colors like red tend to be too distracting and hinder performance as they can draw attention away from the task at hand. The resulting distraction of warm colors takes up focus that could otherwise be more fully applied to performing better on the task. The lower distraction levels of cool colors allow for those resources to be more fully allocated to performance on more difficult tasks where they are needed. Therefore, determining what color temperature is more beneficial to the environment appears to depend on both the nature of the task difficulty and the desired level of stimulation.

Lighting

Lighting and Mood

Findings suggest that a positive mood is best preserved in warmer lighting; Zhu et al. (2019) found that

participants’ moods worsened more in cooler lighting conditions than in warmer lighting conditions. Knez and Kers (2000) found that, contrastingly, in younger adults, a negative mood was sustained more in a warmer lighting condition than in cooler lighting, but for older adults, a negative mood persisted in the cooler lighting condition. This finding partially contradicts some lighting theories that positive mood generally correlates more with warmer lighting than cooler, but this study reveals that the difference in effect may be attributed to age.

Lighting and Cognitive Performance

Compared to red and green lighting, white lighting proved to be rated higher on a usefulness scale, indicating that white lighting facilitated performance on more useful or productive activities, rather than hindering it (Odabaşioğlu & Olguntürk, 2015). Cognitive performance was found to be better in low, cool lighting than in low, warm lighting, and participants were slowest in processing a task measuring their inhibitory capacity (responding to red words flashing on a screen and ignoring black ones) and working memory under a dim, warm lighting source than in other lighting conditions (Zhu et al., 2019). They also found that participants performed best in high, cool light on a long­term memory task compared to other conditions, suggesting that cool lighting is best for promoting some aspects of cognitive performance like long­term memory. Accuracy scores on another task, however, were lower in cool than warm lighting. These findings support others that suggest that the effects of lighting temperature on cognitive performance are dependent on the type of task. Similarly, Stone (2001) found that color temperature affects cognitive performance differently depending on how high of a cognitive load the task requires.

The Current Study

To our knowledge, no previous studies have analyzed the interaction between background color and lighting temperatures on mood and cognitive performance. At the time of this study, enough research is available on the effects of color temperature and lighting temperature separately on mood and cognitive performance to understand the trends, however, there is no research on an integrated approach to color and lighting temperatures on these psychological effects. As the body of research on this topic is continuously growing, this will help inform designers about how to integrate design elements to best achieve the desired psychological effects of a designed space (Poldma, 2009). The current study contributes to the existing literature by replicating main effects and examining potential interactions between color and lighting temperatures on mood and cognitive performance levels. We examined this with a sufficient

FALL 2024

sample size in real­life contexts and provided evidence for what combinations of color and lighting work best for achieving better performance on cognitive tasks and striving towards net positive affect. All APA ethical standards were met in conducting this study, and approval was received from the Pepperdine University Institutional Review Board.

Hypotheses

To better integrate color and lighting interactions into discussions about design as Poldma (2009) points out is necessary, we analyzed their effects on mood, cognitive performance, and physical arousal. These are some of the main outcomes of interest when it comes to the experience of a designed space, and therefore our hypotheses are based on how color and lighting elements of design affect these measures both individually and together. Based on previous research, our hypotheses were as follows:

1. Mood was expected to be better in Cool Color and Warm Lighting conditions than in Warm Color and Cool Lighting conditions.

2. Warm Colors as well as Cool Lighting were expected to be more arousing and stimulating than Cool Colors and Warm Lighting (expressed as higher heart rates).

3. Performance on cognitive tasks was expected to be better in Cool Color and Cool Lighting conditions than in Warm Color and Warm Lighting conditions.

4. The interactions of Warm Color x Cool Lighting, Warm Color x Warm Lighting, Cool Color x Cool Lighting, and Cool Color x Warm Lighting conditions are expected to have different impacts on mood, heart rates, and cognitive performance levels in comparison with each other. As there is no established research on how specific interactions of these conditions affect our outcome variables, we predict that the conditions will have different effects on these outcomes from each other.

Hypothesis 4 helps to bring this body of research more in line with real­life settings, where color and lighting are both present in every space and interact in unknown ways to influence mood and cognition. It is important to better understand this relationship empirically to ensure that spaces are properly designed in reality.

Method

Participants

Participants of this study ( N = 78) were students at Pepperdine University. Participants were at least 18 years old and were determined not to be color blind by the online version of the Ishihara Color Blindness test.

An a priori power analysis of a 2 x 2 mixed ANOVA determined that 62 participants were needed to have 80% power to detect a medium ­ sized effect (.15) with a .05 criterion of significance. The mean age was 18.85 (SD = 1.20), there were 53 (67.95%) women and 24 men (30.77%), and 1 participant who did not indicate their gender (1.28%). In terms of race, 38 (48.72%) participants identified as White/European American, 22 (28.21%) as Asian/Pacific Islander, 12 (15.38%) as Multiracial, 4 (5.13%) as Hispanic/Latino, and 2 (2.53%) as Black/African American. There were 48 (61.54%) first­years, 16 (20.51%) second­years, 7 (8.97%) third­years, 7 (8.97%) fourth­years, and students with majors of all eight major divisions offered at the school. This study made use of convenience sampling. Eligible participants received assignment credit in a psychology course for participating in this research. No participants dropped out after starting.

Internal consistency was calculated for scores on the Positive and Negative Affect Schedule (PANAS) and Remote Associates Test (RAT). Participants’ use of blue­light glasses was measured for exploratory analyses, however, only four participants reported wearing blue light glasses. Therefore, no additional analyses were conducted on this variable.

Design

This study made use of a 2 x 2 experimental design. One independent variable was color temperature which consisted of a warm color condition and a cool color condition that was examined between subjects with random assignment. Another independent variable was lighting temperature which consisted of a warm and cool lighting condition examined within subjects, counterbalanced for order effects. We examined the effects of color and lighting temperatures on mood (as measured by the PANAS), cognitive performance (as measured by the Stroop and RAT tasks), and heart rates (as measured by forearm heart rate monitors). These measures were analyzed within­subjects to use participants as their own controls, rather than between subjects. We did not employ a within­subjects design for the room color, as this change would be very noticeable to participants (unlike manipulating the warmth of the lighting). That is, if participants completed tasks in a red room and then came back to a blue room after the break, this may have been a threat to the validity of the design. Therefore, each participant completed experimental tasks and surveys in one color and both lighting conditions. For the color temperature variable, 47.4% were in the warm color condition (n = 37), and 52.6% were in the cool color condition (n = 41). Participants completed the experiment individually. Data collection stopped

after a predetermined six­week period. Participants with missing data on certain scales and tasks were excluded only from analyses that involved those data.

Materials/Measures

Two questionnaires were administered through Qualtrics, and included an informed consent form, the mood survey, the Ishihara test, the Stroop task, and the RAT items for the trial condition and the experimental conditions. If a participant did not pass the Ishihara test, they were not given the experimental questionnaire.

Condition Materials

The Munsell Color Chart as used by the World Color Survey was used to select the condition colors. The warm color is described as G2 from the Munsell Color chart, and the cool color as H30. These colors were both high in saturation. The warm light had an illuminance factor of around 3,000K, and the cool light had an illuminance factor of around 6,000K.

The color conditions were created by using red and royal blue bulletin paper cut to the same size and fixed behind the computer. For lighting, two lamps with multiple brightness and temperature settings were used at their brightest setting to be set to the coolest setting in the cool lighting condition, and the warmest setting in the warm lighting condition. For the warm lighting condition, the computer screen was also set to a warm light setting to mitigate the contrasting effects of the blue light typically emitted by computer screens.

Ishihara Test

The Ishihara Test (computer version) was used to determine study eligibility by providing an indicator of color blindness. Potential participants were presented with an image of dots in one color forming two numbers inside a circle of dots in another color; the task was to identify the two numbers in the circle. This measure can only determine red­green color blindness; failure to identify the numbers in the circle indicated possible red­green colorblindness and exclusion from the study.

Positive and Negative Affect Schedule

The Positive and Negative Affect Schedule (PANAS) was used to measure participants’ state affect (Watson et al.,1988). The measure was adapted from its original to state, “indicate the extent you feel this way right now,” instead of “…the way you have felt over the past week” to measure state, rather than trait, affect. The scale measures 20 affect indicators, 10 measuring positive affect and 10 measuring negative affect, on a 5­point scale to what degree they resonate with them ranging from 1 (very slightly or not at all) to 5 (extremely). The negative item “afraid” was left out by error and not collected from participants, so

the subscale scores were calculated from 10 positive and 9 negative scores in this study.

Scores were calculated by summing the scores on positive items into a positive affect score (ranging from 10–50, higher scores indicating a higher positive affect level) and those on negative items into a negative affect score (ranging from 9–45, higher scores indicating a higher negative affect level). The scale’s utility is promoted by the evidence of large­scale normative data (Crawford & Henry, 2004). Our internal consistency analysis showed that Cronbach’s alpha was greater than .73 for positive and negative scales each time they were administered.

Reaction Time and Accuracy: Stroop Task

An online Stroop test from Hanover College was administered with 20 trials (one word per trial) per session, for a total of 40 trials per lighting condition (Hanover College, n.d.). The Stroop task was used to calculate attention to detail and cognitive interference by presenting color words in congruent colors (e.g., the word “blue” in blue text) and incongruent colors (e.g., the word “blue” in red text) and measuring participants’ reaction times and accuracy on congruent vs. incongruent trials. Reaction time scores were calculated by averaging the reaction times (in milliseconds) for each set and subtracting incongruent scores from congruent scores; higher scores indicate faster reaction times on incongruent items, even though mean scores tend to be negative due to incongruent trials having slower reaction times than congruent ones. Thus, a reaction time score of ­300 indicates a slower reaction time average on incongruent than congruent trials by 300 milliseconds. Accuracy was calculated by averaging participants’ accuracy (1 for correct, 0 for incorrect) and subtracting incongruent scores from congruent scores. The higher the accuracy score, the more accurate participants were on congruent vs. incongruent items. Test­retest reliability is sufficient for the Stroop task, though many different forms are used (Franzen, 1987). For the purposes of this experiment, an online form was used. Franzen (1987) recommended that participants have prior exposure to the task to ensure the learning curve asymptote is reached before the treatment is given, so a trial run of the Stroop task was administered to participants before the experimental conditions so that they knew how to complete it.

Creative Intelligence: Remote Associates Test (RAT)

The RAT was used to measure creative intelligence, following Xia et al. (2016). Items from this task were adapted from a collection of items from the Remote Associates Test of Creativity. Selected items were included in the Qualtrics survey and chosen to represent an equal distribution of

FALL 2024

difficulty from very easy to very hard. Two versions were created with the same distribution of difficulty, representing four “Very Easy,” four “Easy,” four “Medium,” four “Hard,” and four “Very Hard” items each. The versions were counterbalanced for the order completed in the two lighting conditions. According to Olteţeanu and Zunjani (2020), all internal consistency results for the visual RAT are above .75. Our results also showed strong internal consistency for Version 1 items (α = .84) and Version 2 items (α = .78).

Heart Rate

Heart rate monitors were placed on each participant’s desired forearm at the start of the experiment in the control condition. The Scosche Rhythm R+2.0: Advanced Waterproof & Dustproof Heart Rate Monitor Armband was used to monitor heart rates and the accompanying Rhythm SYNC mobile application was used by the researcher to record participants’ heart rates at the end of each set of tasks. Heart rates were recorded in beats per minute, and these data were reported and recorded in whole numbers and were not altered prior to analyses.

Demographic Survey

A demographic survey was included at the end of the Qualtrics survey. This was used to obtain information about age, sex, race, school year, school division, and whether participants were wearing blue­light glasses during the experiment.

Procedure

Upon agreeing to the terms of informed consent and passing the Ishihara Color Test, participants were asked to complete the PANAS and a trial run of the Stroop task in a room next to the experiment room. Here, participants were given forearm heart monitors and their base heart rates were recorded at the end of each set of tasks. Then, participants were led to a room with a desk and a laptop in one of the assigned color backgrounds and lighting temperature conditions. They were instructed to complete the Remote Associates Test and then proceeded to the Stroop task. They were asked to complete the PANAS at the end of the set of tasks, and there was a five­minute break between tasks that took place outside of the room where the researcher or research assistant switched the lighting mode of the lamp and computer. Heart rates were recorded at the end of each set. Upon completion of the same tasks in the second lighting condition, participants were asked to complete a demographics survey, and then were thanked for their participation and dismissed. The average time to complete the study was about 45 minutes, taking around 15 minutes per experimental condition, 10 minutes to complete the trial, and a 5­minute break to

counteract lighting effects. Each participant participated in the experiment once.

Results

Data was analyzed using the SPSS version 29. Data were not collected from six participants after they scored below the threshold of color blindness determined by the online Ishihara test. They were not included in the 78 ­ participant count for analyses. Only one outlier

Positive Affect as a Function of Lighting and Color Temperature

Note. Positive affect as a function of lighting and color temperature. The error bars represent +/- 1 Standard Error. There were no differences in positive affect based on color or lighting and there was no interaction between color and lighting.

Negative Affect as a Function of Color and Lighting Temperature

Note. Negative affect as a function of color and lighting temperature. The error bars represent +/- 1 Standard Error. There was an interaction between color and lighting: in the warm lighting condition, scores on negative affect in the warm color were higher than in the cool color; in the cool lighting condition, scores on negative affect in the warm color were lower than those in the cool color. There were no main effects of color or lighting on negative affect.

FIGURE 1
FIGURE 2

PSI CHI JOURNAL OF PSYCHOLOGICAL RESEARCH

was detected using the Outlier Labeling Rule (Hoaglin et al., 1986) in the Heart Rate scale in the warm lighting condition. This outlier was deleted listwise. In cases where participants had missing data on the primary scales, they were excluded from analyses using these scales, but retained in other analyses (n = 4). To test our hypotheses, we conducted mixed repeated measures ANOVAs, with the within­subjects factor of lighting (cool vs. warm) and the between ­ subjects factor of color condition (cool vs. warm) on each of the six main outcome variables: positive affect, negative affect, Stroop reaction time, Stroop accuracy, RAT, and heart rate.

PANAS

A mixed repeated measures ANOVA was used to determine whether positive affect (PA) scores from the PANAS in warm and cool lighting (within­subjects) were different in the warm and cool color conditions (between ­ subjects). The main effect of color on PA was not significant F(1, 76) = 3.79, p = .06, η2 p = .05, indicating scores in the warm color (n = 37, M = 19.70, SD = 6.26) did not differ from scores in the cool color (n = 41, M = 23.04, SD = 9.03). The main effect of lighting on PA scores was also not significant F(1, 76) = 1.88,

Differences in Congruent and Incongruent Stroop Reaction Time as a Function of Color and Lighting Temperature

p = .17, η2 p = .02, indicating scores in warm lighting (n = 78, M = 21.79, SD = 8.08) were not different than those in cool lighting (n = 78, M = 21.12, SD = 7.94 ). The interaction effect of color and lighting on PA was not significant, F(1, 76) = 0.89, p = .34, η2p = .01, indicating that positive mood scores in the warm color condition within warm lighting (n = 37, M = 20.30, SD = 6.07) and cool lighting (n = 37, M = 19.11, SD = 6.47) were not different from in the cool color condition within warm lighting (n = 41, M = 23.15, SD = 9.42) and cool lighting (n = 41, M = 22.93, SD = 8.75), see Figure 1.

The mixed repeated measures ANOVA for negative affect (NA) revealed no main effects for color, F(1,76) < .01, p = .96, η2p < .01, indcating the warm color (n = 37, M = 13.28, SD = 4.54) did not differ from the cool color (n = 41, M = 13.33, SD = 4.31). Likewise, there were no main effects for lighting, F(1, 76) = 3.37, p = .07, η2 p = .04, indicating scores in warm lighting (n = 78, M = 13.64, SD = 4.23) did not differ from those in cool lighting (n = 78, M = 12.97, SD = 4.58). However, the interaction effect between color and lighting on NA scores was significant F (1, 76) = 4.10, p = .046, η2p = .05, indicating that, in the warm lighting condition, scores on negative affect in the warm color ( n = 37, M = 14.03, SD = 4.65) were higher than in the cool color (n = 41, M = 13.29, SD = 3.83), but in the cool lighting condition, scores on NA in the warm color condition (n = 37, M =12.54, SD = 4.36) were lower than those in the cool color condition (n = 41, M = 13.37, SD = 4.79); see Figure 2.

Stroop

Note. Differences in congruent and incongruent Stroop reaction time as a function of color and lighting temperature. Reaction Time scores were calculated by subtracting incongruent reaction time averages from congruent ones. As reaction times are typically slower on incongruent trials, this results in a negative number. These scores show how much slower reaction times were on incongruent vs. congruent trials. The error bars represent +/- 1 Standard Error. There were no effects of color or lighting on reaction time and there was no interaction of color and lighting.

Reaction time scores were calculated by subtracting reaction time averages on incongruent trials from congruent ones; the more negative the number, the slower reaction times were on incongruent compared to congruent trials. The repeated measures mixed ANOVA for reaction time on the Stroop task revealed no significant main effects for color, F(1, 73) = 0.98, p = .32, η2p = .01, indicating that the warm color (n = 37, M = ­275.59, SD = 282.54) did not differ from the cool color (n = 41, M = ­341.69, SD = 330.40). Likewise, there were no main effects of lighting, F(1, 73) = .07, p = .79, η2p = .001, indicating that the difference in reaction times between incongruent and congruent trials did not differ in the warm lighting condition (n = 75, M = ­300.90, SD = 326.48) from the cool lighting condition (n = 75, M = ­ 309.98, SD = 286.59). Finally, there was no significant interaction between color and lighting, F(1, 73) = 3.57, p = .06, η2p = .05, indicating that differences in reaction times in the warm colorcondition within warm lighting (n = 37, M = ­234.55, SD = 240.06) and within cool lighting (n = 37, M = ­316.63, SD = 317.46), and in the cool color condition within warm lighting (n = 38,

FALL 2024
FIGURE 3

M = ­365.49, SD = 385.25) and cool lighting (n = 38, M = ­303.51, SD = 257.14) were not significant, see Figure 3.

For accuracy scores in the Stroop task, errors were coded as a 0 and correct responses were coded as a 1, and incongruent scores were subtracted from congruent scores. Thus, the higher the accuracy score, the more accurate participants were on congruent vs. incongruent items. The main effect of color on accuracy was significant, F(1, 73) = 6.49, p = .01, η2p = .08, indicating that those in the cool color condition (n = 38, M = 0.14, SD = 0.33) were significantly more accurate than those in the warm color condition (n = 37, M = 0.02, SD = 0.14). The main effect of lighting on accuracy scores was not significant, F(1, 73) = 3.13, p = .08, η2p = .04, indicating that the differences in accuracy scores within warm lighting (n = 75, M = 0.10, SD = 0.28) and cool lighting (n = 75, M = 0.06, SD = 0.22) was not significant. The interaction effect of color and lighting on accuracy scores was also significant, F(1,73) = 4.08, p = .047, η 2 p = .05, such that the cool color was less accurate in the cool lighting condition ( n = 37, M = 0.11, SD = 0.04) than in the warm lighting condition (n = 38, M = 0.19, SD = 0.37), but the warm color was the same in the cool lighting condition (n = 37, M = 0.02, SD = 0.04) and warm lighting condition (n = 37, M = 0.01, SD = 0.04); see Figure 4.

RAT

A mixed ANOVA was conducted to determine the effects of color and lighting temperatures on summed scores on the RAT. The main effect of the between­subjects factor of color on RAT scores was not significant, F(1, 75) = 0.02, p = .89, η2p = .00, indicating the warm color ( n = 36, M = 7.81, SD = 4.08) did not differ from the cool color (n = 41, M = 7.68, SD = 4.15). The main effect of the within ­ subjects factor of lighting approached significance, F(1, 75) = 3.95, p = .05, η2p = .05, indicating RAT scores in warm lighting (n = 77, M = 7.35, SD = 3.97) were marginally lower than those in cool lighting (n = 77, M = 8.13, SD = 4.24). The interaction effect of color and lighting on RAT scores was not significant, F(1,75) = 2.85, p = .10, η2p = .04, indicating that scores did not differ significantly in the warm color condition within warm (n = 36, M = 7.75, SD = 4.12) and cool (n = 36, M = 7.86, SD = 4.15) lighting, and in the cool color condition within warm (n = 41, M = 7.00, SD = 3.85) and cool (n = 41, M = 8.37, SD = 4.36) lighting. Figure 5 shows the color and lighting interaction means of RAT scores.

Heart Rate

A mixed ANOVA was used to determine if heart rate

scores in warm and cool lighting were different in warm and cool colors. The main effect of color on heart rates was non­significant, F(1, 75) = 0.25, p = .62, η2p = .00, indicating the warm color (n = 36, M = 73.41, SD = 11.11) did not differ from the cool color (n = 41, M = 74.73, SD = 12.00). The main effect of lighting on heart rates, F(1, 75) = 0.91, p = .34, η2p = .01, was also not significant, indicating heart rates in warm lighting ( n = 77, M = 73.78, SD = 11.63) did not differ significantly from those in cool lighting (n = 77, M = 74.49, SD = 11.64). The interaction between color and lighting was also not significant, F(1, 75) < 0.00, p = .98, η2p < .00, indicating that the differences in heart rates in the warm color condition within warm ( n = 36, M = 73.11, SD = 11.41) and cool (n = 36, M = 73.81, SD = 11.09) lighting, and in the cool color condition within warm (n = 41, M = 74.37 SD = 11.93) and cool (n = 41, M = 75.10, SD = 12.21) lighting were not significant. Figure 6 shows the color and lighting interaction means of heart rates.

Differences in Congruent and Incongruent Stroop Accuracy as a Function of Color and Lighting Temperature

Note. Differences in congruent and incongruent Stroop accuracy as a function of color and lighting temperature. Accuracy scores were calculated by coding errors as a 0 and correct responses as a 1 and subtracting incongruent scores from congruent scores. Thus, the higher the accuracy score, the more accurate participants were on congruent vs. incongruent items. The error bars represent +/- 1 Standard Error. There was an interaction between color and lighting. Those in the cool color condition were less accurate in the cool lighting condition than in the warm lighting condition, but those in the warm color condition were no different in accuracy based on the lighting condition. There was also a main effect of color, such that those in the cool color condition were more accurate than those in the warm color condition.

FIGURE 4

Discussion

The current study analyzed how the color and lighting temperatures of a space affect people’s levels of positive and negative affect and cognitive performance. Positive and negative affect were measured using the PANAS, and cognitive performance was measured by creative intelligence scores from the RAT and reaction times and accuracy scores from the Stroop task.

Main Effects

Our first three hypotheses were designed to replicate previous findings on the individual effects of color or lighting, or to examine topics that had provided mixed results in previous research. We hypothesized that positive affect would be higher in cool color and warm lighting conditions, but this was not fully supported. No main effects of color or lighting on positive affect were found, and interaction effects were only significant for negative affect. Contrary to Zhu et al. (2019), positive mood was not found to be higher in warm than cool lighting, however, in agreement with Knez and Kers (2000), negative mood in younger adults was sustained more in warm than cool lighting.

We hypothesized secondly that arousal measured as increased heart rates would be higher in warm colors as well as cool lighting. This was not supported, as no main effects of color and lighting on heart rates were significant. Chen et al. (2022) similarly found that

Creative Intelligence Scores as a Function of Color and Lighting Temperature

lighting temperatures did not change participants’ heart rates significantly, but in contrast, Cha et al. (2020) found significant changes in heart rates in blue, white, and green color schemes. It should be noted that these changes occurred between only cool and achromatic color schemes, and not between warm and cool color schemes. These previous findings and the current findings provide interesting discourse and grounds for further research on the physiological effects of environmental color and lighting.

We hypothesized thirdly that cognitive performance would be better in cool color and cool lighting conditions than in warm color and warm lighting conditions. This was partially supported. Accuracy scores were indeed higher in the blue color than the red color conditions, congruent with Costa et al. (2018).

Creative intelligence was better promoted in cool than in warm light, as demonstrated by scores on the RAT being marginally higher in cool lighting than warm lighting. This supports the lighting aspect of Hypothesis 3. As color did not significantly affect RAT scores, different color temperatures may not affect creative intelligence compared to other areas of cognitive performance.

Interaction Effects

Our final hypothesis was formulated based on our primary theory that color and lighting interact together

Heart Rate as a Function of Color and Lighting Temperature.

Note. Creative intelligence scores as a function of color and lighting temperature. The error bars represent +/- 1 Standard Error. There was no effect of color or lighting on creative intelligence scores and there was no interaction between color and lighting.

Note. Heart rate as a function of color and lighting temperature. The error bars represent +/- 1 Standard Error. There was no effect of color or lighting on heart rate and there was no interaction between color and lighting.

FALL 2024
FIGURE 5
FIGURE 6

to impact the experiences of people who inhabit a space. We hypothesized lastly that the combinations of color and lighting temperatures would have different impacts on mood and cognitive performance levels, which was supported by our results, as color and lighting interacted in different ways to affect these aspects of mood, cognitive performance, and arousal differently.

Negative mood was higher in the Warm Lighting x Red Color condition than in the Warm Lighting x Blue Color condition. In cool lighting, negative mood was higher in the Blue Color condition than in the Red. This suggests that in an environment that is cool in both background color and lighting, and in one that is warm in both background color and lighting, negative mood is higher. It may then follow that having a combination of warm and cool temperatures in background color and lighting is preferable for low levels of negative mood than spaces that are all warm or cool. The slightly neutralizing effect of warm lighting on cool color tones and of cool lighting on warmer color tones may lead to a more neutral mood than combinations that are very cool or very warm all over. This relationship should be further explored. No significant interaction effects on heart rates were found. That accuracy scores in the blue color condition were higher in the warm lighting than cool lighting was contrary to Hypothesis 3, but the interaction effect supported Hypothesis 4. This indicates that a cool background color in combination with cool lighting did not assist participants in accuracy, but the environment with blue color and warm lighting did. This finding suggests that a combination of warm and cool temperatures better promotes accuracy than environments that are either all cool in color and lighting or all warm. Consistent with our results, Zhu et al. (2019) found that participants were less accurate in cool lighting than in warm. Unlike their other results, we did not find that reaction times were slower in warm light, and that overall performance was better in cool light. Although the results of their study did not include the interaction of color, it can still speak to the effect that cool lighting may not, in some circumstances, serve to improve one’s accuracy on a cognitive task. Our results further point to the taskdependent effects of color and lighting temperatures on various aspects of cognitive performance, as Elliot (2019), Stone (2001), and Xia et al. (2016) suggested. Our interaction effect regarding accuracy is unique to the body of research that aims to understand color and lighting temperature effects on cognitive performance. That accuracy was essentially the same in the red color condition between warm and cool lighting sparks debate about why these different interactions occurred. These results––from two measures of cognitive performance from the Stroop task alone––indicate how nuanced

the effects of color and lighting temperatures are. Interactions between color and lighting temperatures did not significantly affect score differences on the creative intelligence task, suggesting that there is indeed more nuance to the ways that warm and cool colors and lighting temperatures affect creative intelligence. Such findings regarding these different elements of cognitive performance are a basis for more in­depth research on the complex relationship between specific cognitive tasks and how background color and lighting temperatures influence them, both alone and in combination. Whether warm colors and cool lighting provide the same distracting stimulation effect on mood as on cognitive functioning may prove fruitful for further research. That cool colors promoted positive emotions more so than warm colors is in accordance with Elliot (2019), Roy et al. (2021), Stone (2001), and Wilms & Oberfeld (2017). Neither lighting nor color temperature incited significant differences in heart rates, indicating that these factors may not influence physiological as much as psychological responses.

Implications

Results of this study can give a basic understanding of how two foundational elements of design–color and lighting–affect humans in psychological manners like mood and cognitive task performance. These results can be incorporated into educational settings especially, where certain aspects of cognitive performance should be supported. For example, if accuracy is important on a given task, it might be best to take tests or practice in a space with predominantly cool surrounding colors and under warm lighting. If creative intelligence and problem­solving are of the highest importance of the task at hand, cool lighting may be better for promoting such performance. Such findings can be implemented by teachers deciding the ideal setting in which to promote performance in students depending on the nature of the subject, and by students when practicing and promoting certain aspects of their own cognitive abilities. While especially important in a home environment, a reduced negative mood may serve as an asset in a school or office space as well. In classrooms, while cool lighting is commonly used to keep students awake and focused, warmer lighting and cool­colored backgrounds––or even cooler lighting in a warmer­colored environment––may be more beneficial in promoting less negative mood in students. This may then motivate students to further engage in the learning process. For an individual completing any work in an office or home office where creative intelligence would be best promoted, opting for more cool lighting may prove beneficial.

These results can inform the design of residences, schools, study and work areas, offices, libraries, counseling

offices, and many other settings. The results of this study can be applied especially to spaces where mood and task performance are major factors. Humans spend their time in a variety of different settings where different levels of performance and comfort may be desired, and designing with intent can increase the effectiveness of these spaces. These findings can be applied to individual, educational, residential, occupational, and institutional settings.

Limitations

This study was conducted at Pepperdine University, a private, Christian, liberal arts college in California, which limits the generalizability of the results. In the setting where the study was conducted, the conditions were composed of a sheet of colored bulletin paper covering one wall of the room facing participants, and two desk lamps. While it is a strength of the study that the colors and lighting elements were represented in a real­life setting as opposed to via photos or videos, the color conditions were only present on the wall participants faced while completing tasks. Similarly, the lighting sources, while the main sources of light in the room, were different than having overhead lights in these temperatures that may be more representative of many other rooms where studying takes place. As participants spent a quite long amount of time in each condition (around 15 minutes in each lighting condition and around 30 minutes in front of either color condition), we believe that the color and lighting setup taking up most of the participants’ fields of vision was sufficient for analyzing the effects of the conditions. The time of day of participation in the experiment was not controlled. This could have led to variations in fatigue or stress levels in different participants that resulted from completing the experiment at different times of day. However, in theory, random assignment should have balanced any such effects between conditions The somewhat limited setup of the study may have contributed to the hypothesized effects on some mood, cognitive performance, and physiological measures not being found that are generally found in other studies.

Suggestions for Future Research

Future research on this topic can be conducted in a greater variety of settings, using a wider variety of color and lighting temperatures in between fully saturated red and blue colors and very cool and very warm lighting sources. Future research can also study participants in these settings for long periods to see what the longitudinal effects, rather than state effects, of certain elements of design are. Future studies on the topic of environmental psychology should explore the complexities that underlie the task­dependent effects

of color, lighting, and other primary design elements such as room layout and size. Future research should also study how color and lighting temperatures interact in different settings where the intended effects may be healing, rehabilitation, physical and cognitive stimulation, and other goals of interior spaces.

References

AL-Ayash, A., Kane, R. T., Smith, D., & Green-Armytage, P. (2015). The influence of color on student emotion, heart rate, and performance in learning environments. Color Research & Application, 41(2), 196–205. https://doi.org/10.1002/col.21949

Costa, M., Frumento, S., Nese, M., & Predieri, I. (2018). Interior color and psychological functioning in a university residence hall. Frontiers in Psychology, 9(1580). https://doi.org/10.3389/fpsyg.2018.01580

Cha, S. H., Zhang, S., & Kim, T. W. (2020). Effects of interior color schemes on emotion, task performance, and heart rate in immersive virtual environments. Journal of Interior Design, 45(4), 51–65. https://doi.org/10.1111/joid.12179

Chen, R., Tsai, M.-C., & Tsay, Y.-S. (2022). Effect of color temperature and illuminance on psychology, physiology, and productivity: An experimental study. Energies, 15(12), 4477. https://doi.org/10.3390/en15124477

Crawford, J. R., & Henry, J. D. (2004). The positive and negative affect schedule (PANAS): Construct validity, measurement properties and normative data in a large non-clinical sample. The British Journal of Clinical Psychology, 43(3), 245–265. https://doi.org/10.1348/0144665031752934

Elliot, A. J. (2019). A historically based review of empirical work on color and psychological functioning: Content, methods, and recommendations for future research. Review of General Psychology, 23(2), 177–200. https://doi.org/10.1037/gpr0000170

Franzen, M. (1987). An investigation of the test-retest reliability of the Stroop colorword test across two intervals. Archives of Clinical Neuropsychology, 2(3), 265–272. https://doi.org/10.1016/0887-6177(87)90014-x

Hoaglin, D. C., Iglewicz, B., & Tukey, J. W. (1986). Performance of some resistant rules for outlier labeling. Journal of the American Statistical Association, 81(396), 991–999. https://doi.org/10.2307/2289073

Kaya, N., & Epps, H. H. (2004). Relationship between color and emotion: A study of college students. College Student Journal, 38(3), 396–405. https://link.gale.com/apps/doc/A123321897/AONE?u=googlescholar&sid= bookmark-AONE&xid=96b09980

Knez, I., & Kers, C. (2000). Effects of indoor lighting, gender, and age on mood and cognitive performance. Environment and Behavior, 32(6), 817–831. https://doi.org/10.1177/0013916500326005

Kwallek, N., Lewis, C. M., & Robbins, A. S. (1988). Effects of office interior color on workers’ mood and productivity. Perceptual and Motor Skills, 66(1), 123–128. https://doi.org/10.2466/pms.1988.66.1.123

Odabaşioğlu, S., & Olguntürk, N. (2015). Effects of coloured lighting on the perception of interior spaces. Perceptual and Motor Skills, 120(1), 183–201. https://doi.org/10.2466/24.PMS.120v10x4

Olteţeanu, A.-M., & Zunjani, F. H. (2020). A Visual Remote Associates test and its validation. Frontiers in Psychology, 11, 26. https://doi.org/10.3389/fpsyg.2020.00026

Poldma, T. (2009). Learning the dynamic processes of color and light in interior design. Journal of Interior Design, 34(2), 19–33. https://doi.org/10.1111/j.1939-1668.2008.01017.x

Roy, S., Banerjee, A., Roy, C., Nag, S., Sanyal, S., Sengupta, R., & Ghosh, D. (2021). Brain response to color stimuli: An EEG study with nonlinear approach. Cognitive Neurodynamics, 15(6), 1023–1053. https://doi.org/10.1007/s11571-021-09692-z

Stone, N. J. (2001). Designing effective study environments. Journal of Environmental Psychology, 21(2), 179–190. https://doi.org/10.1006/jevp.2000.0193

Stroop Experiment. (n.d.). Psych.hanover.edu https://psych.hanover.edu/javatest/cle/Cognition_js/exp/stroop.html

Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063. https://doi.org/10.1037/0022-3514.54.6.1063

Wilms, L., & Oberfeld, D. (2017). Color and emotion: Effects of hue, saturation,

FALL 2024

Afifi, Krumrei-Mancuso, and Trammell | Color and Lighting Effects on Mood, Cognition

and brightness. Psychological Research, 82(5), 896–914. https://doi.org/10.1007/s00426-017-0880-8

Xia, T., Song, L., Wang, T. T., Tan, L., & Mo, L. (2016). Exploring the effect of red and blue on cognitive task performances. Frontiers in Psychology, 7. https://doi.org/10.3389/fpsyg.2016.00784

Yildirim, K., Hidayetoglu, M. L., & Capanoglu, A. (2011). Effects of interior colors on mood and preference: Comparisons of two living rooms. Perceptual and Motor Skills, 112(2), 509–524. https://doi.org/10.2466/24.27.PMS.112.2.509-524

Zhu, Y., Yang, M., Yao, Y., Xiong, X., Li, X., Zhou, G., & Ma, N. (2019). Effects of illuminance and correlated color temperature on daytime cognitive performance, subjective mood, and alertness in healthy adults. Environment and Behavior, 51(2), 199–230. https://doi.org/10.1177/0013916517738077

Megan B. Afifi https://orcid.org/0000­0001­9198­9501

Elizabeth J. Krumrei­Mancuso https://orcid.org/0000­0001­6151­7845

Janet Trammell https://orcid.org/0000­0002­0304­6974

This study was preregistered at https://osf.io/wb9dk. Data collection and analyses were sponsored by the Psychology Honors Program at Pepperdine University. We have no conflicts of interest to disclose.

Correspondence concerning this article should be addressed to Megan B. Afifi, Pepperdine University, 24255 Pacific Coast Hwy, Malibu, CA 90263. Email: meganafifi@gmail.com

Mental Health and Religiosity Among Sexual Minority Students at a Christian University

ABSTRACT. University students are reporting increasing levels of psychological distress and suicidality. Consistent with the minority stress model, sexual minorities (SMs) are especially vulnerable; this is often heightened at religious universities that are nonaffirming of SM identities. We studied mental health and religiosity among 211 undergraduates at a religiously diverse, LGBTQ+ permitting, yet nonaffirming, university. SMs (n = 58) reported higher rates of suicidality (Z = ­4.50, p < .001, ρ = .31) and psychological distress (t = 4.27, df = 209, p < .001, d = 0.66) than non­SMs. The correlation between intrinsic religiosity suicidality (ρ = ­.16, p = .02) was not moderated by SM identity. Similarly, the correlation between intrinsic religiosity and psychological distress (ρ = ­.18, p = .01) was not moderated by SM identity. Religious attendance correlated with higher rates of internalized homonegativity (ρ = .31, p = .02) and lower rates of identity superiority (ρ = ­.36, p = .005) for SMs. These findings highlight the complicated relationship between SM identity and religiosity. This study underscores the importance of offering affirming religious spaces for SM individuals and providing increased psychological support for SM students at religious universities.

Keywords: sexual minorities, religiosity, mental health, religious university, university students

In recent years, universities in the United States have witnessed increasing demand for mental health services and increasing rates of mental illness among university students. A review of two large, national studies performed across a 10­year period found that depression, anxiety, nonsuicidal self­injury, suicidal ideation, and suicide attempts increased markedly in university students between 2007 and 2018 (Duffy et al., 2019). Many of these increases were extreme. For example, in a national study of over 170,000 college students, severe depression, nonsuicidal self­injury, suicide plans, and suicide attempts increased by over 100% in a decade.

These findings are especially concerning for communities that are at a higher risk of mental health

Diversity badge earned for conducting research focusing on aspects of diversity. Preregistration+ badge earned for transparent research practices. The preregistration can be viewed at https://osf.io/yku45/

struggles. The minority stress model theorizes that sexual minority (SM; this includes anyone identifying as gay, lesbian, bisexual, questioning, asexual, etc.) individuals are at a higher risk for psychological distress due to (a) external stressful experiences such as discrimination or violence, (b) expectations of these experiences, (c) concealment of sexual orientation, and (d) the internalization of negative societal expectations and attitudes (Meyer, 2013). Recent research has shown support for the minority stress model among SM students in university settings (Lipson et al., 2019; Riley et al., 2016; Wilson & Liss, 2022). This is especially true at religious universities (Klundt et al., 2021), where the occurrence of discrimination may be higher for SM students. Discrimination, bullying,

and microaggressions (i.e., subtle and indirect discrimination) can be detrimental to the mental health of SM students (Busby et al., 2020; Wolff et al., 2016).

Considering the large number of religiously affiliated universities in the United States, 883 as of 2015, these mental health risks are concerning (National Center for Educational Statistics, 2017). Among these religiously affiliated universities, many have policies against SM people, such as banning same­gender relationships, statements opposing same­gender marriages, and even outright banning of LGBTQ+ identifying students, faculty, and staff. These policies may heavily impact the experiences, and in turn, the mental health of their SM students (Woodford et al., 2018).

SMs and Mental Health

A large body of literature supports the minority stress model’s prediction that SMs are at a higher risk of psychological distress than heterosexual individuals. A systematic review of 199 studies published between 2005 and 2014 revealed that the majority of these studies found higher rates of depression, attempted suicide, anxiety, alcohol and drug use, and other disorders in adult and adolescent SMs compared to non ­ SMs (Plöderl & Tremblay, 2015). Additionally, a recent longitudinal study comparing rates of depression, anxiety disorders, suicidal ideation, substance abuse, and total mental health disorders found that sexual minorities reported significantly higher rates in all these categories compared to their heterosexual counterparts throughout the examined age range, 18 to 35 years of age (Spittlehouse et al., 2020). Both of these studies offer substantial support to the theory that SMs are at a higher risk of mental illness than heterosexuals.

These findings hold true among SM university students, who are at an even higher risk of mental illness than their heterosexual counterparts (Lipson et al., 2019; Wilson & Liss, 2022). A comparative study of 1,777 incoming first­year students found that SM students reported significantly higher levels of depression, anxiety, and distress in comparison with heterosexual students both prior to and at the end of their first semester of college (Riley et al., 2016). Additionally, they experienced a greater increase in these symptoms over a three­month period and greater experiences of stress than heterosexual students. This is likely because they are exposed to the same stressors as heterosexual students in addition to SM­specific challenges as they adjust to the college environment (Evans et al., 2017). Such research supports the minority stress model within a university setting by showing that SM university students are at risk of discrimination, stigma, and isolation, which in turn increases their risk of psychological distress.

Considering rates of mental illness have significantly increased among university students in general in recent years (Duffy et al., 2019), SM university students are especially vulnerable to negative mental health.

SMs, Mental Health, and Religiosity

Although religiosity is a protective factor for psychological distress in heterosexual individuals (Hackney & Sanders, 2003), the relationship between SMs’ mental health and religiosity is complex because religiosity acts as both a risk factor and a protective factor for SMs. Among SM individuals, religiosity is correlated with risk factors such as higher rates of alcohol abuse, anxiety, and internalized homophobia (Barnes & Meyer, 2012; Corbin et al., 2020; Wilkinson & Johnson, 2021). This may be because many religions, specifically religions that are nonaffirming of SMs, teach that same­gender attraction and behaviors are sinful. However, religiosity also has positive impacts for SMs, such as offering belonging, providing social support, reducing health risks, and protection from psychological distress (Dyer, 2022; Lefevor et al., 2018; Wilkinson & Johnson, 2021).

Additionally, the literature provides support for religion acting as both a risk factor and a protective factor for suicidality. Although some studies have found that religiosity decreases the risk of suicidal ideation in SMs (Oh et al., 2022), others have found that religiosity increases the risk (Dyer, 2022; Lytle et al., 2018). A recent study attempted to explain this phenomenon by measuring religious attendance and religious beliefs separately (Park & Hsieh, 2023). They found that religious beliefs were associated with lower suicidality for lesbian, gay, and bisexual individuals. Conversely, religious attendance was associated with higher suicidality among lesbian, gay, and bisexual individuals. This suggests that SMs might be exposed to negative experiences at church, such as stigmatizing messages or microaggressions, that increase their risk of suicidality (Lomash et al., 2018).

SMs at Religious Universities

Understanding the complex relationship between religiosity and mental health for SM students is particularly relevant for SM students attending religious universities. Religious universities can offer unique challenges to SM students. Students at some of these universities experience institutionalized homophobia and marginalization (Woodford et al., 2018). Additionally, they experience personal victimizations and microaggressions, which may be more detrimental to mental health than blatant victimization (Woodford et al., 2014). They may also struggle with reconciling their faith and sexuality, internalized homophobia, and psychological distress (Heiden­Rootes et al., 2018; Klundt et al., 2021). Christy, Rouse, and Krumrei-Mancuso

A large study at Brigham Young University (BYU), a university affiliated with the Church of Jesus Christ of Latter­day Saints, found that SM students reported lower quality of life and higher psychological distress than heterosexual students (Klundt et al., 2021). Additionally, they found that religiosity functioned as a positive influence for measured outcomes, such as decreasing rates of suicidality, for both heterosexual students and SM students. However, religion was a stronger positive influence for heterosexual students than SM students. Finally, they found that higher rates of religiosity were associated with higher rates of internalized homonegativity and lower rates of acceptance concerns. This study highlighted the complicated relationship between religiosity and mental health for SMs.

The reviewed research has consistently displayed increased mental health risks for SM students, which suggests the need for a support system for SM students at both religious and nonreligious universities. Some students have found this support through gendersexuality alliances (GSAs) if their university permits such an organization. Limited research shows that these organizations have been linked with positive outcomes for SM students. For example, a study of SM students at nonaffirming religiously affiliated universities found that being involved with a GSA was correlated with SM students having a more positive perception of their sexuality, less religious incongruence, and fewer struggles with their sexuality than SM students who were not associated with their GSA (Wolff et al., 2016).

Limitations in Literature

There are a few limitations of the existing literature. Due to the exploratory nature of these studies, some of the samples lacked racial diversity (Heiden­Rootes et al., 2018; Klundt et al., 2021; Wolff et al., 2016) or religious diversity (Klundt et al., 2021). There have been somewhat conflicting findings regarding religiosity, which may result from varying measures of religiosity from study to study. For example, religiosity is often measured by affiliation only or by a single item on the importance of religion, rather than a validated scale. These measurements fail to capture the multiple dimensions of religiosity and are overall poor measures of religiousness (Lefevor et al., 2022). Additionally, there is limited research on SM students at religious universities. Within that literature, there are few comparative studies between SM and heterosexual students. To our knowledge, comparative studies have only been conducted at universities where most of the population belongs to a single Christian denomination, which are not representative of religious universities as a whole.

Present Study

Considering the literature showing an increase in mental illness among university students, the heightened risk of mental health struggles for SM students at religiously affiliated universities, and the complicated relationship between religiosity and mental health for SM students, we investigated the relationship between religiosity and mental health in students at a religiously diverse, SM welcoming, but nonaffirming, religiously affiliated university. The present study relied on a widely used measure of religiosity and included a measure of SM­specific concerns. It is a modified replication of Klundt et al. (2021) who conducted a comparative study between SM students and heterosexual students. Despite their study’s strengths, Klundt et al. assessed students at BYU, which is religiously homogeneous (98% of BYU students are members of the Church of Jesus Christ of Latter­day Saints), practices a religion that is dissimilar to many other Christian denominations, and has specific doctrines against same­sex romantic behavior (Klundt et al., 2021).

To expand upon the work of Klundt et al. (2021), the purpose of the current study was to examine the relationship between psychological distress and religiosity of SM compared to heterosexual students at a religious university that is more representative of religious universities in the United States than BYU. First, the university from which we collected data has more religious diversity than BYU. Although our sample was 71% Christian, they identified with a variety of denominations. This means that the participants come from a variety of religious backgrounds and have likely been exposed to different religious doctrines regarding the LGBTQ+ community. Additionally, the university at which the present study took place does not have specific policies against homosexuality, therefore students are able to openly identify as LGBTQ+. This is in line with most Christian universities in the United States, with only 31% officially banning “homosexual acts or behavior” and 55% adopting nondiscrimination policies protecting lesbian, gay, and bisexual students (Coley, 2016; Coley, 2018). The university also has an official GSA that was approved in 2016. In 2014, 45% of Christian colleges in the United States had a GSA and this number has likely grown in recent years (Coley, 2016). However, the university retains a nonaffirming stance and explicitly denounces sexual behavior outside of a marriage between a man and a woman. Due to these characteristics, this study broadens the scope of Klundt et al.’s (2021) findings by more accurately representing the culture of religious universities in the United States.

Our hypotheses were as follows:

1. Based on the minority stress model (Meyers, 2013), SM students would report higher levels of

FALL 2024

psychological distress and suicidality than heterosexual students.

2. Similar to the findings of Wolff et al. (2016), students who experience same­gender attraction and are involved in their university’s GSA would report having less difficulty accepting their sexuality and would report lower levels of incongruence between their religious beliefs and their sexuality than students who experience same­gender attraction and are not involved in their university’s GSA (Wolff et al., 2016).

3. Based on previous research (Klundt et al., 2021), intrinsic religiosity, or strength of personal religious beliefs, would be predictive of lower levels of psychological distress and suicidality for both SM and heterosexual students, but the relationship would be weaker for SM students than heterosexual students.

4. Based on the findings of Klundt et al. (2021) intrinsic religiosity would be predictive of higher levels of identity concerns specific to LGBTQ+ students, such as internalized homonegativity, for students who experience same­gender attraction.

Although Hypotheses 3 and 4 may seem to conflict with each other, multiple studies have documented higher rates of identity concerns specific to LGBTQ+ students without higher rates of psychological distress. Previous authors have proposed that this is because the protective characteristics of religion counteract the harmful impacts of homonegativity (Barnes & Meyer, 2012; Klundt et al., 2021).

Method

Procedure

Preregistrations of minimum sample sizes and primary analyses are available on the Open Science Framework (https://osf.io/yku45/). We obtained approval from the Pepperdine University Institutional Review Board and followed all APA ethical standards. Participants completed electronic consent forms prior to participating in our study. Participants were recruited through introduction to psychology classes ( n = 163). These participants received assignment credit in their class for participating. We recruited additional SM participants by sending a recruitment email to the university’s GSA email list and posting on the university’s GSA social media (n = 39). These students were compensated by being entered into a gift card raffle. Some participants chose not to receive class credit or be entered into the raffle (n = 9). Data were collected through an electronic, selfreport survey. The survey consisted of a demographic questionnaire and several psychological tests. Data collection occurred over a five ­ week period. Any participants

who failed our validity item or had incomplete data (n = 13) were excluded from our analyses. An additional 12 participants were excluded from our analyses because they identified as heterosexual and reported same sex attraction. Although there is documentation of highly religious same sex attracted individuals who do not identify as LGBTQ+, this population is highly unique and may confound the results (Lefevor et al., 2020; Rosik et al., 2021). Participants who failed to complete all items within a single survey were excluded from analyses using that survey.

Participants

The sample consisted of 211 college students from a small liberal arts college on the West Coast. An a priori power analysis indicated that 156 total participants were needed to have 80% power to detect a medium­sized effect (d = 0.50) with a .05 criterion of significance. An additional a priori power analysis indicated that 60 SM participants were needed to have 80% power to detect a medium­sized effect (d = 0.65) with a .05 criterion of significance. The sample included 58 participants who identified with one or more SM identities. The survey was open to all undergraduate students over the age of 18. Participants’ ages ranged from 18 to 24 ( M = 19.00, SD = 1.14). Twenty­eight percent of participants identified with at least one SM identity (n = 58) and 73% did not identify with an SM identity (n = 153). However, TABLE 1 Gender and Sexuality Demographics

Note. The total does not sum to 100% because participants were allowed to select more than

only 23.7% of the sample reported being attracted to the same gender (n = 50). These numbers were different because not all SM identifying people are attracted to their same gender (e.g., asexual and aromantic individuals may not experience any attraction or they may identify as heterosexual). Additional information on participants’ sexualities and gender identities can be found in Table 1. Participants who reported an SM identity without reporting same­gender attraction were excluded from analyses using the Lesbian, Gay, and Bisexual Identity Scale. Sixty percent of SM participants were either active or somewhat active in the GSA (n = 35) and 40% of SM participants were not active in the GSA (n = 23). The sample consisted of 64.0% White (n = 135), 24.2% Asian American (n = 51), 18.5% Hispanic or Latinx (n = 39), 5.7% Black or African American ( n = 12), 3.8% Native Hawaiian or Pacific Islander (n = 8), 2.8% Middle Eastern (n = 6), 2.4% American Indian or Alaskan Native ( n = 5), and 1% did not respond (n = 2). Seventy­one percent of participants identified as Christian, with a large variety in denominational affiliation. Additional religious demographics can be found in Table 2.

2 Religious Demographics

Measures

Counseling Center Assessment of Psychological Symptoms-34

The Counseling Center Assessment of Psychological symptoms ­ 34 (CCAPS ­ 34) is a 34 ­ item survey that assesses mental health (Center for Collegiate Mental Health, 2019; Youn et al., 2015). It has seven subscales, (a) Depression, (b) Generalized Anxiety, (c) Social Anxiety, (d) Academic Distress, (e) Eating Concerns, (f) Hostility, and (g) Alcohol Use, and an overall psychological distress index. Previous research suggests the CCAPS­34 has moderately high internal consistency (Cronbach’s alpha coefficients ranging from .76–.89 per subscale), high test­retest reliability (r = .79–.87 for 1­week test­retest and r = .74–.86 for 2­week test­retest), and high validity when compared to previously validated measures of psychological distress (Correlations ranged from r = .52 to r = .78; Locke et al., 2012). The current study’s Cronbach’s alpha coefficients ranged from .69 to .90.

Duke University Religiosity Index

The Duke University Religiosity Index (DUREL) is a 5­item survey that assesses religious attendance, private religious activity, and intrinsic religiosity (Koenig & Büssing, 2010). The first two dimensions, religious attendance and private religious activity, are single items scored on a 6­point scale ranging from “More than once a week” to “Never” (e.g., “How often do you attend church or other religious meetings?”). The third dimension, intrinsic religiosity, is made up of three items scored on a 5­point scale ranging from “Definitely true of me” to “Definitely not true” (e.g., “My religious beliefs are what really lie behind my whole approach to life”). Previous research suggests that the third dimension has high internal consistency (Cronbach’s alpha between .78 and .91; Storch, Roberti, et al., 2004), high two­week test­retest reliability (intra­class correlation coefficient of .91; Storch, Strawser, et al., 2004), and has been validated against other established measures of religiosity (r’s = .71–.85; Storch, Roberti, et al., 2004). The current sample’s internal consistency was .91. According to the recommendation of the authors, we examined each subscale separately rather than combining them into a single scale.

Lesbian, Gay, and Bisexual Identity Scale

The Lesbian, Gay, and Bisexual Identity Scale (LGBIS) is a 27­item survey designed to measure identity­related constructs among lesbian, gay, and bisexual people (Mohr & Kendra, 2011). Participants score each item on a 6­point scale ranging from “disagree strongly” to “agree strongly.” We chose to adjust the wording of some items in order to increase the inclusivity of the scale. The changes include changing: “same­sex” to “same­gender,” “romantic relationships” to “romantic relationships TABLE

FALL 2024

and/or attractions,” and “LGB” to “LGBTQ+.” There are eight subscales: (a) Acceptance Concerns (e.g., “I often wonder whether others judge me for my sexual orientation”), (b) Concealment Motivation (e.g., “I prefer to keep my same­gender romantic relationships and/ or attractions rather private”), (c) Identity Uncertainty (e.g., “I’m not totally sure what my sexual orientation is”), (d) Internalized Homonegativity (e.g., “If it were possible, I would choose to be straight”), (e) Difficult Process (e.g., “Admitting to myself that I’m an LGBTQ+ person has been a very painful process”), (f) Identity Superiority (e.g., “I look down on heterosexuals”), (g) Identity Affirmation (e.g., “I am glad to be an LGBTQ+ person”), and (h) Identity Centrality (e.g., “My sexual orientation is a central part of my identity”). Previous research suggests that the LGBIS has moderate to high internal consistency (Cronbach’s alpha estimates between .72 to .94) and test­retest reliability in a 6­week period (correlation coefficients for subscales ranged from .70 to .92; Mohr & Kendra, 2011). The current sample’s Cronbach’s alphas ranged from .79 to .91. The LGBIS was only administered to students who reported being attracted to people of the same gender.

Religious Incongruence Scale

This scale was designed to measure religious incongruence within lesbian, gay, and bisexual individuals (Wolff et al., 2016). It was developed to be administered alongside the LGBIS. It consists of two items (“I’ll never be fully accepted by God if I’m in a same­gender relationship,” and “I can’t be true to my faith and be in a same­gender relationship at the same time”). The Religious Incongruence scale had moderate inter­item correlation (r = .57) and acceptable internal consistency (Cronbach’s alpha = .72; Wolff et al., 2016). The current sample’s Cronbach’s alpha was .65.

Suicidal Behavior Questionnaire-Revised

The Suicidal Behavior Questionaire­Revised (SBQ­R) is a 4­item survey that measures the lifetime prevalence of suicidal attitudes, ideation, and previous as well as the possibility of future suicide attempts (Osman et al., 2001). Each item is scored on a 5, 6, or 7­point scale with overall scores ranging from 0–18. In nonclinical high school and college samples, the authors proposed a score of 7 or higher as a cutoff point (Osman et al., 2001). Previous studies reported high internal consistency (Cronbach’s alpha = .97, Osman et al., 2001). The current study’s Cronbach’s alpha was .85.

Results

Analytic Procedures

We used the outlier labeling rule to identify outliers (Hoaglin, 1986). The only scale with outliers was the

substance and alcohol abuse scale. This scale was abnormally distributed and had 23 outliers. We ran the analyses with and without outliers. The statistical significance of the following results did not differ with or without outliers. Our results were significant both with and without outliers, so we present the results with the full sample included.

Descriptive statistics for each of the scales can be found in Table 3. Due to the abnormal distribution of some of our scales, we deviated from our OSF preregistration data analysis plan by using nonparametric alternatives.

Hypothesis 1

A between ­ subjects t test found that psychological distress scores of SM students (M = 1.65, SD = 0.63) were significantly higher than heterosexual students ( M = 1.20, SD = 0.69; t = 4.27, df = 209, p < .001, d = ­0.66). Additionally, a Mann­Whitney­Wilcoxon U test found that suicidality scores of SM students

TABLE 3

Descriptive

Statistics of Study Variables

Note. Possible scores for psychological distress, depression, generalized anxiety, social anxiety, academic distress, eating concerns, hostility, and alcohol and drug abuse range from 0–4. Possible scores for suicidality range from 0–18. Possible scores for intrinsic religiosity range from 3–18. Possible scores for religious attendance and private religious practice range from 1–6. Possible scores for acceptance concerns, concealment motivation, identity uncertainty, internalized homonegativity, difficult process, identity superiority, identity affirmation, identity centrality, and religious incongruence range from 1–6.

( M Rank = 134.04) were significantly higher than heterosexual students ( M Rank = 92.92; Z = ­ 4.50, p < .001, ρ = .31). These results support our hypothesis that SM students would report higher levels of psychological distress and suicidality than heterosexual students. As exploratory analyses, we ran a MANOVA and Mann­Whitney­Wilcoxon U tests to determine whether scores on each of the psychological symptom (CCAP­34) subscales differed between SM students and heterosexual students. The main effect of the MANOVA was statistically significant (F(4,206) = 4.97, p < .001). The between­subjects effect was significant on depression (F(1,209) = 10.68, p < .001), (F(1,209) = 18.17, p < .001), and social anxiety (F(1,209) = 6.33, p =.01). There was not a significant effect for academic distress (F(1,209) = 1.45, p = .23).

Mann­Whitney­Wilcoxon U tests found that the score rank difference between SM and heterosexual students on hostility (31.95, Z = ­3.44, p < .001, ρ = .24) and substance and alcohol abuse (17.39, Z = ­2.04, p = .04, ρ = .14) were significant, but differences on eating concerns (14.21, Z = ­1.53, p = .13, ρ = .11) were not significant.

Hypothesis 2

Contrary to our second hypothesis, a Mann­WhitneyWilcoxon U test found that students who experience same­gender attraction and are involved in the GSA (M Rank = 23.72) and students who experience samegender attraction and are not involved in the GSA (M Rank = 28.67) did not significantly differ on difficulty accepting their sexuality (Z = ­1.16, p = .25, ρ = .17). An additional Mann­Whitney­Wilcoxon U test found that students who experience same­gender attraction and are involved in the GSA (M Rank = 25.88) and students who experience same­gender attraction and are not involved in the GSA (M Rank = 24.83) did not significantly differ on incongruence between their religious beliefs and their sexuality (Z = ­0.26, p = .80, ρ = ­.04). These results do not support our hypothesis that students who experience same­gender attraction and are involved in the GSA would report having less difficulty accepting their sexuality and would report lower levels of incongruence between their religious beliefs and their sexuality than students who experience same­gender attraction and are not involved in the GSA.

Hypothesis 3

To test our third hypothesis, we used two hierarchical regression analyses to examine whether intrinsic religiosity was predictive of lower levels of psychological distress and suicidality, respectively, and whether each of these relationships was moderated by SM status. In step one of the psychological distress model, we entered intrinsic

religiosity and SM status. Intrinsic religiosity (β = ­.06, p = .42) did not significantly predict psychological distress, but SM status (β = .27, p < .001) did significantly aid in the prediction of psychological distress. The overall model was significant (F[2,208] = 9.42, p < .001, R² = .08). When the interaction term was included in the second step, the overall model remained statistically significant (F[3,207] = 6.57, p < .001, R² = .09). However, the .01 change in R² values was not significant (F[1,207] = 0.89, p = .35) and the interaction term was not significant (β = ­.07, p = .35). This lack of interaction between intrinsic religiosity and SM status suggests that SM status does not moderate a relationship between intrinsic religiosity and psychological distress.

In step one of the suicidality model, we entered intrinsic religiosity and SM status. SM status (β = .32, p < .001) significantly aided in prediction, but intrinsic religiosity did not (β = ­.13, p = .13). The overall model was significant (F[2,203] = 15.61, p < .001, R² = .13). When the interaction term was included in the second step, the overall model remained statistically significant ( F [3,202] = 10.37, p < .001, R ² = .13). However, the < .001 change in R² values was not significant (F[1,202] = 0.04, p = .83) and the interaction term was not significant (β = ­ .01, p = .83). This lack of interaction between intrinsic religiosity and SM status suggests that SM status does not moderate the relationship between intrinsic religiosity and suicidality. These two moderation analyses do not support our hypothesis that the relationship between intrinsic religiosity and wellbeing would be weaker for SM students than heterosexual students.

Hypothesis 4

For our final hypothesis, rho coefficients were used to analyze the relationship between intrinsic religiosity and LGBTQ+ identity­specific concerns among only those participants who reported same­gender attraction. Intrinsic religiosity was not significantly related to any of the LGBIS scales. This does not support our hypothesis that intrinsic religiosity would be correlated with higher levels of LGBTQ+ identity­specific concerns, such as internalized homonegativity, for students who report same­gender attraction. Additionally, two preregistered exploratory rho coefficients were used to analyze the relationship between LGBTQ+ identity­specific concerns and religious attendance and private religious practice. Religious attendance was significantly related with internalized homonegativity (ρ = .31, p = .02) and Identity Superiority scores (ρ = ­.36, p = .005). Private religious practice was significantly related with Identity Superiority scores (ρ = ­.28, p = .03).

FALL 2024

Discussion

The results supported our first hypothesis, that SM students would report higher levels of psychological distress and suicidality than their heterosexual counterparts. Additionally, exploratory analyses found that SM students reported higher levels on each of the CCAP subscales except for Academic Distress. These findings are consistent with the minority stress model (Meyer, 2013). Our results are also consistent with previous studies indicating that SM students, especially those on religious campuses, are at risk for psychological distress (Heiden­Rootes et al., 2018; Klundt et al., 2021). This speaks to the demand for increased mental health support for LGBTQ+ students.

The results did not support our second hypothesis, that students who reported same­gender attraction and are involved in the university GSA would report having less difficulty accepting their sexuality and lower levels of incongruence between their religious beliefs and their sexuality than students who reported same­gender attraction and are not involved in the university GSA. The inconsistency between this result and previous research may be because Wolff et al. (2016) compared students across a variety of nonaffirming religious universities, some of which did not allow the formation of GSAs. They theorized that universities that permitted GSAs were more accepting of SMs, in turn limiting the amount of marginalization faced by SM students. Therefore, the existence of a GSA on campus may have more influence than actual participation in the GSA. Additionally, students not involved in the GSA may experience social support from other communities outside of the GSA.

The results did not support our third hypothesis, that intrinsic religiosity would be predictive of lower levels of psychological distress and suicidality for both SM and heterosexual students, but the relationship would be weaker for SM students than heterosexual students. Although intrinsic religiosity had a somewhat weak relationship with psychological distress and suicidality, intrinsic religiosity was not predictive of lower levels of suicidality or psychological distress when entered in the regression model with SM status. This suggests that intrinsic religiosity is a weak protective factor for both SM and non­SM students. This contradicts the findings of Klundt et al. (2021), who found that religiosity was a stronger positive influence for non­SM students than SM students. This contradiction could be due to differences in our samples, such as differences in religious affiliation. However, the results of our study are promising as they indicate that intrinsic religiosity may be equally protective for both SM and non­SM students. The results did not support our final hypothesis, that intrinsic religiosity would

be predictive of higher levels of LGBTQ+ concerns, such as internalized homonegativity, for students who reported same­gender attraction. However, exploratory analyses found that religious attendance was associated with more internalized homonegativity and less identity superiority. This is in line with previous research, which indicates that SMs who frequently attend church experience more negative feelings about their same­gender attraction (Meanley et al., 2016). This is likely due to repeated exposure to anti­LGBTQ+ sentiments in religious spaces.

Implications

The current study has many practical implications. This study highlights the complex relationship between religiosity, mental health, and identity acceptance for SM individuals. Although religious attendance was correlated with internalized homonegativity, intrinsic religiosity was found to be a protective factor for suicidality and psychological distress for both SM and heterosexual populations. This highlights the importance of offering affirming religious spaces for SM individuals. SM individuals are at an increased risk of suicidality (Plöderl & Tremblay, 2015), and it is important for SM individuals to be welcome in religious spaces that may provide them support.

Additionally, this study explores the need for increased psychological support for SM students at religious universities. SM students on average reported significantly higher rates of psychological distress, suicidality, depression, anxiety, and a multitude of other negative psychological symptoms. SM students could benefit from targeted mental health resources. Although this is true on all college and university campuses, it is especially important at religious institutions where SM students are at a higher risk of internalized homophobia and psychological distress (Heiden­Rootes et al., 2018; Klundt et al., 2021).

The current study has several limitations. Data were collected at a single university, limiting the generalizability of the findings. The sample lacked gender diversity, with 68.2% of the sample identifying as cisgender women, 27.5% of the sample identifying as cisgender men, and only 3.7% of the sample identifying as nonbinary or gender questioning. Although this study made an effort to include transgender and nonbinary individuals, a large majority of the sample identified as cisgender. Additionally, the data were self­reported at one timepoint, limiting our ability to make claims regarding causality or directionality.

Future research should explore SM and heterosexual individuals at a large variety of religious universities. It may be beneficial to study different institutional profiles of religiosity, LGBTQ+ acceptance, and conservatism to

Christy, Rouse, and Krumrei-Mancuso | LGBTQ+

contrast university atmospheres. Additionally, future research should explore the impact of intersectional identities, specifically at predominantly White and religiously affiliated institutions.

Despite the limitations of the current study, it contributes to the growing body of literature pertaining to SM students at religious universities. More specifically, it broadens the generalizability of previous studies, specifically Klundt et al. (2021). The study performed by Klundt et al. (2021) collected data from a religious university with an incredibly unique culture, extreme religious homogeneity, and little racial diversity. The similarities between the results of that study and the current study, especially regarding religiosity as a protective factor for suicidality for both heterosexual and SM students, despite differences in campus climates, suggest that this may be generalizable to a larger population. This research may be utilized to better inform academic institutions, specifically religiously affiliated institutions, about the increased need for psychological and religious support for SM students.

References

Barnes, D. M., & Meyer, I. H. (2012). Religious affiliation, internalized homophobia, and mental health in lesbians, gay men, and bisexuals. American Journal of Orthopsychiatry, 82(4), 505–515. https://doi.org/10.1111/j.1939-0025.2012.01185.x

Busby, D. R., Horwitz, A. G., Zheng, K., Eisenberg, D., Harper, G. W., Albucher, R. C., Roberts, L. W., Coryell, W., Pistorello, J., & King, C. A. (2020). Suicide risk among gender and sexual minority college students: The roles of victimization, discrimination, connectedness, and identity affirmation. Journal of Psychiatric Research, 121, 182–188. https://doi.org/10.1016/j.jpsychires.2019.11.013

Center for Collegiate Mental Health (2019). CCAPS User Manual. University Park, PA.

Coley, J. S. (2016). Reconciling religion and LGBT rights: Christian universities, theological orientations, and LGBT inclusion. Social Currents, 4(1), 87–106. https://doi.org/10.1177/2329496516651639

Coley, J. S. (2018). Theologies of exclusion: Christian universities and discrimination against sexual minorities. Sociological Spectrum, 38(6), 422–437. https://doi.org/10.1080/02732173.2018.1564097

Corbin, W. R., Ong, T. Q., Champion, C., & Fromme, K. (2020). Relations among religiosity, age of self-identification as gay, lesbian, or bisexual, and alcohol use among college students. Psychology of Addictive Behaviors, 34(4), 512–520. https://doi.org/10.1037/adb0000559

Duffy, M. E., Twenge, J. M., & Joiner, T. E. (2019). Trends in mood and anxiety symptoms and suicide-related outcomes among US undergraduates, 2007–2018: Evidence from two national surveys. Journal of Adolescent Health, 65(5), 590–598. https://doi.org/10.1016/j.jadohealth.2019.04.033

Dyer, W. J. (2022). Refining research on the intersection between sexual orientation, suicide, and religiosity. Psychology of Religion and Spirituality, 14(2), 179–188. https://doi.org/10.1037/rel0000451

Evans, R., Nagoshi, J. L., Nagoshi, C., Wheeler, J., & Henderson, J. (2017). Voices from the stories untold: Lesbian, gay, bisexual, Trans, and Queer College Students’ experiences with campus climate. Journal of Gay &amp; Lesbian Social Services, 29(4), 426–444. https://doi.org/10.1080/10538720.2018.1378144

Hackney, C. H., & Sanders, G. S. (2003). Religiosity and mental health: A metaanalysis of recent studies. Journal for the Scientific Study of Religion, 42(1), 43–55. https://doi.org/10.1111/1468-5906.t01-1-00160

Heiden-Rootes, K., Wiegand, A., Thomas, D., Moore, R. M., & Ross, K. A. (2018). A national survey on depression, internalized homophobia, college religiosity, and climate of acceptance on college campuses for sexual minority adults. Journal of Homosexuality, 67(4), 435–451. https://doi.org/10.1080/00918369.2018.1550329

Hoaglin, D. C., Iglewicsz, B., & Tukey, J. W. (1986). Performance of some resistant rules for outlier labeling. Journal of American Statistical Association, 81,

991–999. https://doi.org/10.1080/01621459.1986.10478363

Klundt, J. S., Erekson, D. M., Lynn, A. M., & Brown, H. E. (2021). Sexual minorities, mental health, and religiosity at a religiously conservative university. Personality and Individual Differences, 171, 110475. https://doi.org/10.1016/j.paid.2020.110475

Koenig, H. G., & Büssing, A. (2010). The Duke University Religion Index (DUREL): A five-item measure for use in epidemiological studies. Religions, 1(1), 78–85. https://doi.org/10.3390/rel1010078

Lefevor, G. T., Larsen, E. R., Golightly, R. M., & Landrum, M. (2022). Unpacking the internalized homonegativity–health relationship: How the measurement of internalized homonegativity and health matter and the contribution of religiousness. Archives of Sexual Behavior, 52(3), 921–944. https://doi.org/10.1007/s10508-022-02436-y

Lefevor, G. T., Park, S. Y., & Pedersen, T. R. (2018). Psychological distress among sexual and religious minorities: An examination of power and privilege. Journal of Gay & Lesbian Mental Health, 22(2), 90–104. https://doi.org/10.1080/19359705.2017.1418696

Lefevor, G. T., Sorrell, S. A., Kappers, G., Plunk, A., Schow, R. L., Rosik, C. H., & Beckstead, A. L. (2020). Same-sex attracted, not LGBQ: The associations of sexual identity labeling on religiousness, sexuality, and health among Mormons. Journal of Homosexuality, 67(7), 940–964. https://doi.org/10.1080/00918369.2018.1564006

Lipson, S. K., Raifman, J., Abelson, S., & Reisner, S. L. (2019). Gender minority mental health in the US: Results of a national survey on college campuses. American Journal of Preventive Medicine, 57(3), 293–301. https://doi.org/10.1016/j.amepre.2019.04.025

Locke, B. D., McAleavey, A. A., Zhao, Y., Lei, P. W., Hayes, J. A., Castonguay, L. G., Li, H., Tate, R., & Lin, Y. C. (2012). Development and initial validation of the Counseling Center Assessment of Psychological Symptoms–34. Measurement and Evaluation in Counseling and Development, 45(3), 151–169. https://doi.org/10.1177/0748175611432642

Lomash, E. F., Brown, T. D., & Paz Galupo, M. (2018). “A whole bunch of love the sinner hate the sin”: LGBTQ microaggressions experienced in religious and spiritual context. Journal of Homosexuality, 66(10), 1495–1511. https://doi.org/10.1080/00918369.2018.1542204

Lytle, M. C., Blosnich, J. R., De Luca, S. M., & Brownson, C. (2018). Association of religiosity with sexual minority suicide ideation and attempt. American Journal of Preventive Medicine, 54(5), 644–651. https://doi.org/10.1016/j.amepre.2018.01.019

Meanley, S., Pingel, E. S., & Bauermeister, J. A. (2016). Psychological well-being among religious and spiritual-identified young gay and bisexual men. Sexuality Research and Social Policy, 13(1), 35–45. https://doi.org/10.1007/s13178-015-0199-4

Meyer, I. H. (2013). Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: Conceptual issues and research evidence. Psychology of Sexual Orientation and Gender Diversity, 1(S), 3–26. https://doi.org/10.1037/2329-0382.1.s.3

Mohr, J. J., & Kendra, M. S. (2011). Revision and extension of a multidimensional measure of sexual minority identity: The Lesbian, Gay, and Bisexual Identity Scale. Journal of Counseling Psychology, 58(2), 234–245. https://doi.org/10.1037/a0022858

National Center for Educational Statistics. (2017, June). Fall enrollment and number of degree-granting postsecondary institutions, by control and religious affiliation of institution: Selected years, 1980 through 2015 Retrieved February 15, 2022, from https://nces.ed.gov/programs/digest/d16/tables/dt16_303.90.asp

Oh, H., Goehring, J., Smith, L., Zhou, S., & Blosnich, J. (2022). Sexual minority status, religiosity, and suicidal behaviors among college students in the United States. Journal of Affective Disorders, 305, 65–70. https://doi.org/10.1016/j.jad.2022.02.068

Osman, A., Bagge, C. L., Gutierrez, P. M., Konick, L. C., Kopper, B. A., & Barrios, F. X. (2001). The Suicidal Behaviors Questionnaire-Revised (SBQ-R): Validation with clinical and nonclinical samples. Assessment, 8(4), 443–454. https://doi.org/10.1177/107319110100800409

Park, K., & Hsieh, N. (2023). A national study on religiosity and suicide risk by sexual orientation. American Journal of Preventive Medicine, 64(2), 235–243. https://doi.org/10.1016/j.amepre.2022.08.020

Plöderl, M., & Tremblay, P. (2015). Mental health of sexual minorities. A systematic review. International Review of Psychiatry, 27(5), 367–385. https://doi.org/10.3109/09540261.2015.1083949

Riley, T. J., Kirsch, A. C., Shapiro, J. B., & Conley, C. S. (2016). Examining stress

FALL 2024

and coping as a mediator for internalizing symptomatology: A comparison between sexual minority and majority first‐year college students. Journal of Adolescence, 49(1), 124–133. https://doi.org/10.1016/j.adolescence.2016.03.005

Rosik, C. H., Lefevor, G. T., & Beckstead, A. L. (2021). Sexual minorities who reject an LGB identity: Who are they and why does it matter? Issues in Law & Medicine, 36(1), 27–43.

Spittlehouse, J. K., Boden, J. M., & Horwood, L. J. (2019). Sexual orientation and mental health over the life course in a birth cohort. Psychological Medicine, 50(8), 1348–1355. https://doi.org/10.1017/s0033291719001284

Storch, E. A., Roberti, J. W., Heidgerken, A. D., Storch, J. B., Lewin, A. B., Killiany, E. M., Baumeister, A. L., Bravata, E. A., & Geffken, G. R. (2004). The Duke Religion Index: A psychometric investigation. Pastoral Psychology, 53(2), 175–181. https://doi.org/10.1023/b:pasp.0000046828.94211.53

Storch, E. A., Strawser, M. S., & Storch, J. B. (2004). Two-week test-retest reliability of the Duke Religion Index. Psychological Reports, 94(3), 993–994. https://doi.org/10.2466/pr0.94.3.993-994

Wilkinson, D. J., & Johnson, A. (2021). A systematic review of quantitative studies capturing measures of psychological and mental health for gay and lesbian individuals of faith. Mental Health, Religion & Culture, 24(9), 993–1016. https://doi.org/10.1080/13674676.2021.1975668

Wilson, L. C., & Liss, M. (2022). Safety and belonging as explanations for mental health disparities among sexual minority college students. Psychology of Sexual Orientation and Gender Diversity, 9(1), 110–119. https://doi.org/10.1037/sgd0000421

Wolff, J. R., Himes, H. L., Soares, S. D., & Miller Kwon, E. (2016). Sexual minority students in non-affirming religious higher education: Mental health, outness, and identity. Psychology of Sexual Orientation and Gender Diversity, 3(2), 201–212. https://doi.org/10.1037/sgd0000162

Woodford, M. R., Han, Y., Craig, S., Lim, C, & Matney, M. M. (2014). Discrimination and mental health among sexual minority college students: The type and form of discrimination does matter. Journal of Gay & Lesbian Mental Health, 18, 142–163. https://doi.org/10.1080/19359705.2013.833882

Woodford, M. R., Kulick, A., Garvey, J. C., Sinco, B. R., & Hong, J. S. (2018). LGBTQ policies and resources on campus and the experiences and psychological well-being of sexual minority college students: Advancing research on

structural inclusion. Psychology of Sexual Orientation and Gender Diversity, 5(4), 445–456. https://doi.org/10.1037/sgd0000289

Youn, S. J., Castonguay, L. G., Xiao, H., Janis, R., McAleavey, A. A., Lockard, A. J., Locke, B. D., & Hayes, J. A. (2015). The Counseling Center Assessment of Psychological Symptoms (CCAPS): Merging clinical practice, training, and research. Psychotherapy, 52(4), 432–441. https://doi.org/10.1037/pst0000029

Author Note

Steven V. Rouse https://orcid.org/0000­0002­1080­5502

Elizabeth J. Krumrei­Mancuso https://orcid.org/0000­0001­6151­7845

Danica Christy is now at the Department of Psychology, University of Nevada, Las Vegas.

To avoid any conflict of interest in the manuscript review process, Steve Rouse (who is a coauthor of this article and the editor of the journal) did not include his name on the first two versions of this manuscript, and the Associate Editor assigned to this manuscript did not know of his involvement; this was, however, disclosed to the Managing Editor for full transparency. Rouse recused himself from decisions about the publication of the manuscript, supporting the decision of the Associate Editor. Only after the manuscript was conditionally accepted was Rouse’s inclusion fully disclosed.

Positionality Statement: Danica Christy identifies as a White, cisgender lesbian. Steve Rouse identifies as a bisexual, White, cisgender man. Elizabeth Mancuso identifies as a heterosexual, White, cisgender woman. All three authors come from a Christian background. The authors acknowledge that their perspectives are influenced by these and other aspects of their identity and life experiences.

Transparent Change: We preregistered with an intention to use independent­sample t tests. At the encouragement of a reviewer, we switched to using MANOVA for our analyses. This work was financially supported by Seaver College. Correspondence concerning this article should be addressed to Danica P. Christy. Email: danica.christy@unlv.edu

Internalized Stigma and Substance Use: Does Race Matter?

ABSTRACT. Substance use disorders are some of the most stigmatized disorders compared to other mental health conditions. Little research has examined self­stigma felt by adolescents (ages 15–17) and young adults (ages 18–22) diagnosed with a substance use disorder, and less research has focused on how racial identity may exacerbate stigma. Using a between­subjects design, the present study analyzed self­stigma of 133 adolescents and young adults using the Substance Abuse Self­Stigma Scale. One­way analyses of variance demonstrated that adolescents and young adults who did not identify as White reported significantly higher levels of stigma compared to their White peers on total scale measures of stigma, F (1, 131) = 104, p < .001, η² = .44, as well as subscales of self­devaluation, F(1, 131) = 37.9, p < .001, η² = .22, fear of enacted stigma, F(1, 131) = 88.78, p < .001, η² = .40, and stigma avoidance/ values disengagement, F(1, 131) = 101.73, p < .001, η² = .43. The findings have important implications for the psychological wellness of adolescents and young adults diagnosed with substance use disorders.

Keywords: intersection, race, substance use, adolescents, drugs, stigma

According to the 2022 National Survey on Drug Use and Health, 17.3% of individuals aged 12 and over had a substance use disorder (SUD; Substance Abuse and Mental Health Services Administration, 2023) and people self­identifying as multiracial (35.1%) reported the highest percentage of illicit drug use followed by Black (26.7%) individuals. Youth substance use represented a significant subset of the overall substance use problem; 27.8% of young adults ages 18–25 and 8.7% of adolescents ages 12–17 were diagnosed with an SUD (Substance Abuse and Mental Health Services, 2023). In addition, recent Monitoring the Future data found that, for the first time in many years, Black or African American 12th grade students reported higher levels of alcohol, nicotine, and prescription drug use than their White and Hispanic peers (Miech et al., 2023).

A person with an SUD may be subject to many deleterious effects, including increased levels of stigma (Yang et al., 2017). Although research has found that adults with SUDs experience higher levels of stigma than individuals with other psychiatric disorders (Barry et al., 2014), less research has examined stigma in adolescents or young adults, or how multiple stigmatizing identities, such as also being a member of a racially stigmatized group, may exacerbate stigma. The present study examined whether adolescents (ages 15–17) and young adults (ages 18–21) who do not identify as White and were in treatment for substance abuse disorder experienced more self­stigma than their White peers.

Stigma

People who misuse substances may experience psychological distress or impaired quality of life (Chang

Diversity badge earned for conducting research focusing on aspects of diversity.

et al., 2022; Earnshaw, 2020) because of social stigma. Stigma can exist in many forms, including social stigma and internalized self­stigma. Public stigma refers to society’s view of a condition, such as mental illness or drug addiction, and includes devaluation and discrimination toward those diagnosed (Brohan et al., 2011). Individuals with stigmatized conditions often become aware of the public’s negative attitudes and internalize them as self­stigma (Corrigan & Rao, 2012). Borenstein (2020) defined self ­ stigma as internalized negative attitudes and shame that people may hold regarding an aspect of their condition, including mental illness or addiction.

Numerous studies have demonstrated the persistence of both public and self­stigma toward individuals with SUDs with consistent findings demonstrating higher levels for individuals with SUDs than those with other mental or physical illness conditions (Barry et al., 2014; Livingston et al., 2012; Luoma et al., 2013; Yang et al., 2017). Abusing substances has been found to cause individuals to be perceived as criminals (Chang et al., 2022) unsuitable marriage or work partners, undeserving of employment or housing (Barry et al., 2014), having weaker personalities (Chang, et al., 2022), and more dangerous (Schomerus et al., 2010; Yang et al., 2017) than those with a mental illness. In a review of qualitative research, Hammerlund et al. (2018) found that people with SUDs reported feelings of shame, guilt, and motivation to avoid the title of “addict” or “junkie.”

Stigma has the potential to harm many aspects of an individual’s well­being. It can create barriers for treatment and recovery (Adams & Volkow, 2020; Lannin et al., 2016) that can include bias from health care providers (van Boekel et al., 2013), internalized hopelessness about one’s convalescence (Corrigan et al., 2010) or internalized stigma toward help­seeking (Gutierrez et al., 2020; Smith et al., 2016). Self­stigma, or internalizing negative beliefs, has been found to impact well­being by lowering self­esteem and self­efficacy (Crapanzano et al., 2018; da Silveira et al., 2018; Ritsher & Phelan, 2004; Rusch et al., 2006), increasing isolation (Earnshaw et al., 2013), reducing social support (Earnshaw et al., 2013), and increasing suicidal ideation (Wastler et al., 2020). When public stigma is internalized, life goals may become more difficult to achieve, including employment (Sum et al., 2021), independent living, and meaningful relationships (Corrigan & Wassel, 2008; Earnshaw et al., 2013).

Although less research is devoted toward adolescents’ and young adults’ experiences of stigma, Adlaf et al. (2009) found that more than half of adolescents (7th–12th grade) reported that they would feel ashamed if friends discovered that someone in their family used

substances. In a study of young people (ages 18–25) with SUDs, Vatanasin and Dallas (2022) found that most participants (79%) reported a moderate amount of selfstigma with negative feelings and aimlessness. Similarly, Blyth et al. (2023) reported that 75% of participants ages 12–19 used stigmatizing language, such as “addict,” when describing their own or another person’s substance use. Adolescents and young adults are greatly impacted by awareness of public stigma, as the role of others is critical in the development of their own identities (Harter, 2012). Identity formation is a normal developmental milestone in adolescence, one that is shaped by social and cultural influences (Erikson, 1968). Identity formation is influenced not only by what the adolescent or young person believes themselves to be, but also what they believe others see them to be (Trieber & Booysen, 2021). Thus, many adolescents and young adults who struggle with substance use may internalize the negative stigma held by the public into their identities. This is even more concerning for adolescents and young adults who identify with more than one societally stigmatized group (Gibbons et al., 2010).

Intersection of Race With Stigma

Individuals with an SUD who are also members of other stigmatized groups, such as people of color, may face compounded or intersecting forms of stigma, as analyzed through an intersectional framework (Crenshaw, 1989; Earnshaw, 2020; Gary, 2005). The individual may feel the public’s stigma toward them for both identities: being a person who misuses substances and being non­White. Research has consistently shown that people of color experience public stigma in the form of discrimination leading to health, social, emotional, and economic disparities (Amaro et al., 2021; Centers for Disease Control and Prevention, 2023; Chen & Mallory, 2021; Macedo et al., 2019; Rivera, 2014). The intersection of race and ethnicity has also been demonstrated as a contributing factor toward stigma against individuals with SUDs. Kulesza et al. (2016) found that participants were more likely to associate Latinx individuals who inject drugs with deserving punishment rather than treatment, than they were for White individuals with an SUD. Similarly, Curry and Corral­Camacho (2008) analyzed prison sentences for drug­related crimes in Texas and found the probability of receiving prison time was greater for African American men than for White men. Zemore et al. (2009 reported that Hispanic individuals with SUDs endorsed greater levels of selfstigma than White individuals, and people of color held more stigmatizing views of former alcoholics than White individuals (Smith et al., 2010). Finally, in an examination of the effect of double stigma upon help­seeking

barriers in Black participants diagnosed with either a mental illness or addiction, Yu et al. (2022) found that racial stigma predicted help­seeking barriers through the effects of internalized stigma.

Given the increase in substance use by Black or African eighth graders, as demonstrated by the most recent Monitoring the Future research (Miech et al., 2023), it is important to examine how race may intersect the experience of stigma. We hypothesized that adolescents (ages 15–17) and young adults (ages 18–22) with SUDs who do not identify as White would have higher levels of self­stigma about their substance use than their White peers with SUDs.

Method

Participants

Participants consisted of 133 adolescents and young adults between the ages of 15 and 21 (M = 16) receiving outpatient treatment at various substance use recovery centers in the Northeastern United States. Of the 133 participants, 48% did not identify as White, and 52% identified as White. Of those not identifying as White, most identified as Black (51%) with Latinx (24%), Indian (3%), Afro­Caribbean (6%), and mixed (16%) comprising the remainder. Fifty­four percent of the participants identified as male and 46% as female. No participants identified as nonbinary.

Materials

Participants completed two scales. First, they completed a short demographic form, which asked participants to identify their race, age, and gender. Participants were provided a blank line to record their race, and were offered a second forced choice question, namely, whether they identified as White. Both age and gender were queried using open format questions. In addition to the short demographic form, the Substance Abuse Self Stigma Scale (SASSS) was used to measure the participants’ levels of self­stigma. The scale, developed by Luoma et al. (2013), is a self­report survey that was designed to measure self­stigma in individuals who are misusing substances. The SASSS consists of three subsections with 8 items in Section 1 measuring self­devaluation, 9 items in Section 2 measuring participants’ fear of enacted stigma, and 23 items in Section 3 measuring stigma avoidance and values disengagement (Luoma et al., 2013). Higher scores indicate greater levels of stigma. In the SASSS, ten items are reverse coded. Examples of items from Sections 1, 2, and 3 respectively are: “I have the thought that I can’t be trusted,” “a job interviewer wouldn’t hire me if I mentioned my substance history in a job interview,” and, “I avoid doing things where I would be blamed if it didn’t work out.” Participants were asked

to rate how much they agreed with the statement based upon a 5­point scale, from 1 (never or almost never) to 5 (very often; Luoma et al., 2013). Luoma et al. (2013) reported an overall SASSS Cronbach alpha of .86. The present study found a Cronbach alpha of .83 for the overall SASSS scale.

Procedure

Data collection commenced in the fall semester of 2020 and continued until the fall semester of 2022. Substance use counseling agencies in the northeastern part of the Unites States that served adolescents and young people were solicited for data collection through contact with directors. Those that agreed to allow us to interview their clients did not have an Institutional Review Board, thus approval was obtained through the Institutional Review Board of the researchers’ institution, Mount Saint Mary College. Prior to the start of the study, participants were informed of the procedure, possible implications, and detrimental effects of the study, and informed consent was given. Participants were reminded that their participation was voluntary, they could discontinue the study at any time, for any reason, and that their responses would be anonymous. For adolescents under the age of 18, guardian informed consent as well as participant assent, was obtained. Data were collected via pen and paper and consisted of a demographic survey and the SASSS. Upon completion of the data collection, participants were debriefed in­person and presented with a 15­minute Google Slides presentation about public figures who struggled with substance use issues and were able to overcome them. Chosen public figures for the presentation consisted of equal numbers of Black, White, and Hispanic individuals. At the end of the presentation, participants were encouraged to voice any additional thoughts or concerns about the present research.

Results

All 133 of the participants’ responses were coded into Statistical Product and Service Solutions (SPSS) version 16.0 for analysis and interpretation of the data. The independent variable consisted of participants’ identification as White or not White. The dependent variables consisted of the scores on the SASSS, which included total overall score and scores for each subscale of the instrument (i.e., Subscales 1= representing selfdevaluation, Subscale 2 = fear of enacted stigma, and Subscale 3 = stigma avoidance and values disengagement) for a total of 4 dependent variables. One­way ANOVAs were performed for each dependent variable, resulting in four one­way ANOVAs in this betweensubjects design.

FALL 2024

The means and standard deviations for the overall SASSS scores as well as for the three subscales can be found by race (White and not White) in Table 1. Mean scores on the total scale as well as on each subscale were higher for participants not identifying as White than White participants, indicating higher levels of stigma. Participants not identifying as White reported a mean of 138.9 (SD = 24.8) on the total scale, whereas White participants’ mean was 98.6 (SD = 20.4). ANOVAs were performed to test for significant differences between total and subscale score means.

A one­way ANOVA on the dependent variable of Subscale 1 of the SASSS found a significant effect for race, F(1,131) = 37.9, p < .001, η² = .22 , with participants who did not identify as White scoring significantly higher on self­devaluation than White participants. Because higher scores indicate greater stigma, participants not identifying as White reported greater stigma than White participants on self­devaluation.

A one­way ANOVA on the dependent variable of Subscale 2 of the SASSS measuring fear of enacted stigma found a significant effect for race, F(1, 131) = 88.78, p < .001, η² = .40, with participants not identifying as White scoring significantly higher than White participants. Because higher scores indicate greater levels of stigma, participants not identifying as White reported greater levels of fear of enacted stigma than White participants.

A one­way ANOVA on the dependent variable of Subscale 3 of the SASSS measuring stigma avoidance/ values disengagement found a significant effect for race, F(1, 131) = 101.73, p < .001, η²= .43, with participants who did not identify as White scoring significantly higher than White participants. Because higher scores indicate greater levels of stigma, participants not identifying as White reported greater stigma avoidance and values disengagement than White participants.

A one­way ANOVA on the total SASSS scale found a significant effect for race, F(1, 131) = 104, p < .001, η² = .44, with participants who did not identify as White scoring significantly higher than White participants, indicating greater overall stigma being reported by those not identifying as White.

Discussion

Our hypothesis that adolescents (ages 15–17) and young people (ages 18–22) with SUDs who did not identify as White would report higher levels of self­stigma regarding their substance use than their White peers, was supported. Self­stigma of substance use was greater on all three subscales (i.e., self­devaluation, fear of enacted stigma, stigma avoidance and values disengagement), as well as the entire scale, in adolescents and young people

who did not identify as White than it was for those who identified as White.

The present research has important health implications for individuals seeking care for SUDs. Chang et al. (2022) found that self­stigma levels remained unchanged over substance misuse treatment progression, most likely because the stigma was not addressed. For SUD clients identifying with historically marginalized groups, addressing stigma may take on even greater importance. Awareness of how multiple stigmas may influence adolescents and young people with SUDs can help create educational tools that explicitly reject racial stereotypes and provide appropriate racial role models that encourage greater access to psychological wellness.

Future research may wish to examine how stigma may impact treatment initiation and completion, especially for individuals who may possess stigma in compounded or intersecting forms. Although research examining the effect of stigma upon treatment seeking has found mixed results (Hammarlund et al., 2018), findings surrounding stigma from more than one source have been clearer. Multiple stigmas were found to have help­seeking implications, with adults (Acevedo et al., 2012; da Silveira et al., 2018; Hammarlund et al., 2018; Saloner & LeCook, 2013; Yu et al., 2022) and adolescents (Cumming et al., 2011) demonstrating that those who possess stigma from multiple sources are less likely to seek treatment for behavioral health disorders than those without.

For the adolescent at a crucial stage of identity development, intersecting multiple dimensions of the self may become a more challenging task for those who have an SUD. Understanding one’s identity both as a person who misused substances and a person of color is not an easy feat. Assisting adolescents and young people in overcoming internalized stigma can contribute to the formation of a strong self­identity necessary for future psychological wellness. Treiber and Booysen (2021) recommended that treatment of adolescents and young adults focus on deconstructing the “druggie” persona

TABLE 1

Means, Standard Deviations, and One-Way ANOVA Results by Race on SASSS Subsection and

Note aNIW = those not identifying as White. * p < .001

Scale Scores

as it has negative implications for overall well­being, potentially hampering the reconstruction of full identities for successful adulthood. A strong sense of identity empowers the adolescent for future adult success as an autonomous, resilient individual (Stephenson, 2023).

The present study had several limitations. First, our sample size was low; adolescents tend to be a challenging sample group due to the necessity of securing parental consent. Although many potential participants gave full assent, retrieval of guardian consent forms was an obstacle thereby reducing our overall dataset. The study also spanned a time when the Black Lives Matter movement was in full force, thus potentially exacerbating feelings of racial stigma in participants potentially creating a history threat to external validity. Future research should seek to replicate our findings with larger sample sizes.

References

Acevedo, A., Garnick, D. W., Lee, M. T., Horgan, C. M., Ritter, G., Panas, L., Davis, S., Leeper, T., Moore, R., & Reynolds, M. (2012). Racial and ethnic differences in substance abuse treatment initiation and engagement. Journal of Ethnicity in Substance Abuse, 11(1), 1–21. https://doi.org/10.1080/15332640.2012.652516

Adams, J. M., & Volkow, N. D. (2020). Ethical imperatives to overcome stigma against people with substance use disorders. American Medical Association Journal Ethics, 22(1), 702–708. https://doi.org/10.1001/amajethics.2020.702

Adlaf, E. M., Hamilton, H. A., Wu, F., & Noh, S. (2009). Adolescent stigma toward drug addiction: Effects of age and drug use behaviour. Addictive Behaviors, 34(4), 360–364. https://doi.org/10.1016/j.addbeh.2008.11.012

Amaro, H., Sanchez, M., Bautista, T., & Cox, R. (2021). Social vulnerabilities for substance use: Stressors, socially toxic environments, and discrimination and racism. Neuropharmacology, 188 https://doi.org/10.1016/j.neuropharm.2021.108518

Barry, C. L., McGinty, E. E., Pescosolido, B. A., & Goldman, H. H. (2014). Stigma, discrimination, treatment effectiveness, and policy: Public views about drug addiction and mental illness. Psychiatric Services, 65(10), 1269–1272. https://doi.org/10.1176/appi.ps.201400140

Blyth, S. H., Cowie, K., Jurinsky, J., & Hennessy, E. A. (2023). A qualitative examination of social identity and stigma among adolescents recovering from alcohol or drug use. Addictive Behavior Reports, 18 https://doi.org/10.1016/j.abrep.2023.100505

Borenstein, J. (2020, August). Stigma, prejudice, and discrimination against people with mental illness. American Psychiatric Association. https://www.psychiatry.org/patients-families/stigma-and-discrimination

Brohan, E., Gauci, D., Sartorius, N., & Thornicroft, G. (2011). Self-stigma, empowerment and perceived discrimination among people with bipolar disorder or depression in 13 European countries: The GAMIAN-Europe study. Journal Affective Disorders, 129(1–3), 56–63. https://doi.org/10.1016/j.jad.2010.09.001

Center for Disease Control and Prevention. (2023, September 18). Racism and health. https://www.cdc.gov/minorityhealth/racism-disparities/index.html

Chang, K. C., Chen H. P., Huang S.W., Chen, J. S., Potenza, M. N., Pakpour, A. H., & Lin, C. Y. (2022). Comparisons of psychological distress and self-stigma among three types of substance use disorders receiving treatment-asusual approaches: Real-world data from a 9-month longitudinal study. Therapeutic Advances in Chronic Disease, 13, 1–12. https://doi.org/10.1177/20406223221140393

Chen, S., & Mallory, A. B. (2021). The effect of racial discrimination on mental and physical health: A propensity score weighting approach. Social Science Medicine, 285(4), https://doi.org/10.1016/j.socscimed.2021.114308

Corrigan, P. W., Larson, J. E., & Kuwabara, S. A. (2010). Social psychology of the stigma of mental illness: Public and self-stigma models. In J. E. Maddux & J. P. Tangney (Eds.), Social psychological foundations of clinical psychology (pp. 51–68). The Guilford Press.

Corrigan, P. W., & Rao, D. (2012). On the self-stigma of mental illness: Stages,

disclosure, and strategies for change. The Canadian Journal of Psychiatry/ La Revue Canadienne de Psychiatrie, 57(8), 464–469. https://doi.org/10.1177/070674371205700804

Corrigan, P. W., & Wassel, A. (2008). Understanding and influencing the stigma of mental illness. Journal of Psychosocial Nursing and Mental Health Services, 46(1), 42–48. https://doi.org/10.3928/02793695-20080101-04

Crapanzano, K. A., Hammarlund, R., Ahmad, B., Hunsinger, N., & Kullar, R., (2019). The association between perceived stigma and substance use disorder outcomes: A review. Substance Abuse and Rehabilitation, 10, 1–12. https://doi.org/10.2147%2FSAR.S183252

Crenshaw, K. (1989). Demarginalizing the intersection of race and sex: A black feminist critique of antidiscrimination doctrine, feminist theory and antiracist politics. University of Chicago Legal Forum, 1(8), 139–167. https://chicagounbound.uchicago.edu/uclf/vol1989/iss1/8

Cumming, J. R., Wen, H., & Druss, B. (2011) Racial/ethnic differences in treatment for substance abuse disorders among U. S. adolescents. Journal of the American Academy of Child and Adolescent Psychiatry, 50, 1265–1274. https://doi.org/10.1016/j.jaac.2010.11.004

Curry, T. R., & Corral-Camacho, G. (2008). Sentencing young minority males for drug offenses. Punishment & Society, 10(3), 253–276. https://doi.org/10.1177/1462474508090231

da Silveira, P. S., Casela, A. L. M., Monteiro, E. P., Ferreira, G. C. L., deFreitas, J. V. T., Machado, N. M. (2018). Psychosocial understanding of self-stigma among people who seek treatment for drug addiction. Stigma and Health, 3(1), 42–52. https://doi.org/10.1037/sah0000069

Earnshaw, V. A. (2020). Stigma and substance use disorders: A clinical, research, and advocacy agenda. American Psychologist, 75(9), 1300–1311. https://doi.org/10.1037/amp0000744

Earnshaw, V. A., Smith, L. R., & Copenhaver, M. (2013). Drug addiction in the context of methadone maintenance therapy: An investigation into understudied sources of stigma. International Journal of Mental Health and Addiction, 11(1), 110–122. https://doi.org/10.1007/s11469-012-9402-5

Erikson, E. (1968). Identity: Youth and crisis. W. W. Norton and Company. Gary, F. (2005). Stigma: Barrier to mental health care among ethnic minorities. Issues in Mental Health Nursing, 26, 979–999. https://doi.org/10.1080/01612840500280638

Gibbons, F. X., Etcheverry, P. E., Stock, M. L., Gerrard, M., Weng, C. Y., Kiviniemi, M., & O’Hara, R. (2010). Exploring the link between racial discrimination and substance use: What mediates? What buffers? Journal of Personality and Social Psychology, 99(5), 785–801. https://doi.org/10.1037/a0019880

Gutierrez, D., Crowe, A., Mullen, P. R., Pignato, L. & Fan, S. (2020). Stigma, help seeking, and substance use. The Professional Counselor, 10(2), 220–234. https://doi.org/10.15241/dg.10.2.220

Hammarlund, R., Crapanzano, K. A., Luce, L., Mulligan, L., & Ward, K. M. (2018). Review of the effects of self-stigma on the treatment-seeking decisions of individuals with drug-and alcohol-use disorders. Substance Abuse and Rehabilitation, 9, 115–136. https://doi.org/10.2147/SAR.S183256

Harter, S. (2012). The construction of the self: Developmental and sociocultural foundations. Guilford Press.

Kulesza, M., Matsuda, M., Ramirez, J. J., Werntz, A. J., Teachman, B. A., & Lindgren, K. P. (2016). Towards greater understanding of addiction stigma: Intersectionality with race/ethnicity and gender. Drug and Alcohol Dependence, 169, 85–91. https://doi.org/10.1016/j.drugalcdep.2016.10.020

Lannin, D. G., Vogel, D. L., Brenner, R. E., Abraham, W. T., & Heath, P. J. (2016). Does self-stigma reduce the probability of seeking mental health information? Journal of Counseling Psychology, 63(3), 351–358.  https://doi.org/10.1037/cou0000108

Livingston, J. D., Milne, T., Fang, M. L., & Amari, E. (2012). The effectiveness of interventions for reducing stigma related to substance use disorders: A systematic review. Addiction, 107(1), 39–50. https://doi.org/ 10.1111/j.1360-0443.2011

Luoma, J. B., Nobles, R. H., Drake, C., E., Hayes, S. C., O-Hair, A., Fletcher, L., & Kohlenberg, B. S. (2013). Self-stigma in substance abuse: Development of a new measure. Journal of Psychopathology and Behavioral Assessment, 35, 223–234. https://doi.org/10.1007/s10862-012-9323-4

Macedo, D. M., Smithers, L. G., Roberts, R. M., Haag, D. G., Paradies, Y. & Jamieson, L. M. (2019). Does ethnic-racial identity modify the effects of racism on the social and emotional wellbeing of Aboriginal Australian children? PLoS ONE, 14(8). https://doi.org/10.1371/journal.pone.0220744

Miech, R. A., Johnston, L. D., Patrick, M. E., O’Malley, P. M., Bachman, J. G., & Schulenberg, J. E., (2023). Monitoring the Future national survey results on drug use, 1975–2022: Secondary school students. Monitoring the

FALL 2024

Future Monograph Series. Ann Arbor, MI: Institute for Social Research, University of Michigan. https://monitoringthefuture.org/wp-content/ uploads/2022/12/mtf2022.pdf

Ritsher, J. B., & Phelan, J. C. (2004). Internalized stigma predicts erosion of morale among psychiatric outpatients. Psychiatry Research, 129(3), 257–265. https://doi.org/10.1016/j.psychres.2004.08.003

Rivera, L. M. (2014). Ethnic-racial stigma and health disparities: From psychological theory and evidence to social policy solutions. Journal of Social Issues, 70(2), 198–205. https://doi.org/10.1111/josi.12055

Rusch, N., Lieb, K., Bohus, M., Corrigan, P. W. (2006). Self-stigma, empowerment, and perceived legitimacy of discrimination among women with mental illness. Psychiatric Services, 57, 399–402. https://doi.org/10.1176/appi.ps.57.3.399

Saloner, B., & Le Cook, B. (2013). Blacks and Hispanics are less likely than Whites to complete addiction treatment, largely due to socioeconomic factors. Health Affairs, 32, 135–145. https://doi.org/10.1377/hlthaff.2011.0983

Schomerus, G., Lucht, M., Holzinger, A., Matschinger, H., Carta, M. G., & Angermeyer, M. C. (2010). The stigma of alcohol dependence compared with other mental disorders: A review of population studies. Alcohol and Alcoholism, 46(2), 105–112. https://doi.org/10.1093/alcalc/agq089

Smith, L. R., Earnshaw, V., A., Copenhaver, M. M., & Cunningham, C. O. (2016). Substance use stigma: Reliability and validity of a theory-based scale for substance-using populations. Drug and Alcohol Dependence, 162, 34–43. https://doi.org/10.1016/j.drugalcdep.2016.02.019

Smith, S. M., Dawson, D. A., Goldstein, R. B. & Grant, B. F. (2010). Examining perceived alcoholism stigma effect on racial-ethnic disparities in treatment and quality of life among alcoholics. Journal Studies Alcohol Drugs, 7(2), 231–236. https://doi.org/10.15288/jsad.2010.71.231

Stephenson, T. (2023, May 1). Building a powerful self-identity: Why it matters for adolescents. Monash University. https://lens.monash.edu/@education/2023/05/01/1385697/building-apowerful-self-identity-why-it-matters-for-adolescents

Substance Abuse and Mental Health Services Administration. (2023). Key substance use and mental health indicators in the United States: Results from the 2022 National Survey on Drug Use and Health (HHS Publication No. PEP23-07-01-006, NSDUH Series H-58). Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration. https://www.samhsa.gov/data/report/2022-nsduh-annual-national-report

Sum, M. Y., Chan, S. K. W., Tse, S., Bola, J. R., & Chen, E. Y. H. (2021). Internalized stigma as an independent predictor of employment status in patients with schizophrenia. Psychiatric Rehabilitation Journal, 44(3), 299–302.

https://doi.org/10.1037/prj0000451

Treiber, D., & Booysen, L. A. E. (2021). Identity (re)construction of female adolescents with substance use disorders. International Journal Environmental Research and Public Health, 18(13), 7022. https://doi.org/10.3390/ijerph18137022

van Boekel, L. C., Brouwers, E. P. M., van Weeghel, J., & Garretsen, H. F. L. (2013). Stigma among health professionals towards patients with substance use disorders and its consequences for healthcare delivery: Systematic review. Drug Alcohol Dependence, 131, 23–35. https://doi.org/10.1016/

Vatanasin, D., & Dallas, J. C. (2022). Factors predicting self-stigma among youths receiving substance abuse treatment. Pacific Rim International Journal of Nursing Research, 26(1), 78–89.

Wastler, H., Lucksted, A., Phalen, P., & Drapalski, A. (2020). Internalized stigma, sense of belonging, and suicidal ideation among veterans with serious mental illness. Psychiatric Rehabilitation Journal, 43(2), 91–96.

https://doi.org/10.1037/prj0000386

Yang, L., Wong, L. Y., Grivel, M. M., & Hasin, D. (2017). Stigma and substance use disorders: An international phenomenon. Current Opinions Psychiatry, 30(50), 378–388. https://doi.org/10.1097%2FYCO.0000000000000351 Yu, Y., Matlin, S. L., Crusto, C. A., Hunter, B., & Tebes, J. K. (2022). Double stigma and help-seeking barriers among Blacks with a behavioral health disorder. Psychiatric Rehabilitation Journal, 45(2), 183–191.  https://doi.org/10.1037/prj0000507

Zemore, S. E., Mulia, N., Ye, Y., Borges, G. & Greenfield, T. K. (2009). Gender, acculturation, and other barriers to alcohol treatment utilization among Latinos in three national alcohol surveys. Journal Substance Abuse Treatment, 36(4), 446–456. https://doi.org/10.1016/j.jsat.2008.09.005

Author Note

Anne Ferrari

https://orcid.org/0000­0002­1475­9697

Positionality Statement: Anne Ferrari identifies as a cisgender White female who is nondisabled. Mikaela Burch identifies as a heterosexual, cisgender African American and White woman. She is disabled. All authors acknowledge that their perspectives are influenced by their positions within these dimensions of identity. Correspondence concerning this article should be addressed to Anne Ferrari, Mount Saint Mary College, 330 Powell Ave, Newburgh, NY 12550. Email: Anne.Ferrari@msmc.edu

The Ideal Affect of Filipinx Americans

Audrienne Casidsid, William Peruel, Jonna-Lynn Alonso, and Christie Napa Scollon*

Department of Psychology, Western Washington University

ABSTRACT. Previous studies have found differences in ideal affect between East Asian populations and European American populations. However, no study has looked at the specific affective preferences of Filipinx Americans. Thus, the present study compared the ideal affect of Filipinx Americans and European Americans. Analyses revealed nearly identical ideal affect profiles between the Filipinx American and European American samples, p = .88, η2p = .00. Additionally, high arousal positive states were equally preferred to low arousal positive states in both the Filipinx American sample (p = .57, Cohen’s d = 0.06) and the European American sample (p = .83, Cohen’s d = 0.03). The results are consistent with the notion that religious influences shape ideal affect, whereas collectivism in this case did not (cf. Tsai et al., 2006). The results highlight the heterogeneity among collectivist Asian groups and underscore the need to examine the intersectionality of cultural influences on affect. More psychological research on Filipinx people is needed to unpack the experience of this unique culture.

Keywords: Filipinx American, ideal affect, HAP, LAP

ABSTRACTO

Estudios anteriores han encontrado diferencias en el afecto ideal entre las poblaciones del este de Asia y las poblaciones Europeo­Americanas. Sin embargo, ningún estudio ha analizado las preferencias afectivas específicas de los Estadounidenses de origen Filipinx. Por lo tanto, el presente estudio comparó el afecto ideal de los Estadounidenses de origen Filipinx y los Estadounidenses de origen Europeo. Los análisis revelaron perfiles de afecto ideal casi idénticos entre las muestras Filipinxs Americanas y Europeo­Americanas, p = .88, η2p = .00. Además, los estados positivos de alta excitación fueron igualmente preferidos a los estados positivos de baja excitación tanto en la muestra FilipinxAmericana ( p = .57, d de Cohen = 0.06) como en la muestra Europeo­Americana (p = .83, d de Cohen = 0.03). Los Resultados son consistentes con la noción de que las influencias religiosas dan forma al afecto ideal, mientras que el colectivismo en este caso no lo hizo (cf. Tsai et al., 2006). Los resultados ponen de relieve la heterogeneidad entre los grupos colectivistas Asiáticos y subrayan la necesidad de examinar la interseccionalidad de las influencias culturales sobre el afecto. Se necesita más investigación psicológica sobre las personas Filipinx para desentrañar la experiencia de esta cultura única.

Diversity badge earned for conducting research focusing on aspects of diversity.

Casidsid, Peruel, Alonso, and Scollon | Filipinx

From pride to sorrow to anger to elation, many would argue that emotional experiences enrich the human experience. However, there are considerable cultural differences in the extent to which people would like to feel specific emotions. For instance, previous studies have shown that more individualistic cultures tend to value emotional experiences around enthusiasm and excitation, but collectivistic cultures tend to value feelings of calmness or relaxation much more than enthusiasm (Tsai, 2007). Differences in how much people value specific emotions can account, at least in part, for some of the differences in emotional experience.

Affect Valuation Theory

Psychologists and anthropologists have historically treated cultural differences in affect as a single construct (Mesquita et al., 1997; Wierzbicka, 1994). However, more current research on culture and emotions has suggested that people of different cultural backgrounds have different preferences for what emotions they want to feel. For instance, Eid and Diener (2001) found that individualistic and collectivistic cultures differed in norms regarding emotional experiences. Similarly, Tamir et al. (2016) found that people desired to feel different emotions based on how much those emotions aligned with their own values, which varied throughout different cultural regions.

Tsai’s affect valuation theory presents the idea of culture affecting emotional preferences by distinguishing between actual affect, the emotions people typically experience whether they like them or not, and ideal affect, the emotions people want to experience. Although ideal and actual affect may influence or reinforce one another, affect valuation theory predicts that they are two distinct constructs, along with the notion that culture influences ideal affect more than actual affect (Tsai et al., 2006). In other words, culture affects what emotions people would like to ideally feel.

Affect valuation theory breaks down commonly felt emotions into eight sub­octants, differing across dimensions of valence and arousal. For example, the High Arousal Positive (HAP) octant includes feelings of excitement, enthusiasm, and strength. On the other end of the arousal dimension is the Low Arousal Positive (LAP) octant, which includes feelings of serenity and calm. The octants of HAP and LAP have received the most attention in culture and emotion literature because they have shown the most distinct and reliable cultural differences (e.g., Tsai et al., 2006; Tsai et al., 2007a; Tsai et al., 2007b).

East–West Differences in Ideal Affect

Research on affect valuation theory has exclusively relied on East–West comparisons, that is comparing scores on

ideal affect among East Asians and East Asian Americans to their White American counterparts. Consistently, this body of work has shown that East Asians value LAP more than HAP, whereas White Americans tend to value HAP over LAP (Tsai et al., 2006; Tsai et al., 2007a; Tsai et al., 2007b). If culture influences affect valuation, then it is important to understand how and why. Tsai has identified two potential factors that impact affect valuation.

First, interpersonal goals shape desired emotions, according to Tsai et al. (2007c). For instance, people in individualistic cultures typically prioritize influencing others’ behaviors to meet their needs as opposed to adjusting one’s own behavior to maximize group harmony. HAP emotions, such as enthusiasm, are instrumental to achieving influencing goals. Conversely, people from collectivistic cultures prioritize harmony in their social relationships and often adjust their own behavior to meet group needs. Thus, for them, LAP states such as serenity are instrumental to adjusting goals which maximize group harmony (Tsai et al., 2007c).

Second, previous studies have found religion to underpin preferences for ideal affective states. Tsai et al. (2007b) coded classical and contemporary texts from both Western and Eastern religious philosophies for frequency of HAP and LAP words. Christian texts such as the Bible tended to promote HAP states, and Eastern texts such as the Tao de Ching and the Bhagavad Gita tended to promote LAP states (Tsai et al., 2007b).

Filipinx Americans and Ideal Affect

Past research has only compared East Asian or East Asian American respondents to European Americans in their affect valuation (e.g. Tsai, 2007; Tsai et al., 2006; Tsai et al., 2007c). The present study extends Tsai’s research on affective valuation theory to examine the affect valuation of Filipinx Americans who occupy a unique cultural space. Traditionally speaking, the Filipinx people have more collectivistic values (Fuligni & Pederson, 2002). Furthermore, the values of kapwa, interconnectedness, and familial obligation, would mark the Philippines as a textbook example of collectivism (David, 2013). As such, Filipinx people likely prioritize adjusting goals over influencing goals in their interpersonal relationships. Based on this, we might expect Filipinx people to value LAP over HAP, similar to East Asians.

On the other hand, Philippine culture has been heavily impacted by nearly four hundred years of colonization, first by Spain, then later by the United States. Due to the effects of Spanish colonization, Christian values have been interwoven within the very fabric of Philippine culture. As such, about 65% of Filipinx Americans identify themselves as Catholic (Pew

Research Center, 2012). Additionally, Jasso et al. (2003) reported Filipinx immigrants as the second largest contributor of Catholic immigrants in the United States. Based on their religious affiliation, we might expect Filipinx Americans to value HAP more than LAP, as suggested by Tsai et al. (2007b).

Consequences of Affect Valuation

Are there any real consequences of affect valuation?

Bencharit et al. (2009) examined ideal affect in the context of job interviews and found that there are practical consequences of affect valuation. In a series of studies, they examined if (a) cultural differences in ideal affect impact the way job applicants present themselves, and (b) differences in emotional expression that are consistent with ideal affect determine who gets hired. Their results showed that job applicants who express affective states that match the ideal affect of the potential employer’s culture were more likely to get hired. To put this more concretely, someone hiring for an American company tends to perceive applicants who display HAP states such as engagement or enthusiasm as more competent (Paulhus et al., 2013; Wolf et al., 2016). Mismatches in ideal affect could be one reason Asian Americans are frequently overlooked for leadership positions, and other positions, unlike their European American peers. On the other hand, someone hiring for an East Asian organization perceives applicants who display calmness and serenity—both LAP states—as being more competent.

Tsai and colleagues have similarly demonstrated that ideal affect drives monetary donations on the microlending platform Kiva (Park et al., 2020). Donors from countries that value HAP give more money to Kiva applicants who display HAP in their profile pictures, whereas donors from countries that value LAP give more money to Kiva applicants who display LAP in their profile pictures.

TABLE 1

Sample Demographics

Research on affect valuation theory can also shed some light on the activities people participate in, which can have either positive or negative impacts to health and overall life satisfaction. According to Tsai (2007), one tenet of affect valuation theory is that people will try to reduce the gap between their actual and ideal affect by participating in specific mood producing activities aligned with their ideal affect. For instance, those who ideally want to feel HAP states, such as excitement and enthusiasm, are more likely to engage in challenging physical activities or use mood enhancing drugs than someone who values LAP states (Tsai et al., 2007, as cited in Tsai, 2007). In addition, this preference for HAP states may explain higher rates of stimulant drug abuse such as cocaine in America compared to those in China (United Nations Office for Drug and Crime, 2006). Thus, further research on affect valuation theory may extend to various domains, including work policy and rehabilitation practices.

Overview and Predictions

Reflecting findings from the existing literature, we expected that, for both the European American sample and the Filipinx American sample, ideal affect would differ from actual affect, replicating Tsai et al. (2006). Specifically, we predicted that ideal positive affect (PA) would be higher than actual PA, and ideal negative affect would be lower than actual negative affect.

Replicating past research, we expected European Americans to show an overall preference for HAP over LAP, and that European Americans would prefer HAP more than Filipinx Americans. Finally, Filipinx values can be classically characterized as being more on the collectivistic side. Yet, the religious preferences produced by centuries of colonization could have a lasting impact on ideal affect. Thus, we predicted that Filipinx Americans would prefer the LAP affective state more than European Americans. Additionally, we predicted that Filipinx Americans would prefer HAP states equally to LAP states.

Method

Participants

Approval to work with human participants was obtained through the Western Washington University Institutional Review Board before recruitment of participants. One hundred eighty undergraduate students participated in the study (106 Filipinx American and 74 European American). European American students were recruited through this university’s psychology human subjects pool in exchange for course participation credit. The subject pool consisted of students taking introductory level psychology courses. The sample of

FALL 2024

Filipinx Americans were part of a larger study, where eligible Filipinx Americans were compensated with a $10 Amazon gift card for completion of an online survey. Recruitment for the Filipinx American sample was done via word of mouth, social media outreach, and email correspondence with administrators of local Filipinx organizations. Table 1 shows the sample characteristics. In the Filipinx American sample, 72% of respondents identified as women, 23% identified as men, and 5% identified as nonbinary or did not provide their gender. In the European American sample, 73% of respondents identified as women, 16% identified as men, and 11% identified as nonbinary or did not provide their gender. The Filipinx American sample (n = 106) was larger than the European American sample (n = 74). The Filipinx American sample was also slightly older than the European American sample, t(150) = 9.59, p < .001, possibly due to the sampling procedure for our European American group.

Measures

We utilized the Affect Valuation Index (Tsai et al., 2006). This measure included items used to assess actual and ideal affect. Responses to the Affect Valuation Index have been shown to correspond to real­world behaviors, such as the hiring of job applicants (Bencharit et al., 2019) and making monetary donations (Park et al., 2020).

To measure actual affect, participants rated a list of 25 emotion words (e.g., enthusiastic) on how much they typically felt the emotion on average, using a scale of 1 (very slightly or not at all) to 5 (extremely or all of the time). Participants were also given an identical list of 25 emotion words to assess their ideal affect. Participants rated how they ideally would like to feel each emotion

Note. HAP = High Arousal Positive Affect; PA = Positive Affect; LAP = Low Arousal Positive Affect; LA = Low Arousal; LAN = Low Arousal Negative Affect; NA = Negative Affect; HAN = High Arousal Negative Affect; HA = High Arousal. Casidsid, Peruel, Alonso, and Scollon | Filipinx American

on average, using the same scale of 1 (very slightly or not at all) to 5 (extremely or all of the time). The items, and the order of these items, remained the same for both measures. Scores on sub­octants were computed for both actual and ideal affect consisting of: high­arousal positive (HAP), positive (PA), low­arousal positive (LAP), low arousal (LA), low­arousal negative (LAN), negative (NA), high­arousal negative (HAN), and high arousal (HA).

Table 2 shows the means and standard deviations for each ideal and actual affect sub­octant from the entire study population, the Filipinx American sample, and the European American sample. Table 3 displays the reliability coefficients for each subscale and the correlations between ideal and actual affect. Scores were aggregated between each scale, then ipsatized to account for individual cultural differences. We ipsatized participants’ ideal affect scores by computing Z­scores for each participant’s response to each ideal affect item using the respective participant’s ideal affect mean and standard deviation, in effect removing between­person variance. The same was done for each actual affect item. Some participants were not included in the total sample size, due to incomplete responses or giving uniform answers to each question. Finally, attention check questions were included in the survey, to which all participants responded correctly.

Results

Overall, the data from this study did not support our predictions of a difference between the ideal affect profiles of Filipinx Americans and European Americans. However, the data did support our prediction that Filipinx Americans would equally prefer HAP states to LAP states.

TABLE 2
Means and Standard Deviations for Ideal and Actual Affect Octants

Ideal Versus Actual Affect

We ran a series of pairwise t tests to determine if ideal affect differed from actual affect (one for each octant), as shown in Table 4. For example, we compared ideal HAP to actual HAP, and ideal LAP to actual LAP. Tsai’s Affect Valuation Theory predicts that ideal affect and actual affect will differ, and we found this to be true in 6 out of 8 octants. Participants experienced less PA, HAP, and LAP than they ideally wanted to feel, all ts (179) > 15,

TABLE 3

Internal Consistency of Subscales and Correlations

(HAP)

Positive Affect (PA) Happy, satisfied, content

Low arousal positive (LAP) Calm, at rest, relaxed, peaceful (serene)

Low arousal (LA) Quiet, still, passive

Low arousal negative (LAN) Dull, sleepy, sluggish

Negative Sad, lonely, unhappy

High arousal negative (HAN) Fearful, hostile, nervous

High arousal Aroused, surprised, astonished

Note.* p < .05. ** p < .01.

Note. HAP = High Arousal Positive Affect; PA = Positive Affect; LAP = Low Arousal Positive Affect; LA = Low Arousal; LAN = Low Arousal Negative Affect; NA = Negative Affect; HAN = High Arousal Negative Affect; HA = High Arousal.

all ps < .001, all Cohen’s ds > 0.80. Similarly, participants also experienced more negative affect, HAN, and LAN than they ideally wanted to feel, all ts (179) > 14, all ps < .001, all Cohen’s ds > 0.50. There was no significant difference between ideal low arousal and actual low arousal, t(179) = 0.94, p = .20, Cohen’s d = 0.10, nor was there a significant difference between ideal high arousal and actual high arousal, t(179) = 6.89, p = .24, Cohen’s d = 0.11.

In an effort to make a comparison to past research, we conducted an identical analysis to Tsai et al. (2006). We performed a 2 (sample: Filipinx American vs. European American) x 2 (Ideal Affect: HAP vs. LAP) repeated­measures analysis of covariance (ANCOVA) on Ideal Affect ratings, controlling for actual HAP and actual LAP. The analysis was conducted on the ipsatized ideal affect ratings. We were primarily interested in whether there was an Ideal Affect x Sample interaction, as Tsai reported in her study comparing European Americans and East Asians (Tsai et al., 2006). In contrast to what was found with East Asian samples, we did not find a significant Ideal Affect x Sample interaction, F(1, 176) = 0.022, p = .88, η2p = .00, meaning the ideal affect profiles of the Filipinx American participants were on average nearly identical to the European American profiles (see Table 5). To help interpret this finding, we plotted the non­ipsatized means by sample and octant in Figure 1. As shown in Figure 1, Filipinx Americans and European Americans in our sample were nearly identical in their ideal affect profiles.

Lastly, using a two­tailed paired­sample t test, we examined if ideal HAP and ideal LAP differed for the Filipinx Americans and European Americans separately. Results revealed that ideal HAP and ideal LAP did not differ in the Filipinx American sample, t(105) = 0.58, p = .57, Cohen’s d = 0.06, nor in the European American sample, t(73) = 0.21, p = .83, Cohen’s d = 0.03. In other words, both groups equally preferred HAP and LAP states.

Discussion

In this study, we found evidence in support of our first hypothesis, which predicted that ideal affect would differ from actual affect, replicating Tsai et al. (2006). Specifically, our analyses revealed that ideal affect differed from actual affect in 6 out of the 8 affective octants.

In our study, participants felt fewer positive emotions than they ideally wanted to feel, and felt more negative emotions than they ideally wanted to feel, similar to what was found in previous studies examining affect valuation (Tsai et al., 2006).

Ideal Affect in Filipinx American and European American Cultures

We predicted that Filipinx Americans would prefer

FIGURE1
Filipinx Ideal Affect Vs. European American Ideal Affect
Filipinx American European American

Casidsid, Peruel, Alonso, and Scollon | Filipinx American Ideal Affect

HAP states equally to LAP states, given the prevalence of Catholicism in the Filipinx American population. Filipinx values are widely considered to be collectivistic, which would theoretically lead Filipinx Americans to value LAP states over HAP states (Tsai et al., 2007c). However, we suspected that the impacts of Spanish colonialism, specifically the transmission of the Catholic religion, would lead to an equal valuing of HAP states to LAP states, because Christian cultures have been found to endorse HAP states more often (Tsai et al, 2007b). These data did support our hypothesis, yielding some support for this claim.

Furthermore, given the pervasiveness of Christian values in American culture, we predicted that European Americans would prefer HAP more than Filipinx Americans. Additionally, considering the traditionally collectivistic values found in the Filipinx culture, we suspected that Filipinx Americans would prefer LAP more than European Americans. However, our data did not support these hypotheses. Instead, Filipinx Americans and European Americans showed nearly identical ideal affective profiles. This may be because 95 out of 106 Filipinx American respondents reported growing up in a Catholic household, prompting lower valuing of LAP states.

In conclusion, our findings lend support to the idea of actual affect (the emotions actually experienced) and ideal affect (the desired emotions) being distinct constructs. However, our sample varied from past research, which suggested that a culture whose values are predominantly collectivistic would tend to prefer LAP over HAP (Tsai et al., 2006). Instead, the ideal affective profiles for our European American sample and our Filipinx American sample were nearly identical, in that both groups equally preferred LAP and HAP states. This suggests that, compared to one’s cultural values of independence versus interdependence, one’s religion may be an equally strong, if not stronger, driver of ideal affect preferences.

These results also hold many potential implications for how Filipinx Americans behave. As previously mentioned, existing research on affect valuation has demonstrated that people will act in ways that will bring them closer to their ideal emotional state, such as engaging in different types of physical activity (Tsai et al., 2007, as cited in Tsai, 2007). We found that our sample of Filipinx Americans does value HAP states, suggesting that Filipinx Americans will also prefer to engage in activities that will evoke HAP. Furthermore, the ideal affect preferences of Filipinx Americans could have employment­related consequences, as previous studies have suggested that job applicants who express emotions that align with employers’ ideal affect preferences are

more likely to be hired (Bencharit et al., 2019). Our finding that Filipinx Americans equally value HAP and LAP states could mean that Filipinx American employers may equally prefer candidates who express enthusiasm and other similar emotions, as well as candidates who express low arousal emotions like calmness. Similarly, Park et al. (2020) found that ideal affect preferences impact how likely people are to donate money to others, as participants in their study were likely to donate more money to individuals on a donation website when their profiles showed facial expressions that matched participants’ ideal affective state. Because Filipinx Americans appear to value both HAP and LAP states equally, they may be equally likely to donate to individuals who express HAP and LAP emotions.

The ideal affect preferences of Filipinx Americans

TABLE 4

Results of Paired-Samples t Tests Comparing Ideal Affect and Actual Affect

TABLE 5

Results of 2 (Sample: Filipinx American vs. European American) x 2 (Ideal Affect: HAP vs. LAP) Repeated-Measures ANCOVA Controlling for Actual HAP and Actual LAP

Note. HAP = High Arousal Positive Affect; LAP

may also have some practical consequences when it comes to the types of media that children from this population are shown. Tsai et al. (2007a) found that the most popular children’s books in the United States were more likely to have characters who expressed excitement, whereas characters from the most popular children’s books in Taiwan were more likely to have calm expressions. The results from our study suggest that children’s media popular among Filipinx Americans may have an equal representation of characters expressing HAP and LAP states.

Although this study was the first to examine the affective valuation of Filipinx Americans, it contains limitations that could potentially be addressed in future studies. One limitation of our study is that our analyses did not include demographic characteristics other than ethnicity, such as age or immigrant generation. By not considering these other aspects of participants’ identities, we were unable to observe potential relationships between those traits and participants’ affective experiences. This is especially pertinent based on the current study’s results, as it seems that, in our sample of Filipinx Americans, religious preference might have driven affective preferences just as much as ethnic background. To that end, we could not see how unique combinations of identities could potentially be related to different affective preferences and experiences, even within the same ethnic group. For instance, younger Filipinx Americans who are second ­ generation immigrants may have different affective preferences to similarly aged Filipinx Americans who are first ­ generation immigrants. Future studies can address this issue by including such demographic factors, in addition to ethnicity, in their analyses.

Another limitation was our measurement of religion. In our study, there was no in­depth look into participants’ religiosity, as participants simply reported which religions they practice and which religions they were raised in. Future research on the effects of religion on affect valuation may seek to further operationalize religion by using more specific survey items that identify participants’ religious practices or identification with religious values. By doing this, we can have a stronger understanding of the relationship between religion and affect valuation.

All in all, these surprising findings illustrate the need to conduct further research on this unique yet under­researched population. In the field of affective research, future studies may explore the Filipinx American affective experience in comparison with other Asian populations, such as other Southeast Asians and East Asians, to further tease out the effects culture has on emotion on a narrower scale. Likewise, future

studies may compare the affective profile of Filipinx Americans to that of other populations impacted by Western colonization, such as Indigenous Americans. With further studies, we can add the voices and narratives of this under­researched population into the broader psychological literature, thereby improving the understanding of affect across cultures.

References

Bencharit, L. Z., Ho, Y. W., Fung, H. H., Yeung, D. Y., Stephens, N. M., RomeroCanyas, R., & Tsai, J. L. (2019). Should job applicants be excited or calm?

The role of culture and ideal affect in employment settings. Emotion, 19(3), 377–401. https://doi.org/10.1037/emo0000444

David, E. J. R. (2013). Brown skin, White minds: Filipino -/ American postcolonial psychology (NA). Information Age Publishing.

Eid, M., & Diener, E. (2001). Norms for experiencing emotions in different cultures: Inter-and intranational differences. Journal of Personality and Social Psychology, 81(5), 869–885. https://doi.org/10.1037/0022-3514.81.5.869

Fuligni, A. J., & Pedersen, S. (2002). Family obligation and the transition to young adulthood. Developmental Psychology, 38(5), 856. https://doi.org/10.1037/0012-1649.38.5.856

Jasso, G., Massey, D. S., Rosenzweig, M. R., & Smith, J. P. (2003). Exploring the religious preferences of recent immigrants to the United States: Evidence from the New Immigrant Survey Pilot. In Y. Y. Haddad, J. I. Smith, & J. L. Esposito (Eds.), Religion and immigration: Christian, Jewish, and Muslim experiences in the United States (pp. 217–253). AltaMira Press.

Mesquita, B., Frijda, N. H., & Scherer, K. (1997). Culture and emotion. In J. W. Berry, P. R. Dasen, & T. S. Saraswathi (Eds.), Handbook of cross-cultural psychology (2nd ed., Vol. 2, pp. 255–297).

Park, B., Genevsky, A., Knutson, B., & Tsai, J. (2020). Culturally valued facial expressions enhance loan request success. Emotion, 20(7), 1137–1153. https://doi.org/10.1037/emo0000642

Paulhus, D. L., Westlake, B. G., Calvez, S. S., & Harms, P. D. (2013). Self-presentation style in job interviews: The role of personality and culture. Journal of Applied Social Psychology, 43 2042–2059. https://doi.org/10.1111/jasp.12157

Pew Research Center. (2012). Asian Americans: A mosaic of faith. https://www.pewresearch.org/religion/2012/07/19/asian-americans-amosaic-of-faiths-overview/

Tamir, M., Schwartz, S. H., Cieciuch, J., Riediger, M., Torres, C., Scollon, C., Dzokoto, V., Zhou, X., & Vishkin, A. (2016). Desired emotions across cultures: A valuebased account. Journal of Personality and Social Psychology, 111(1), 67. https://doi.org/10.1037/pspp0000072

Tsai, J. L. (2007). Ideal affect: Cultural causes and behavioral consequences. Perspectives on Psychological Science, 2(3), 242–259. https://doi.org/10.1111/j.1745-6916.2007.00043.x

Tsai, J. L., Knutson, B., & Fung, H. H. (2006). Cultural variation in affect valuation. Journal of Personality and Social Psychology, 90(2), 288–307. https://doi.org/10.1037/0022-3514.90.2.288

Tsai, J. L., Louie, J. Y., Chen, E. E., & Uchida, Y. (2007a). Learning what feelings to desire: Socialization of ideal affect through children’s storybooks. Personality and Social Psychology Bulletin, 33(1), 17–30. https://doi.org/10.1177/0146167206292749

Tsai, J. L., Miao, F. F., & Seppala, E. (2007b). Good feelings in Christianity and Buddhism: Religious differences in ideal affect. Personality and Social Psychology Bulletin, 33(3), 409–421. https://doi.org/10.1177/0146167206296107

Tsai, J. L., Miao, F. F., Seppala, E., Fung, H. H., & Yeung, D. Y. (2007c). Influence and adjustment goals: Sources of cultural differences in ideal affect. Journal of Personality and Social Psychology, 92(6), 1102–1117. https://doi.org/10.1037/0022-3514.92.6.1102

United Nations Office for Drug Control and Crime Prevention Staff. (2006). 2006 World Drug Report: Vol. 2.: Statistics. United Nations Publications. Wierzbicka, A. (1994). Emotion, language, and cultural scripts. In S. Kitayama & H. Markus (Eds.), Emotion and culture: Empirical studies of mutual influence (pp. 133–196). https://doi.org/10.1037/10152-004

Wolf, E. B., Lee, J. J., Sah, S., & Brooks, A. W. (2016). Managing perceptions of distress at work: Reframing emotion as passion. Organizational Behavior and Human Decision Processes, 137, 1–12. http://dx.doi.org/10.1016/j.obhdp.2016.07.003

FALL 2024 PSI CHI JOURNAL OF PSYCHOLOGICAL

Author Note

This research was conducted by three Filipinx­Americans who were born and raised in the West Coast region of the United States. We acknowledge our standpoint as members of the Filipinx diaspora who have primarily been educated within a Western epistemology. As members of our local Filipinx American communities, we have made the decision to use the term “Filipinx” instead of “Filipino" in this article based on our experiences interacting

within these communities, keeping with local norms of inclusivity. However, we acknowledge the discourse surrounding the usage of these two different terms, including the colonial background of “Filipinx,” and recognize that there are different contexts in which either term could be appropriate. As researchers and members of the diaspora, we value the usage of either term. Correspondence concerning this article should be addressed to Christie Napa Scollon. Email: christie.scollon@wwu.eduReferences

Casidsid, Peruel, Alonso, and Scollon | Filipinx American Ideal Affect

Loneliness Rates Among Undergraduates According to the National College Health Assessment From 2008 to 2019

Eunji Shin1, Khanh Bui*1, and Joshua H. Park2

1Social Science Division, Pepperdine University

2Natural Science Division, Pepperdine University

ABSTRACT. The present study documented undergraduate loneliness rates from fall 2008 to spring 2019. Participants consisted of undergraduates who completed the National College Health Assessment II (NCHA II) during this time period. The NCHA II assessed loneliness by having students self­identify if they had felt “very lonely” within the last 12 months. We found that 54.90% to 67.40% of undergraduates self­identified as feeling “very lonely” during these survey periods. Results indicated that most undergraduates experienced loneliness, and undergraduate loneliness rates had been increasing, even after controlling for gender, race, response rate, residential status (domestic versus international), public versus private, school type (two­year versus four­year), and school size (< 5,000, 5,000–20,000, and > 20,000).

Keywords: loneliness, undergraduates, national assessment, cross ­ temporal data, counseling

Loneliness—also referred to as perceived social isolation—is the aversive perception of a discrepancy between one’s desired and actual social relationships in either quantity or quality (Hawkley & Capitanio, 2014; Peplau & Perlman, 1982). Due to its subjective nature, people can experience loneliness despite being in the company of others (House et al., 1988; Matthews et al., 2017; Pinquart & Sorensen, 2001; Stoliker & Lafreniere, 2015). One’s experience of loneliness may be influenced by factors such as frequency of social interactions, physical proximity to others, level of social support, and level of disconnectedness from one’s social networks (Bell & Gonzalez, 1988; Cacioppo & Hawkley, 2009; Hudson et al., 2000; Wright et al., 2013). Although loneliness can occur among any age group, CIGNA (2018) reported that Generation Z has the highest loneliness rate among five generations (Generation Z, millennials, Generation X, Baby Boomers, and the Greatest Generation).

Among Generation Z, loneliness may be particularly prevalent among college students (Cutrona, 1982; Ponzetti, 1990), potentially stemming from the numerous stressors experienced by adolescents transitioning

into emerging adulthood (ages 18–29) as they navigate new social contexts (Qualter et al., 2015). This heightened susceptibility to loneliness warrants immediate concern, as loneliness is significantly correlated with negative health consequences such as impaired sleep quality (Matthews et al., 2017); hazardous lifestyle choices, such as binge drinking, drug abuse, and overeating (Hoover et al., 1979; Knox et al., 2007; Sherry et al., 2012); and increased risk of depression and suicide (Hoover et al., 1979; Matthews et al., 2017; Van Orden et al., 2008; Weber et al., 1997; Westefeld & Furr, 1987). To our awareness, only two cross­temporal studies have examined U.S. undergraduate loneliness rates. In a meta ­ analysis, Clark et al. (2014) found that loneliness in both high schoolers and undergraduates slightly declined between 1978 and 2012. In the other study, Buecker et al. (2021) found a modest increase in loneliness among emerging adults from 1976 to 2019. One possible explanation for Clark et al. (2014) and Buecker et al.’s (2021) discrepant findings may be that they did not examine identical data sources, ranges of years, and age groups (Buecker et al., 2021). For instance, Clark et al. (2014) included data from high school students who completed Monitoring the Future

FALL

surveys (MtF), whereas Buecker et al. (2021) neither included high school students nor examined data from MtF. In the present study, we attempted to reconcile these contradictory findings by using data from the American College Health Association’s (ACHA) National College Health Assessment II (NCHA II). This assessment has health data from 2000 to the present from students from over 1,100 public, private, two­year, and four­year colleges or universities. For the purposes of this study, we specifically examined loneliness data collected from 2008 to 2019 (ACHA, n.d.). The NCHA first assessed loneliness in 2008 using a single item; however, since 2019, the NCHA has assessed loneliness using a different measure. Thus, the longest time span that was available to examine loneliness trends among undergraduates was from 2008 to 2019.

In examining the correlation between time and loneliness rates, it is important to consider whether this relation is associated with changes in the population of interest or changes in the composition of the sample. For instance, it is possible that the samples skewed more female over time, and women might have reported experiencing more loneliness than men (Borys & Perlman, 1985; Nicolaisen & Thorsen, 2024). As another example, the population of international students might have increased as a result of the growing diversity of college campuses. This demographic shift could contribute to an increase in loneliness rate as international students may feel lonely adjusting to an unfamiliar environment (Sherry et al., 2010). Other possible conflating variables include race (Diehl et al., 2018; Taylor & Nguyen, 2020), response rate (Fosnacht et al., 2017; Perneger et al., 2014; Rindfuss et al., 2015), public versus private (Ketchen Lipson et al., 2014), school type (two­year versus four­year), and school size (Ketchen Lipson et al., 2014). Thus, we examined the correlations between time and loneliness rates while taking into account these potentially conflating variables. By accounting for these factors, we aimed to provide a more nuanced understanding of the trends in undergraduate loneliness rates over time. Given the limited prior research on this specific time frame and population, our approach was not hypothesis ­ driven. The primary goal of the present study was to document loneliness rates among undergraduates in the United States from 2008 to 2019 according to data from the NCHA II. A secondary goal was to test whether we would also see Clark et al.’s (2014) finding of a weak decrease in loneliness from 1978 to 2012 when the range of years was restricted to 2008 to 2012, and whether we would see Buecker et al.’s (2021) finding of a weak increase in loneliness from 1976 to 2019.

Method

Data

To assess loneliness rates in undergraduates from 2008 to 2019, we conducted a secondary analysis of the NCHA II. Like other versions of the NCHA, the NCHA II is a comprehensive, nationally representative survey that covers a broad range of mental and physical health issues among college students in the United States (Lederer & Hoban, 2022). The NCHA has demonstrated past reliability and validity with its data through systematic evaluation and comparison with other nationally representative data sets, including the National College Health Risk Behavior Survey (Douglas et al., 1997) and the College Alcohol Study (Lee et al., 2000).

The NCHA has been administered during the fall and spring semesters at postsecondary institutions that choose to participate. The NCHA has provided data only from schools that used random selection (by student or classroom) to administer the survey. Some institutions offered incentives to students for completing the survey, whereas others did not. The NCHA was administered only on paper until 2003, when the NCHA­Web version first became available. The format of administration of the NCHA (i.e., paper or web) was left to each institution’s discretion.

Data from the NCHA II range from fall 2008 to spring 2019 (ACHA, n.d.). However, because the ACHA did not publish findings on undergraduates separate from graduate students until spring 2011, we requested undergraduate demographic and loneliness data using the NCHA Data Request Form for survey periods prior to spring 2011. For survey periods from spring 2011 to spring 2019, we extracted undergraduate demographic and loneliness rates from the ACHA’s published reports. These data are publicly available and anonymous; thus, we received exemption from Pepperdine University’s IRB for our study.

Sample

From fall 2008 to spring 2019, undergraduates from 1,532 American colleges/universities participated in ACHA­NCHA II. Approximately 92% of respondents were 18–29 years old, and 65% were women. The racial and ethnic breakdown was approximately 70% White, 12.40% Asian or Pacific Islander, 11% Hispanic or Latino/a, and 6.50% Black or African American. Other groups included approximately 4% Biracial or Multiracial, 2.75% Other, and 2% American Indian or Alaskan Native.

Instrument

The NCHA II measured loneliness by asking students if they had felt “very lonely” in the last 2 weeks, in the last 30 days, and in the last 12 months. The NCHA II categorized and reported the percentage of students who Shin, Bui, and Park

answered in the affirmative to any of the three questions as being lonely within the last 12 months. We used these reported (collapsed) percentages in our analyses.

Coding for Survey Period

Survey period consisted of the academic term (fall, spring, or summer) and the calendar year (e.g., 2012). We coded the survey period with a linear step value of 1 for each subsequent survey period. Thus, the coding of the variable survey period was 1 = fall 2008, 2 = spring 2009, 3 = summer 2009, . . ., and 32 = spring 2019. Because the ACHA does not administer the NCHA during the summer academic terms, we did not have loneliness rates for summer academic terms.

Analytical Procedures

We used SPSS Version 25 to conduct statistical analyses. For data from fall 2008 to spring 2019, we computed the Pearson correlation coefficient for the relationship between survey period and the percentage of students

who self­identified as being “very lonely” in the last 12 months. Our decision to focus on the 12 ­ month prevalence of loneliness was informed by the guidelines outlined by the National Institute of Mental Health (n.d.). Although point prevalence measures (i.e., last 2 weeks and last 30 days) provide valuable information, the 12­month period prevalence best reflects both transient and persistent experiences of loneliness throughout the past year.

Each data collection was done randomly; therefore, it is possible that some students completed more than one survey. To account for this possibility, instead of using α = .05, we used α = .01. The more stringent α level of .01 compensates for artificially small standard errors if some students completed the NCHA in multiple survey periods.

Results

Loneliness Rates

As shown in Table 1 and Figure 1, undergraduate

Percent of Undergraduates Who Self-Identified as Feeling "Very Lonely" in the Last 12 Months From Fall 2008 to Spring 2019

Note. 1–5, 11,13 M.T. Hoban (personal communication, August 20, 2021). 6–10, 12, 14–22 Data come from ACHA-NCH.

* Response rates come from full reports of web survey administration only (per M.T Hoban's advice, personal communication, February 2, 2024)

TABLE 1

loneliness rates were the lowest at 54.90% in fall 2010 and the highest at 67.40% in spring 2019. We found a strong positive correlation between survey period and loneliness rate (percentage of students who self­identified as being “very lonely” in the last 12 months) between fall 2008 and spring 2019, r(20) = .80, p < .001.

As previously noted, we considered whether changes in loneliness rates were due to shifts in the population or sample composition. Our analyses examined the correlations between loneliness rates and the following potentially conflating variables: gender, race, response rate, residential status (domestic versus international), public versus private, school type (two­year versus four­year), and school size. For these variables, we entered the percentages for the category with the largest average across the 22 surveys (see Table 1).

The mean percentage of students experiencing loneliness was notably high (M = 60.32%, SD = 3.18%; see Table 2). Loneliness rate showed the strongest correlation with survey period (time), r (13) = .80, p < .001. In addition to time, the percentage of domestic students was also strongly correlated with loneliness rate, r(13) = .79, p < .01. The percentage of domestic students was also strongly correlated with time, r (13) = .80,

p < .001, suggesting that the number of domestic students taking the survey has been increasing. However, even when controlling for the percentage of domestic students and the other possibly conflating variables, the partial correlation between loneliness rate and survey period remained highly significant, r(13) = .66, p = .004.

In addition to the partial correlation, one can control for the possibly conflating variables by running a hierarchical (sequential) regression with these variables entered in the first block as control variables and then entering the main variable of interest, which was survey period, in the second block. When we did this, the hierarchical regression with just the control variables identified above resulted in an R2 of .73 [F(7, 14) = 5.30, p = .004]. When we next entered survey period, R2 was .85 [F(8, 13) = 8.90, p < .001], which was an R2 change of .12. This change was significant, F(1, 13) = 10.42, p = .007 (see Table 3).

Regardless of which statistical procedure was used, we arrived at the same conclusion: even after controlling for gender, race, response rate, residential status (domestic versus international), public versus private, school type (two­year versus four­year), and school size, survey period still accounts for a significant amount of the variance in

Percent of Undergraduates Who Self-Identified as Feeling

in the Past 12 Months From Fall 2008 to Spring 2019

FIGURE 1
“Very Lonely”

Loneliness Among Undergraduates | Shin, Bui, and Park

loneliness rate. In other words, the positive relationship between survey period and loneliness rate remained.

Reconciling Findings

of Buecker et al. (2021) and Clark et al. (2014)

Consistent with Buecker et al.’s (2021) finding of an increase in loneliness rates from 1976 to 2019, we found an increase in loneliness rates from 2008 to 2019. Whereas their analyses were with emerging adults (ages 18–29), our analyses were with undergraduates.

TABLE 2

Descriptive Statistics and Zero-Order Correlations.

1.

2.

3.

4.

5.

6.

7.

8.

9. Percent Midsize

Note. Number of Survey Periods: 22 * p < .05. ** p <

Adjusted R Squared

Note. Number of Survey Periods: 22

Undergraduates could be over the age of 29, but almost all undergraduates in our sample were 18–29 years old.

In addition, we examined if we would observe Clark et al.’s (2014) finding of a small decrease in loneliness among college students from 1978 to 2012 for NCHA loneliness data from 2008 to 2012. We found a weak negative correlation, r(7) = ­.34, p = .37. This correlation, however, was not statistically significant.

Discussion

Findings on national loneliness rates among undergraduates are rare (Clark et al., 2014). To address this gap in the literature, we documented loneliness rates from 2008 to 2019 among undergraduates in the United States. We found that most undergraduates in the United States are lonely, supporting previous research claims (e.g., Diehl et al., 2018). Furthermore, our findings did not corroborate Clark et al.’s (2014) finding that undergraduate loneliness rates slightly declined from 2008 to 2012; instead, our findings indicated a general, incremental increase in loneliness rates from 2008 to 2019, supporting Buecker et al.’s (2021) finding that loneliness rates among emerging adults are increasing.

Regarding how demographic changes might have influenced loneliness rates, the negative correlation between response rate and survey period suggests that, as time progressed, fewer students participated in the survey. This finding could indicate a range of possible reasons, such as survey fatigue or declining engagement with surveys, which, in turn, could affect loneliness rates due to a smaller pool of survey respondents. On the other hand, the positive correlation between the percentage of domestic students and survey period indicates that, as time progressed, the number of domestic students increased. This demographic shift could reflect changes in university admissions policies, fluctuations in international student numbers due to geopolitical factors, or shifts in the rates at which the domestic population goes to college. An increase in domestic students could, in various ways, impact the social dynamics on campus, potentially contributing to feelings of loneliness—especially if they lead to a sense of cultural or social homogeneity. However, our analyses also suggest that survey period is still a strong predictor of loneliness, even after controlling for these variables. Although demographic changes may certainly play a role, they do not seem to fully account for the increase in loneliness.

Limitations

One limitation is the inability to distinguish between the percentage of participants who completed the survey on paper versus those who completed it online, as the mode

of survey administration can influence responses (Sax et al., 2008). In the present study, we only have response rate data for participants who completed the web survey, which limits our ability to fully understand how survey platform might have affected our responses. Despite this limitation, most students completed the survey online, and response rates for the web survey were also higher than for the paper survey; thus, it was recommended by the ACHA’s Chief Research Officer to include data only from those who completed the web survey (M.T. Hoban, personal communication, February 2, 2024). Additionally, the correlation between loneliness rate and survey period remained strong even when response rate was controlled for, highlighting that it is unlikely to be influenced solely by mode of survey completion.

Another limitation is that loneliness was measured using a single item. In addition, we could not assess test­retest reliability because of the absence of repeated measures for all participants. Nonetheless, it is important to recognize the subjective nature of loneliness, which the single item measures directly by asking respondents to reflect on their personal feelings of loneliness. The use of this direct approach is supported by previous research indicating that single­item measures of loneliness—although lacking the depth and dimensionality of multi­item measures—can still effectively capture the construct (Mund et al., 2022).

Moreover, the single item does not differentiate between transient and persistent feelings of loneliness over the past 12 months. This distinction is crucial, as previous research suggests that the frequency and duration with which loneliness is experienced is critical in understanding its potential negative consequences (Martín­María, 2020). However, the single­item measure used in our study effectively captures the prevalence of loneliness among undergraduates, which was our primary objective. This foundation paves the way for more nuanced future investigations. We advocate for future studies—whether correlational or experimental—to delve deeper into the frequency and persistence of loneliness. Such research is crucial for expanding understanding of the complex relationship between loneliness and its psychological impact.

Additionally, our results might have been affected by nonresponse bias due to low response rates averaging about 13% (Wu et al., 2022). Although it is true that a low response rate can bias results if there are significant differences in response rate between respondents and nonrespondents on the variables of interest, researchers have found that greater survey participation only minimally impacts survey results and data quality (Fosnacht et al., 2017; Perneger et al., 2014; Rindfuss et al., 2015). Additionally, a high rate of nonresponse only increases

the potential for bias; it does not conclusively bias results (Massey & Tourangeau, 2013). Indeed, Fosnacht et al. (2017) found that most surveys with low response rates of even 5% to 10% were reliable, provided the administration included at least 500 students, a criterion that our study far exceeded.

Furthermore, although the NCHA provides national data from a large number of students, it is subject to self­selection bias. Students at participating schools were able to choose whether to participate or not. Self­selection prevents a sample from being representative of a population and, therefore, generalizable (Heckman, 2010). Individuals of certain demographics (e.g., female, higher socioeconomic status, White) are more likely to participate in survey research than individuals of other demographics (Goyder et al., 2002; Jang & Vorderstrasse, 2019; Smith, 2008). Data from the NCHA support this finding. In the NCHA II, female students made up an average of 65.59% of undergraduate participants. However, the National Center for Education Statistics (NCES) reports that female students actually made up around 58% of undergraduates between 2009 and 2019 (COE - Undergraduate Enrollment, 2021). In addition, White students made up an average of 70% of undergraduate participants in the NCHA II. However, according to the 2018 United States Census Bureau and the NCES, White students made up just over 50% of undergraduates in 2017 (US Census Bureau, 2018).

Directions for Future Research

One direction for future research is to investigate loneliness rates by different social categories (e.g., race, gender identity, income). As previously noted, loneliness rates and survey participation may vary significantly across demographics. Averaging rates across individuals from diverse demographic backgrounds may obscure important nuances and variations in the data (Speelman & McGann, 2016).

A second direction for future research is to take an intersectional approach when examining loneliness among college students. “Intersectionality” refers to an interdisciplinary analytical paradigm often used to examine individuals’ experiences through the lens of intersecting, systematically oppressed identities in diverse contexts (Cole, 2009). Utilizing this paradigm can help illuminate the unique challenges faced by minoritized individuals (Robards et al., 2020). Existing research on minoritized undergraduate populations reveals that these groups often experience heightened levels of loneliness compared to other groups (Diehl et al., 2018). Moreover, a study by Elmer et al. (2022) examining loneliness rates among the LGBTQ+ found

that minoritization is closely associated with loneliness and that minority status contributes to cross­cultural loneliness. To increase awareness of how loneliness affects minoritized individuals and to more equitably address their social well ­ being needs, we strongly advocate for conducting research with minoritized communities using an intersectional framework.

A third direction for future research is to continue to examine loneliness rates cross ­ temporally while employing one consistent measure. Although the ACHA provides data on undergraduate loneliness from 2008 to 2023, the method for assessing loneliness changed in 2019 with the administration of the newest version of the NCHA (the NCHA III). Because this shift in measurement introduces a source of discontinuity in the data, we chose not to include data from the NCHA III. Furthermore, previous research (e.g., Conti et al., 2023) has found that the COVID pandemic had a profound influence on undergraduates’ experiences with loneliness. Thus, we recommend that future studies examine loneliness from many years prior to and many years following the COVID pandemic to account for the influence it may have had on undergraduate loneliness.

In sum, this study investigated loneliness rates among undergraduates in the United States from fall 2008 to spring 2019 using data from the ACHA’s NCHA­II. We found that (a) most undergraduates in the United States were lonely and (b) loneliness rates were increasing. A better understanding of loneliness rates can help inform practices aimed to prevent and combat loneliness and promote well­being among undergraduates.

References

American College Health Association. (n.d.). Publications and reports. https://www.acha.org/NCHA/ACHA-NCHA_Data/Publications_and_ Reports/NCHA/Data/Publications_and_Reports.aspx

Bell, R. A., & Gonzalez, M. C. (1988). Loneliness, negative life events, and the provisions of social relationships. Communication Quarterly, 36(1), 1–15. https://doi.org/10.1080/01463378809369703

Borys, S., & Perlman, D. (1985). Gender differences in loneliness. Personality and Social Psychology Bulletin, 11(1), 63–74. https://doi.org/10.1177/0146167285111006

Buecker, S., Mund, M., Chwastek, S., Sostmann, M., & Luhmann, M. (2021). Is loneliness in emerging adults increasing over time? A preregistered crosstemporal meta-analysis and systematic review. Psychological Bulletin, 147(8), 787–805. https://doi.org/10.1037/bul0000332

Cacioppo, J. T., & Hawkley, L. C. (2009). Perceived social isolation and cognition. Trends in Cognitive Sciences, 13(10), 447–454. https://doi.org/10.1016/j.tics.2009.06.005

Cigna. (2018, May). Cigna U.S. loneliness index: Survey of 20,000 Americans examining behaviors driving loneliness in the United States. https://www.multivu.com/players/English/8294451-cigna-us-lonelinesssurvey/docs/IndexReport_1524069371598-173525450.pdf

Clark, D. M. T., Loxton, N. J., & Tobin, S. J. (2014). Declining loneliness over time. Personality and Social Psychology Bulletin, 41(1), 78–89. https://doi.org/10.1177/0146167214557007

Cole, E. R. (2009). Intersectionality and research in psychology. American Psychologist, 64(3), 170–180. https://doi.org/10.1037/a0014564

Conti, C., Lanzara, R., Rosa, I., Müller, M. M., & Porcelli, P. (2023). Psychological correlates of perceived loneliness in college students before and during the COVID-19 stay-at-home period: A longitudinal study. BMC Psychology, 11(1). https://doi.org/10.1186/s40359-023-01099-1

Cutrona, C. E. (1982). Transition to college: Loneliness and the process of social adjustment. In L. A. Peplau & D. Perlman (Eds.), Loneliness: A sourcebook of current theory, research, and therapy (pp. 291–-309). John Wiley & Sons. Diehl, K., Jansen, C., Ishchanova, K., & Hilger-Kolb, J. (2018). Loneliness at universities: Determinants of emotional and social loneliness among students. International Journal of Environmental Research and Public Health, 15(9), 1865. https://doi.org/10.3390/ijerph15091865

Douglas, K. A., Collins, J. L., Warren, C., Kann, L., Gold, R., Clayton, S., Ross, J. G., & Kolbe, L. J. (1997). Results from the 1995 National College Health Risk Behavior Survey. Journal of American College Health, 46(2), 55–67. https://doi.org/10.1080/07448489709595589

Elmer, E. M., van Tilburg, T., & Fokkema, T. (2022). Minority stress and loneliness in a global sample of sexual minority adults: The roles of social anxiety, social inhibition, and community involvement. Archives of Sexual Behavior, 51, 2269–2298. https://doi.org/10.1007/s10508-021-02132-3

Fosnacht, K., Sarraf, S., Howe, E., & Peck, L. K. (2017). How important are high response rates for college surveys? The Review of Higher Education, 40(2), 245–265. https://doi.org/10.1353/rhe.2017.0003

Goyder, J., Warriner, K., & Miller, S. (2002). Evaluating socio-economic status (SES) bias in survey nonresponse. Journal of Official Statistics, 18(1), 1–12. Hawkley, L. C., & Capitanio, J. P. (2015). Perceived social isolation, evolutionary fitness and health outcomes: A lifespan approach. Philosophical Transactions of the Royal Society B: Biological Sciences 370(1669). https://doi.org/10.1098/rstb.2014.0114

Heckman, J. J. (2010). Selection bias and self-selection. Microeconometrics 242–266. https://doi.org/10.1057/9780230280816_29

Hoover, S., Skuja, A., & Cosper, J. (1979). Correlates of college students’ loneliness. Psychological Reports, 44(3_suppl), 1116–1116. https://doi.org/10.2466/pr0.1979.44.3c.1116

House, J., Landis, K., & Umberson, D. (1988). Social relationships and health. Science, 241(4865), 540–545. https://doi.org/10.1126/science.3399889

Hudson, D. B., Elek, S. M., & Campbell-Grossman, C. (2000). Depression, self-esteem, loneliness, and social support among adolescent mothers participating in the new parents project. Adolescence, 35(139), 445–453. Jang, M., & Vorderstrasse, A. (2019). Socioeconomic status and racial or ethnic differences in participation: Web-based survey. JMIR Research Protocols, 8(4), e11865. https://doi.org/10.2196/11865

Ketchen Lipson, S., Gaddis, S. M., Heinze, J., Beck, K., & Eisenberg, D. (2015). Variations in student mental health and treatment utilization across US colleges and universities. Journal of American College Health, 63(6), 388–396. https://doi.org/10.1080/07448481.2015.1040411

Knox, D., Vail-Smith, K., & Zusman, M. (2007). The lonely college male. International Journal of Men’s Health, 6(3), 273–279. https://doi.org/10.3149/jmh.0603.273

Lederer, A. M., & Hoban, M. T. (2022). The development of the American College Health Association-National College Health Assessment III: An improved tool to assess and enhance the health and well-being of college students. Journal of American College Health, 70(6), 1606–1610. https://doi.org/10.1080/07448481.2020.1834401

Matthews, T., Danese, A., Gregory, A. M., Caspi, A., Moffitt, T. E., & Arseneault, L. (2017). Sleeping with one eye open: Loneliness and sleep quality in young adults. Psychological Medicine, 47(12), 2177–2186. https://doi.org/10.1017/s0033291717000629

Martín-María, N., Caballero, F. F., Miret, M., Tyrovolas, S., Haro, J. M., AyusoMateos, J. L., & Chatterji, S. (2019). Differential impact of transient and chronic loneliness on health status. A longitudinal study. Psychology & Health, 35(2), 177–195. https://doi.org/10.1080/08870446.2019.1632312

Massey, D. S., & Tourangeau, R. (2012). Where do we go from here? Nonresponse and social measurement. The ANNALS of the American Academy of Political and Social Science, 645(1), 222–236. https://doi.org/10.1177/0002716212464191

Mund, M., Maes, M., Drewke, P. M., Gutzeit, A., Jaki, I., & Qualter, P. (2022). Would the real loneliness please stand up? the validity of loneliness scores and the reliability of single-item scores. Assessment, 107319112210772. https://doi.org/10.1177/10731911221077227

Mushtaq, R., Shoib, S., Shah, T., & Mushtaq, S. (2014). Relationship between loneliness, psychiatric disorders and physical health? A review on the psychological aspects of loneliness. Journal of Clinical and Diagnostic Research, 8(9). https://doi.org/10.7860/jcdr/2014/10077.4828

National Institute of Mental Health (NIMH). (n.d.). What is prevalence? https://www.nimh.nih.gov/health/statistics/what-is-prevalence

Nicolaisen, M., & Thorsen, K. (2024). Gender differences in loneliness over time:

FALL 2024
PSI CHI JOURNAL OF PSYCHOLOGICAL RESEARCH

A 15-year longitudinal study of men and women in the second part of life. International Journal of Aging & Human Development, 98(1), 103–132. https://doi.org/10.1177/00914150231194243

Peplau, L. A., & Perlman, D. (1982). Perspectives on loneliness. In L. A. Peplau & D. Perlman (Eds.), Loneliness: A sourcebook of current theory, research, and therapy (pp. 1–18). John Wiley & Sons.

Perneger, T. V., Courvoisier, D. S., Hudelson, P. M., & Gayet-Ageron, A. (2014). Sample size for pre-tests of questionnaires. Quality of Life Research, 24(1), 147–151. https://doi.org/10.1007/s11136-014-0752-2

Pinquart, M., & Sorensen, S. (2001). Influences on loneliness in older adults: A meta-analysis. Basic and Applied Social Psychology, 23(4), 245–266. https://doi.org/10.1207/s15324834basp2304_2

Ponzetti, J. J. (1990). Loneliness among college students. Family Relations, 39(3), 336–340. https://doi.org/10.2307/584881

Qualter, P., Vanhalst, J., Harris, R., Van Roekel, E., Lodder, G., Bangee, M., Maes, M., & Verhagen, M. (2015). Loneliness across the life span. Perspectives on Psychological Science, 10(2), 250–264. https://doi.org/10.1177/1745691615568999

Robards, F., Kang, M., Luscombe, G., Hawke, C., Sanci, L., Steinbeck, K., Zwi, K., Towns, S., & Usherwood, T. (2020). Intersectionality: Social marginalisation and self-reported health status in young people. International Journal of Environmental Research and Public Health, 17(21), 8104. https://doi.org/10.3390/ijerph17218104

Rindfuss, R. R., Choe, M. K., Tsuya, N. O., Bumpass, L. L., & Tamaki, E. (2015). Do low survey response rates bias results? Evidence from Japan. Demographic Research, 32(26), 797–828. https://doi.org/10.4054/demres.2015.32.26

Sax, L. J., Gilmartin, S. K., Lee, J. J., & Hagedorn, L. S. (2008). Using web surveys to reach community college students: An analysis of response rates and response bias. Community College Journal of Research and Practice, 32(9), 712–729. https://doi.org/10.1080/10668920802000423

Sherry, M., Thomas, P., & Chui, W. H. (2010). International students: A vulnerable student population. Higher Education, 60(1), 33–46. https://doi.org/10.1007/s10734-009-9284-z

Sherry, S. B., Hewitt, P. L., Stewart, S. H., Mackinnon, A. L., Mushquash, A. R., Flett, G. L., & Sherry, D. L. (2012). Social disconnection and hazardous drinking mediate the link between perfectionistic attitudes and depressive symptoms. Journal of Psychopathology and Behavioral Assessment, 34(3), 370–381. https://doi.org/10.1007/s10862-012-9291-8

Smith, W. G. (2008). Does gender influence online survey participation? A recordlinkage analysis of university faculty online survey response behavior. Speelman, C. P., & McGann, M. (2016). Editorial: Challenges to mean-based analysis in psychology: The contrast between individual people and general science. Frontiers in Psychology, 7. https://doi.org/10.3389/fpsyg.2016.01234

Stoliker, B. E., & Lafreniere, K. D. (2015). The influence of perceived stress loneliness and learning burnout on university students’ educational experience. College Student Journal, 49(1), 146–160.

Taylor, H. O., & Nguyen, A. W. (2020). Depressive symptoms and loneliness among Black and White older adults: The moderating effects of race. Innovation in Aging, 4(5). https://doi.org/10.1093/geroni/igaa048

US Census Bureau. (2018, December 12). More than 76 million students enrolled in U.S. schools [News release]. The United States Census Bureau. https://www.census.gov/newsroom/press-releases/2018/school-enrollment.html

Van Orden, K. A., Witte, T. K., Gordon, K. H., Bender, T. W., & Joiner, T. E., Jr. (2008). Suicidal desire and the capability for suicide: Tests of the interpersonalpsychological theory of suicidal behavior among adults. Journal of Consulting and Clinical Psychology, 76(1), 72–83. https://doi.org/10.1037/0022-006X.76.1.72

Weber, B., Metha, A., & Nelsen, E. (1997). Relationships among multiple suicide ideation risk factors in college students. Journal of College Student Psychotherapy, 11(3), 49–64. https://doi.org/10.1300/j035v11n03_06

Westefeld, J. S., & Furr, S. R. (1987). Suicide and depression among college students. Professional Psychology: Research and Practice, 18(2), 119–123. https://doi.org/10.1037/0735-7028.18.2.119

Wright, K. B., King, S., & Rosenberg, J. (2013). Functions of social support and selfverification in association with loneliness, depression, and stress. Journal of Health Communication, 19(1), 82–99. https://doi.org/10.1080/10810730.2013.798385

Wu, M.-J., Zhao, K., & Fils-Aime, F. (2022). Response rates of online surveys in published research: A meta-analysis. Computers in Human Behavior Reports, 7(2), 1–11. https://doi.org/10.1016/j.chbr.2022.100206

Author Note

This research was funded by Pepperdine University’s Academic Year Undergraduate Research Initiative, which is administered by Katy Carr, Associate Vice Provost of Pepperdine University’s Office of Research, Grants, and Foundation Relations.

We thank Dr. Mary Hoban, Chief Research Officer at the American College Health Association, for providing data that we requested. We thank Christine Kukich, Senior Research Analyst at the American College Health Association, for answering our questions. We thank Emilie Chai, undergraduate psychology student at the University of California, San Diego, for proofreading and feedback.

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. The opinions, findings, and conclusions presented/reported in this article/presentation are those of the author(s) and are in no way meant to represent the corporate opinions, views, or policies of the American College Health Association (ACHA). ACHA does not warrant nor assume any liability or responsibility for the accuracy, completeness, or usefulness of any information presented in this article/presentation.

Correspondence concerning this article should be addressed to Eunji (“Amber”) Shin, Social Science Division, Pepperdine University, Malibu CA, 90263­4372, United States.

Email: eunji.shin@pepperdine.edu

Quality Dating and Wellness Among a Religious College Student Population: A Mixed-Methods Approach

Robert R. Wright*1, Melissa Wilson1, Christian Nienstedt2, Carson Ewing3, Andres Rodriguez1, Cade Anderson1, Natalie Johnson1, and Lindsay Johnson1

1Department of Psychology, Brigham Young University–Idaho

2Department of Psychology, Alliant International University, Fresno

3Department of Educational Psychology, University of Utah

ABSTRACT. Growing concerns for loneliness, social isolation, and the health of young adults point to the importance of the dating context. This study aimed to identify and examine quality dating experience (QDE) and poor dating experience (PDE) relative to the well­being of religious college students identified as members of the Church of Jesus Christ of Latter­day Saints, including gender differences. Focus group (n = 58) and online survey (n = 515) participants came from introductory psychology courses at a large religious institution. A mixed ­ methods design was used to qualitatively identify quality and poor dating themes and then, using these themes, examine the dating experience using quantitative data from an online survey questionnaire. Focus group thematic analyses revealed patterns of gender similarity (e.g., compatibility, safety concerns, hyper­focus on marriage) and disparity (e.g., monetary value, date activity details) for both QDE and poor dating experience (PDE). Quantitative survey results highlighted substantial relationships between QDE, PDE, and wellness variables including mood, life satisfaction, depressive symptoms, anxiety, stress, loneliness, physical health symptoms, and perceived peer support. Interestingly, men had statistically stronger (p < .05) relationships between PDE and 3 health variables: depressive symptoms, peer support, and interpersonal conflict. This suggests that men may have more adverse health profiles than women when undergoing PDEs in a more traditional religious context. Results supported QDE and PDE as influential variables that go beyond the simple metric of dating frequency to capture a more comprehensive perspective of health among religious college students, including gender differences.

Keywords: quality dating, romantic, mixed method, religious, emerging adults

Diversity badge earned for conducting research focusing on aspects of diversity.

Wright, Wilson, Nienstedt, Ewing, Rodriguez, Anderson, Johnson, and Johnson |

Social relationships are an essential aspect of overall health and wellness. Perceived strong social relationships reduce mortality and extend life (Holt­Lunstad et al., 2010). Certain relationships, such as healthy marriages, offer enormous benefits, from adopting healthy behaviors and emotional regulation (Skoyen et al., 2013) to notable improvements in both the length and quality of life (Burleson et al., 2013; Manzoli & Villari, 2007). Moreover, social relationships with peers strongly influence health and wellness, particularly for emerging adults (Bryan et al., 2013), who frequently select future romantic partners and marital spouses from among their peers. Dating has often been used to foster good social relationships and companionship, including marriage (Bryan et al., 2013; Myers et al., 2005), especially within religious communities (Bartkowski et al., 2011). Relatedly, there is growing concern over declining marriage rates (CDC, 2023), as well as troubling trends of loneliness (U.S. Surgeon General, 2023) and social isolation related to death and disease (e.g., Holt­Lunstad et al., 2015). Dating and romantic involvement offer a potential remedy, particularly through positive or high­quality experiences among emerging adults in religious college contexts where marriage is encouraged, and rates are generally higher (Parker & Stepler, 2017). Moreover, these contexts have substantial influence across the United States with more than 7,000 colleges and universities reporting a religious affiliation and providing education for millions of college students each year (NCES, 2023).

Despite potential disagreement regarding the definition of what exact interactions constitute a date, defining a quality date or a dating experience with high worth or value poses even more challenges. Indeed, the expectations of dating exert a strong influence on one’s assessment of dating experiences, particularly whether the expectations were met or not (e.g., Vannier & O’Sullivan, 2017, 2018). Moreover, this is impacted further by social factors such as gender (e.g., Paynter & Leaper, 2016), as well as religion (e.g., Langlais & Schwanz, 2017), making it imperative to consider these contextual factors by first taking a qualitative approach to define quality dating within a religious context (Charmaz, 1995). Furthermore, because social relationships are positively tied to many facets of health and well­being (cf., Newman & Roberts, 2013), quality dating experiences (QDEs) among religious adult college students are likely to show similar relationships with a wide range of wellness variables (e.g., physical, behavioral, mental). Despite these implications, few, if any, studies have investigated general QDEs as they relate to health and wellness within a religious context where marriage is often emphasized as a primary purpose of

dating, such as among members of the Church of Jesus Christ of Latter­day Saints.

Quality Dating and Expectations

Dating is traditionally a Western societal practice to facilitate the identification of marriage partners (e.g., Huston et al., 1981; Myers et al., 2005), but this has been shaped over time by sociocultural values into a complex custom filled with expectations and beliefs (e.g., Buss at el., 2001). As part of this complexity, research has suggested that the average young adult holds strong dating expectations for an ideal type of relationship (Banker et al., 2010) and believes they should be looking for this kind of relationship in dating experiences with a potential partner. However, higher unrealistic expectations lead to more discontent and less devotion in relationships and are associated with lower relationship satisfaction, investment, and commitment (Vannier & O’Sullivan, 2017, 2018). Moreover, many express the belief and desire to meet a romantic partner organically, but they most often resort to nonorganic methods (e.g., online dating sites), often creating disappointment and dissatisfaction (Parker & Stepler, 2017; Portolan & McAlister, 2022). This is likely compounded further by the heavy emphasis many place on effective interpersonal communication in dating (Cohen, 2016) and the increased use of electronics and online dating forums in the wake of the COVID­19 pandemic restrictions (Vogels & McClain, 2023; Wright et al., 2022). Furthermore, other studies have suggested substantial gender differences in dating expectations from women holding traditional standards that men should pay for and initiate dates (Paynter & Leaper, 2016) to men focusing more on physical and sexual aspects of dating than women (Bartoli & Clark, 2006; Buss et al., 2001; Ha et al., 2012).

Similarity theories offer some insight into understanding the complexity of how individuals endeavor to meet these dating expectations and have quality experiences. For example, the matching phenomenon states that, when selecting a potential mate, individuals choose those who “match” with them in level of desirability (Feingold, 1988; Tidwell et al., 2013). This applies to objective physical characteristics such as appearance and weight (Schafer & Keith, 1990) and attitudes and beliefs (e.g., Cramer et al., 1996; Regan, 1998), emphasizing the importance of perceived similarity over actual similarity (Reid et al., 2013; Tidwell et al., 2013). Indeed, Michinov and Monteil (2002) found that perceived similarities have a clear positive relationship to attraction, but dissimilarities have a more substantial negative impact. For instance, couples who participate in religious activities together have greater romantic relationship quality ( Langlais & Schwanz, 2017) and those with

higher religious attendance hold more traditional dating standards (Paynter & Leaper, 2016). Furthermore, in a study among religiously active college students, Wright et al. (2007) found support for the similarity principle in verbal communication, such that women were more attracted to men who verbally communicated similarly to them. Findings such as these suggest that religious context and beliefs should be considered alongside dating experience quality.

Religious Contextual Influence

Religious involvement can strongly influence selfperceptions, peer networks, and social behavior, which are directly related to dating (Smith, 2005). Moreover, among certain religious sects (e.g., conservative Protestants, Catholics), dating is a topic of central importance to religious observances such as marriage. Indeed, although not fully representative of all religious affiliations, Christian faiths embody nearly 66% of college graduates (Pew Research Center, 2023) and actively encourage marriage among their young adults through doctrine, culture, and practice. Many Christian young adults in college report feeling a cultural pressure to date for purposes of marriage (George, 2019). Moreover, those who are actively religious often approach dating more traditionally (e.g., marriage) whereas those who are not religiously active may date with other expectations (e.g., casual sex; Burdette et al., 2009; Weitbrecht & Whitton, 2020; Whitehead & Popenoe, 2000). This suggests that dating quality may mean something different to those who are actively religious due to the influence of religious beliefs and context.

For instance, among the Christian sect of the Church of Jesus Christ of Latter­day Saints (previously known as Mormon, LDS), traditional gender roles (e.g., men pay for dates; Lever et al., 2015) and values (e.g., abstinence from premarital sex, marriage as the goal of dating to establish families) are encouraged with a particular focus on marriage as the goal for dating (Bartkowski et al., 2011). Indeed, young adults who are single (not married) in this faith often report it as a temporary state considering their goal to get married, which is advocated by the religion (Darrington et al., 2005). Furthermore, this focus on the importance of dating for marriage likely coincides with observed higher rates of marriage among this religiously active group (Bartkowski et al., 2011) and may correspond with a wide spectrum of health benefits. In support of this, a longitudinal study of over 25 years examining the health and mortality of members of this church highlighted that those who were married, among other conditions, had the lowest total death rates and longest life expectancies ever documented (Enstrom & Breslow,

2008). Furthermore, college students in this faith have demonstrated noteworthy links between positive health behaviors (e.g., diet, sleep, exercise) and improved health outcomes (e.g., depressive symptoms, anxiety, blood pressure; Wright et al., 2023; Wright, Nelson, et al., 2020), suggesting that positive social behaviors (e.g., QDE) may provide similar benefits. Collectively, these studies suggest that a population of religious young adults in college, particularly members of the Church of Jesus Christ of Latter­day Saints, provides an opportunity to examine health and wellness relative to QDE.

Dating Quality and Wellness

Finally, quality romantic relationships have associations with a broad range of health and wellness indicators (cf., Burleson et al., 2013) especially for emerging adults (Braithwaite et al., 2010; Gomez­Lopez et al., 2019). Much of the literature on dating and wellness among emerging adults at college has examined dating experience using relationship status as a proxy indicator rather than a direct measure of dating experience. For instance, in a large national sample, Kamp Dush and Amato (2005) reported that, even when relationship happiness was controlled, individuals in more committed dating relationships experienced a higher level of subjective well­being than those who dated infrequently or not at all. Considering a large sample of more than 1,600 emerging adult college students, Braithwaite et al. (2010) found that those in committed romantic relationships experienced greater well­being, fewer mental health problems (e.g., depression, anxiety), and were less likely to be overweight/obese than single students. In a large sample of undergraduate students, Whitton et al. (2013) reported that involvement in a committed relationship, as opposed to being single, was associated with fewer depressive symptoms, especially for college women. Moreover, college students in committed dating relationships are more likely to make better health decisions, decreasing their likelihood of participation in health­risk behaviors such as problem alcohol use (e.g., Whitton et al., 2013) and increasing their likelihood of improvements in both nutrition and physical activity behaviors (e.g., Markey et al., 2007; Wright et al., 2023).

Going a step beyond simple relationship status, some studies suggest other factors such as gender and dating duration as important factors. For instance, one noteworthy study highlighted a stronger impact of a recent romantic relationship breakup (poor dating experience) on women’s emotional health than on men (Simon & Barrett, 2010), which is generally supported throughout the literature (Gomez­Lopez et al., 2019). Another study examined positive romantic dating experiences from adolescence to young adulthood

and reported a decrease in depressive symptomology as positive dating experiences continue to occur longitudinally (Olson & Crosnoe, 2017). Among a large undergraduate student sample, Freeman et al. (2023) reported romantic duration as an important factor in dating quality, suggesting that greater duration is often part of greater quality. These studies along with other systematic reviews of this literature (Gomez­Lopez et al., 2019; Kansky, 2018) highlight how positive dating and romantic relationships can be beneficial to college student health and wellness. However, few studies look at the quality of experiences with associated health and wellness in the nonmarital romantic dating setting, particularly within a religious context where ideals and goals for dating may influence differential profiles.

Current Study

The current study sought to identify QDEs along with its counterpart, poor quality dating experiences (PDEs), and then elucidate the relationship of these with health and wellness of a group of emerging adult college students who were members of the Church of Jesus Christ of Latter­day Saints. Specifically, we proposed three research questions:

RQ1: What constitutes a QDEs or PDEs for men and women among religious college students?

RQ2: How does QDE and PDE relate to indicators of wellness among religious college students?

RQ3: Are the relationships in RQ1 and RQ2 different between men and women among religious college students?

To address these research aims, we employed a mixed­method design, which incorporates the strengths of both qualitative and quantitative methods (Morgan, 2014). We employed focus group methodology where qualitative data was used to define QDE and PDE. We then developed quantitative measures of QDE and PDE from the findings of these focus groups to explore the relationships between health/wellness and dating experiences (quality and poor).

Method

QDE and PDE Measure Development

To determine what constitutes a QDE and differentiate this from PDE, we gathered qualitative data using focus group methodology. The main purpose of this approach was to identify emergent themes of descriptions of dating experiences to create representative quantitative measures. Our methodology followed Morgan’s (2014) recommendations and the method used by Wright et al. (2014). Before conducting these focus groups, we obtained permission from the institutional review board (IRB) for ethics compliance. Participants consisted of

58 men and women (64%) with an average age of 20.63 years ( SD = 2.21) and were mostly White ethnicity (88.1%) along with African Americans (3.4%), Hispanics (3.4%), and Multicultural (5.1%). Average lifetime dating experience was 4.97 years ( SD = 3.50), mean dating time at Brigham Young University–Idaho was 9.64 months (SD = 11.79), and the average number of in­person dates during the past three months was 5.09 (SD = 6.07). Among all participants, 52% reported being first­years (38% were 1st semester 1st­year students), 26% sophomores, 14% juniors, and 9% seniors. A total of four focus groups involved men participants (n = 21) and five focus groups were women participantsa (n = 37). All participants self­identified as being members of the Church of Jesus Christ of Latter­day Saints.

Focus groups were conducted across two semesters in the year 2022 and consisted of 5 to 10 participants each (see Morgan, 1996) who identified with male or female biological sex and were gender­segregated including moderators (members of the research team). Focus groups lasted for one hour following a semistructured format adapted from Morgan (1996). Moderators asked five scripted questions in each focus group and the semistructured nature of the interviews allowed interviewers to ask these questions in any order according to the flow of group discussion or ask additional questions relevant to participant comments. For the present purposes, we only focused on the questions regarding quality dating and dating concerns (i.e., PDEs), which were: “What is a quality date?” and “What are dating concerns for students at Brigham Young University–Idaho?” Audio recordings of each focus group were transcribed into text using the Trint program, available online.

We used conventional content analysis of each focus group following a three­step process to identify consistent or recurring themes (Hsieh & Shannon, 2005). First, based on recommended coding conventions (Charmaz, 1995), each corresponding pair of research assistants (who conducted the focus group) separately analyzed the transcript to identify commentary in which thematic elements seemed evident. Second, the pair met together and created a single version of the transcript with agreed­upon thematic codes within their focus groups. Following which, all research members of the same sex met together to integrate and develop descriptions of the thematic labels created. To reduce potential bias, research assistants did not compare or examine themes yielded from focus groups of the other sex.

To verify the reliability of the themes, six coders, who were not part of the theme development process (three for each sex), were asked to label the manuscript sections using the labels identified. All were trained independently and instructed to identify the presence

Wright, Wilson, Nienstedt, Ewing, Rodriguez, Anderson, Johnson, and Johnson

Quality

Dating Religious Health and Wellness | Wright, Wilson, Nienstedt, Ewing, Rodriguez, Anderson, Johnson, and Johnson

or absence of each code in the descriptions. Kappa coefficients were calculated and averaged across all three coders for each thematic code to determine interrater reliability. This provided a more accurate estimate as chance agreement is factored out by subtracting out the possibility that the coders would agree based on their tendency to select a certain code. Following recommendations by McHugh (2012) and Wright et al. (2014), coefficient values were considered acceptable with at least a moderate level of agreement (κ > .40).

In response to “What is a quality date?” the men focus groups produced six thematic codes that all demonstrated acceptable interrater reliability, and the women focus groups yielded three thematic codes all with acceptable interrater reliability (see Table 1). In response to our question, “What are dating concerns for students at Brigham Young University–Idaho?”, men focus groups yielded six thematic codes with five demonstrating acceptable interrater reliability (see Table 2). Women focus groups, on the other hand, produced four emergent themes, all with acceptable interrater reliability

TABLE 1

Quality Dating Experience Focus Group Emergent Themes

What is a quality date?

The date is enjoyable as the two people are friends before the date and can be friends after the date

Quality over Quantity 0.73 93% 6 (14%) Quality date is better than several dates

Communication 0.59 84% 11 (25%) Communication is natural between the individuals/it is easy to communicate with the other person

Socially Comfortable 0.56 86% 8 (18%) It is comfortable to be around the other person on a date/the other person is capable socially

Compatibility 0.44 87% 6 (14%) The two individuals on the date are compatible with one another/aspects of each individual work well with the other Women Only

Activity 0.81 95% 9 (16%) What you spend your time doing (including what you do on a first verses second date) will determine whether a date is quality

Personal Character 0.59 79% 27 (47%) The personality or character traits a person has is important (examples: respectful, chivalrous, well-mannered, supportive); not necessarily physical traits

Connection 0.57 79% 21 (37%) How the two people interact and connect will determine whether a date is quality; this may include similar interests, friendly conversation, open communication, shared beliefs, and mutual growth

Note. Kappa and percent agreement values are averages across all three coder comparisons.

(see Table 2). Next, we created gender­specific measures of QDE and PDE based on the emergent themes from the focus groups (see Appendix A and B).

Participants and Procedure

Following IRB approval for the quantitative online questionnaire portion of the current study, participants for the quantitative questionnaire portion of our study were solicited from introductory psychology courses on campus by email invitation. Interested students followed a link (via Qualtrics), whereupon they provided consent and completed an online questionnaire regarding college student life, including experiences related to their dating experiences and various aspects of their health and wellness. Data were collected during three semesters from 2022 to 2023. Student participants were given course credit for their participation and were allowed to select between several options for this course credit. Participants (n = 515) were an average of 20.12 years (SD = 2.34) and comprised mostly of women (60.6%), and most were White (83.9%) with Hispanic (3.5%), Black (2.1%), Asian American (1.9%), and Native American (0.6%) also represented. Education level was mostly first­year students (62.9%) or sophomores (24.3%), and 71.1% were single with 28.9% reporting being in a dating relationship (not marriage). Finally, participants reported being currently enrolled in an average of 12.51 (SD = 2.15) credits, and many were employed part­ (40.6%) or full­time (3.9%). All participants self­identified as being members of the Church of Jesus Christ of Latter­day Saints.

Measures

Dating Experience Constructs

First, building on the themes generated in our focus groups, we created two 10­item gender­specific measures regarding QDE (see Appendix A) for the past three months on a 5­point Likert scale (1 = strongly disagree, 5 = strongly agree) with higher values meaning greater quality. Both exhibited acceptable internal consistency (αs = .89, .92, respectively). Next, to capture the inverse of quality dating, we constructed two measures (8 items for men, 12 items for women) of PDE (see Appendix B) on the same timeframe and agreement scale as above with higher values representing poorer dating experiences. Both measures demonstrated acceptable internal consistency (αs = .83, .84). Dating frequency was captured by a single item asking how often they went on dates during the past three months.

Mental Wellness Constructs

Second, we assessed mental health and wellness with a variety of measures. Affect was captured using an

Wright, Wilson, Nienstedt, Ewing, Rodriguez, Anderson, Johnson, and Johnson | Quality Dating Religious Health and Wellness

eight­item measure of mood on a five­point frequency scale (1 = not at all, 5 = extremely) regarding how much a mood adjective described their mood over the past month along positive (i.e., happy, alert, enthusiastic, relaxed; α = .62) and negative (i.e., sad, irritable, bored, nervous; α = .68) dimensions (Wright et al., 2017). Acute depressive symptoms during the past week were assessed using the Center for Epidemiologic Studies Depression (CES ­ D) 5 ­ item measure (Bohannon et al., 2003) on a 4 ­ point scale (1 = rarely or none of the time; 4 = most or all of the time; α = .77). Anxiety over the past three months was assessed using a 4 ­ item measure on a 5 ­ point frequency scale (1 = never, 5 = very often; α = .82; Butz & Yogeeswaran, 2011). Perceived stress was captured using seven items from the Perceived Stress Scale (Cohen et al., 1983) on a 5­point frequency scale (1 = never, 5 = very often; α = .84). Using a 7­point agreement scale (1 = strongly disagree, 7 = strongly agree), satisfaction with life (Diener et al., 1985) was queried with five items (α = .87) and body appreciation (i.e., body image) was assessed on a 7­point agreement scale (1 = not at all true, 7 = very true) using the 13­item Body Appreciation Scale (Avalos et al., 2005; α = .94).

Social Wellness Constructs

Regarding social health and wellness, perceived loneliness during the past month was assessed using the 3­item Short Loneliness Scale (Hughes et al., 2004) on a 5­point frequency scale (1 = never, 5 = all the time; α = .81 ). Social support was examined from both perceptual and behavioral perspectives. For the perceptual perspective, we first asked participants to indicate the number of close friends they felt they had (i.e., people that you feel at ease with, can talk to about private matters, and can call on for help). For peer­ specific social support, we used eight items on a 7 ­ point agreement scale (1 = strongly disagree , 7 = strongly agree) regarding perceptions of social support from peers (Wood et al., 2004; α = .71). Then, to capture perceptions of general social support, we used the Interpersonal Support Evaluation List (ISEL; Cohen & Hoberman, 1983), which is a 12­item measure on a 4­point agreement scale (1 = definitely false, 4 = definitely true) of perceived availability of social support within one’s general social contacts (α = .86) Measurement of behavioral social support involved an 8­item measure of social integration (i.e., in­person social interactions) on a daily frequency scale (α = .74) in the past month (Twenge et al., 2017). Interpersonal conflict with others in general was assessed using six items (Wright et al., 2017) on a 5­point frequency scale (1 = never, 5 = very often) for the past 3 months (α = .87). Finally, as other potential indicators of social wellness, we queried daily

time spent on social media as well as time spent on screens. For daily time spent on social media, we asked participants to indicate how much time they spent on all social media each day during the past month on a sliding scale (0 to 10 hours). Daily time spent viewing a screen (screen time) used four items (Wright et al., 2022) to create a sum score of daily screen time on a typical day during the past month on a smartphone, tablet, computer, and television.

Physical Wellness Constructs

Lastly, physical wellness was assessed with the single item EuroQol Fifth Dimension (Kind et al., 2005) measure of overall subjective health so participants rated their own health on a scale from 0 (worst physical health) to 100 (best physical health). Physical health symptoms were measured using Spector & Jex’s (1998) 18­item Physical Symptom Inventory (e.g., headache, fatigue) during the past 30 days. To capture sedentary behavior on a typical day, we used a 10­item adapted version of the Sedentary Behavior Questionnaire (Rosenberg et al., 2010) on a 9­point scale (0 = none, 9 = 6 hours or more) with 10 behaviors (e.g., watching television, playing video games, sitting in a car).

TABLE 2

Dating Experience Focus Group Emergent Themes

Men Only

are dating concerns fors tudents at Brigham Young UniversityIdaho?

What are dating concerns for students at Brigham Young University–Idaho?

Meeting with a potential partner may be unsafe

Major differences may exist between yourself and a potential partner

Dating with the exclusive purpose/priority of marriage

The other person is or will be rude/treats you or others poorly

Getting rejected from potential partners for a period of time or more than once Fear of Investment

5 (13%) Fear of getting too involved or being committed to a potential partner for an extended period of time

Women Only

11 (20%) The feeling one has about whether they are safe in the presence of another person

Concern that someone only wants to get married because everyone else is doing it or because it is the norm

The negative characteristics that a person displays; examples include deceitful, manipulative, isolating, pushy, possessive Lack of Communication

Failure of dating partners to adequately communicate expectations for the dating relationship because they don’t want to appear too eager or for some other reason

Note. Kappa and percent agreement values are averages across all three coder comparisons.

Data Analysis

First, as our data were gender­specific, we analyzed differences between women and men in terms of both QDE and PDE using independent­samples t tests and Cohen’s d main effects. Next, we examined relationships between these dating experience variables and the health and wellness indicators using correlation analysis. Moreover, we applied a Fisher’s transformation of Pearson’s r to z to enable a statistical comparison of the gender­specific correlations, as this standardizes correlation coefficients for direct comparison. Similarly, for subsequent t tests on differences between women and men in these correlations, this transformation enables detection of significant differences due to this standardization. To protect against possible Type I error, which may be inflated by conducting multiple significance tests, we applied Bonferroni’s correction (which reduces the alpha level to be considered statistically significant) for the t tests on differences between women and men in correlation strength. Finally, we explored a few alternative explanations for the observed results by examining differences in other demographic variables age, dating frequency, and relationship status (single versus dating relationship).

Results

Means, standard deviations, and other descriptive information for study variables are listed in Tables 3 and 4.

Participants reported an average of 7.80 (SD = 10.30) dates in the past 3 months, and increased dating frequency was significantly related to increased positive affect, life satisfaction, general social support, and social integration as well as decreased perceived loneliness. However, these relationships were rather modest, suggesting that dating frequency alone may not be a good predictor of wellness in this context. Moreover, both age and number of credits enrolled were not significantly related to dating frequency, QDE, or PDE.

Regarding our created measures of Quality Dating Experience (QDE) and Poor Dating Experience (PDE), the correlations between them were negative for both men and women (r = ­.42, ­.52, respectively), providing support of their theoretical inverse relationship. Moreover, dating quality experience did not significantly differ between men ( M = 3.84, SD = 0.62) and women ( M = 3.88, SD = 0.66), t(487) = 0.52, p = .50, d = 0.05. However, PDE differed significantly, t(491) = 5.42, p < .001, d = 0.49) as women (M = 2.64, SD = 0.58) reported PDEs more frequently than men (M = 2.33, SD = 0.68). Moreover, QDE was reported significantly higher than PDE for both men, t(392) = 23.37, p < .001, d = 2.36, and women, t(586) = 24.21, p < .001, d = 2.00. As might be expected, dating frequency was positively correlated with QDE for both men and women, but significantly more so for women (see Table 4). Moreover, dating frequency

TABLE 3

Correlation Matrix for Study Variables Across Entire Sample

7.

8.

9. Loneliness

10. Number Close Friends

Note * p < .001; Dating Quality and Poor Dating Experience variables are not reported here, but in Table 4 because they are gender specific. Internal consistency estimates (Cronbach’s α) are listed on the diagonal. Dating frequency is according to prior 3 months. Social media time, screen time, and sedentary behavior are in minutes per day..

Wright, Wilson, Nienstedt, Ewing, Rodriguez, Anderson, Johnson, and Johnson | Quality Dating Religious Health and Wellness

was negatively correlated with PDE for both men and women, though this relationship was stronger for women. Thus, women reported PDEs more frequently and exhibited a stronger relationship between quantity and quality of dates than men.

Next, we examined health and wellness across and women and men relative to their dating experience (see Table 4). In general, relationships between the QDE and PDE were in the expected direction (poorer wellness associated with lower QDE) and were in the same direction for men and women, suggesting similar relationships between these variables regardless of gender. Among the mental wellness variables, all were significantly (p < .05) related in the expected directions to the QDE and PDE (except negative mood and QDE), with poorer health being generally associated with lower QDE. However, in terms of differences, men generally exhibited stronger significant relationships than women for the wellness variables associated with the QDE and PDE. Satisfaction with life, depressive symptoms, and body appreciation were the strongest, and depressive symptoms demonstrated a significantly stronger (p < .05) relationship with PDE for men than women.

Furthermore, the social and physical wellness indicators were generally related to the QDE and PDE in the expected directions for both men and women, though not all were significant (see Table 4). Perceived loneliness, general social support, and interpersonal conflict exhibited the strongest relationships with the PDE for both women and men. However, peer support and interpersonal conflict manifested significant gender differences with men reporting a statistically stronger association than women. Interestingly, daily social media time and daily screen time demonstrated small and nonsignificant associations, suggesting that electronic media use may not have much of a relationship with the evaluation of one’s dating experience. Similarly, physical wellness variables exhibited small or inconsequential correlations with the QDE and PDE, though these were also in the expected directions, overall. Collectively, these results suggest that dating experiences likely are similarly related for both women and men with the notable exceptions of dating frequency being stronger for women whereas depressive symptoms, peer social support, and interpersonal conflict were more strongly related for men.

Finally, we explored alternative explanations including age, dating frequency, and relationship status differences that could offer competing explanations for the results. First, although age significantly differed between men ( M = 20.92, SD = 2.04) and women (M = 19.60, SD = 2.38) t(513) = 6.46, p < .001, d = 0.57, it was not significantly related to the QDE or PDE,

suggesting that age was not a confounding variable. Second, both women and men reported similar frequency of dating activity in the past 3 months with men at an average of 7.00 dates (SD = 10.32) and women at 8.32 dates (SD = 10.27) t(477) = 1.38, p = .17, d = 0.13, suggesting that observed differences between men and women on the QDE and PDE are likely not related to differences in dating frequency. Third, we investigated the difference between being single and being in a dating relationship (not married but dating one person more exclusively than others). Generally, across both men and women, those in a current dating relationship scored significantly higher on the QDE and lower on the PDE than those who were not (see Table 5), which would be expected. Thus, these results suggest that, although being in a current committed dating relationship may play a role in

Correlations for QDE and PDE With Wellness Variables Across Genders

Body Appreciation

Loneliness

Number

Peer Support

Subjective Health

Sedentary Behavior

Note * p < .05; ** p < .01; QDE = Quality Dating Experience; PDE = Poor Dating Experience. Fisher’s r to z transformations were conducted on the Pearson r values to enable appropriate comparisons for statistical significance and reported here. Δ represents the transformed correlation value difference between men and women, such that a negative value represents a stronger absolute value for women and vice versa. Bonferroni corrections were applied for difference testing of the correlation values. Social Media Time and Screen Time are both in terms of daily minutes.

TABLE 4

the perceived dating experience (higher ratings of QDE), age and frequency of dating are likely not confounding variables in the current analyses of QDE and PDE.

Discussion

Using a mixed­methods approach, the current study examined expectations and perceptions regarding QDE and PDE among a religious college student emerging adult population of members of the Church of Jesus Christ of Latter­day Saints. Focus groups revealed similar and contrasting perspectives between women and men for dating experiences, supporting the qualitative approach in elucidating specific themes that were central and defining for the dating experience as a college student in a religious context. Next, upon creating measures of QDE and PDE from these themes, a large quantitative survey uncovered relationships between both dating experience variables and several wellness factors, suggesting a connection between one’s dating experience and overall wellness. Finally, both similar and unique patterns were observed between women and men, which further suggests a need to consider gender as an important characteristic in perceptions of the quality of one’s dating experience.

First, for Research Question 1, focus groups uncovered several dating experience themes that were similar for both women and men in this religious context while noting some differences. The quality dating themes of compatibility, friendship, socially comfortable, and friendship elicited from the men focus groups were similar in content to personal character and connection in the women focus groups. These similar findings support the matching phenomenon’s (Feingold, 1988; Tidwell et al.,

TABLE 5

Differences in Relationship Status Across Genders on the QDE and PDE

2013) assertion that similarity produces attraction and, by extension, quality experiences. However, notable differences were also evident, particularly between the men’s theme of monetary value and the women’s theme of activity, highlighting a potential difference of focus, likely due to gender­related expectations (e.g., Paynter & Leaper, 2016) and norms such as an expectation for men to pay for dates (Lever et al., 2015). Interestingly, some potential themes were not identified including physical attraction (Ha et al., 2012), dating outcome, and shared religious activity (Langlais & Schwanz, 2017), which may be a unique finding within a religious dating context where these may be assumed or deemed socially unacceptable to report.

The PDE themes demonstrated some congruence between women and men, particularly regarding safety and a concern for getting married too quickly. This is interesting in a religious dating environment where dating should lead to marriage (Myers et al., 2005), suggesting that dating safety remains a concern along with the worry that dating may elicit marriage prematurely. Moreover, notable gender differences revolved around communication. Whereas men reported being rejected and receiving rudeness from potential dating partners, women identified a lack of communication. It may be that men receive negative communication and women do not receive enough communication when defining PDE, which is in ­ line with prior research emphasizing the role of communication in dating (Cohen, 2016; Wright et al., 2007). Finally, it is interesting to note that only one of the themes identified across both questions for both women and men (fear of investment) failed to achieve at least a moderate level of interrater agreement, suggesting that the remaining themes are likely prominent within this religious college student dating context.

Second, for Research Question 2, QDE and PDE was related to many wellness variables and more strongly than dating frequency. Particularly strong correlations emerged across the genders for perceptions of loneliness, satisfaction with life, depressive symptoms, peer, and general social support, suggesting that both women and men experienced feelings of isolation from the social context under conditions of less QDE. This finding underscores the importance of dating experiences in this population, particularly considering recent increasing trends in loneliness and social isolation (e.g., Holt­Lunstad et al., 2015; U.S. Surgeon General, 2023) even among this same religious population (Wright et al., 2018). Moreover, the connection between poor dating and poorer wellness may be rooted in the social ideal that successful social integration in a religious context mandates quality social interactions, particularly

Wright, Wilson, Nienstedt, Ewing, Rodriguez, Anderson, Johnson, and Johnson | Quality Dating Religious Health and Wellness

with the other sex. However, it is also feasible that those who already experience poorer mental health elicit poorer dating experiences or are apt to perceive them as such. Regardless, these results suggest that perceptions of dating quality experience can be used as a proxy indicator of wellness, particularly for mental health, and that using a simple metric of dating frequency may be failing to capture a more comprehensive perspective.

Third, for Research Question 3, our results highlighted some notable differences between women and men. Although this may be expected in a religious dating context that emphasizes differing traditional gender roles, significant differences highlighted the stronger association of PDE for men’s wellness compared to women, contrary to other studies (Gomez­Lopez et al., 2019; Simon & Barrett, 2010). A potential explanation for the constructs of depressive symptoms, perceived peer social support, and interpersonal conflict exhibiting this stronger pattern for men than women may involve traditional dating expectations for gender roles espoused in many religious contexts. For instance, in this context, men are generally expected to ask women on dates, plan the activities, and pay for the date (Lever et al., 2015). Women, on the other hand, are expected to either accept or decline and then participate in the planned activities. Thus, a PDE may reflect how well the man is able to succeed in his gender role expectations and, by extension, lead to increased depressive symptoms, conflict with others, and a decrease in perceptions of peer acceptance and support.

Supporting this explanation of gender roles, dating frequency had a stronger association with dating quality experience for women than men, suggesting that frequency of dates for women may lead to increased dating quality experience or vice versa. Indeed, according to these gender role expectations, men are freer to increase their dating frequency but less able to control the quality of the dating experience, as this involves further interpersonal interaction. Women, on the other hand, have less freedom to increase their dating frequency, but more decision latitude during the dating experience as they engage interpersonally. Thus, as dating frequency increases for women, this may engender a sense of increased quality, or women who have greater QDEs may also be drawing more dating opportunities in the future. Furthermore, building on these findings, mental health practitioners, educators, and even religious leaders may need to be sensitive to some of these expressed gender differences in dating. For instance, in a more traditional religious setting, an acknowledgement of these unique perceived gender roles, social pressures, and social identity of the genders within the dating context may help these stakeholders to support young adults. This may be

particularly important in fostering healthy relationships and promoting overall well­being within the context of their religious beliefs and community settings. Finally, some wellness variables and alternative explanations may not be important when considering dating quality experience. Despite studies highlighting the importance of social media, electronic media use, and screen time in this population (e.g., Wright et al., 2018; Wright, Schaeffer, et al., 2020; Wright et al., 2024) and others (Twenge et al., 2017) regarding social and mental health, our study failed to uncover a relationship. This may be due to screen time, electronic media, and social media becoming more mainstream among emerging adults rather than a novel distraction or impediment to the dating experience, an interpretation further supported by the nonsignificant relationship with dating frequency. Moreover, our findings suggest that gender differences in frequency of dating and age are likely not viable competing explanations for these observed differences in the dating quality experience. However, dating relationship status mattered, such that those who are in a current dating relationship reported better quality dating experience. This is to be expected, as one does not exclusively date someone until it has already been determined that some amount of compatibility or desirability exists in the potential relationship. In fact, this further supports the idea that dating is performing its adaptive function in this traditional religious context, as dating quality with one person should be predictive of future marriage potential.

Potential Limitations and Future Research

This investigation has some potential limitations. First, the cross­sectional study design precludes any causal conclusions, as temporal primacy was not established. Moreover, using correlations limits inferential conclusions, though we applied Fisher’s transformation before making any direct statistical comparisons, and we used Bonferroni corrections to decrease chances of Type I error. Second, despite using a mixed­method design that builds on the strengths of both qualitative and quantitative data, the limitations of both are also possible. For instance, the focus groups might have limited generalizability along with the resulting quantitative measures. However, our conduction of multiple gender­segregated focus groups until the point of data saturation partially mitigates this concern. Third, other factors not included in these analyses (e.g., personality) may attenuate or moderate these findings, such that those who are more extraverted or neurotic may demonstrate differential patterns of relationships between dating and corresponding health. Finally, sample characteristics may pose difficulties in generalizing these results to other populations beyond

the traditional college student setting such as those of lower socioeconomic status or different cultural perspectives. Moreover, the current study espoused heteronormative and cisgender assumptions related to dating within a sample of members of the Church of Jesus Christ of Latter­day Saints, which may not always be the supported (Klundt et al., 2021).

Despite these potential limitations, insights from this study offer some direction for future research. First, although it seems plausible that the quality of dating experience may cause wellness outcomes, the reverse is also plausible, such that those who have poorer wellness may elicit or cause more dating frustrations. Future research examining dating quality over time could address this issue while also controlling for several other potentially confounding variables (e.g., interactions prior to dating, personality characteristics). Second, future studies could restrict examination to only those who are single or in an exclusive dating relationship to identify potentially unique or more nuanced elements of quality dating at each of these two distinct dating stages. Third, future research could explore the validity of our created measures (QDE, PDE) among other single college students at other conservative or religious campuses. Indeed, comparison to another religious or non­religious college campus could provide further interesting insights into how well these generalize in other contexts and populations (e.g., sexual minorities). Going a step further, future research might examine the predictive validity of our created measures in following college students who score high on the QDE (and low on the PDE) in dating relationships to determine whether they are predictive of other behavioral outcomes such as engagement or marriage. Moreover, building on the concept that personality characteristics influence the dating process, future studies could examine how personality may account for the observed relationships between dating experiences and health. Finally, sophisticated methodological designs could be implemented to study QDE and PDE using in­lab observations (Galliher et al., 2008) from a dyadic perspective (Kenny & Acitelli, 1994).

In conclusion, using a mixed­methods design to investigate dating quality experience among single college students at a religious institution of higher education, we identified emergent themes of QDE and PDE, created measures, and uncovered consistent relationships between quality dating experience and better overall wellness. Thus, this work provides a building block in understanding a context in which to potentially address the growing national challenges in marriage, social isolation, and loneliness by targeting dating experiences among college students within a religious context.

References

Avalos, L., Tylka, T. L., & Wood-Barcalow, N. (2005). The Body Appreciation Scale: Development and psychometric evaluation. Body Image, 2(3), 285–297. https://doi.org/10.1016/j.bodyim.2005.06.002

Banker, J. E., Kaestle, C. E., & Allen, K. R. (2010). Dating is hard work: A narrative approach to understanding sexual and romantic relationships in young adulthood. Contemporary Family Therapy, 32(2), 173–191. https://doi.org/10.1007/s10591-009-9111-9

Bartkowski, J. P., Xu, X., & Fondren, K. M. (2011). Faith, family, and teen dating: Examining the effects of personal and household religiosity on adolescent romantic relationships. Review of Religious Research, 248-265.

Bartoli, A. M., & Clark, M. D. (2006). The dating game: Similarities and differences in dating scripts among college students. Sexuality & Culture, 10(4), 54–80. https://doi.org/10.1007/s12119-006-1026-0

Bohannon, R. W., Maljanian, R., & Goethe, J. (2003). Screening for depression in clinical practice: Reliability and validity of a five-item subset of the CESdepression. Perceptual and Motor Skills, 97(3), 855–861. https://doi.org/10.2466/pms.2003.97.3.855

Braithwaite, S. R., Delevi, R., & Fincham, F. D. (2010). Romantic relationships and the physical and mental health of college students. Personal Relationships, 17(1), 1–12. https://doi.org/10.1111/j.1475-6811.2010.01248.x

Bryan, K. S., Puckett, Y. N., & Newman, M. L. (2013). Peer relationships and health: From childhood through adulthood. In M. L. Newman & N. A. Roberts (Eds.), Health and social relationships: The good, the bad, and the complicated (pp. 167–188). American Psychological Association. https://doi.org/10.1037/14036-008

Burdette, A. M., Ellison, C. G., Hill, T. D., & Glenn, N. D. (2009). “Hooking up” at college: Does religion make a difference?. Journal for the Scientific Study of Religion, 48(3), 535-551.

Burleson, M. H., Roberts, N. A., Vincelette, T. M., & Guan, X. (2013). Marriage, affectionate touch, and health. In M. L. Newman & N. A. Roberts (Eds.), Health and social relationships: The good, the bad, and the complicated (pp. 67–93) American Psychological Association. https://doi.org/10.1037/14036-004

Buss, D. M., Shackelford, T. K., Kirkpatrick, L. A., & Larsen, R. J. (2001). A half century of mate preferences: The cultural evolution of values. Journal of Marriage & Family, 63(2), 491–503. https://doi.org/10.1111/j.1741-3737.2001.00491.x

Butz, D. A., & Yogeeswaran, K. (2011). A new threat in the air: Macroeconomic threat increases prejudice against Asian Americans. Journal of Experimental Social Psychology, 47(1), 22–27. https://doi.org/10.1016/j.jesp.2010.07.014

Centers for Disease Control and Prevention. (2023). National marriage and divorce rate trends for 2000–2021. Retrieved June 8, 2023, from https://www.cdc.gov/nchs/fastats/marriage-divorce.htm

Charmaz, K. (1995). Grounded theory. In J. A. Smith, R. Harre, & L. Van Langenhove (Eds), Rethinking methods in psychology (pp. 27–49).

Sage Publications.

Cohen, S., & Hoberman, H. M. (1983). Positive events and social supports as buffers of life change stress. Journal of Applied Social Psychology, 13(2), 99–125. https://doi.org/10.1111/j.1559-1816.1983.tb02325.x

Cohen, S., Kamarck, T., & Mermelstein, R. (1983). A global measure of perceived stress. Journal of Health and Social Behavior 24(4), 385–396. https://doi.org/10.2307/2136404

Cohen, M. (2016). It’s not you, it’s me...no, actually it’s you: Perceptions of what makes a first date successful or not. Sexuality & Culture, 20(1), 173–191. https://doi.org/10.1007/s12119-015-9322-1

Cramer, R. E., Schaefer, J. T., & Reid, S. (1996). Identifying the ideal mate: More evidence for male-female convergence. Current Psychology, 15, 157–166. https://doi.org/10.1007/BF02686948

Darrington, J., Piercy, K. W., & Niehuis, S. (2005). The social and cultural construction of singlehood among young, single Mormons. The Qualitative Report, 10(4), 639-661.

Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction With Life Scale. Journal of Personality Assessment, 49(1), 71–75. https://doi.org/10.1207/s15327752jpa4901_13

Enstrom, J. E., & Breslow, L. (2008). Lifestyle and reduced mortality among active California mormons, 1980–2004. Preventive Medicine, 46(2), 133–136. https://doi.org/10.1016/j.ypmed.2007.07.030

Feingold, A. (1988). Matching for attractiveness in romantic partners and same-sex friends: A meta-analysis and theoretical critique Psychological Bulletin, 104(2), 226–235. https://doi.org/10.1037/0033-2909.104.2.226

Wright, Wilson, Nienstedt, Ewing, Rodriguez, Anderson, Johnson, and Johnson | Quality Dating Religious Health and Wellness

Freeman, H., Simons, J., & Benson, N. E., (2023). Romantic duration, relationship quality, and attachment insecurity among dating couples. International Journal of Environmental Research and Public Health, 20(1), 856–874. https://doi.org/10.3390/ijerph20010856

Galliher, R. V., Enno, A. M., & Wright, R. R. (2008). Convergence and divergence among multiple methods for assessing adolescent romantic relationships. Journal of Adolescence, 31(6), 747–769. https://doi.org/10.1016%2Fj.adolescence.2007.12.003

George, S. K. (2019). Ring by spring: Dating and relationship cultures at Christian colleges. Wipf and Stock Publishers.

Gomez-Lopez, M., Viejo, C., & Ortega-Ruiz, R. (2019). Well-being and romantic relationships: A systematic review in adolescence and emerging adulthood. International Journal of Environmental Research and Public Health, 16(13), 2415–2446. https://doi.org/10.3390%2Fijerph16132415

Ha, T., Berg, J., Engels, R., & Lichtwarck-Aschoff, A. (2012). Effects of attractiveness and status in dating desire in homosexual and heterosexual men and women. Archives of Sexual Behavior, 41(3), 673–682. https://doi.org/10.1007/s10508-011-9855-9

Holt-Lunstad, J., Smith, T. B., Baker, M., Harris, T., & Stephenson, D. (2015). Loneliness and social isolation as risk factors for mortality: A metaanalytic review. Perspectives on Psychological Science, 10(2), 227–237. https://doi.org/10.1177/1745691614568352

Holt-Lunstad, J., Smith, T. B., & Layton, J. B. (2010). Social relationships and mortality risk: A meta-analytic review. PLoS Medicine, 7(7). https://doi.org/10.1371/journal.pmed.1000316

Hsieh, H.-F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277–1288. https://doi.org/10.1177/1049732305276687

Hughes, M. E., Waite, L. J., Hawkley, L. C., & Cacioppo, J. T. (2004). A short scale for measuring loneliness in large surveys. Research on Aging, 26(6), 655–672. https://doi.org/10.1177/0164027504268574

Huston, T., Surra, C., Fitzgerald, N., & Cate, R. (1981). From courtship to marriage: Mate selection as an interpersonal process. In S. Duck & R. Gilmour (Eds.), Personal relationships, 2: Developing personal relationships (pp. 53–90). Academic Press.

Kamp Dush, C. M., & Amato, P. R. (2005). Consequences of relationship status and quality for subjective well-being. Journal of Social and Personal Relationships, 22(5), 607–627. https://doi.org/10.1177/0265407505056438

Kansky, J. (2018). What’s love got to do with it?: Romantic relationships and well-being. In E. Diener, S. Oishi, & L. Tay (Eds.), Handbook of well-being. DEF Publishers.

Kenny, D. A., & Acitelli, L. K., (1994). Measuring similarity in couples. Journal of Family Psychology, 8(4), 417–431. https://doi.org/10.1037/0893-3200.8.4.417

Kind, P., Brooks, R., & Rabin, R. (2005). EQ-5D concepts and methods: A developmental history. Springer.

Klundt, J. S., Erekson, D. M., Lynn, A. M., & Brown, H. E. (2021). Sexual minorities, mental health, and religiosity at a religiously conservative university. Personality and Individual Differences, 171, 110475. https://doi.org/10.1016/j.paid.2020.110475

Langlais, M., & Schwanz, S. (2017). Religiosity and relationship quality of dating relationships: Examining relationship religiosity as a mediator. Religions, 8(9), 187. https://doi.org/10.3390/rel8090187

Lever, J., Frederick, D. A., & Hertz, R. (2015). Who pays for dates? Following versus challenging gender norms. Sage Open, 5(4), 2158244015613107. Manzoli, L., &Villari, P. (2007). Marital status and mortality in the elderly: A systematic review and meta-analysis. Social Science & Medicine, 64(1), 77–97. https://doi.org/10.1016/j.socscimed.2006.08.031

Markey, C. N., Markey, P. M., & Gray, H. F. (2007). Romantic relationships and health: An examination of individuals’ perceptions of their romantic partners’ influences on their health. Sex Roles, 57(1), 435–445. https://doi.org/10.1007/s11199-007-9266-5

McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica, 22(3), 276–282. https://doi.org/10.11613/BM.2012.031

Michinov, E., & Monteil, J.-M. (2002). The similarity–attraction relationship revisited: Divergence between the affective and behavioral facets of attraction. European Journal of Social Psychology, 32(4), 485–500. https://doi.org/10.1002/ejsp.104

Morgan, D. L. (1996). Focus groups. Annual Review of Sociology, 22(1), 129–152. https://doi.org/10.1146/annurev.soc.22.1.129

Morgan, D. L. (2014). Integrating qualitative and quantitative methods: A pragmatic approach. Sage Publications, Inc.

Myers, J. E., Madathil, J., & Tingle, L. R. (2005). Marriage satisfaction and wellness in India and the United States: A preliminary comparison of arranged marriages and marriages of choice. Journal of Counseling and Development, 83, 183–192.

National Center for Education Statistics. (2023). Fall enrollment and number of degree-granting postsecondary institutions, by control and religious affiliation of institution: Selected years, 1980 through 2020. Retrieved on October 30, 2023, at https://nces.ed.gov/programs/digest/d21/tables/dt21_303.90.asp

Newman, M. L., & Roberts, N. A. (2013). Health and social relationships: The good, the bad, and the complicated. American Psychological Association.   Olson, J. S., & Crosnoe, R. (2017). Are you still bringing me down? Romantic involvement and depressive symptoms from adolescence to young adulthood. Journal of Health and Social Behavior, 58(1), 102–115. https://doi.org/10.1177/0022146516684536

Parker, K., & Stepler, R. (2017, September 14). As U.S. marriage rate hovers at 50%, education gap in marital status widens. Pew Research Center. https://www.pewresearch.org/short-reads/2017/09/14/as-u-s-marriagerate-hovers-at-50-education-gap-in-marital-status-widens/ Paynter, A., & Leaper, C. (2016). Heterosexual dating double standards in undergraduate women and men. Sex Roles, 75(1), 393–406. https://doi.org/10.1007/s11199-016-0628-8

Pew Research Center. (2023). Religious landscape study: Religious composition of college graduates. Retrieved on October 30, 2023, at https://www.pewresearch.org/religion/religious-landscape-study/ educational-distribution/college/ Portolan, L., & McAlister, J. (2022). Jagged love: Narratives of romance on dating apps during COVID-19. Sexuality & Culture, 26(1), 354–372. https://doi.org/10.1007/s12119-021-09896-9

Regan, P. C. (1998). What if you can’t get what you want? Willingness to compromise ideal mate selection standards as a function of sex, mate value, and relationship context. Personality and Social Psychology Bulletin, 24(12), 1294–1303. https://doi.org/10.1177/01461672982412004

Reid, C., Davis, J., & Green, J. (2013). The power of change: Interpersonal attraction as a function of attitude similarity and attitude alignment. The Journal of Social Psychology, 153(6), 700–719. https://doi.org/10.1080/00224545.2013.824404

Rosenberg, D. E., Norman, G. J., Wagner, N., Patrick, K., Calfas, K. J., & Sallis, J. F. (2010). Reliability and validity of the Sedentary Behavior Questionnaire (SBQ) for adults. Journal of Physical Activity and Health, 7(6), 697–705. https://doi.org/10.1123/jpah.7.6.697

Schafer, R., & Keith, P. (1990). Matching by weight in married couples: A life cycle perspective. The Journal of Social Psychology, 130(5), 657–664. https://doi.org/10.1080/00224545.1990.9922958

Simon, R. W., & Barrett, A. E. (2010). Nonmarital romantic relationships and mental health in early adulthood: Does the association differ for women and men? Journal of Health and Social Behavior, 51(2), 168–182. https://doi.org/10.1177/0022146510372343

Skoyen, J. A., Kogan, A. V., Novak, S. A., & Butler, E. A. (2013). Health behavior and emotion regulation in couples. In M. L. Newman & N. A. Roberts (Eds.), Health and social relationships: The good, the bad, and the complicated (pp. 121–142). American Psychological Association. https://doi.org/10.1037/14036-006

Smith, C. 2005. Soul searching: The religious and spiritual lives of American teenagers. Oxford University Press.

Spector, P. E., & Jex, S. M. (1998). Development of four self-report measures of job stressors and strain: Interpersonal Conflict at Work Scale, Organizational Constraints Scale, Quantitative Workload Inventory, and Physical Symptoms Inventory. Journal of Occupational Health Psychology, 3(4), 356–367. https://doi.org/10.1037/1076-8998.3.4.356

Tidwell, N., & Eastwick, P., & Finkel, E. J. (2013). Perceived, not actual, similarity predicts initial attraction in a live romantic context: Evidence from the speed‐dating paradigm. Personal Relationships, 20(2), 199–215. https://doi.org/10.1111/j.1475-6811.2012.01405.x

Twenge, J. M., Joiner, T. E., Rogers, M. L., & Martin, G. N. (2017). Increases in depressive symptoms, suicide-related outcomes, and suicide rates among U.S. adolescents after 2010 and links to increased new media screen time. Clinical Psychological Science, 6, 3–17.

U.S. Surgeon General. (2023). Our epidemic of loneliness and isolation: The U.S. Surgeon General’s advisory on the healing effects of social connection and community. Retrieved June 8, 2023, from https://www.hhs.gov/sites/ default/files/surgeon-general-social-connection-advisory.pdf

Vannier, S. A., & O’Sullivan, L. F. (2017). Passion, connection, and destiny: How

romantic expectations help predict satisfaction and commitment in young adults’ dating relationships. Journal of Social and Personal Relationships, 34(2), 235–257. https://doi.org/10.1177/0265407516631156

Vannier, S. A., & O’Sullivan, L. F. (2018). Great expectations: Examining unmet romantic expectations and dating relationship outcomes using an investment model framework. Journal of Social and Personal Relationships, 35(8), 1045–1066. https://doi.org/10.1177/0265407517703492

Vogels, E. A., & McClain, C. (2023). Key findings about online dating in the U.S. Pew Research Center. Retrieved June 8, 2020, at https://www.pewresearch. org/short-reads/2023/02/02/key-findings-about-online-dating-in-the-u-s/

Weitbrecht, E. M., & Whitton, S. W. (2020). College students’ motivations for “hooking up”: Similarities and differences in motives by gender and partner type. Couple and Family Psychology: Research and Practice, 9(3), 123–143. https://doi.org/10.1037/cfp0000138

Whitehead, B. D., & Popenoe, D. (2000). Sex without strings, relationships without rings. The state of our unions, 2000 (pp. 6–20). The National Marriage Project, Rutgers University Press.

Whitton, S. W., Weitbrecht, E. M., Kuryluk, A. D., & Bruner, M. R. (2013). Committed dating relationships and mental health among college students. Journal of American College Health, 61(3), 176–183. https://doi.org/10.1080/07448481.2013.773903

Wood, M. D., Read, J. P., Mitchell, R. E., & Brand, N. H. (2004). Do parents still matter? parent and peer influences on alcohol involvement among recent high school graduates. Psychology of Addictive Behaviors, 18(1), 19–30. https://doi.org/10.1037/0893-164x.18.1.19

Wright, R. R., Bates, S. C., & Ferguson, T. J. (2007). Effects of gender communication patterns on opposite gender attraction. Psi Chi Journal of Undergraduate Research, 12(3), 87–95 https://doi.org/10.24839/1089-4136.JN12.3.87

Wright, R. R., Hardy, K., Simpson, S., Egli, M., Mullins, R., & Martin, S. (2018). Loneliness and social media use among religious Latter-day Saint college students: An exploratory study. Journal of Technology in Behavioral Science, 3(1), 12–25. https://doi.org/10.1007/s41347-017-0033-3

Wright, R. R., Larson, J., Richards, S., Hoffmann, S., & Nienstedt, C. (2022). The COVID-19 pandemic: Electronic media use and health among U.S. college students. Journal of American College Health, 1–16. https://doi.org/10.1080/07448481.2022.2155463

Wright, R. R., Mohr, C. D., & Sinclair, R. R. (2014). Conflict on the treatment floor: An investigation of interpersonal conflict experienced by nurses. Journal of

Research in Nursing, 19(1), 26–37. https://doi.org/10.1177/1744987113485577

Wright, R. R., Nelson, R., Garcia, S., & Butler, A. (2020). Health behavior change in the classroom: A means to a healthy end? Journal of Primary Prevention, 41(5), 445–472 https://doi.org/10.1007/s10935-020-00605-0

Wright, R. R., Nixon, A., Peterson, Z., Thompson, S., Olson, R., Martin, S., & Marrott, D. (2017). The Workplace Interpersonal Conflict Scale: An alternative to conflict assessment. Psi Chi Journal of Psychological Research, 22(3), 163–180. https://doi.org/10.24839/2325-7342.JN22.3.163

Wright, R. R., Rodriguez Espinoza, A., Adair, M. E., & Marrott, D. (2024). Sticks and stones: Cyberbullying victimization, instigation and associated health among online college students. Journal of Technology in Behavioral Science, 9, 1–13.

Wright, R. R., Schaeffer, C., Mullins, R., Evans, A., & Cast, L. (2020). Comparison of student health and well-being profiles and social media use. Psi Chi Journal of Psychological Research, 25(1), 14–21.  https://doi.org/10.24839/2325-7342.JN25.1.14

Wright, R. R., Shuai, S., Maldonado, Y., & Nelson, C. (2023). The CENTS program: Promoting healthy eating by addressing perceived barriers. Psychology & Health, 1–19 https://doi.org/10.1080/08870446.2021.2011281

Author Note

Robert R. Wright https://orcid.org/0000­0002­4101­7840

Christian Nienstedt https://orcid.org/0000­0001­9654­6734

Carson R. Ewing https://orcid.org/0000­0002­5535­4864

This research was supported by internal funding from Brigham Young University–Idaho for student­ and faculty­directed research. We would like to thank (in alphabetical order) Samuel Chambers, Annie Harrison, Spencer Heindel, Keegan Hokanson, Maren Layton, Stephanie Merrick, Shelby W. Morgan, Sara Mouser, and Lavear Whitney for their assistance throughout the conduction of this study. The authors declare no conflict of interest. The data that we used for the current study are available from the corresponding author, upon reasonable request.

Correspondence concerning this article should be addressed to Robert R. Wright, Department of Psychology, Brigham Young University–Idaho, 210 West 4th South Rexburg, ID 83460­2140. Telephone: 208­496­4085. Email: wrightro@byui.edu

Wright, Wilson, Nienstedt, Ewing, Rodriguez, Anderson, Johnson, and Johnson | Quality Dating Religious Health and Wellness

APPENDIX A

Quality Dating Experience (QDE) Measures

Men Only

1. Make me feel socially comfortable

2. Are okay with a cheap or creative dating activity

3. Communicate well with me

4. Create a connection with me through communication

5. I have interacted with beforehand in another context

6. Are not someone I have just met

7. Have similar standards/morals

8. Have shared interests

9. Are fun to be around

10. Have a personality that is compatible with mine

Women Only

1. Are gentlemen

2. Engage in dating activities with me that are fun and enjoyable.

3. Have a personality that I find interesting/attractive

4. Are respectful

5. Engage in dating activities with me that are appropriate for getting to know them

6. Have similar standards/morals.

7. Are supportive of me

8. Communicate to me the planned dating activity(ies) beforehand.

9. Have shared interests.

10. I feel a connection with.

APPENDIX B

Poor Dating Experience (PDE) Measures

Men Only

1. I feel uncomfortable or uneasy while I am on a date with someone.

2. I see “red flags” (e.g., warning signs) while I am on a date with someone.

3. I feel that my dating partner(s) pressure me to get married too quickly.

4. Those I date are rude or impolite

5. Those I date (or want to date) reject my efforts to date them

6. Investing my time and energy into dating is just not worth it

7. I feel unsafe while I am on a date with someone.

8. Major personal differences arise between me and those I date

Women Only

1. I feel like those I date act or become possessive.

2. According to my dating partner(s), getting married quickly is the norm.

3. I date those who I do not know very well.

4. I feel like those I date try to isolate or separate me from others.

5. I see “red flags” (e.g., warning signs) while I am on a date with someone.

6. I feel uncomfortable or uneasy while I am on a date with someone.

7. I feel unsafe while I am on a date with someone.

8. When I go on dates, I feel the conversation is one-sided.

9. I feel uncomfortable when those I date are unclear about their expectations of me.

10. I feel like those I date try to manipulate me.

11. I am concerned that people I date are not straightforward about their intentions.

12. I feel that my dating partner(s) pressure me to get married too quickly.

Race Differences in Stressor-Related Negative Affect and Daily Rumination

ABSTRACT. This study investigated race differences in the withinperson relationships among daily reports of rumination, stress, and negative affect (NA). Past research illustrating that the withinperson relationship between stress and NA predicts long­term outcomes has emphasized the importance of early intervention for those with stronger daily relationships between stress and NA. We examined whether within­person increases in daily rumination exacerbate the relationship between daily stress and NA. Further, we explored whether the exacerbating effect of daily rumination on the relationship between daily stress and NA is greater for People of Color (POC) compared to White participants. Participants ( N = 92) completed a global questionnaire with demographic information and 2 weeks of daily questionnaires assessing daily reports of perceived stress, NA, and rumination. We analyzed the data using multilevel modeling to parse between­person effects from the within­person relationships among daily stress, NA, and daily rumination. Results revealed that within­person increases in daily rumination and daily perceived stress related to greater daily NA. Greater overall stress and rumination related to greater daily NA. POC reported greater daily NA compared to White participants. The two­way interaction model indicated that daily within­person rumination exacerbated the relationship between daily perceived stress and daily NA. Results suggest that POC may benefit from interventions and preventive strategies aimed at increasing well­being in general and decreasing NA. In addition, introducing strategies to prevent increases in daily rumination on high stress days can be particularly helpful in reducing NA.

Keywords: daily stress, daily negative affect, people of color, daily rumination

Understanding how the daily relationship between stress and negative affect (NA) fluctuates and differs depending on contextual, daily variables (e.g., rumination), and person ­ level variables (e.g., race) can inform preventative care and interventions aimed at uplifting and maintaining well ­ being among those most at risk. Studies have consistently illustrated a strong, positive relationship

between daily stress and NA (Blaxton et al., 2022; Colgan et al., 2019; Montpetit et al., 2010; Mroczek & Almedia, 2004; Stawski et al., 2008), termed stressor related negative affect (SRNA; Stawski et al., 2019). The strength of this relationship significantly predicts chronic physical health conditions and affective distress levels up to 10 years later (Charles et al., 2013; Piazza, 2013). The significant findings emphasize the

Diversity badge earned for conducting research focusing on aspects of diversity.

importance of early intervention for the well­being of those with particularly strong relationships between daily stress and NA (Montpetit et al., 2010). Moreover, stress and coping theory suggests that a person’s perception of stress and the way they cope with that stress can affect their response to the stressor (Folkman & Lazarus, 1986). The physiological impact of stress depends on a variety of factors including contextual, historical, cumulative, and acute stress processes (Epel et al., 2018). Indeed, research has shown that contextual factors not only influence SRNA (Blaxton et al., 2022), but also the long­term effects of the daily SRNA (Blaxton et al., 2022; Brose et al., 2011; Charles et al., 2013; Parrish et al., 2011; Piazza, 2013). Rumination specifically results in increased perceptions of the severity of stress (Watkins & Roberts, 2020). Thus, days of greater rumination may relate to a stronger daily stress­NA relationship, which could highlight a potential pathway for reducing daily SRNA. In addition, some individuals may be particularly susceptible to experiencing greater SRNA and greater rumination due to contextual circumstances. Because People of Color (POC) experience greater discrimination than White people (Dalessandro et al., 2023), we explored whether SRNA is stronger for POC and whether the potentially exacerbating effect of daily rumination on the daily stress­NA relationship is also stronger for POC.

Daily Rumination in Relation to Daily Stress and Negative Affect Research has shown that greater rumination relates to greater stress (Catalino et al., 2017; Genet & Siemer, 2012; Pavani et al., 2016; Sladek et al., 2020) and greater NA (Catalino et al., 2017; Genet & Siemer, 2012; Pavani et al., 2016). Specifically, daily stress and cortisol levels increase on days when people ruminate more than usual (Sladek et al., 2020). Participants ruminated 1.5 standard deviations above their mean score on days of greater than usual stress, which related to higher waking cortisol levels the next day (Sladek et al., 2020). Thus, yesterday’s daily rumination can affect tomorrow’s stress, and greater rumination may exacerbate the negative effects of stress.

Not only does daily rumination have a strong positive relationship with daily stress (Sladek et al., 2020), but greater rumination also influences NA (Catalino et al., 2017; Genet & Siemer, 2012; Pavani et al., 2016). For example, rumination amplifies NA with unnatural life stressors produced in lab settings (Genet & Siemer, 2012). In everyday life, individuals who tend to ruminate more on a day­to­day basis also show greater NA, and this relationship is stronger for individuals experiencing greater overall daily stress (Catalino et al., 2017). Thus,

a combination of stressful experiences and high levels of rumination relate to greater levels of NA (Catalino et al., 2017; Genet & Siemer, 2012; Pavani et al., 2016). These chronically higher levels of NA can lead to worse physiological health and less satisfaction with social relationships (Pavani et al., 2016). In addition, consistent levels of rumination predict symptoms of depression and anxiety up to a year later (Pavani et al., 2016). Thus, rumination appears to intensify and maintain NA levels in short­ and long­term situations (Pavani et al., 2016). These findings indicate significant betweenperson relationships among rumination, stress, and NA. Although between­person findings do not necessarily relate to the within­person level (Brose et al., 2010), we hypothesized that greater daily rumination exacerbates the relationship between daily stress and NA within individuals as well.

Racial Differences in Stress and Negative Affect

POC experience greater stress and NA, and may thus also experience greater daily SRNA (Bergeman et al., 2020; Ong et al., 2009). Indeed, among a sample of Mexican adolescents, racial discrimination reported over the course of the last year predicted daily stress levels (Zeiders, 2017). In addition, NA ratings were higher than the person’s mean NA scores on days with more discriminatory acts or stressors reported and even higher on days when other stressors occurred, like work or family matters, compared to the days reported with only discrimination related stressors (Ong et al., 2009). Discrimination historically causes significantly higher levels of perceived stress in marginalized groups, including groups based on race, gender, and people with different sexual orientations (Dalessandro et al., 2023). Data show that life­long stressors of discrimination cause major depressive disorders and generalized anxiety disorders, comparable to the levels that come with traumatic events such as military combat, sexual assault, and physical assault (Ong et al., 2009). For example, African Americans report increased perceived stress compared to White Americans and are more likely to have severe, long­term, depression (Ojebuoboh et al., 2022). This chronic stress predicts more physiological health problems in the future, including cardiovascular disease (Ong et al., 2009).

Epel et al. (2018) explained that stress encompasses a complex process involving interactions between individual and environmental factors, historical and current events, and psychological and physiological reactivity. The authors provided a model to understand stress that highlights how stressor exposures across the life course and captured at difference time­scales influence habitual responding and stress reactivity. Understanding stress

Race, Daily Stress, and Daily Rumination |

as a process involves recognizing the cumulative effects of stress over time and the interaction between acute stress responses and chronic stressors. For example, chronic stressors, like discrimination, can increase the frequency and severity of daily stressors and amplify emotional and physiological responses to these stressors. This cumulative stress exposure can then lead to longterm health impacts, such as increased inflammation, accelerated aging, and higher risk of disease. Because the strength of the daily relationship between stress and NA also predicts long­term health (Charles et al., 2013; Piazza, 2013), daily SRNA may illustrate one potential pathway for increased stress perceptions among POC (Bergeman et al., 2020). Multilevel modeling allowed us to study stress as a process and compare participants to themselves, situating them within their own context (Hoffman, 2009). Thus, by focusing on the within­person relationships among daily SRNA and rumination, we examined whether POC experience greater SRNA. We furthered explore whether daily rumination amplifies SRNA more for POC compared to White participants.

Purpose of the Current Study

The purpose of the current study was three­fold. First, we hypothesized that daily rumination exacerbates the relationship between daily stress and NA. Second, we hypothesized that POC experience an exacerbated relationship between daily stress and NA. Finally, we explored whether the exacerbating effect of daily rumination on the relationship between daily stress and NA is greater for POC compared to White participants.

Method

Participants and Procedure

Descriptive statistics and intercorrelations among the measured variables are presented in Table 1. The participants included 92 individuals from a convenience sample at Metropolitan State University in St. Paul, Minnesota. After the study was approved by the

Institute’s Human Subjects Review Board, participants were recruited from psychology classes and provided informed consent via Qualtrics. Participants completed a global data questionnaire, identifying race and ethnicity for the current study. Participants then completed nightly questionnaires over the course of 14 days, which assessed daily stress, daily NA, and daily rumination. The dataset included a total of 776 days out of the possible 1,288 days. Consequently, 40% of the data were missing. We do control for the total number of missing days for each participant in the analyses.

Measures

Positive and Negative Affect Schedule (PANAS)

Participants reported NA using the NA subscale from the Positive and Negative Affect Schedule (Watson et al., 1988). The questions used displayed 14 NA items that participants rated on a 5­point scale containing the response items not at all, a little, moderately, quite a bit, and extremely. For example, participants were asked to respond to, “Today I felt guilty,” using the 5­point scale. If more than two responses were missing from the reported questionnaire, the total NA score was coded as missing. If fewer than two questions were missing from the reported questionnaire, the missing data point was substituted with the mean score of NA for the participant for that day. Individual­level reliability across the 14 days of the study was .86 (see Bonito et al., 2012; Nezlek, 2017, for computational details).

Perceived Stress Scale

Participants reported answers for stress each night using the 10 ­ item Perceived Stress Scale (Cohen & Williamson, 1988). The questions were modified to reflect their perceived stress over the course of the day they reported. Specifically, the original Perceived Stress Scale asks participants to report their feelings of stress over the last month, but we asked participants to report their feelings of stress over the course of that day, which is consistent with previous research using the Perceived Stress Scale to assess daily SRNA (Blaxton et al., 2023). The questionnaire was rated on a 4­point scale containing the response options strongly disagree, disagree, agree, and strongly agree. For example, participants responded to, “I was upset today because of something the happened unexpectedly,” using the 4­point scale. If more than two questions were missing from the reported questionnaire, the participant’s stress score was coded as missing for that day. Questionnaires missing fewer than 20% substituted the mean score for the missing day. Individual­level reliability across the 14 days of the study was .74 (see Bonito et al., 2012; Nezlek, 2017 for computational details).

TABLE 1

Daily Rumination Measure

Participants reported their levels of rumination by answering four questions and rating them on a scale of 0–100 (Slavish et al., 2018). For example, participants responded to “Today, how often did you experience a train of thought that was difficult to get out of your head?” If only one question was missing from the reported answers, the mean for the other three scores was substituted for the missing item. If more than one question was missing, the daily rumination score was coded as missing. Individual­level reliability across the 14 days of the study was .79 (see Bonito et al., 2012; Nezlek, 2017, for computational details).

Analytic Approach

We analyzed the data with multilevel modeling, where Level 1 included daily scores (i) for each participant, which were nested in Level 2 average scores (j). To effectively parse the within ­ person effects from the between­person effects, we person mean centered each Level 1 variable (Wang & Maxwell, 2015). The main effects equation was:

NAij = b0j + b1j(day-1) + b2j(stressij – stressj) + b3j(ruminationij – ruminationj) + eij

b0j = g00 + g01(POC) + g02(stress ) + g03(rumination ) + u0j

b1j = g10 + u01

b2j = g20 + u02

b1j = g30 + u03

Level 1 includes the effect of time (day) to control for its effect on daily NA as well as within­person fluctuations in daily stress (g20) and daily rumination (g30). Level 2 includes the between­person effects of whether the participant was a POC ( g 10), average stress levels ( g 20), and average rumination levels ( g 30) over the 14 days of data collection. Although we do not show it in the equation for the sake of simplicity, we also controlled for total number of missing days and age at Level 2. The SAS Proc Mixed procedure with maximum likelihood allowed us to analyze the data to test the aims of our study. We first examined the main effects model (Model 1) to test whether greater daily stress relates to greater daily NA among the participants. Next, we added the possible Level 1 and cross­level two­way interactions to the model between daily stress and daily rumination. ( g 40), POC and daily stress ( g 21), and POC and daily rumination (g31) to examine whether daily rumination exacerbates the relationship between daily stress and daily NA as well as whether POC experience an exacerbated relationship between daily stress and daily NA compared to White participants. Finally, we created the three­way interaction model by including the cross­level interaction between daily stress, daily rumination, and POC (g41) to examine whether the exacerbating effect of

daily rumination on the daily stress­NA relationship is greater for POC compared to White participants.

Results

Demographic Results

The participants (N = 92) ranged in age from 17–65 (M = 31.71; SD = 11.93). Seventy­three participants reported their gender with 12 reporting a gender identity of man, 58 of women, and three of “Another Gender Identity.” The participants (N = 76) who reported their race/ethnicity included 43 people who identified as White and 33 that identified as a POC. More specifically, 54% of the participants identified as White, 20% identified as Black, 18% identified as Asian, 4% identified as Hispanic, 3% identified as Middle Eastern, and 1% identified as American Indian/Alaskan Native. The 72 participants who reported income included 45 participants with above $25,000 a year. The other 27 participants reported an income of $25,000 or less. Among the 92 participants, there were 512 days missing in total, causing 39.75% of the possible data to be missing. We analyzed whether there were demographic differences in any of the variables of interest. Results revealed that older adults reported less NA (b = ­0.23, p = .02), less overall stress (b = ­0.10, p = .03), and less rumination (b = ­0.61, p = .007) compared to younger adults. There were also differences in age between POC and White participants (t = 2.78; p = .007), with more White participants being older (n = 42; M age = 34.81; SD age = 12.73) compared to POC (n = 28; M age = 27.07; SD age = 8.98). Finally, a greater amount of missing data among the participants did predict greater perceived stress (b = 0.35, p < .001), greater NA (b = 0.48, p = .02), and greater rumination (b = 1.09, p = .03). Because age and number of missing days related to both the independent and dependent variables, we controlled for age and number of missing days in the multilevel models.

Results From Analytic Models

Results revealed that 58% of the variance in daily NA exists between participants (t00 = 73.07, z = 6.00, p < .001) and within­person fluctuations explain 42% of the variance in daily NA ( s 2 = 53.66, z = 18.49, p < .001; Nezlek, 2001). The main effects model revealed that within ­ person increases in daily rumination ( g 30 = 0.18, p < .001) and daily perceived stress (g20 = 0.72, p < .001) related to greater daily NA. Greater overall stress ( g 02 = 0.80, p < .001) and rumination ( g 03 = 0.19, p < .001) related to greater daily NA. In addition, POC reported greater daily NA (M = 28.49, SD = 12.46) compared to White individuals (g01 = 2.83, p = .02; M = 24.09, SD = 5.90). The two­way interaction model that included three interactions between

Blaxton
Dobrzynski

Race, Daily Stress, and Daily Rumination |

daily stress and daily rumination, POC status and daily stress, and POC status and daily rumination indicated that daily within­person rumination exacerbated the relationship between daily perceived stress and daily NA ( g 40 = 0.01, p < .001; see Figure 1). The two­way interactions between POC and daily stress (g21) as well as POC and daily rumination (g31) were not significant. The three­way interaction between POC, daily stress, and daily rumination (g41) was also not significant.

Discussion

Results from the study emphasized the importance of situating SRNA in the context of the individual experiencing that SRNA to best inform interventions and preventative care strategies. Specifically, the results expanded upon previous SRNA research (Blaxton et al., 2022; Colgan et al., 2019; Montpetit et al., 2010; Mroczek & Almedia, 2004; Stawski et al., 2008), indicating that college students also experience significant SRNA. Moreover, they illustrated that days of greater rumination are also days of greater SRNA, suggesting that targeting rumination may be one pathway to reduce stress reactivity. Finally, results indicated that POC experience greater daily NA overall compared to White participants. Although many individuals would likely benefit from interventions and preventive care strategies aimed at developing resilience to stress, lowering NA, and promoting well­being, our study indicated that POC experience greater daily NA than White individuals. This finding adds to the literature that highlights differences in daily well­being between POC and White individuals (Dalessandro et al., 2023; Ong et al., 2009). Previous

research has indicated that greater discrimination relates to poorer daily well­being (Ong et al., 2009; Zeiders, 2017). Epel et al. (2018) explained that stress results from an interplay of a variety of contextual factors both within and outside the individual. Experiencing greater daily NA compared to White individuals may reflect the negative effects from long­term, historical discrimination. Interventions and preventive care strategies focusing on increasing well­being in general among POC, including reducing social discrimination, may be particularly beneficial.

The lack of support for all hypotheses may be due to the high amount of missing data; however, we do control for missingness in the analyses. Notably, individuals with a greater amount of missingness tended to report greater stress, NA, and rumination. Including more participants in the sample might increase the power of the study and increase the likelihood of capturing participants with higher scores on the variables of interest. In addition, future research can examine whether SRNA and rumination differ based on specific racial differences, rather than just POC compared to White participants. Finally, because past research has indicated that individuals higher in trait acceptance show less overall daily rumination, one potential pathway for reducing the relationship between daily rumination and SRNA may be through increasing acceptance (Catalino et al., 2017). Thus, future research can examine how a Just­In­Time intervention, aimed at increasing acceptance in response to a momentary increase in daily stress, may reduce the exacerbating effect of daily rumination on daily SRNA.

In sum, results from the current study showed that POC do illustrate greater daily NA compared to White participants; however, we do not have evidence that POC experience the relationship between SRNA and rumination differently than White participants. We do see that increases in daily rumination relate to an exacerbated relationship between daily stress and NA, suggesting that targeting daily rumination may be an effective way to reduce SRNA.

References

Blaxton, J. M., Whitehead, B. R., & Bergeman, C. S. (2022). Age differences among different sources of stressor related negative affect. The International Journal of Aging and Human Development, 97(3), 289–305. https://doi.org/10.1177/00914150221112282

Bonito, J. A., Ruppel, E. K., & Keyton, J. (2012). Reliability estimates for multilevel designs in group research. Small Group Research, 43(4), 443–467. https://doi.org/10.1177/1046496412437614

Catalino, L. I., Arenander, J., Epel, E., & Puterman, E. (2017). Trait acceptance predicts fewer daily negative emotions through less stressor-related rumination. Emotion, 17(8), 1181–1186. https://doi.org/10.1037/emo0000279

Charles, S. T., Piazza, J. R., Mogle, J., Sliwinski, M. J., & Almeida, D. M. (2013). The wear and tear of daily stressors on mental health. Psychological Science, 24(5), 733–741. https://doi.org/10.1177/0956797612462222

Cohen, S., & Williamson, G. (1988). Perceived stress in a probability sample of the US. In S. Spacapam & S. Oskamp (Eds.), The social psychology of health: Claremont symposium on applied social psychology (pp. 31–67). Sage.

FIGURE 1
Daily Stress and Daily Rumination

Colgan, D. D., Klee, D., Memmott, T., Proulx, J., & Oken, B. (2019). Perceived stress mediates the relationship between mindfulness and negative affect variability: A randomized controlled trial among middle‐aged to older adults. Stress and Health: Journal of the International Society for the Investigation of Stress, 35(1), 89–97. https://doi.org/10.1002/smi.2845

Dalessandro, C., & Lovell, A. (2023). Race, marginalization, and perceptions of stress among workers worldwide post‐2020. Sociological Inquiry, 93(1), 571–591. https://doi.org/10.1111/soin.12505

Epel, E. S., Crosswell, A. D., Mayer, S. E., Prather, A. A., Slavich, G. M., Puterman, E., & Mendes, W. B. (2018). More than a feeling: A unified view of stress measurement for population science. Frontiers in Neuroendocrinology, 49, 146–169. https://doi.org/10.1016/j.yfrne.2018.03.001

Folkman, S., Lazarus, R. S., Dunkel-Schetter, C., DeLongis, A., & Gruen, R. J. (1986). Dynamics of a stressful encounter: Cognitive appraisal, coping, and encounter outcomes. Journal of Personality and Social Psychology, 50(5), 992–1003. https://doi.org/10.1037/0022-3514.50.5.992

Genet, J. J., & Siemer, M. (2012). Rumination moderates the effects of daily events on negative mood: Results from a diary study. Emotion, 12(6), 1329–1339. https://doi.org/10.1037/a0028070

Montpetit, M. A., Bergeman, C. S., Deboeck, P. R., Tiberio, S. S., & Boker, S. M. (2010). Resilience-as-process: Negative affect, stress, and coupled dynamical systems. Psychology and Aging, 25(3), 631–640. https://doi.org/10.1037/a0019268

Mroczek, D. K., & Almeida, D. M. (2004). The effect of daily stress, personality, and age on daily negative affect. Journal of Personality, 72(2), 355–378. https://doi.org/10.1111/j.0022-3506.2004.00265.x

Nezlek, J. B. (2017). A practical guide to understanding reliability in studies of within-person variability. Journal of Research in Personality, 69, 149–155. https://doi.org/10.1016/j.jrp.2016.06.020

Ojebuoboh, A. R., Gonzalez-Feliciano, A. G., Brown, K. M., Khan, R. J., Xu, R., DeRoo, L. A., Lewis, J., Quarells, R. C., & Davis, S. K. (2022). Association of active coping to unfair treatment with perceived stress and depressive symptoms in African Americans: Mh-grid study. BMC Psychiatry, 22. https://doi.org/10.1186/s12888-022-03772-y

Ong, A. D., Fuller-Rowell, T., & Burrow, A. L. (2009). Racial discrimination and the stress process. Journal of Personality and Social Psychology, 96(6), 1259–1271. https://doi.org/10.1037/a0015335

Parrish, B. P., Cohen, L. H., & Laurenceau, J.-P. (2011). Prospective relationship between negative affective reactivity to daily stress and depressive symptoms. Journal of Social and Clinical Psychology, 30(3), 270–296. https://doi.org/10.1521/jscp.2011.30.3.270

Pavani, J.-B., Le Vigouroux, S., Kop, J.-L., Congard, A., & Dauvier, B. (2016). Affect and affect regulation strategies reciprocally influence each other in daily life: The case of positive reappraisal, problem-focused coping, appreciation and rumination. Journal of Happiness Studies: An Interdisciplinary Forum on Subjective Well-Being, 17(5), 2077–2095. https://doi.org/10.1007/s10902-015-9686-9

Piazza, J. R., Charles, S. T., Sliwinski, M. J., Mogle, J., & Almeida, D. M. (2013). Affective reactivity to daily stressors and long-term risk of reporting a chronic physical health condition. Annals of Behavioral Medicine: A

Publication of the Society of Behavioral Medicine, 45(1), 110–120. https://doi.org/10.1007/s12160-012-9423-0

Sladek, M. R., Doane, L. D., & Breitenstein, R. S. (2020). Daily rumination about stress, sleep, and diurnal cortisol activity. Cognition and Emotion, 34(2), 188–200. https://doi.org/10.1080/02699931.2019.1601617

Slavish, D. C., Sliwinski, M. J., Smyth, J. M., Almeida, D. M., Lipton, R. B., Katz, M. J., & Graham-Engeland, J. E. (2018). Daily Rumination Measure [Database record]. PsycTESTS. http://dx.doi.org/10.1037/t68024-000

Stawski, R. S., Scott, S. B., Zawadzki, M. J., Sliwinski, M. J., Marcusson-Clavertz, D., & Kim, J., Lanza, S. T., Green, P. A., Almeida, D. M., & Smyth, J. M. (2019). Age differences in everyday stressor-related negative affect: A coordinated analysis. Psychology and Aging, 34(1), 91–105. https://doi.org/10.1037/pag0000309

Stawski, R. S., Sliwinski, M. J., Almeida, D. M., & Smyth, J. M. (2008). Reported exposure and emotional reactivity to daily stressors: The roles of adult age and global perceived stress. Psychology and Aging, 23(1), 52–61. https://doi.org/10.1037/0882-7974.23.1.52

Watkins, E. R., & Roberts, H. (2020). Reflecting on rumination: Consequences, causes, mechanisms and treatment of rumination. Behaviour Research and Therapy, 127, 103573. https://doi.org/10.1016/j.brat.2020.103573

Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063–1070. https://doi.org/10.1037/0022-3514.54.6.1063

Zeiders, K. H. (2017). Discrimination, daily stress, sleep, and Mexican-origin adolescents’ internalizing symptoms. Cultural Diversity and Ethnic Minority Psychology, 23(4), 570–575. https://doi.org/10.1037/cdp0000159

Author Note

Jessica M. Blaxton https://orcid.org/0000-0002-6548-9826

Sydney Dobrzynski is now in the Psychology Department at Augsburg University.

Positionality Statement: Jessica identifies as a heterosexual, cisgender White woman. Jessica is nondisabled. Sydney identifies as a nonheterosexual cisgender White woman, who is disabled according to the Americans with Disabilities Act. The authors acknowledge that their identities influence their perspectives.

Public Significance Statement: This research indicates that People of Color experience greater daily NA compared to White participants. In addition, people experience greater stressor related NA when they ruminate more than they typically do, suggesting that targeting daily rumination may be one way to reduce the longterm ramifications of daily stress reactivity.

Neither I nor any member of my immediate family have a significant financial arrangement or affiliation with any product or services used or discussed in my paper, nor any potential bias against another product or service.

Correspondence concerning this article should be addressed to Jessica Blaxton, Psychology Department, Metropolitan State University, St. Paul, MN 55108. Email: Jessica.blaxton@metrostate.edu

Publish Your Research in Psi Chi Journal

Undergraduate, graduate, and faculty submissions are welcome year round. Only one author (either first author or coauthor) is required to be a Psi Chi member. All submissions are free. Reasons to submit include

• a unique, doctoral­level, peer­review process

• indexing in PsycINFO, EBSCO, and Crossref databases

• free access of all articles at psichi.org

• our efficient online submissions portal

View Submission Guidelines and submit your research at www.psichi.org/?page=JN_Submissions

Become a Journal Reviewer

Doctoral­level faculty in psychology and related fields who are passionate about educating others on conducting and reporting quality empirical research are invited become reviewers for Psi Chi Journal. Our editorial team is uniquely dedicated to mentorship and promoting professional development of our authors—Please join us!

To become a reviewer, visit www.psichi.org/page/JN_BecomeAReviewer

Resources for Student Research

Looking for solid examples of student manuscripts and educational editorials about conducting psychological research? Download as many free articles to share in your classrooms as you would like.

Search past issues, or articles by subject area or author at www.psichi.org/journal_past

Learn About Psi Chi

Psi Chi is the International Honor Society in Psychology. Membership is primarily open to undergraduates, graduate students, transfer students, full­time and part­time faculty members, and alumni.

See membership benefits and a link to apply at www.psichi.org/page/member_benefits Register an account: http://pcj.msubmit.net/cgi-bin/main.plex

Turn static files into dynamic content formats.

Create a flipbook
Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.