Research Reports

Romanian Children’s Representations of Negative and Self-Conscious Emotions in a Narrative Story Stem Technique

Loredana Apavaloaie*a, Timothy Pageb, Loren D. Marksb

Europe's Journal of Psychology, 2014, Vol. 10(2), 318–335, https://doi.org/10.5964/ejop.v10i2.704

Received: 2013-10-18. Accepted: 2014-03-08. Published (VoR): 2014-05-28.

Handling Editor: Rhian Worth, University of South Wales, Newport, United Kingdom

*Corresponding author at: Western Carolina University, College of Education and Allied Professions, Department of Human Services, Birth-Kindergarten Program, 218B Killian Building, USA. E-mail: lapavaloaie@wcu.edu

This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

This research uses children’s story-stem play narratives to investigate dimensions of negative emotional expression. Fifty-one Romanian children between 6 and 11-years old participated in the study. Children’s narratives were coded for three basic negative emotions and five self-conscious emotions. Parents completed a general questionnaire for demographic data and the amount of time they spent with their children. Differences were found for frequencies of negative emotional representations in relation to the specific story-stems in which they occurred. Girls were more likely than boys to enact in their narratives guilt feelings coupled with apology following some wrongdoing. Children who spent more time with parents enacted significantly less anger and fear. Simultaneous expressions of multiple negative emotions were observed in the narrative responses of these middle childhood-aged Romanian children. While findings should be viewed with caution, owing to the small and homogeneous sample, new directions for future research with this assessment method are indicated.

Keywords: story stems, representations, negative emotions, self-conscious emotions, middle-childhood

Young children’s experience and expression of specific negative emotions have been a growing focus in the developmental psychological literature. By negative emotions, we refer to emotional responses to unpleasant circumstances, including the specific emotions of anger, disgust, guilt, fear, sadness, and shame (Colombetti, 2005). A specialized sub-set of this literature is the study of how children represent emotional experience through creative expression in various forms such as the stories they tell. Young children’s developing capacities for the representation of experience provide researchers with opportunities for understanding complex phenomena that would otherwise be very difficult for children to communicate directly. Studies have linked children’s representations of negative emotions to physiological and behavioral indicators (e.g., Kochanska, 2001; Wan & Green, 2010), patterns of language usage (e.g., Melzi & Fernández, 2004), and parenting (e.g., Lagacé-Séguin & d’Entremont, 2006). Many characteristics of children’s representations of negative emotions have also been studied. Within this literature, associations between children’s verbalized representations of negative emotions and attachment security and their emotional understanding have been the most studied (Fivush & Wang, 2005). Taken together, the existing evidence supports the contention that children’s representations of negative emotionality as expressed in relationship contexts can be reliably assessed.

Basic Negative Emotions

Paul Ekman, one of the most influential researchers in the field of emotional facial expression and the theory of basic negative emotions, has identified three specific negative emotions, also called primary aversive emotions, anger, fear, and sadness (Ekman, 1992, 1999). These are expressed universally in all humans via facial expressions, regardless of race, culture, sex, ethnicity, or national origin (Ekman, 2003). For this reason, they are known as basic negative emotions (Johnson-Laird & Oatley, 1989). Basic negative emotions appear within the first nine months of life (Campos, Barrett, Lamb, Goldsmith, & Stenberg, 1983). They have a significant role in children’s social development (Izard, 1992) in that understanding their expression is always dependent on the social relational contexts in which they occur. As reactions to disagreeable circumstances, the basic negative emotions also stimulate preparation for action to improve such circumstances (Rutherford, Chattha, & Krysko, 2008).

Self-Conscious Emotions

In addition to the basic negative emotions, children develop self-conscious emotions (Lewis, 1994) as they move into the pre-school years. Self-conscious emotions emerge from how children evaluate their actions in connection to social norms or how they think others will evaluate their actions. Thus, self-conscious emotions are a unique class of emotions because they involve more complex perceptions of motivation and appraisal (Bretherton, Fritz, Zahn-Waxler, & Ridgeway, 1986). Lewis (1994) identifies the specific self-conscious emotions of shame and guilt. Whereas basic negative emotions occur when children react more directly to external circumstances (Russell & McAuley, 1986), self-conscious emotions occur when children evaluate themselves in relation to some perceived normative social standard (Lewis, 2000).

The expression of negative and self-conscious emotions at extreme levels may be indicators of persistent problems with emotion regulation which could be associated with deleterious effects on a child’s development. In simple terms, emotional and/or behavioral problems corresponding to these dimensions have long been associated in the developmental literature with externalizing and internalizing problems (Achenbach & Edelbrock, 1981). The fact that a child may express these emotions, however, should not be equated with simply good or bad. Children’s capacities to express a range of emotions, especially those associated with disturbing experiences, are a hallmark of good mental health, as long as this does not overwhelm the child or reflect persistent problems in emotion regulation (Boris & Page, 2012). Concern should arise, therefore, when extreme levels of negative and self-conscious emotions are observed. Children appear to learn to modulate and regulate emotional expression in their early caregiving relationships (Kopp, 1982). Long-standing dysregulated emotion may be evidence of persistent problematic interactions with caregivers.

The study of young children’s experience of self-conscious emotions has been increasing during the past three decades due to the development of new assessments. Unlike the basic negative emotions, the expressions of self-conscious emotions are not as easily identifiable through facial expressions (Izard, 1977), thus, it is difficult to assess them directly (Tangney & Dearing, 2002). The most widely used assessments for measuring self-conscious emotions are child-report assessments, global adjective checklists, scenario-based assessments, statement-based assessments, and researcher-report assessments of children’s nonverbal behavior (Tracy, Robins, & Tangney, 2007). These methods rely on either direct questions or researcher observations. In contrast, projective and representational assessments attempt to assess children’s perceptions indirectly by tapping into their schematic memories of familiar experiences (Hodges, Steele, Hillman, & Henderson, 2003). A presumed advantage of such methods is that they may mitigate the obstacle of limited self-reflective capacities commonly found in young children. Among recent developments in representational assessments for children, narrative story-stem techniques have acquired an extensive empirical literature (see Emde, Wolf, & Oppenheim, 2003).

Narrative Story Stem Techniques

Narrative story stem techniques are representational assessments primarily designed to assess young children’s internal working models of attachment, caregiving, or other close relationships (Bretherton, Ridgeway, & Cassidy, 1990). Bowlby’s (1973) concept of internal working model refers to the extracted and synthesized assumptions and expectations children have formed about the availability and supportiveness of caregivers, as well as their own worthiness to receive care. The organization of these memories serves as an unconscious “lens,” or cognitive filter, through which the young child views himself/herself, others, and relations with others.

The emergence of language and symbolic play in early childhood indicates new capacities for representational thought, including more complex organizations of internal working models (Appelman, 2000). As the maturing child develops greater sophistication in autonomous capacities, the nature of represented experience with caregivers becomes increasingly influential for the achievement of emotional security. Because of the significance of these qualitative changes in cognitive and emotional capacities in early and middle childhood, assessments of children’s perceptions and well-being should target their represented experience (Main, Kaplan, & Cassidy, 1985). Accumulated evidence has established that narrative story stem techniques are an important method to access children’s internal working models and accomplish this aim (Emde, 2003).

Narrative story-stem techniques present children aged approximately 4 through 10 with brief story-stems that depict highly emotional, moral, and/or relationship-oriented scenarios. Each story-stem typically features a familiar, mild conflict, enacted with the aid of props and family figurines to facilitate their comprehension (Page, 2001). Each story is begun by the interviewer by moving the family figurines and props. Once the story-stem has been presented, the child is asked by the interviewer, “Please, show and tell me what happens next!” In order to indicate that the child should continue or end the story, the interviewer uses standard prompts throughout the protocol (e.g., “Does anything else happen in the story?” or “Is that the end of the story?”). Indications of the end of each story occur when the child addresses the main point, signals that s/he ends the story, or does not continue the story after the prompts.

Narrative story-stem tasks have demonstrated validity as assessments of young children's representations of attachment and parent-child relationships. A substantial literature has demonstrated associations between young children’s narrative responses and their current attachment security to their mothers as reflected in the Strange Situation assessments of attachment in infancy (Bretherton, Ridgeway, & Cassidy, 1990; Cassidy, 1988) and middle childhood (Moss, Bureau, Béliveau, Zdebik, & Lépine, 2009). Children’s narrative responses have also been shown to be associated with qualities of parent-child interactions observed at home (Bretherton et al., 2013; Dubois-Comtois & Moss, 2008).

A number of story-stem protocols have been developed to access children’s experiences and perceptions (Bettmann & Lundahl, 2007). The most widely applied of these are the MacArthur Story Stem Battery (MSSB; Bretherton, Oppenheim, Buchsbaum, Emde, & The MacArthur Narrative Working Group, 1990), the Attachment Story Completion Task (ASCT; Bretherton, Oppenheim, et al., 1990), and the Manchester Child Attachment Story Task (MCAST; Green, Stanley, Smith, & Goldwyn, 2000). Many researchers have also adapted story-stem protocols to coincide with the topics of their studies and research questions (e.g., Pass, Arteche, Cooper, Creswell, & Murray, 2012).

According to Hodges and colleagues (2000), the narratives children create in response to story stem assessments are more than a simple copy of their experiences of parent-child relationships. They may elicit how children reflect upon reality or how they create imaginary situations about the realities of their family life. Thus, through representational methods such as story stem protocols, children can explore and express their understanding of family roles and personal family experiences that may transcend their literal reality (Hodges, Steele, Hillman, Henderson, & Neil, 2000). The representational nature of story-stem protocols may also provide a sense of detachment from the direct recall of emotionally intense experience, which can allow children a sense of control and safety. Administrators, therefore, must be trained to be sensitive to this potential dimension of some children’s experience, and assist them to engage in the protocol, or not, as they may choose.

Negative Emotionality in Narrative Story-Stem Research

The research to date with narrative story-stem techniques has involved primarily Western samples, though the study of non-Western children has been growing in recent years, notably in South Korea and Japan (e.g., see Katsurada, 2007). Cultural variations in the ways in which children make use of this method are an important and on-going focus for research, to which this study contributes. Approaches to coding children’s narratives tend to vary with the interest of researchers. However, all approaches involve at some level assessment of qualities of emotional expression enacted in the narratives, with particular attention to negative emotions. For example, Wan and Green (2010) used The Manchester Child Attachment Story Task (MCAST; Green et al., 2000) with a sample of 77 clinically-referred children in the UK. They assessed associations between the negative and atypical story content themes and child disruptive behavior and maternal depressed mood. Children’s narrative responses were coded with a new procedure developed by the first author, a classification of negative and atypical story content themes (e.g., maternal/child anger, maternal/child sadness, maternal/child fear). The results of the study indicated that 83% of the children displayed at least one negative and/or atypical story content theme. Representations of children as aggressive or angry, however, were rare. Children’s representations of negative story content themes were associated with severe behavioral symptoms reported by their mothers. Children in the clinical range of behavior disorders had a tendency to represent more maternal sadness, as well as role-reversal and maternal injury. Compared to boys, girls with depressed mothers enacted fewer total negative representations.

Toth and colleagues (2000) also investigated associations between story-stem representations and children’s behavioral problems. They coded story-stem representations of moral-affiliative (e.g., guilt) and conflictual themes (e.g., aggression) in the MacArthur Story Stem Battery (MSSB; Bretherton, Oppenheim, et al., 1990) in a sample of 65 preschoolers (43 maltreated and 22 non-maltreated). They drew their story-stem coding protocol from the MacArthur Narrative Coding Manual (Robinson, Mantz-Simmons, Macfie, & The MacArthur Narrative Working Group, 1992) and the Narrative Emotion Coding Manual (Warren, Mantz-Simmons, & Emde, 1993). The findings of the study indicated that maltreated children, in comparison with non-maltreated children, represented fewer moral-affiliative themes and more conflictual themes.

Warren, Emde, and Sroufe (2000) investigated the play narratives of 35 nonclinical children in relation to mother ratings of child anxiety when the children were 6 years of age. Their study demonstrated that children’s negative story endings, typified by fear or other negative emotion, significantly predicted separation anxiety, overanxious, and avoidant disorder symptoms at a 12-month follow-up. Their coding of children’s negative story endings was based on the Narrative Emotion Coding system (NEC; Warren et al., 1993), which has been a particularly significant contribution to the study of anxiety symptoms in young children’s story stem narratives. Using the NEC, Warren (2003) demonstrated associations between negative emotions, narrative incoherence, and children’s inability to resolve the central problems of the story stem narratives.

Consistent with these findings in younger children, von Klitzing, Kelsay, Emde, Robinson, & Schmitz (2000) used the MacArthur Story Stem Battery (Bretherton, Oppenheim, et al., 1990) and coding system to code content themes and coherence in the narrative responses of a nonclinical sample of 652 same-sex twins. The findings indicated that child’s emotionally incoherent responses and dysregulated aggression were positively associated with parent ratings of externalizing symptoms with the Child Behavior Checklist (CBC; Achenbach & Edelbrock, 1981).

Some limited research with story-stem methods has included analyses of representations of social emotions. Aksan and Goldsmith (2003), for example, investigated associations between maternal reports of temperament and children’s guilt representations in two affectively-focused narratives presenting peer transgression and stealing scenarios. This study involved a nonclinical sample of 114 five-year-old girls. Four components (i.e., confession, punishment, repair, and withdrawal) reflected children’s guilt in the narratives, coded on a 5-point scale. The findings indicated that components of temperamental characteristics were associated with more confession representations but fewer withdrawal representations. In contrast, none of the temperamental characteristics was associated with punishment representations or repair representations. Similar to the Aksan and Goldsmith study, Luby and colleagues (2009) also used narrative story-stems to specifically measure children’s expressions of self-conscious emotions. In their study, 4 story-stems taken from the MSSB were used with a sample of European-American depressed preschoolers between 3 and 5 years of age. Representations of shame and guilt, as coded with the MacArthur Narrative Coding Manual (Robinson, Mantz-Simmons, Macfie, Kelsay, & The MacArthur Narrative Working Group, 2002), were significantly associated with preschool depression.

Although studies on representations of negative emotionality in early childhood have received growing interest in story stem research, questions remain about the extent of variability of such expressions. In addition, there has been relatively little attention paid to variations in representational expressions of emotion in middle childhood-aged children. Furthermore, much remains to be learned about how such expression may vary cross-culturally.

Gender and age differences in children’s responses to narrative story stems

Previous findings indicate gender differences in analyses of children’s narrative representations in story-stem protocols, including the use of negative themes. The Luby et al. (2009) study referenced above also examined gender differences in positive and negative emotional reactivity. They found that, in contrast to comparison groups, boys within the depressed/at risk groups displayed a predominance of reactive anger. On the other hand, girls showed a predominance of reactive sadness. Earlier studies with typically developing children also indicated boys displaying higher levels of manifestations of anger than girls (Zahn-Waxler, Shirtcliff, & Marceau, 2008). These studies also found girls displaying higher levels of fear, sadness, and guilt than boys (Carter, Briggs-Gowan, Jones, & Little, 2003; Zahn-Waxler et al., 2008). Similarly, boys’ narrative responses have been shown to be characterized by more aggressive and fewer prosocial themes than girls’ (Hodges, Steele, Hillman, & Henderson, 2003; Hodges et al., 2000; Page & Bretherton, 2001). Furthermore, Luby and colleagues (2009) found that girls used more shame and guilt representations than boys on the MSSB.

The middle childhood years bring more sophisticated abilities to understand and interpret basic and self-conscious emotions (Denham, Bassett, & Wyatt, 2007). Emotional expression is more pronounced with increasing age. Growing socialization pressures require ever more complex dimensions of communication of intention and need (Chaplin & Aldao, 2013; Kopp, 1982). Luby et al. (2009) revealed that older children represented more frequent expressions of shame than younger children. Drawing on the literature on gender and age differences, we anticipated gender and age influences on narrative qualities. Boys’ tendencies to express more aggression and less fear, sadness, shame, and guilt than girls at this age have been documented (Gillian, 1982).

Amount of time parents spend with their children and children’s expression of negative emotionality in narrative stems

We originally intended to examine the children’s story-stem responses in relation to an index of relationship qualities in their families. However, due to restrictions we faced in time and resources, we were extremely limited in the amount of data we were able to gather from families. We therefore decided to ask only one simple question regarding the amount of time parents spent per day with their children. We focused on this one simple dimension in the assumption that the busy lives of middle-class parents where both parents work outside the home are likely to present fewer opportunities for positive interactions for many young children. This may have negative consequences for their emotional lives. While admittedly a crude measure, we assumed that total amount of time spent could, for most children, capture an important dimension of needed parental contact. We therefore expected that a measure of time spent with parents would vary negatively with children’s representations of negative emotions.

Purpose of the study

Based on attachment theory and previous lines of work, the present study was designed to investigate children’s narrative representations of negative and self-conscious emotions in middle childhood. This age period has not been studied extensively despite its theoretical significance. It is among the first studies in the literature on children’s narrative representations, along with Wan and Green (2010), to systematically examine these dimensions of emotional expression simultaneously. The study is also unique in that, for the first time, narrative representations among a sample of Romanian children were studied. The first goal of the study therefore was to describe the frequencies of children’s representations of negative and self-conscious emotions in relation to the specific story-stems in which these occur. We expected that the emotional valences presented in the story-stems themselves would influence the emotions the children expressed in their narratives, essentially a priming effect. Such correspondences could have important implications for the ways in which narrative protocols are presented and the conclusions drawn from them.

We also examined the child characteristics of gender and age, and the amount of quality time typically spent with parents, in relation to the expression of negative and self-conscious emotions in narratives. We hypothesized that boys would be more likely to represent anger than girls, whereas girls would be more likely to represent fear and sadness than boys in their stories. Regarding gender differences in children’s representations of self-conscious emotions, we hypothesized that girls would be more likely to represent shame and guilt than boys. We also hypothesized that older children would represent higher frequencies of negative emotions. Older children have advanced understanding and capacities for communication, such as conveying requests for help, comfort, or support and for addressing social wrongdoing in relation to significant social partners. Finally, we hypothesized that the more time children spend with their parents, the lower frequencies of negative emotions they would represent in their narratives.

Method

Participants

The first author recruited a sample consisting of 51 children (32 boys/19 girls) and their parents from Richard Wurmbrand Collegei, in Iasi, Romania. The age of participants ranged from 6 to 11 (M = 8.47, SD = 1.10). The children were recruited from the school’s four first- through fourth-grade classes. Eight children were in the first grade, 15 children were in the second grade, 15 children were in the third grade, and 13 children were in the fourth grade. There were 16 to 28 children in each class.

Measures

Representations of negative and self-conscious emotions

Children’s representations of negative and self-conscious emotions were assessed with the Narrative Story-Stem Task (NSST). This is a generic term we use for the basic method underlying story stem protocols. Ten specific story-stems were employed in the reported study (see Table 1 for a short description of the stories).

Table 1

Short Descriptions of the Story Stems

Story Stem Story Description
Birthday party Warm-up: The mother calls everyone to the table to have a birthday party. The younger child has a birthday (not coded).
Spilled juice The family of four (a younger sibling, an older sibling, a mother, and a father) is sitting around the dinner table, and the younger sibling reaches across the table for some juice and accidentally spills the pitcher of juice.a
Hurt knee The two siblings and the parents go to the park. The younger sibling sees a rock and wants to climb it. On the way up, the child falls down and cries out that he has hurt his knee.b
Monster The mother tells the older child that it is time to go to bed. The child goes into the bed room and reports seeing a monster.b
Departure The parents tell the children that they are going on a trip over night and that the grandma will stay with them. The child is asked to physically make the car, which carries the parents, drive away.b
Reunion The investigator drives the car back onto the table, and leaves the parents in the car and says that the parents are back from their trip over night.a
Headache The mother and younger child are sitting on the couch with the TV on. Mother turns off the TV and asks for quiet, saying she has a headache. The child’s friend comes and asks to play inside.c
Bathroom shelf The mother goes briefly to the neighbor’s, telling both children not to touch anything on the bathroom shelf while she is away. After the mother leaves, the younger child cuts his/her finger on the toy box and asks the older for a band aid.c
Uncle Peter The mother is sitting on the couch, crying. The mother tells the younger child that she is sad because Uncle Peter has died.d
Three’s a crowd The older child and friend are playing in the wagon. When the younger child enters the scene and asks to join them, the friend tells the older child that if (s)he allow the younger child to play, (s)he will not be his/her friend anymore.c
Ball play The older sibling and his friend are playing with the ball. Suddenly, the older sibling cries, “Ouch! That hurt my hand!”e
Family fun Wind-down (not coded)

aFrom the Attachment Story Completion Task (ASCT; Bretherton, Oppenheim, et al., 1990).

bFrom the Attachment Story Completion Task (ASCT; Bretherton, Oppenheim, et al., 1990) revised by Granot and Mayseless (2001).

cFrom the MacArthur Story-Stem Battery (MSSB; Bretherton, Oppenheim, et al., 1990).

dFrom Zahn-Waxler et al. (1994).

eAdapted from Warren, Emde, and Sroufe (2000).

A beginning story, Birthday party, is used so that the child can become familiar with the protocol. An ending story, Family fun, is used to detach the child from the protocol. Both beginning and ending stories are positively emotionally charged, and are not included in coding or data analyses.

Coding the story stem task responses

Children’s representations of negative and self-conscious emotions were coded in the following procedure. The first author transcribed all of the children’s story-stem completions and identified all instances of the children’s enactments of the three basic negative emotions. Each of the 10 story-stem narratives was then scored for frequencies of each of the 3 negative emotions for each child on 3-point scales. Zero (0) represented none (i.e., there was no indication of a representation of negative emotion), 1 represented minimal (i.e., there was one indication of a representation of negative emotion), and 2 represented elaborate (i.e., there was more than one indication of a representation of negative emotion). Three summary content theme scores were derived by summing the scores for each emotion theme across all the stories; the score for each summary content theme, therefore, had a potential range of 0 to 20.

The coding of children’s representations of self-conscious emotions followed the same sequence as that for negative emotions. The five self-conscious themes - shame-self, shame-others, guilt-repairing, guilt-apologizing, and guilt-feelings were adapted from Luby et al. (2009). Shame-self was identified when the child was described as experiencing negative self-evaluation and global self-worth (e.g., “being ashamed”). Shame-others was identified when the child was described as experiencing global negative remarks about another character in the narrative (e.g., “Shame on you!”), in effect blaming others for shameful behavior. Guilt-repairing was identified when the child was described as having guilt feelings following some wrongdoing and trying to repair it physically or verbally (e.g., “I’ll fix it.”). Guilt-apologizing was identified when the child was described as having guilt feelings following some wrongdoing and therefore, trying to apologize (e.g., “I’m sorry!”). Guilt-feelings were identified when the child was described as having guilt feelings following some wrongdoing, but without repair or apology (e.g., “I felt bad.”). The scoring procedure was the same as for representations of negative emotions. Five summary content theme scores were derived with potential values of 0-20.

Reliability analyses of children’s representations of negative emotion codes and self-conscious emotion codes were conducted on 20% of the sample (10 transcripts translated into English). Coding reliabilities of 0.90, 0.90, 0.79, and 0.77, respectively, were attained using the kappa statistic. The second coder was unaware of the children’s demographic data and the study hypotheses. All interrater disagreements were resolved by discussion.

Children’s demographic information and time spent with parents

The information to assess the children’s ages, grades, and how many hours per day they spend with their parents was collected from the parent consent form and a general questionnaire. The exact wording of the question pertaining to time spent per day was, “How many hours per day do you spend with your child?” The amount of time children spent with their parents ranged from 2 to 12 hours (M = 4.68, SD = 1.61). The consent form included both the description of the study and children’s demographic information.

Procedure

The study’s use of human subjects was approved by the University Internal Review Board. Permission to conduct the study was obtained from the local school board in Iasi. Parent consent forms and the parenting questionnaires were distributed to teachers during a regular faculty meeting. Teachers gave the consent forms and the parenting questionnaires to the parents of all first through fourth graders. Interested parents returned the consent forms and the parenting questionnaires either to the teachers or to the first author.

The first author, a native speaker of Romanian, had previously translated the story stem task from English into Romanian. A second native Romanian speaker checked the translation of the script for accuracy. The first author administered the story stem task. She spent several hours in the participating classrooms before administering the protocol so that the children could become familiar with her. She administered the NSST at the school, during their regular school hours, in one session per child. She invited each child out of the classroom to an experimental psychology laboratory where she sat across a little table from the child to administer the story stems. Each individually videotaped session lasted about 40 minutes. The first author also transcribed the children’s responses to the story stems verbatim, in Romanian, from the videotapes. She also included a summary of all nonverbal actions that the children made with the bear family figurines. Finally, she translated the Romanian transcripts into English. A second native Romanian speaker also fluent in English checked the transcripts and translations for accuracy.

Data Analysis

Statistical analyses were performed using SPSS version 19. Frequency distributions were used for analyzing the occurrence of children’s representations of negative and self-conscious emotions. In the second step of the statistical analysis, Pearson correlations coefficients were computed to analyze associations between emotions, children’s age, and the amount of time children spent with parents. A chi-square test of independence was performed to examine the relation between gender and each of the emotion variables. Finally, Generalized Linear Models with Poisson distribution (McGullagh & Nelder, 1997) were used to test the association between the frequency of each emotion response, examined as dependent variables, and children’s age, gender, and amount of time typically spent with parents as independent covariates. Missing data for children’s age and time spent with parents reduced the sample size for the multi-variate analyses to 38. Poisson models are often known as log-linear models and are used for frequency data (Coxe, West, & Aiken, 2009). Square-root data transformations were performed to improve normality for the emotion variables. Log transformation was performed for the amount of time children spent with their parents. An alpha level equal to 0.05 as criterion for significance was used.

Results

Frequencies of Children’s Representations of Negative and Self-Conscious Emotions in Relation to Specific Story-Stems

Representations of the negative and self-conscious emotions identified a priori were found in the children’s narratives (see Figure 1). The most frequently represented negative emotion was sadness (112 occurrences). The second most frequently represented negative emotion, fear, occurred approximately half (50 occurrences) as often as sadness. Representations of sadness were followed by representations of anger (22 occurrences). Five stories, Monster in the bedroom (28 occurrences), Uncle Peter (27 occurrences), Spilled juice (27 occurrences), Three’s a crowd (21 occurrences), and Bathroom shelf (21 occurrences) elicited the most negative emotions. They were followed by Departure (16 occurrences), Headache (14 occurrences), Ball play (13 occurrences), Hurt knee (12 occurrences), and Reunion (5 occurrences). In terms of the specific stories that elicited the greatest number of specific negative emotions, the Uncle Peter story (26 occurrences) elicited the most representations of sadness. The Monster story (20 occurrences) was the most powerful in eliciting fear. The Spilled Juice story (7 occurrences) was the most powerful in eliciting anger. These emotional responses closely match the emotional valences of the story stems. The Uncle Peter story-stem portrays the mother crying over the death of Uncle Peter. The Monster story-stem presents the child calling out in fear of a monster in the bedroom. Finally, the Spilled Juice story presents the child accidentally spilling juice at the supper table.

Click to enlarge
ejop.v10i2.704-f1
Figure 1

Frequency of emotion responses.

With respect to self-conscious emotions, the most frequently represented self-conscious emotion was guilt-apologizing (122 occurrences). It was also the most frequently represented emotion overall. The second most frequently represented self-conscious emotion was shame-others (81 occurrences). It was followed by guilt-repairing (69 occurrences), which occurred approximately half as often as guilt-apologizing, and shame-self (58 occurrences). There were few representations of guilt-feelings (14 occurrences). Five stories, Spilled juice (75 occurrences), Headache (58 occurrences), Bathroom shelf (56 occurrences), Three’s a crowd (47 occurrences), and Ball play (33 occurrences) elicited the most self-conscious emotions. With reference to the specific stories that elicited the greatest number of specific self-conscious emotions, Spilled juice elicited the most representations of guilt-apologizing (28 occurrences), guilt-repairing (36 occurrences), and guilt feelings (4 occurrences). Three’s a crowd elicited the most occurrences of shame-others (17 occurrences). Bathroom shelf (14 occurrences) elicited the most representations of shame-self (14 occurrences). Headache also elicited 4 occurrences of guilt-feelings.

Descriptive Results and Bi-Variate Analyses Between Study Variables

The bi-variate analysis results between study variables are presented in Table 2.

Table 2

Descriptive Statistics for Emotion Variables and Correlations between Emotions and Child-Related Variables (N = 51)

Correlations
Emotion Variable M SD Actual Range 1 2 3 4 5 6 7 8 Age Time
1. Anger .31 .58 0-2 .59*** .50*** .35** .35** .01 -.07 .18 -.06 -.39*
2. Fear .64 .77 0-2 .82*** .27+ .33* .12 .16 .34* -.01 -.18
3. Sadness 1.05 1.06 0-3 .26+ .34* .18 .25+ .28* -.10 -.20
4. Shame-self .68 .85 0-3 .36** .13 -.05 -.10 -.12 -.41**
5. Shame-others .82 .97 0-3 .22 .06 .04 -.22 -.18
6. Guilt-repairing .85 .80 0-2 .17 .32* .27+ .18
7. Guilt-apologizing 1.28 .91 0-3 .16 -.01 -.14
8. Guilt-feelings .18 .50 0-2 .13 .03

Note: Anger variable was non-normally distributed, after square root transformations, with skewness of 1.51 (SE = .33) and kurtosis of .61 (SE = .66). Guilt-feelings variable was also non-normally distributed with skewness of 2.58 (SE = .33) and kurtosis of 5.17 (SE = .66).

+p ≤ .1. *p ≤ .05. **p ≤ .01. *** p ≤ .001.

As expected, the basic negative emotion variables, anger, fear, and sadness, were intercorrelated; these were, in fact, the strongest found, suggesting a qualitative difference between this group of emotions compared to the others. Furthermore, fear and sadness were extremely intercorrelated (.82), indicating a specific and distinct association of these dimensions of emotional expression compared to others. The two shame-based self-conscious emotion variables were also intercorrelated. Two of the guilt-based emotions were correlated, guilt-repairing and guilt feelings. Among the self-conscious emotion variables, shame-self and shame-others were also correlated with anger. Guilt-feelings was also correlated with fear and sadness. Contrary to our hypothesis, our bi-variate results did not find an age distinction for children’s representations of negative and self-conscious emotions. One marginally positive association at the 0.10 probability level was found for children’s expression of guilt combined with an effort to repair, where older age was associated with more frequent representations of this emotion. The amount of time children spent with their parents was negatively related to children’s representations of anger and shame-self. Children whose parents reported spending more time with them were rated as displaying fewer expressions of these emotions. No other significant associations were found between the amount of time and emotion variables.

The only significant gender distinction was found for guilt combined with an apology, χ2 = 15.12 (N = 51; p < .05). Consistent with our hypothesis, boys were less likely to express guilt combined with an apology than were girls.

Multi-Variate Analyses: Child Characteristics in Relation to Representations of Negative and Self-Conscious Emotions in Story-Stems

The multi-variate analysis results are presented in Table 3.

Table 3

Coefficient Estimates from Poisson Regressions and Associated Significance Tests for Effects of Child Gender, Child Age, and Time Child Spends with Parents on Basic Negative Emotions and Self-Conscious Emotions in the Narrative Story Stem Technique (N = 38)

Emotion Variable Gender
Age
Time
Likelihood Ratio χ2
b Wald χ2 b Wald χ2 b Wald χ2
Anger .71 1.17 .26 1.37 -.73 9.54** 12.19**
Fear -.36 1.18 .44 7.18** -.46 6.94** 12.88**
Sadness -.13 .34 .10 .88 -.22 4.94* ns
Shame-self .16 .20 -.05 .11 -.32 4.45* 7.43+
Shame-others .28 1.07 -.23 4.04* .06 .65 ns
Guilt-repairing .08 .08 .24 3.75* .06 .45 ns
Guilt-apologizing -.40 3.90* .14 2.05 -.13 2.62 7.58+
Guilt-feelings .10 .02 .56 3.93* -.02 .01 ns

+p < .1. *p < .05. **p < .01.

Two of the multivariate equations were only marginally significant, those predicting shame-self and guilt-apologizing. The significant independent variables in each of these, time spent with parents and child gender, respectively, were also found to be significantly related to these emotion variables in the bi-variate analyses. Two other equations were significant at the .01 level, those predicting anger and fear (likelihood χ2 ratios of 12.19 and 12.88, respectively). Significant independent variables in these equations were time spent with parents and child age. Time spent with parents was associated, negatively, with frequencies of anger (b = -.73, χ2 = 9.54) and fear representations (b = -.46, χ2 = 6.94). Child age was positively associated with fear representations (b = .44, χ2 = 7.18).

Discussion and Conclusions

Based on attachment theory and previous lines of work, the current study investigated children’s representations of negative and self-conscious emotions with a narrative story stem technique. Our findings contribute to the important and on-going focus of cross-cultural story-stem research by investigating dimensions of negative emotional expression in Romanian children in middle childhood. In addition, differences were found for frequencies of negative emotional representations in relation to the specific story-stems in which they occurred. As expected, the emotional valences presented in the story-stems themselves were associated with the emotions the children expressed in their narratives. For example, the Uncle Peter story was the most powerful story in eliciting and representing sadness, very likely because it presented a scenario of the death of a family member. These findings thus provide evidence for a priming effect in NSST protocols whereby specific story stems are likely to evoke specific emotional responses. It may be that such a priming effect is particularly potent for children who have sensitivities to the emotions in question (e.g., prior exposure to sadness or grief). As such, researchers and practitioners working with story-stem protocols would be well-advised to select story stems based on their interest in the evocation of specific emotional responses and their understanding of their subjects’ prior exposure to significant emotional experience.

With respect to gender differences in children’s expressions of negative and self-conscious emotions, girls were more likely than boys to have guilt feelings coupled with apology following some wrongdoing, as hypothesized and previously found (Luby et al., 2009). Differences in socialization of gender roles have been discussed as explanations for similar findings, particularly girls’ heightened risk for internalizing emotional problems (Luby et al., 2009). The use of narrative methods such as the NSST to identify these tendencies should be a continuing focus for research. Our results did not confirm other differences in emotional expression between genders, however. This may have been a characteristic of our sample. Past research has found tendencies for girls to include more sadness, fear, and shame themes (Luby et al., 2009) and fewer anger themes in their narratives (Zahn-Waxler et al., 2008). The Romanian children in our study, however, did not conform to this patternii. Future research with culturally diverse samples should consider this question.

The finding that the highest bi-variate correlation was found for fear and sadness is consistent with theory and assessment in that these two emotions are regarded as uniquely “internalizing” emotions (Achenbach & Edelbrock, 1981). It is also interesting to note that representations of anger were associated with the highest number of other emotions, including the two shame-based emotional representations, but not the guilt-based representations. This is also consistent with theory in that the experience of guilt is distinct from shame; guilt involves more of a sense of responsibility to others. The correlation of guilt feelings with fear and sadness and not anger, may be an indicator of a constellation of internalizing emotions. Furthermore, the relative differences in magnitudes of the intercorrelations between the basic negative emotions (anger, fear, and sadness) and the self-conscious emotions (the shame-based variables and guilt-feelings) provide evidence for qualitative differences between these classes of emotion variables. That such differences are discernible at the representational level supports the theoretical assertion of developmentally-based differences in the origins and function of these emotions.

Perhaps the most surprising of our findings involve the measure of the time children reportedly spent with their parents. The data obtained from this single, simple question yielded the study’s most potent findings. In particular, children who reportedly spent more time with parents enacted significantly less anger and fear, and to a lesser extent sadness and shame-self, in their narrativesiii. Children’s age also contributed significantly to the obtained variation in enactments of fear, suggesting a greater level of familiarly with fear in narratives among older children. We have no data to show that extreme expressions of negative or self-conscious emotions in these narrative responses are associated with actual emotional or behavioral regulatory problems. There have been ample demonstrations of such linkages, however, in prior studies. Hill, Fonagy, Lancaster, and Broyden (2007) point out that associations between children’s “dysregulated aggressive responses” to narrative story-stem protocols and externalizing behavioral problems are among the “most robust” findings of the story-stem literature. Our findings suggest that narrative representations similar to what in other studies has been strongly associated with behavioral dysregulation may vary with this simple index of the parent-child relationship. Replication of this is needed with other samples, and future studies would be greatly enhanced by the addition of independent assessments of children’s behavior. We were also limited by our sample size to explore potential complexities within this finding. For example, it is conceivable that the actual relationship of the measure of time spent with parents and children’s representations of negative emotions is not linear. Future research on this issue should explore such a possibility.

Overall, the results of the present study support the idea that children’s responses to this narrative measure reflect their capacities for a wide range of specific emotional expression (Bretherton, Prentiss, & Ridgeway, 1990; Oppenheim, Emde, & Warren, 1997). The present study extends research on representations of negative emotionality with the NSST to middle childhood. This age period has not been studied extensively in this regard despite its theoretical significance. It is among the first studies in the literature on children’s narrative representations to systematically examine dimensions of negative emotional expression simultaneously. It is also the first study to examine these representations among a sample of Romanian children.

Limitations and Future Research

Although the study allowed for investigating children’s representations of negative and self-conscious emotions in a Romanian cultural context using the story-stem task, the sample size was small and homogenous, hence findings are not generalizable to other populations. It is also likely that the small sample size limited the statistical power of the bi-variate and multi-variate analyses. As a next step, it will be important to examine children’s expression of these emotions in larger and more diverse samples. The study is also cross-sectional in design, thereby precluding claims about long term implications of findings from this investigation alone. Future researchers will need longitudinal studies in order to assess changes in representations of negative emotionality over time.

Despite the limitations of the current study, the results add an important dimension to the research field of children’s narratives. NSST methods can elicit a surprising range of emotional expression from children, which provides unique opportunities to understand their emotional lives. Future research should continue to explore linkages of these expressions of emotion with the circumstances within which children live. Important social and developmental indices of their adjustment and well-being should also be considered for future research.

Notes

i) Richard Wurmbrand College is one of the first private Christian K-12 schools in Romania. According to the Romanian Ministry of Education and Research (2001) statistics, less than 2% of elementary school students attend private schools in Romania.

ii) Previous research has documented important differences between U.S. and Eastern European (including Romanian) cultural ideals for children and parents (Nesteruk & Marks, 2009; Nesteruk, Marks, & Garrison, 2009).

iii) Qualitative and theoretical work indicates that parents are also beneficially impacted in myriad ways by time spent with children (Palkovitz, 2002; Palkovitz, Marks, Appleby, & Holmes, 2003).

Funding

The authors have no funding to report.

Competing Interests

The authors have declared that no competing interests exist.

Acknowledgments

We would like to thank all participating students, their families and their teachers, and especially Mr. Cristian Lucaci, Director of Richard Wurmbrand College, for his enthusiasm to participate in the research and with helping organize data collection. We would also like to thank Dr. Greg Adkison with helping analyze data.

References

  • Achenbach, T. M., & Edelbrock, C. S. (1981). Behavioral problems and competencies reported by parents of normal and disturbed children aged 4 through 16 [Monograph]. Monographs of the Society for Research in Child Development, 46(1, Serial No. 188).

  • Aksan, N., & Goldsmith, H. H. (2003). Temperament and guilt representations in children’s narratives. In R. N. Emde, D. P. Wolf, & D. Oppenheim (Eds.), Revealing the inner worlds of young children: The MacArthur Story Stem Battery and parent-child narratives (pp. 129-146). New York, NY: Oxford University Press.

  • Appelman, E. (2000). Attachment experiences transformed into language. The American Journal of Orthopsychiatry, 70(2), 192-202. https://doi.org/10.1037/h0087760

  • Bettmann, J. E., & Lundahl, B. W. (2007). Tell me a story: A review of narrative assessments for preschoolers. Child and Adolescent Social Work Journal, 24, 455-475. https://doi.org/10.1007/s10560-007-0095-8

  • Boris, N., & Page, T. (2012). Assessing primary caregiver relationships. In S. Janko Summers & R. Chazan-Cohen (Eds.), Understanding early childhood mental health: A practical guide for professionals (pp. 125-139). Baltimore, MD: Brookes Publishing.

  • Bowlby, J. (1973). Attachment and Loss: Vol. 2. Separation. New York, NY: Basic Books.

  • Bretherton, I., Fritz, J., Zahn-Waxler, C., & Ridgeway, D. (1986). Learning to talk about emotions: A functionalist perspective. Child Development, 57, 529-548. https://doi.org/10.2307/1130334

  • Bretherton, I., Gullon-Rivera, A. L., Page, T. F., Oettel, B. J., Corey, J. M., & Golby, B. J. (2013). Children’s attachment-related self-worth: A multi-method investigation of postdivorce preschoolers’ relationships with their mothers and peers. Attachment & Human Development, 15(1), 25-49. https://doi.org/10.1080/14616734.2012.744733

  • Bretherton, I., Oppenheim, D., Buchsbaum, H., Emde, R., & The MacArthur Narrative Working Group (1990). The MacArthur Story Stem Battery. Unpublished manual, University of Wisconsin-Madison, Madison, WI.

  • Bretherton, I., Prentiss, C., & Ridgeway, D. (1990). Family relationships as represented in a story-completion task at thirty-seven and fifty-four months of age. New Directions for Child and Adolescent Development, 1990, 85-105. https://doi.org/10.1002/cd.23219904807

  • Bretherton, I., Ridgeway, D., & Cassidy, J. (1990). Assessing internal working models of the attachment relationship: An attachment story completion task for 3-year-olds. In M. T. Greenbert, D. Cicchetti, & E. M. Cummings (Eds.), Attachment in the preschool years: Theory, research, and intervention (pp. 272-308). Chicago, IL: University of Chicago Press.

  • Campos, J. J., Barrett, K. C., Lamb, M. E., Goldsmith, H. H., & Stenberg, C. (1983). Socioemotional development. In M. M. Haith & J. J. Campos (Eds.), Handbook of child psychology: Vol. 2. Infancy and developmental psychology (4th ed., pp. 783-915). New York, NY: Wiley.

  • Carter, A. S., Briggs-Gowan, M. J., Jones, S. M., & Little, T. D. (2003). The Infant-Toddler Social and Emotional Assessment (ITSEA): Factor structure, reliability, and validity. Journal of Abnormal Child Psychology, 31, 495-514. https://doi.org/10.1023/A:1025449031360

  • Cassidy, J. (1988). Child-mother attachment and the self in six-year-olds. Child Development, 59, 121-134. https://doi.org/10.2307/1130394

  • Chaplin, T. M., & Aldao, A. (2013). Gender differences in emotion expression in children: A meta-analytic review. Psychological Bulletin, 139(4), 735-765. https://doi.org/10.1037/a0030737

  • Colombetti, G. (2005). Appraising valence. Journal of Consciousness Studies, 12(8), 103-126.

  • Coxe, S., West, S. G., & Aiken, L. S. (2009). The analysis of count data: A gentle introduction to Poisson regression and its alternatives. Journal of Personality Assessment, 91(2), 121-136. https://doi.org/10.1080/00223890802634175

  • Denham, S. A., Bassett, H. H., & Wyatt, T. (2007). The socialization of emotional competence. In J. Grusec & P. Hastings (Eds.), The handbook of socialization (pp. 614-637). New York, NY: Guilford Press.

  • Dubois-Comtois, K., & Moss, H. (2008). Beyond the dyad: Do family interactions influence children’s attachment representations in middle childhood? Attachment & Human Development, 10(4), 415-431. https://doi.org/10.1080/14616730802461441

  • Ekman, P. (1992). Are there basic emotions? Psychological Review, 99, 550-553. https://doi.org/10.1037/0033-295X.99.3.550

  • Ekman, P. (1999). Basic emotions. In T. Dalgleish & M. J. Power (Eds.), The handbook of cognition and emotion (pp. 45-60). Sussex, United Kingdom: John Wiley and Sons.

  • Ekman, P. (2003). Emotions revealed: Recognizing faces and feelings to improve communication and emotional life. New York, NY: Times Books.

  • Emde, R. N. (2003). Early narratives: A window to the child’s inner world. In R. N. Emde, D. P. Wolf, & D. Oppenheim (Eds.), Revealing the inner worlds of young children: The MacArthur Story-Stem Battery and parent-child narratives (pp. 3-26). New York, NY: Oxford University Press.

  • Emde, R. N., Wolf, D. P., & Oppenheim, D. (2003). Revealing the inner worlds of young children: The MacArthur Story Stem Battery and parent-child narratives. New York, NY: Oxford University Press.

  • Fivush, R., & Wang, Q. (2005). Emotion talk in mother-child conversations of the shared past: The effects of culture, gender, and event valence. Journal of Cognition and Development, 6, 489-506. https://doi.org/10.1207/s15327647jcd0604_3

  • Gillian, C. (1982). In a different voice. Cambridge, MA: Harvard University Press.

  • Granot, D., & Mayseless, O. (2001). Attachment security and adjustment to school in middle childhood. International Journal of Behavioral Development, 25(6), 530-541. https://doi.org/10.1080/01650250042000366

  • Green, J. M., Stanley, C., Smith, V., & Goldwyn, R. (2000). A new method of evaluating attachment representations in young school-age children: The Manchester Child Attachment Story Task. Attachment & Human Development, 2(1), 48-70. https://doi.org/10.1080/146167300361318

  • Hill, J., Fonagy, P., Lancaster, G., & Broyden, N. (2007). Aggression and intentionality in narrative responses to conflict and distress story stems: An investigation of boys with disruptive behaviour problems. Attachment & Human Development, 9(3), 223-237. https://doi.org/10.1080/14616730701453861

  • Hodges, J., Steele, M., Hillman, S., & Henderson, K. (2003). Mental representations and defenses in severely maltreated children: A story stem battery and rating system for clinical assessment and research applications. In R. N. Emde, D. P. Wolf & D. Oppenheim (Eds.), Revealing the inner worlds of young children: The MacArthur Story Stem Battery and parent-child narratives (pp. 240-267). New York, NY: Oxford University Press.

  • Hodges, J., Steele, M., Hillman, S., Henderson, K., & Neil, M. (2000). Effects of abuse on attachment representations: Narrative assessments of abused children. Journal of Child Psychotherapy, 26, 433-455. https://doi.org/10.1080/00754170010003674

  • Izard, C. E. (1977). Human emotions. New York, NY: Plenum Press.

  • Izard, C. E. (1992). Basic emotions, relations among emotions, and emotion-cognition relations. Psychological Review, 99, 561-565. https://doi.org/10.1037/0033-295X.99.3.561

  • Johnson-Laird, P. N., & Oatley, K. (1989). The language of emotions: An analysis of a semantic field. Cognition & Emotion, 3, 81-123. https://doi.org/10.1080/02699938908408075

  • Katsurada, E. (2007). Attachment representation of institutionalized children in Japan. School Psychology International, 28(3), 331-345. https://doi.org/10.1177/0143034307078543

  • Kochanska, G. (2001). Emotional development in children with different attachment histories: The first three years. Child Development, 72, 474-490. https://doi.org/10.1111/1467-8624.00291

  • Kopp, C. B. (1982). Antecedents of self-regulation: A developmental perspective. Developmental Psychology, 18, 199-214. https://doi.org/10.1037/0012-1649.18.2.199

  • Lagacé-Séguin, D. G., & d’Entremont, M.-R. L. (2006). The role of child negative affect in the relations between parenting styles and play. Early Child Development and Care, 176, 461-477. https://doi.org/10.1080/03004430500039960

  • Lewis, M. (1994). Myself and me. In S. T. Parker, R. W. Mitchell, & M. L. Boccia (Eds.), Self-awareness in animals and humans: Developmental perspectives (pp. 20-34). New York, NY: Cambridge University Press.

  • Lewis, M. (2000). Self-conscious emotions: Embarrassment, pride, shame, and guilt. In M. Lewis & J. M. Haviland-Jones (Eds.), Handbook of emotions (2nd ed., pp. 623–636). New York, NY: Guildford Press.

  • Luby, J., Belden, A., Sullivan, J., Hayen, R., McCadney, A., & Spitznagel, E. (2009). Shame and guilt in preschool depression: Evidence for elevations in self-conscious emotions in depression as early as age 3. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 50, 1156-1166. https://doi.org/10.1111/j.1469-7610.2009.02077.x

  • Main, M., Kaplan, N., & Cassidy, J. (1985). Security in infancy, childhood and adulthood: A move to the level of representation. In I. Bretherton, & E. Waters (Eds.), Growing points of attachment theory and research [Monograph]. Monographs of the Society for Research in Child Development, 50(1-2, Serial No. 209).

  • McGullagh, P., & Nelder, J. A. (1997). Generalized linear models (2nd ed.). London, United Kingdom: Chapman & Hall.

  • Melzi, G., & Fernández, C. (2004). Talking about past emotions: Conversations between Peruvian mothers and their preschool children. Sex Roles, 50, 641-657. https://doi.org/10.1023/B:SERS.0000027567.55262.10

  • Moss, E., Bureau, J.-F., Béliveau, M.-J., Zdebik, M., & Lépine, S. (2009). Links between children’s attachment behavior at early school-age, their attachment-related representations, and behavior problems in middle childhood. International Journal of Behavioral Development, 33(2), 155-166. https://doi.org/10.1177/0165025408098012

  • Nesteruk, O., & Marks, L. D. (2009). Grandparents across the ocean: Eastern European immigrants’ struggle to maintain intergenerational relationships. Journal of Comparative Family Studies, 40, 77-95.

  • Nesteruk, O., Marks, L. D., & Garrison, M. E. (2009). Immigrant parents’ concerns regarding their children’s education in the U.S. Family and Consumer Sciences Research Journal, 37, 422-441. https://doi.org/10.1177/1077727X08330671

  • Oppenheim, D., Emde, R. N., & Warren, S. L. (1997). Children's narrative representations of mothers: Their development and associations with child and mother adaptation. Child Development, 68, 127-138. https://doi.org/10.2307/1131930

  • Page, T. (2001). The social meaning of children's narratives: A review of the attachment-based Narrative Story-Stem Technique. Child & Adolescent Social Work Journal, 18, 171-187. https://doi.org/10.1023/A:1011006402275

  • Page, T., & Bretherton, I. (2001). Mother- and father-child attachment themes as represented in the story completions of preschoolers in postdivorce families: Linkages with teacher ratings of social competence. Attachment & Human Development, 3, 1-29. https://doi.org/10.1080/713761897

  • Palkovitz, R. (2002). Involved fathering and men’s adult development. Mahwah, NJ: Lawrence Erlbaum and Associates.

  • Palkovitz, R., Marks, L. D., Appleby, D. W., & Holmes, E. K. (2003). Parenting and adult development: Contexts, processes and products of intergenerational relationships. In L. Kucynski (Ed.), The handbook of dynamics in parent-child relations (pp. 307-323). Thousand Oaks, CA: Sage.

  • Pass, L., Arteche, A., Cooper, P., Creswell, C., & Murray, L. (2012). Doll play narratives about starting school in children of socially anxious mothers, and their relation to subsequent child school-based anxiety. Journal of Abnormal Child Psychology, 40(8), 1375-1384. https://doi.org/10.1007/s10802-012-9645-4

  • Robinson, J., Mantz-Simmons, L., Macfie, J., & Kelsay, K. & The MacArthur Narrative Working Group (2002). The MacArthur Narrative Coding Manual. Unpublished manuscript, University of Denver, Denver, CO.

  • Robinson, J., Mantz-Simmons, L., & Macfie, J. & The MacArthur Narrative Working Group. (1992). The Narrative Coding Manual. Unpublished manuscript, University of Colorado, Boulder, CO.

  • Romanian Ministry of Education and Research. (2001, March). The Romanian education system: The national report. Retrieved from http://www.ibe.unesco.org/International/ICE/natrap/Romania.pdf

  • Russell, D., & McAuley, E. (1986). Causal attributions, causal dimensions, and affective reactions to success and failure. Journal of Personality and Social Psychology, 50, 1174-1185. https://doi.org/10.1037/0022-3514.50.6.1174

  • Rutherford, M. D., Chattha, H. M., & Krysko, K. M. (2008). The use of aftereffects in the study of relationships among emotion categories. Journal of Experimental Psychology, 34, 27-40.

  • Tangney, J. P., & Dearing, R. (2002). Shame and guilt. New York, NY: Guilford.

  • Toth, S. L., Cicchetti, D., Macfie, J., Rogosch, F. A., & Maughan, A. (2000). Narrative representations of moral affiliative and conflictual themes and behavioral problems in maltreated preschoolers. Journal of Clinical Child Psychology, 29, 307-318. https://doi.org/10.1207/S15374424JCCP2903_2

  • Tracy, J. L., Robins, R. W., & Tangney, J. P. (2007). The self-conscious emotions:Theory and research. New York, NY: Guilford Press.

  • von Klitzing, K., Kelsay, K., Emde, R. N., Robinson, J., & Schmitz, S. (2000). Gender-specific characteristics of 5-year-olds’ play narratives and associations with behavior ratings. Journal of the American Academy of Child and Adolescent Psychiatry, 39, 1017-1023. https://doi.org/10.1097/00004583-200008000-00017

  • Wan, M. W., & Green, J. (2010). Negative and atypical story content themes depicted by children with behavior problems. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 51, 1125-1131. https://doi.org/10.1111/j.1469-7610.2010.02239.x

  • Warren, S. L. (2003). Narratives in risk and clinical populations. In R. N. Emde, D. P. Wolf, & D. Oppenheim (Eds.), Revealing the inner worlds of young children: The MacArthur Story Stem Battery and parent – child narratives (pp. 222 – 239). New York, NY: Oxford University Press.

  • Warren, S. L., Emde, R. N., & Sroufe, L. A. (2000). Internal representations: Predicting anxiety from children's play narratives. Journal of the American Academy of Child & Adolescent Psychiatry, 39, 100-107. https://doi.org/10.1097/00004583-200001000-00022

  • Warren, S. L., Mantz-Simmons, L., & Emde, R. N. (1993). Narrative emotion coding. Unpublished manuscript.

  • Zahn-Waxler, C., Cole, P. M., Richardson, D. T., Friedman, R. J., Michel, M. K., & Belouad, F. (1994). Social problem solving in disruptive preschool children: Reactions to hypothetical situations of conflict and distress. Merrill-Palmer Quarterly, 40, 98-119.

  • Zahn-Waxler, C., Shirtcliff, E. A., & Marceau, K. (2008). Disorders of childhood and adolescence: Gender and psychopathology. Annual Review of Clinical Psychology, 4, 275-303. https://doi.org/10.1146/annurev.clinpsy.3.022806.091358

About the Authors

Loredana Apavaloaie is an Assistant Professor in the Department of Human Services, Birth-Kindergarten Program at Western Carolina University. Her research interests involve narrative story stem techniques with young children and the power of the early parent and caregiver-child relationship on the young children’s social and emotional competence.

Timothy Page is an Associate Professor in the School of Social Work at Louisiana State University. His research interests involve child and family treatment, vulnerable children, narrative methodologies with young children, and clinical practice.

Loren D. Marks is an Associate Professor in the School of Social Work at Louisiana State University. His research interests involve the influence of religious faith on marriages and families. He is also interested in African-American marriages and families.