To answer the research question, “What changes are needed to reach cross-cultural equivalence of the PEM-CY in German as spoken in the three countries?”, results are presented in two Tables. Table 2 presents the process of changes during the pre-final versions 1 to 6, and the final results are presented and explained according to the four type of equivalences in Table 3. We illustrate each type of equivalence with quotes provided by parents during the think-aloud interviews and examples from field observations made during the filling in of the Pre-final Versions 1-3 of PEM-CY (German).
Table 2: Development of equivalence (Version 1-6)
Stage
|
Original
|
Equivalence
|
Changes made and cultural adaptations
|
|
|
Version PEM-CY
|
PEM-CY (English)
|
semantic
|
ideomatic
|
experimental
|
conceptual
|
PEM-CY (G) (German)
|
|
STAGE I
|
Translation (T1/T2)
|
· gender
|
|
x
|
|
|
· removal of gender nomenclating for child (her or she )
|
|
· wording (e.g. “environment”)
|
x
|
|
|
|
· use of different words (synonyms)
e.g. environment (G: “Umfeld”, “Umwelt”)
|
|
· wording (e.g. “community”, “involvement”)
|
x
|
|
|
|
· lack of direct translation into German
e.g. “community (G:“gesellschaftlich” “gemeinschaftlich”)
involvement (“beteiligt” versus “engagiert”)
|
|
· wording (e.g. school lunch)
|
|
x
|
|
|
· country specific wordings e.g. “Jause”(Austria) versus “Vesper”(Germany), “Znüni”(Switzerland)
|
|
STAGE II
|
Synthesis (T12)
|
· wording (e.g. assignments, lunch preparation)
|
|
x
|
|
|
· agreement to choose words commonly used in all three countries e.g. (G: “Hausaufgaben”, “Essen zubereiten”)
|
|
· “involvement”
|
x
|
|
|
|
· agreement on “being part and involved” (G. “beteiligt und eingebunden sein” )
|
|
· activities
|
|
|
x
|
|
· removal of activities that are not typical in German speaking countries (e.g. public speaking”)
· addition of cultural adapted activities , e.g. “soccer”, “learning vocabulary”
|
|
· structure
|
|
|
|
x
|
· present questions 8. (9.) of environment on next page
|
|
STAGE IV
|
Pre-final 1
|
· general wording
|
x
|
|
|
|
· small changes in used language structure, e.g. change from survey to “questionnaire” (G: “Fragebogen”)
|
|
· response item
|
x
|
|
|
|
· revised e.g. “not an issue” (G: “nicht relevant”)
|
|
First round of interviews (#1 - #7)
|
|
STAGE IV
|
Pre-final 2
|
· introduction
|
|
|
|
x
|
· adapt introduction
- add age frame of PEM-CY (5-17 years)
- explain “participation “ and “environment”.
- add a sentence that that this survey is not about the child’s independence.
- express that activities are just examples
|
|
· explanations
|
|
|
x
|
|
· add encouragement for parents to fill in school setting
|
|
· sequences
|
|
|
x
|
|
· change sequence of activity groups and start with “1. video gaming”.
|
|
· response items
|
|
|
x
|
x
|
· change into “on school days”
· repeat the 4 month frame of frequency on each page
· insert a 2 phase response option to all environmental parts: “No, it is no issue”, “yes it is an issue” and then explain supportiveness.
|
|
· “demands”
|
|
|
|
x
|
· insert “demands and expectations” to questions 4-6 in environments
|
|
· “involvement”
|
|
|
|
|
· change of German word for “involvement” (G: “Engagement”) (see stage II)
|
|
· structure
|
|
|
|
x
|
· add subtitles to A(frequency), B (involvement), C (wished changes)
· add line for comments (voluntary)for all activity groups
|
|
Second round of interviews (#8 - #11)
|
|
STAGE V
|
Pre-final 3
|
· “child”
· “neighborhoods”
|
x
|
|
|
|
· use whenever possible “child and adolescent”
· replaced by “visits to public areas”
|
|
· explanations
|
|
|
|
x
|
· present a definition of home, school and community on each page
|
|
· response items environment
|
|
|
|
x
|
· inserted a note that parents should think broadly about the environment sections
· change the answer format: headline (A and B answers) and subtheme (B1, B2, B3) referring to hindering and supportive environments
|
|
Third round of interviews (#12 -#15)
|
|
STAGE IV
|
Pre-final 4
|
· “school”
|
|
|
|
x
|
· add “school and kindergarten”
|
|
· visualization
|
|
|
|
x
|
· visually structure the item “wished changes” with a thicker line
· highlight “skip to C”
|
|
STAGE V
|
Pre-final 5
|
· explanations
|
|
|
x
|
|
· explaining that garden or yard is part of home
· explaining that way to school is part of school
|
|
· “demands”
|
|
|
|
x
|
· remove “expectations” (see stage IV)
|
|
· structure
|
|
|
|
x
|
· remove proposed structure (see Stage V) and verbalize supporting and hindering environment (see figure 2)
|
|
The Pre-final Version 6, after the backtranslation and grammar check by linguist, became the final version (see Table 3)
|
|
|
|
|
|
|
|
|
|
|
Table 3. Synthesis of needed equivalence changes to develop the PEM-CY (German)
Equivalent changes
|
Explanation
|
Original PEM-CY
|
Changes made to culturally adapt the PEM-CY (German)
|
Semantic equivalence
|
A similar semantic expression
|
· “community”
|
· “societal” (G: gesellschaftlich”)
|
|
· “involvement”
|
· “engagement” (G: “Engagement”)
|
|
· “participation”
|
· “participation“ G: “Teilhabe”
|
|
· “children
|
· “children and adolescents”
· (G: “Kinder und Jugendliche ”)
|
Idiomatic equivalence
|
Less misleading expression
|
· “the child“- he or she
|
· neutral form (it) (“G: “es”)
|
|
· “assignment” and “homework”
|
· G: “Hausaufgaben”
|
|
· “climate”
|
· “seasonal conditions” (G: “Jahreszeiten”)
|
Experiential equivalence
|
Words that represent culturally based experiences
|
· activity examples used in the original PEM-CY that are not common for children in the targeted countries: “Brownies”, “mentoring”, “lunchroom supervisor”, “public speaking”, “working in a store”, “baseball”
|
· removed uncommon examples and added new examples: “playing Lego®, “showering”, “learning vocabulary, “going to school”, “bullying and misuse”, “soccer”, “skiing”, “walking”, “salary during apprenticeship and internship”.
|
|
· “Video gaming” is the first group of activities in the Home setting
|
· “Video gaming” moved and is now the fourth group of activities in in the Home setting
|
|
· school participation: response option “daily”
|
· school participation – response option changed to “daily at school days”
|
|
· school participation
|
· kindergarten and school participation
|
|
· “neighborhood”
|
· “visits in public area”
|
Conceptual equivalence
|
Covering
linguistically the same logic, meaning or mental images
|
|
Additional information:
· enhanced definition of “participation” and “environment”
· added information about the possible age of children (5-17)
· explained that it is not about independence
· included the time frame of four months on each page
· added encouragement to fill in school setting despite little knowledge
· instructed global thinking in the “environmental sections”
· provided examples for all environmental items
|
|
|
Structural changes:
· add headings for all participation aspects (frequency, involvement, wish for changes)
· insert “activity group” as subheading
· make thicker lines between options for wishes for changes
· highlight “Skip to C”
· explain environment and settings on each page
· repetition of “environmental factor” in possible answers
· present all questions with the same answer format in the environment part on the same page.
|
|
|
Comments
· added line for possible comments for desired changes in participation
|
3.1. Semantic equivalence
Overall, the four words “community”, “involvement”, “participation” and “children” could not be simply translated and needed in-depth discussion between the linguists and the expert team. Some of the words were tested and discussed with end-users during Pre-final Version 1-3. Due to the lack of a direct translation for “community”, we used “societal” (German “gesellschaftlich”) as the best alternative to refer to any public space or social entity outside the home and school.
The word “involvement” is multifaceted, comprised of several different aspects, and no single German translation exists. One mother explained some difficulties in judging her child’s involvement:
«The word «independence» would have fit better to our situation. Yes, he can do everything, he just has to be reminded. Sometimes, he goes shopping for me or picks up apples at a farm [...] How involved he is? I don’t know. He makes it for me, but if he would not be obliged to do it, he would do something else. But when he does it, he is reliable, everything is perfect, he can handle the money and he behaves decently. For involvement I consider his joy and his motivation. He may not have it, but nevertheless, he performs well, I don’t have to be ashamed” (P #2).
This mother added that observing independence is easier than observing involvement. Most parents mentioned motivation in connection with involvement. Some spoke about an inner process of being present and active. Others connected it with being interested, curious and open. One mother mentioned that involvement also depends on others.
“It means he takes part actively. but he also has to be accepted by others.” (P.#5)
These aspects could not be transferred directly into one German translation. We finally agreed after the second round of interviews to use “engagement” (German (G): “Engagement”) and “being engaged” (G: “engagiert sein”) which, according to the linguist, fits with the English use.
For “participation”, two German words exist. An equivalent of “to take part” (G: “teilnehmen”) and a more complex, less common word “to participate” (G: “teilhaben”), used mainly in professional language. Parents often overread this word and mentioned that they are less used to the later one. However, they agreed that “teilhaben” comprises more depth. Therefore, “teilhaben” is used in the adapted PEM-CY (German). One mother mentioned a problem when judging her childs’ participation and the inherent norms:
«Well considering participation...should I judge whether she takes part with healthy children or with other children with disabilities? I have to confess that my daughter hardly participates in settings with healthy children. Either she is accompanied by us, or she participates in activities that are geared for children with disabilities. Like swimming. If she is expected to participate in swimming here in the town, regularly, the answers would be completely different». (P #13)
The final word that required discussion was “children”. The PEM-CY addresses participation of children from 5 to 17 years. In German, children over the age of 14 are called “adolescents” (G: “Jugendliche”). Similar to the “Y” in the title PEM-CY, “adolescents” needed to be mentioned beside the word “children” throughout the measure.
3.2. Idiomatic equivalence
Three changes could be interpreted as belonging to this category. In the English version, “child” is always referred to as he/she. As “child” in German is neutral (“das Kind”), we did not need to use gender differences. Next, the expert committee agreed to use one single word (G: “Hausaufgaben”) for all school-tasks done at home (E: “homework” and “assignments”). Some parents were confused by the word “climate” when translated into German, and its’ relevance at school.
« Weather condition, climate? <laughs> So here I am at the point [...] to just finish it, quick and dirty. This does not make sense. Climate at school? I don’t question this. I presume that there is enough light and enough heating and no rain in the classroom. » (P. #6)
We therefore chose the wording “seasonal conditions” (G: “Jahreszeiten”) to align with the original meaning of outdoor climate.
3.3. Experiential equivalence
To capture the different cultural experiences, several examples for activities from the original PEM-CY were removed from the German version. Examples of these include “mentoring”, acting as “lunchroom supervisor”, “public speaking”, “working in a store”, being a “Brownie”, and playing “baseball”. Although these activities are known in the German speaking contexts, they do not have the same cultural importance to serve as examples in the PEM-CY (German). The experts agreed on more typical cultural activities such as “playing Lego®“, “showering”, “learning vocabulary, “going to school”, “bullying and misuse”, playing “soccer”, “skiing”, “walking” and receiving “salary during apprenticeship and internship”. Parents did not raise any concerns with the proposed activities. However, some were surprised that “video gaming” was the first activity mentioned in the Home setting.
«My child is 6 years of age. I am proud that video gaming is an activity he did not yet discover. But I am rather astonished to see it here as the first listed activity. (»P. #5)
The PEM-CY (German) starts instead with “indoor games” and lists the “video gaming” closer to “watching TV”.
In the School setting, German speaking parents rarely chose the option “daily” for participation frequency. They reasoned their children were not attending school on weekends. We therefore changed it from “daily” to “daily on school days”. As school starts in German-speaking countries generally at 6 or 7 years of age, we added the word “kindergarten” in the school section, to include the 5 year-old children.
In the Community setting, a mother of a girl with arthrogryposis indicated that her daughter never participates in neighborhood outings like shopping or going to a movie.
«If you skip the word “neighborhood”, I would answer this question totally different. My daughter is 17 years, she uses public mobility and can attend with her scooter malls and cinemas in the city. “Neighborhood” is even not our village, it is narrower, just here, our neighbors. » (P.#13)
The term ‘neighborhood’ was considered too restrictive to best reflect the equivalent idea in Germany, Austria and Switzerland. We replaced it with the term ‘’in public’ (G: “in der Öffentlichkeit”), to be sure parents understood this to include public spaces that are beyond the immediate vicinity of the home, but within reach of public transport, for example.
3.4. Conceptual equivalence
To ensure conceptual equivalence of the PEM-CY (German), the expert group used three different kinds of adaptations: adding additional information, improving the visual structure of the questionnaire and providing opportunities for parents to add comments.
Additional information was needed in various forms: first, additional definitions of “participation” and “environment” were added in the introduction, as parents who did not understand English did not get this information and aim from the title – PEM-CY. This was also helpful as parents interpreted these concepts in many different ways, with one misinterpretation shown in the following example:
«Participation for me is when my child does something with somebody else, thus not necessarily alone. Therefore I have problems with the participation item “computer games”, because here he is alone. At least two persons must be involved to talk about “participation» (P. #8).
Next, the age frame of the assessment is more fully explained in the introduction. This helped parents to understand that not all activities are suited to their child. For example, young children would not be expected to use technology for socializing. Also, as parents in the first round often mixed up “independence” and “participation”, we strongly emphasized in the introduction that this assessment is not about independence. Further, the settings (home, school, and community) are explained on each page because parents were confused about separating these settings clearly. For example, parents wondered if the yard of the house was part of the home setting or already part of the community setting. Finally, parents often forgot the time frame of four months during scoring. Mentioning this on each scoring page of participation supported a more correct answering pattern.
The School setting was another area in which additional information was needed. Contrary to the Home setting, where parents saw themselves as a knowledgeable informant, most hesitated to fill in the School setting section. When children don’t talk about school experiences, parents feel uninformed about school. It involved also environmental aspects, as one mother reasoned:
«I have the time to support my child at school. But this is not wished for. I could attend and bring him to activities at school. So, I could choose “yes”. Theoretically. But at the entrance of the school is a sign indicating” from here on I can do it all by myself”. We parents should not enter the school. » (P.#6)
Other parents mentioned that everything is okay as long as teachers don’t complain. Therefore, an additional sentence in the PEM-CY (German) encourages parents to fill the school part out according to their knowledge gained from conversations with their child and/or teachers.
When considering the environment section, we found it supportive to add examples to all environmental questions. In the first and second round of interviews, parents had difficulties with the change of focus from the detailed participation part to the general environment part. We provided additional instructions to help them think more globally (see Figure 2). To further support their understanding, each item of environment was explained by examples of activities. While the original PEM-CY asks about “the physical demands of typical activities in the home (e.g. strength, endurance coordination)”, this was changed in the German Version to “the physical demands for activities at home, referring to the strength, endurance and coordination required (e.g. during playing, dressing, cooking)”. Generally, the three items asking about “physical, cognitive and social-communicative demands” were difficult for most participants. The mother of a girl with arthrogryposis explained.
«When I think of emptying the dish washer[...] it is clear that it is harder for her than for her brother. But I do not expect her to do the same as her brother. So, what are here demands? I don’t understand[...] is this a requirement or demands I judge and pose on her? Of course, she removes the plastic issues and not the heavy loads. I don’t know what to do here. This does not make sense to me. »(P.#13)
The PEM-CY team from CanChild indicated that their intention was to focus on activity demands (and not expectations of others), leading to a rephrasing in German to emphasize different activities.
To improve the visual structure of the questionnaire and make it easier to complete, titles were added to the three scoring aspects of participation (frequency, involvement and change desired). This change was needed because in the first round, parents confused these aspects or did not fill them out separately. Titles made the three categories more explicit. It was also easier to refer to them in the introduction. Parents also had difficulties understanding that the “activities” are just examples. We titled these activities as “activity groups” and instructed them in the introduction to choose one or two activities out of an activity group. This supported understanding. Finally, as proposed by parents, we inserted thicker lines between the different types of change desired. This was intended to help parents to stay in the correct row and mark the correct answer.
In the first round of interviews, parents also had difficulties comprehending the concept and logic based on the format of most questions in the environment section. A mother of a child with DCD for example stated:
«I don’t understand this theme «environment» quite right. I don’t see a connection between activities, these questions and the provided answers. I can’t answer them. » (P.#10)
Parents felt overwhelmed being asked if the environmental element is (1) an issue and if it is, (2) is it available and/or adequate and whether it is (3) supporting or hindering the child’s participation. The following example illustrates how a father of a boy with autism spectrum disorder searched for an answer for the item: “The social demands of typical activities in the home (e.g., communication, interacting with others).” He read the question twice loudly and then expressed his thoughts:
«Well, here I am asked about influence. But influence does not support. I have to make a cognitive triangle here. The scale does not fit to the question, well, I guess I have to transmit the scale to demands. I imagine myself a typical situation at home at the table. My son has some difficulties with social communicative situations…what shall I choose here. Sometimes these situations make it easier, sometimes not [reads the question again]. For me this does not fit. I…I really do not get it. It always helps sometimes and makes it harder sometimes. There is never just one direction. This is somehow much too global. I stop here, may be later I’ll understand it better. »(P.#12)
In addition to the item format, parents struggled with the global answer that was expected. We proposed a two-phase response option to ease these difficulties: “if it is an issue, is it helpful or does it make it harder”. This was rejected by the PEM-CY team from CanChild with the argument that changing to a dichotomic response may affect the psychometric properties of the assessment. Instead we agreed to insert the environmental factor into each possible answer (see Figure 2)
Although most participants found completing the PEM-CY tiresome and strenuous, during the first round they wanted the opportunity to express their concrete wishes for change in their child’s participation. Some started to underline the activity in which they wished to see changes. To address this, we added a column to offer parents space to voluntarily write additional comments. This seemed to improve their comfort in answering the questions as there were only a few comments in following rounds.
3.5. Parents’ suggestions for additional PEM-CY revisions
Some changes proposed by parents were beyond the cultural adaptation of the PEM-CY. For example, parents indicated that they would like to see activities in connection with sleep and restoration, and questions about planning of activities. Some proposed to separate item 5 “getting together with other people” in Home participation. While for some people it is normal for all inner circle family members (parents and siblings) to meet and participate on a daily basis, involving children with relatives or guests at home might be different. In the environmental sections it was suggested that insurance coverage be included, which seems specifically important for children in need of medical or technical aids and personal assistance. As these changes would have changed the nature of the measure, they were not included in the PEM-CY (German)