Validity and reliability studies of the uskudar self-consciousness scale (USSCS)
In this section, first the validity and reliability studies of the Uskudar Skepticism Scale (USSES) and then the Uskudar Narcissism Scale (USNAS) will be included. At the beginning of the validity and reliability studies, whether the data were suitable for factor analysis was examined with the Kaiser Meyer Olkin (KMO) sampling coefficient and the Bartlett Test of Sphericity. Accordingly, the KMO coefficient value was found to be .92. The result of the Bartlett Test of Sphericity was found to be significant (X2 = 7500.809; df:190; p = 0.000). Thus, the results showed that the data were suitable for factor analysis [32]. Exploratory factor analysis (EFA) was performed with 26-item candidate scale data created after the expert opinion phase. During EFA, values with eigenvalue greater than 1 formed a factor and a 4-factor structure emerged for USSES [33].
Table 1
USSES Factor Structure and Explained Variance Ratio
USSES | Eigenvalue | Variance | Cumulative Variance |
---|
Factor 1 | 6,89 | 34,48 | 34,48 |
Factor 2 | 1,50 | 7,49 | 41,98 |
Factor 3 | 1,11 | 5,56 | 47,54 |
Factor 4 | 1,07 | 5,37 | 52,92 |
As seen in Table 1, the eigenvalues of the factors vary between 6.89 and 1.07. The explained variance rate in the total scale was 52.62%. After determining the number of factors, item factor loadings were examined and items with overlapping or low factor loadings (9,10,16,19,22,26) were removed from the scale. The factor loadings of the remaining 20 items after the removal of 6 items are given in Table 2.
Table 2
USSES Item Factor Loads, Item Total Correlations and Cronbach Alpha Values
Factor | New Item No. | Items | Factor Load | Item Total Correlation | Cronbach Alpha |
---|
F1 | 1 | Q14: I cut people out of my life because of a small mistake. | ,66 | ,62 | ,81 |
2 | Q20: I do not forgive people; I consider it my right to take revenge. | ,65 | ,60 |
3 | Q1: My sense of revenge is strong and I never know what I will be angry about. | ,65 | ,65 |
4 | Q2: I would consider going to court even for a simple reason. | ,60 | ,44 |
5 | Q13: I am special and I cannot handle criticism. | ,59 | ,55 |
6 | Q21: I like myself and always defend myself against people. | ,51 | ,51 |
7 | Q11: I make a big deal out of something simple; I enjoy testing people. | ,51 | ,54 |
8 | Q18: I perceive a simple mistake or omission as disloyalty. | ,43 | ,66 |
9 | Q7: I make comments that upset others even though they are not true. | ,43 | ,38 |
F2 | 10 | Q24: Sometimes I do not trust even my closest people, I think I will be deceived. | ,83 | ,36 | ,68 |
11 | Q25: I agree with the statement that you should not even trust your father in this world. | ,79 | ,35 |
12 | Q23: I remember the saying: “Human beings do not always behave decently” every day. I always fear so that they would not hurt me. | ,67 | ,30 |
13 | Q8: I am confident, but I am a skeptic, I do not believe people easily. | ,51 | ,38 |
F3 | 14 | Q15: I protect the person I love at all costs. | ,73 | ,62 | ,81 |
15 | Q17: I see various connections between events. | ,67 | ,49 |
16 | Q12: I do not forget the bad treatment done to me. | ,55 | ,37 |
F4 | 17 | Q5: I am different and I believe in metaphysical things easily. | ,77 | ,34 | ,64 |
18 | Q6: I recommend exaggerated punishments for some people, and sometimes I start by saying, “These people...” | ,52 | ,33 |
19 | Q4: Trusting people makes me anxious; even if two people are talking from afar and do not look at me, I take it upon myself. | ,49 | ,38 |
20 | Q3: I often question people’s commitment and loyalty to me. | ,46 | ,38 |
Total | | | | | ,89 |
Explanation
As a result of the EFA, the USSES scale form, consisting of 20 items and 4 factors, was rated on a 5-point Likert type as “Strongly Disagree”, “Slightly Agree”, “Moderately Agree”, “Very Agree”, “Strongly Agree”. A minimum of “1” and a maximum of “5” points can be obtained from each item There are no items that need to be reverse scored.
As seen in Table 2, the factor and item distributions in the scale were determined, and the items were renumbered. Subsequently, each of the factors to which the new numbered items belong was given a name. Accordingly, Factor 1 (Items 1–9) is “Seeking Revenge”; Factor 2 (Items 10–13) “Fear of Harm”; Factor 3 (Items 14–16) “Sense of Grandeur”; Factor 4 (Items 17–20) “External Attribution”. Item-total correlations were found to be within the acceptable range for each item and correlated with the scale (r > .30). Within the scope of reliability studies, Cronbach Alpha values, which are the internal consistency coefficients of the factors and the scale total, were calculated. The Cronbach Alpha values of the factors were found to be between .64 and .81; and the total scale was found to be .89.
After the USSES factor structure was formed, a scale model was drawn using the AMOS program with the data set consisting of 400 people, and confirmatory factor analysis was applied in Fig. 1. The goodness-of-fit values were found to be in the acceptable range and the model was validated (X2/sd = 2.99 < 3; RMSEA = .07 < .08; NFI = .91 > .90; NNFI = .96 > .95; CFI = .96 > .95; GFI = .92 > .90; AGFI = .86 > .85).
In the second stage of the study, validity and reliability studies of the USNAS Scale were conducted. Exploratory factor analysis (EFA) was conducted with the 27-item candidate scale data created after the expert opinion phase. After the EFA, Eigenvalue values greater than 1 for USNAS formed factors and a 5-factor structure emerged as seen in Table 3.
Table 3
USNAS Factor Structure and Explained Variance Ratio
USNAS | Eigenvalue | Variance | Cumulative Variance |
---|
Factor 1 | 7,62 | 30,50 | 30,50 |
Factor 2 | 2,01 | 8,04 | 38,54 |
Factor 3 | 1,32 | 5,28 | 43,83 |
Factor 4 | 1,20 | 4,82 | 48,65 |
Factor 5 | 1,02 | 4,09 | 52,75 |
As seen in Table 3, the eigenvalues of the factors vary between 7.62 and 1.02. The explained variance rate in the total scale was 52.75%. When two overlapping items were removed from the scale (9,15), a 25-item and 5-factor scale structure emerged. The factor loadings of the items are given in Table 4.
Table 4
USNAS Item Factor Loads, Item Total Correlations and Cronbach Alpha Values
Factor | New It. No. | Items | Factor Load | Item Total Correlation | Cronbach Alpha |
---|
F1 | 1 | I5: I enjoy paying attention to other people’s flaws. | ,70 | ,45 | ,81 |
2 | I4: It is easy for me to make negative comments about others. | ,68 | ,57 |
3 | I23: When there is a problem, my first reaction is usually to look for fault in others. | ,63 | ,56 |
4 | I7: Most of the time I do not think I am making a mistake. | ,60 | ,47 |
5 | I6: I get angry when I do not get what I want, the reasons for the situation are not important to me. | ,58 | ,61 |
6 | I16: Most of the time I want the rules to be tailored to me. | ,48 | ,59 |
7 | I10: I do not mind using others to achieve my goal. | ,47 | ,49 |
8 | I17: When asking questions in a meeting, I make comments that show that I know more than the speaker. | ,46 | ,52 |
9 | I22: When others criticize me, I think they are jealous of me. | ,40 | ,60 |
F2 | 10 | I1: I have dreams of being big, famous and rich, I like to pretend that these dreams have come true. | ,68 | ,54 | ,74 |
11 | I26: Being successful, powerful and rich is one of my primary interests. | ,67 | ,64 |
12 | I24: I often think that it is better not to live than to be an ordinary person. | ,64 | ,54 |
13 | I27: Someone else’s success does not make me happy, even if it is the person I love, and I even get jealous sometimes. | ,48 | ,40 |
14 | I21: I love competition, but I cannot stand losing. | ,47 | ,66 | |
F3 | 15 | I18: I often think that other people misunderstand me. | ,81 | ,56 | ,72 |
16 | I19: I often think that I am treated unfairly. | ,78 | ,60 |
17 | I8: If I realize I did something wrong, I can easily feel depressed. | ,51 | ,55 |
18 | I20: People see my successes but say I am difficult. | ,41 | ,56 |
F4 | 19 | I12: I am very selective about the people I meet and the people in my life. | ,74 | ,45 | ,67 |
20 | I11: I categorize everything and prioritize what is most important to me. | ,66 | ,56 |
21 | 114: I do not care about other people’s feelings and thoughts if they do not benefit me. | ,63 | ,49 |
22 | I25: Things that do not conform to my ideal have no value. | ,48 | ,59 |
F5 | 23 | I3: I have more success than my peers. | ,82 | ,46 | ,72 |
24 | I2: I am important, smart and talented. | ,80 | ,52 |
25 | I13: I feel special in the way I dress and the car I drive. | ,47 | ,56 |
Total | | | | | ,90 |
Explanation
As a result of the EFA, the USNAS scale form, consisting of 25 items and 5 factors, was rated on a 5-point Likert type as “Strongly Disagree”, “Slightly Agree”, “Moderately Agree”, “Very Agree”, “Strongly Agree”. A minimum of “1” and a maximum of “5” points can be obtained from each item There are no items that need to be reverse scored.
As seen in Table 4, the factor and item distributions in the scale were determined, and the items were renumbered. Subsequently, each of the factors to which the new numbered items belong was given a name. Accordingly, Factor 1 (Items 1–9) is “Egocentrism and Devaluing Others”; Factor 2 (Items 10–14) “Grandiose Fantasy”; Factor 3 (Items 15–18) “Entitlement and Inability to Self-Criticize”; Factor 4 (Items 19–22) “Exhibitionism Factor 5 (Items 23–25) “Superiority”. Item-total correlations were found to be within the acceptable range for each item and correlated with the scale (r > .30). Within the scope of reliability studies, Cronbach Alpha values, which are the internal consistency coefficients of the factors and the scale total, were calculated. The Cronbach Alpha values of the factors were found to be between .67 and .81; and the total scale was found to be .90.
After the USNAS factor structure was formed, a scale model was drawn using the AMOS program with the data set consisting of 400 people, and confirmatory factor analysis was applied. The goodness-of-fit values were found to be in the acceptable range and the model was validated in Fig. 2 (X2/df = 2.97 < 3; RMSEA = .07 < .08; NFI = .94 > .90; NNFI = .98 > .95; CFI = .96 > .95; GFI = .92 > .90; AGFI = .87 > .85).
After determining the dimensional structure of both scales, the relationship between the dimensions was examined with the Pearson Correlation coefficient analysis and the results are given in Table 5.
Table 5
USSCS Scale and Relationship of Factors
USKUDAR SELF-CONSCIOUSNESS SCALE |
---|
Uskudar Skepticism Scale | F1 | F2 | F3 | F4 | Uskudar Narcissism Scale | F1 | F2 | F3 | F4 | F5 |
---|
F1: Seeking Revenge | 1 | | | | F1: Egocentrism and Devaluing Others | 1 | | | | |
F2: Fear of Harm | .56 | 1 | | | F2: Grandiose Fantasy | .63 | 1 | | | |
F3: Sense of Grandeur | .55 | .63 | ,1 | | F3: Entitlement and Inability to Self-Criticize | .60 | .53 | 1 | | |
F4: External Attribution | .63 | .59 | .61 | 1 | F4: Exhibitionism | .47 | .49 | .46 | 1 | |
- | | | | | F5: Superiority | .39 | .45 | .33 | .49 | 1 |
USSCS | .85 | .81 | .81 | .83 | USSCS | .85 | .81 | .77 | .74 | .64 |
As expected, the scales are dimensionally consistent within themselves, that is, the dimensions are moderately correlated (r > .30 < .70) and highly correlated with the scale total scores (r > .70).
After developing the USSCS scale, the psychometric examinations were conducted. First, it was examined whether there was a relationship between the Uskudar Skepticism Scale and Uskudar Narcissism Scale. A high level of relationship was found (r > .70) as seen in Table 6.
Table 6
Pearson Correlation Value of Scales
Scales | N | X | r | p |
---|
USSES & USNAS | 1119 | 41.26 | .77 | .000 |
1119 | 49.60 |
First, the average scores obtained from the scales were calculated and the results are given in Table 7. Then, differences according to gender, age and some social media questions were tested with parametric tests.
Table 7
Average USSCS Scores of Groups
Groups /USSES | X | Sd | Groups /USNAS | X | Sd |
---|
F1: Seeking Revenge | 14.67 | 5.42 | F1: Egocentrism and Devaluing Others | 14.38 | 5.39 |
F2: Fear of Harm | 9.49 | 3.99 | F2: Grandiose Fantasy | 8.44 | 3.79 |
F3: Sense of Grandeur | 9.28 | 2.90 | F3: Entitlement and Inability to Self-Criticize | 9.40 | 3.78 |
F4: External Attribution | 7.80 | 3.18 | F4: Exhibitionism | 10.30 | 3.57 |
- | | | F5: Superiority | 7.11 | 2.86 |
Total (n = 1119) | 41.26 | 12.75 | Total (n = 1119) | 49.64 | 15.10 |
When Table 6 is examined, it is seen that the average score from the total USSES scale is X = 41.26; and from the USNAS scale, it is seen that the average score is X = 49.64. When the evaluation intervals obtained with the equal spacing technique are taken into consideration, in the 1119-person Turkey sample in which the study was conducted, the skepticism and narcissism was found to be at a low level. The evaluation intervals and application forms of the scales are given in Appendix-1.
In the study where self-consciousness was examined, it can be said that self-consciousness was at a low level. When the sub-dimensions were examined in terms of skepticism, seeking revenge was found to be “none”, the fear of harm and external attribution were found to be at a low level, and the sense of grandeur was found to be at a medium level. When the sub-dimensions were evaluated in terms of narcissism, egocentrism and devaluing others, grandiose fantasy were evaluated as “none”. In other dimensions, a low level of narcissism was revealed (Entitlement and inability to self-criticize, exhibitionism, superiority). The graphs created with the total scores of the scale are given in Graph 1.
*USSES can be seen on the left side; USNAS can be seen on the right side
Graph 1. USSES & USNAS Average Score
Within the scope of psychometric studies, the differences in two separate scale scores according to the age variable were analyzed. The age variable was first grouped as X, Y, Z according to the generation theory. One-Way ANOVA and LSD analysis technique were preferred for the difference between the groups. Highly significant differences emerged in each category (p < 0.001). In this direction, the total scores of the two scales and the Cohen d calculations showing the mean scores, standard deviations and the effect size created by the difference according to the generations are given in Table 8 and Table 9.
When the results are examined, it is seen that the Generation Z group (Age: 18–30) has the highest average scores in both scales and dimensions. Especially the difference between Generation Z and Generation X (Age: >45) is seen to be high (d > 0.50). Thus, it can be said that as age increases, skepticism and narcissism tendencies decrease, as seen in generation groups. As age decreases, skepticism, narcissism and the level of self-consciousness in general increase.
Table 8
Average USSES Scores of Age Groups of Generations
Scale | X | Sd | d | |
---|
USSES – Generation Z: 18–30 (n = 420) | 46.14 | 13.07 | 0.95ac 0.53ab 0.38bc | |
USSES – Generation Y: 30–45 (n = 512) | 39.40 | 12.11 | |
USSES – Generation X: >45 (n = 177) | 35.20 | 9.46 | |
Sub-Scales |
Seeking Revenge – Generation Z: 18–30 (n = 420) | 16.31 | 5.94 | 0.73ac 0.41ab 0.30bc |
Seeking Revenge – Generation Y: 30–45 (n = 512) | 14.03 | 5.11 |
Seeking Revenge – Generation X: >45 (n = 177) | 12.67 | 3.79 |
Fear of Harm – Generation Z: 18–30 (n = 420) | 10.70 | 4.12 | 0.73ac 0.41ab 0.31bc |
Fear of Harm – Generation Y: 30–45 (n = 512) | 9.05 | 3.78 |
Fear of Harm – Generation X: >45 (n = 177) | 7.91 | 3.45 |
Sense of Grandeur – Generation Z: 18–30 (n = 420) | 10.05 | 2.68 | 0.69ac 0.35ab 0.29bc |
Sense of Grandeur – Generation Y: 30–45 (n = 512) | 9.03 | 3.01 |
Sense of Grandeur – Generation X: >45 (n = 177) | 8.20 | 2.64 |
External Attribution – Generation Z: 18–30 (n = 420) | 9.06 | 3.51 | 0.87ac 0.57ab 0.33bc |
External Attribution – Generation Y: 30–45 (n = 512) | 7.26 | 2.76 |
External Attribution – Generation X: >45 (n = 177) | 6.40 | 2.37 |
The range is between 1–5.
aReference group was calculated as Scale & Subscale: Age/Generation Z total X1-X2/SD Generation Z
bReference group was calculated as Scale & Subscale: Age/Generation Y total X1-X2/SD Generation Y
cReference group was calculated as Scale & Subscale: Age/Generation X total X1-X2/SD Generation
Table 9
Average USNAS Scores of Age Groups of Generations
Scale | X | Sd | d | |
---|
USNAS – Generation Z: 18–30 (n = 420) | 55.60 | 15.75 | 0.93ac 0.56ab 0.36bc | |
USNAS – Generation Y: 30–45 (n = 512) | 47.25 | 13.86 | |
USNAS – Generation X: >45 (n = 177) | 42.59 | 11.72 | |
Sub-Scales |
Egocentrism and Devaluing Others – Generation Z: 18–30 (n = 420) | 15.84 | 6.14 | 0.62ac 0.37ab 0.25bc |
Egocentrism and Devaluing Others – Generation Y: 30–45 (n = 512) | 13.77 | 4.83 |
Egocentrism and Devaluing Others – Generation X: >45 (n = 177) | 12.63 | 3.93 |
Grandiose Fantasy – Generation Z: 18–30 (n = 420) | 10.13 | 4.12 | 0.98ac 0.67ab 0.30bc |
Grandiose Fantasy – Generation Y: 30–45 (n = 512) | 7.63 | 3.18 |
Grandiose Fantasy – Generation X: >45 (n = 177) | 6.77 | 2.54 |
Entitlement and Inability to Self-Criticize – Generation Z: 18–30 (n = 420) | 10.76 | 3.88 | 0.77ac 0.52ab 0.23bc |
Entitlement and Inability to Self-Criticize – Generation Y: 30–45 (n = 512) | 8.79 | 3.56 |
Entitlement and Inability to Self-Criticize – Generation X: >45 (n = 177) | 8.00 | 3.17 |
Exhibitionism – Generation Z: 18–30 (n = 420) | 11.09 | 3.70 | 0.55ac 0.28ab 0.28bc |
Exhibitionism – Generation Y: 30–45 (n = 512) | 10.08 | 3.42 |
Exhibitionism – Generation X: >45 (n = 177) | 9.13 | 3.31 |
Superiority – Generation Z: 18–30 (n = 420) | 7.75 | 2.89 | 0.62ac 0.27ab 0.33bc |
Superiority – Generation Y: 30–45 (n = 512) | 6.96 | 2.82 |
Superiority – Generation X: >45 (n = 177) | 6.05 | 2.57 |
The range is between 1–5.
aReference group was calculated as Scale & Subscale: Age/Generation Z total X1-X2/SDGeneration Z
bReference group was calculated as Scale & Subscale: Age/Generation Y total X1-X2/SDGeneration Y
cReference group was calculated as Scale & Subscale: Age/Generation X total X1-X2/SDGeneration X
Another analysis was made according to the level of education. The level of education was grouped as primary school, high school, college, university and postgraduate. For this, variance analysis One-Way-ANOVA and LSD difference test were applied and significant differences were found in both scales (p < 0.005). Although there were significant differences in each category in the dimensions, the results according to the total scores of the scale are given in Table 10.
Table 10
Average USSES & USNAS Scores According to Education Level
Scale | X | Sd | d | |
---|
USSES – Primary education (n = 120) | 35.83 | 9.33 | 0.63ab | |
USSES – High school (n = 274) | 40.86 | 12.20 | |
USSES – College (n = 83) | 42.19 | 13.55 | |
USSES – University (n = 540) | 42.51 | 12.94 | |
USSES – (n = 93) | 43.33 | 13.71 | | |
USNAS – Primary education (n = 120) | 43.93 | 12.97 | 0.59ab |
USNAS – High school (n = 274) | 47.54 | 14.28 |
USNAS – College (n = 83) | 49.45 | 15.63 |
USNAS – University (n = 540) | 51.51 | 15.12 |
USNAS- Postgraduate (n = 93) | 52.30 | 14.99 |
The range is between 1–5.
aReference group was calculated as Scale & Subscale: Primary education total X1-X2/SDPrimary education
bReference group was calculated as Scale & Subscale: Postgraduate total X1-X2/SDPostgraduate
When the average scale scores in Table 10 are examined, it is seen that skepticism and narcissism increase as the level of education increases. According to the Cohen (d) effect analysis, the effect size between the lowest and highest scores was found to be high (d > 0.50). Thus, it can be said that people with a postgraduate education level have a higher level of skepticism and narcissism than others. In second place are those with a university education level. People with a primary school education level have the lowest level of skepticism and narcissism.