At the onset of the process, based on the information available in the literature, a Table of the Epigenetic Characteristics for Sports (QCEE) was created, consisting of 74 Olympic sports as well as those culturally pertaining to Brazil. The dermatoglyphic and anthropometric characteristics of each of these sports were determined, after which the most important characteristic for the modality was selected followed by the values of those of lesser importance, as shown in the spreadsheet available at https://portal.unit.br/labimh/planilhas/.
The first experimental step was to verify the content and face validity of the QCEE, using the Delphi methodology [20]. To that end, a questionnaire was sent as a link to trainers, specialists, doctors, and individuals with expertise in the field of sports in order to obtain their opinion. When clicking on the link, the QCEE proposal appeared, with the expertise modality of the evaluator and the order of physical and anthropometric characteristics needed. The evaluator could agree with the proposition or suggest a new order. The level of agreement among specialists regarding the variables in the chart was noted.
The results of this validation are presented in Table 1:
Table 1
– Content and face validity results using the Delphi method
Link sent
|
Sample
|
% agreement
|
% disagreement
|
1st dispatch
|
50
|
|
|
Returned
|
42
|
72.2
|
27.8
|
2nd dispatch
|
42
|
|
|
Returned
|
37
|
84.6
|
15.4
|
3rd dispatch
|
37
|
|
|
Returned
|
35
|
100
|
0.0
|
In this study, a ≤ 99% level was estimated due to the responsibility of carrying out sports guidance being decisive for an individual’s future and sports development. In this type of study, usually between five and ten specialist samples are used [21]; however, we used 50 specialists due to the quantity of validations and the need for expertise in the modalities. From there, rounds started with the link being sent for assessment. The following aspects were assayed:
Round 1
In the first round, the link was sent with the QCEE proposition. With the link, evaluators received clear explanations about the aim of the study, the procedure that would be done, and a consent form. After that, they filled in their personal data with information on their sport of expertise as a researcher and the scope of their activities.
When the table with the physical and anthropometric characteristics of each modality according to a scale of requirement was presented, the specialist could agree or disagree with the proposal. In case of disagreement, they could suggest a change. Thus, in the first round, only 42 out of the 50 evaluators answered the report concerning the table (in time). Of the 42, there was no minimal agreement for acceptance of the tool, representing an agreement level of 72.2%.
Round 2
With similar points that needed correction, the table was adapted to the evaluators’ opinions and sent back again with pertinent guidelines. At this second moment, a minimal agreement value was reached (80%), though it was not yet what was set as a goal by the research. 37 evaluators answered the report out of the 42 sent out; with this, the agreement level of 84.6% of returned answers was reached.
Round 3
Finally, the corrected material was sent back to 37 specialists and only 35 answered, an expected sample loss. In this third and last Delphi round, a 100% consensus among the evaluators’ answers was reached, validating the Sports Epigenetic Characteristics Table, composed of 74 sports modalities classified according to levels of physical and anthropometric requirements for each one. This enabled us to advance with anthropometric and dermatoglyphic data collection and attain the remaining levels of validation.
After the content and face validity of the instrument was determined, the next validation procedures were conducted to assess their reliability (intrarater error) and objectivity (interrater error).
The Reliability assessment (intrarater error) showed significant correlations (p < 0.001) greater than or equal to r = 0.97, a number which in fact indicates a very strong correlation (Table 2).
Table 2
– Reliability assessment (intrarater) of the instrument
Variable
|
Ratio
|
α
|
p-value
|
Weight (Kg)
|
1.0
|
1.0
|
< 0.001
|
Height (cm)
|
1.0
|
1.0
|
< 0.001
|
Reach (cm)
|
1.0
|
1.0
|
< 0.001
|
HRR
|
1.0
|
1.0
|
< 0.001
|
BMI
|
1.0
|
1.0
|
< 0.001
|
Force
|
1.0
|
1.0
|
< 0.001
|
Speed
|
0.99
|
1.0
|
< 0.001
|
Motor Coordination
|
1.0
|
1.0
|
< 0.001
|
Power
|
1.0
|
1.0
|
< 0.001
|
Agility
|
1.0
|
1.0
|
< 0.001
|
Hypertrophy
|
0.99
|
1.0
|
< 0.001
|
Flexibility
|
0.97
|
1.0
|
< 0.001
|
Endurance
|
1.0
|
1.0
|
< 0.001
|
When the dermatoglyphic and anthropometric variables are observed, and the tool’s reliability is tested, one can see that the closer to r = 1.0, the better. The variables speed and flexibility are the most distant, though still within a very strong correlation.
Objectivity (interrater error) also expressed high result reliability, with all values obtained greater than or equal to 0.94, demonstrating a very strong correlation (Table 3).
Table 3
– Objectivity assessment (interrater) of the instrument
Variable
|
Ratio
|
p-value
|
α
|
Weight (Kg)
|
1.0
|
< 0.001
|
1.0
|
Height (cm)
|
1.0
|
< 0.001
|
1.0
|
Reach (cm)
|
1.0
|
< 0.001
|
1.0
|
HRR
|
1.0
|
< 0.001
|
1.0
|
IMC
|
1.0
|
< 0.001
|
1.0
|
Force
|
0.99
|
< 0.001
|
1.0
|
Speed
|
0.98
|
< 0.001
|
1.0
|
Motor Coordination
|
1.0
|
< 0.001
|
1.0
|
Power
|
0.99
|
< 0.001
|
1.0
|
Agility
|
0.99
|
< 0.001
|
1.0
|
Hypertrophy
|
0.97
|
< 0.001
|
1.0
|
Flexibility
|
0.94
|
< 0.001
|
1.0
|
Endurance
|
0.94
|
< 0.001
|
1.0
|
When the error in objectivity among researchers is observed, it is clear that this was greater when compared with the intra-evaluation error. This is also expected since it involves the applier’s particularities, even when considering protocol and training control.
As to objectivity, the variables force, speed, power, agility, flexibility and resistance were the most distant among the criteria of evaluation. Flexibility and resistance stood out with a 0.94 relation; this can most likely be explained by the error among evaluators regarding the counting of dermatoglyphic lines. Nevertheless, the correlation still stood out as being very strong.
Hence, concerning general criteria, the validation process of the Protocol for Sports Vocation Guidance occurred as follows (Table 4):
Table 4
– General Levels of Protocol Validation
Variable
|
Agreement Level
(validity)/average relation
|
p-value
|
α
|
Validity
|
100%
|
-
|
-
|
Reliability
|
1.00
|
p < 0,001
|
α ≥ 0,99
|
Objectivity
|
0.99
|
p < 0,001
|
α ≥ 0,99
|
The instrument can therefore be considered valid, according to the indices obtained in each validation stage, as follows: Validity (100% agreement in the 3rd round; Reliability (r mean = 1.00; p < 0.001 and α ≥ 0.99) and Objectivity (r mean = 0.99; p < 0.001 and α ≥ 0.99).