To ensure the coexistence of autonomous personal mobility vehicles (PMVs) and pedestrians in a pedestrian zone, they should be able to smoothly pass across and avoid each other. Studies suggest that it is possible that PMVs and pedestrians can pass each other in a short period of time without compromising their comfort; this can be achieved through understanding how pedestrians react to the behavior of PMVs and by modifying the autonomous navigation of PMVs accordingly. Therefore, in this study, the avoidance behavior characteristics of pedestrians were investigated. Experiments were conducted to understand the influence of the selected avoiding behavior parameters and to understand the behavior characteristics of pedestrians in relation to the behavior of PMVs. Furthermore, a path planning strategy that enables smooth passing was developed based on these characteristics. The usefulness of this method was evaluated. The avoidance time and the avoiding angular velocity at the start and end of the avoidance behavior were the parameters that contributed to smooth autonomous navigation. The results show that pedestrian tolerance improves and the avoidance width decreases depending on these parameters. Furthermore, smooth autonomous navigation can be achieved using the characteristics of pedestrians’ cognition against PMVs.