Cancer's genomic complexity poses significant challenges in identifying the crucial driver variants that fuel oncogenesis. To overcome these obstacles, we present ModVAR, an innovative multimodal model that seamlessly integrates DNA sequences, protein tertiary structures, and cancer omics data to predict driver variants with exceptional precision. Leveraging pre-trained models DNAbert2 and ESMFold, combined with a novel self-supervised strategy for omics data, ModVAR consistently outperforms 14 leading prediction methods. It achieves an outstanding AUROC of 0.985 in clinical benchmarks and 0.952 in experimental assay-related benchmarks, underscoring its effectiveness in identifying both clinically and experimentally validated variants. ModVAR also excels in predicting cancer indels, with an AUROC of 0.901, and demonstrates remarkable generalization with an AUROC of 0.981 for non-cancer disease variants. These results underscore ModVAR's robustness and versatility, positioning it as a powerful tool in genomics and precision medicine. Additionally, its application to COSMIC has generated a publicly available resource of 3,971,946 annotated variants, driving an advancement in cancer research and personalized therapy.