Arbuscular mycorrhiza (AM) plays crucial roles in terrestrial ecosystems. This study employed high-throughput sequencing to analyze the structure and diversity, ecological distribution patterns, and relationships with soil factors of AM fungal communities in the rhizosphere soil and roots of Allium ramosum at different elevations on Chunkun Mountain in North China. In total, 1 431 amplicon sequence variants (ASVs) belonging to 95 AM fungal virtual taxa (VTs) encompassing 7 families and 8 genera were obtained from rhizosphere soil and root samples. Among these, the genus Ambispora was exclusively detected in the rhizosphere soil. The genus with the highest relative abundance was Glomus, and Claroideoglomus was the next. Altitude significantly influenced the diversity of AM fungal communities in the rhizosphere soil and roots of A. ramosum. The Chao1 indices for both roots and rhizosphere soil, together with the root Shannon index, peaked in the middle altitude range, whereas the Shannon index of rhizosphere soil reached its highest value in the high-altitude range. The AM fungal alpha diversity index in the rhizosphere soil was significantly higher than that in the roots (P<0.05), suggesting that roots exhibit selectivity towards symbiotic AM fungi. The results of the redundancy analysis (RDA) and the Monte Carlo permutation test indicated that soil organic carbon is a key driving factor for the arbuscular mycorrhizal (AM) fungal communities in the rhizosphere soil and roots of A. ramosum (P<0.001). Total phosphorus also had highly significant influence on the AM fungal community in rhizosphere soil (P<0.001). This study provides reference for the further development and utilization of A. ramosum.