Biological invasions by alien and range-expanding native plant species can suppress native plants through allelopathy. However, the homeland security hypothesis suggests that some native plants can resist invasion by producing allelopathic compounds that inhibit the growth of invasive plants. Most research has focused on allelopathic interactions between individual native and invasive plant species, with less emphasis on how allelopathy helps entire native communities resist invasions. Additionally, limited knowledge exists about allelopathic interactions between range-expanding native species and recipient native communities, and their influence on invasion success. To bridge this knowledge gap, we conducted two greenhouse competition experiments to test reciprocal allelopathic effects between a native woody range-expanding species, Betula fruticosa, and a community of four native herbaceous species (Sanguisorba officinalis, Gentiana manshurica, Sium suave, and Deyeuxia angustifolia) in China. We assessed whether B. fruticosa and the native community differed in their competitive effects and responses, and whether these were influenced by activated carbon, which neutralizes allelochemicals in the soil. Activated carbon reduced the suppressive effects of the native community on the above-ground biomass of B. fruticosa, which indicates that the native community exerted a strong allelopathic effect on B. fruticosa. In contrast, activated carbon only marginally enhanced the suppressive effects of B. fruticosa on the native community, which indicates that allelopathy is not the primary mechanism by which B. fruticosa exerts its suppression. Overall, these findings support the homeland security hypothesis and suggest that biotic resistance from the native herbaceous community may limit the invasion success of the woody range-expander B. fruticosa.