To achieve the economic and low-carbon operation of Virtual Power Plant (VPP) under the "dual-carbon" background, this paper proposes a two-stage stochastic optimal scheduling model integrating a Concentrating Solar Power (CSP) plant and a Pumped Storage Hydro (PSH) station. First, the overall framework of the VPP is constructed, and a CSP plant model integrated with a heat recovery device is established to enhance the system"s combined heat and power regulation capability. Additionally, a PSH station model is introduced to improve energy storage flexibility and promote renewable energy accommodation. Second, a power and heat supply model comprising a gas turbine, a gas boiler, and a waste heat boiler is established. By coupling Power-to-Gas (P2G) technology and Carbon Capture Systems (CCS), the captured CO? is combined with hydrogen and converted into synthetic natural gas, which is then recycled to the gas-fired equipment. Concurrently, a stepped carbon trading mechanism is incorporated to reduce carbon emission costs. Finally, deterministic scenario comparisons demonstrate the roles of the CSP plant and the PSH station in improving the system"s economic and low-carbon performance. Furthermore, the application of the two-stage stochastic optimization method under uncertain scenarios verifies that the proposed strategy can still effectively enhance the renewable energy integration capacity while simultaneously ensuring the economic and low-carbon benefits of the VPP.