When black carbon deposits on snow/ice surface, it can reduce the albedo and increase the absorption of shortwave radiation. The changes in black carbon and their impact on the sea ice melting process are worth investigating. Study of the influence of black carbon in the Arctic Ocean was conducted using the CICE sea ice model. The results indicates that under the impact of black carbon deposition from different sources, from 1980 to 2014, the simulated summer albedo of the Arctic Ocean decreased by 0.82% to 1.71%, ultimately causing a decrease in sea ice extent by 0.97%−1.93%. In the Barents Sea, Kara Sea, and Laptev Sea, the summer sea ice area reduction caused by black carbon is approximately 2–3 times greater than the overall reduction in the Arctic Ocean. The simulation results under different black carbon deposition all show that from 1980 to 1995, the impact of black carbon on albedo in the Arctic exhibited a decreasing trend. However, from 1996 to 2014, the black carbon effect shifted to an increasing trend. In low-latitude regions, due to the retreat of sea ice, the effect of black carbon showed a decreasing trend, while in high-latitude regions, due to the cumulative effect of black carbon in multi-year ice, the radiative impact of black carbon showed an enhancing effect.