Continental margin sediments are important ocean carbon repository, and the internal carbon cycle is mainly driven by the mineralization processes of sedimentary organic matter. Most organic carbon is transformed to Dissolved Inorganic Carbon (DIC) by mineralization processes after being delivered to continental margin sediments, and DIC from pore water diffuses into the upper water column and participates in the ocean carbon cycle. At the same time, some DIC combines ions such as Ca²⁺ and Mg²⁺ and precipitates as authigenic carbonate minerals so that carbon is stored in the deposits. Based on the biogeochemical study of the mechanism and efficiency of organic matter burial, we discussed the interaction among sulfate reduction, methanogenesis and anaerobic oxidation of methane, and the effect of organic mineralization on the formation of authigenic carbonate. By reviewing the above-mentioned aspects, we can obtain a better understanding of the role of continental margin sediments in the global carbon cycling budgets as well as its climate and environmental effects.