Abstract: The in-vessel retention is adopted by the third generation nuclear power technology as an important severe accident mitigation strategy. The integrity of reactor pressure vessel depends on the heat flux distribution of molten pool. In present study, the solidification model in open source CFD software OpenFOAM was applied to simulate solidification and natural convection which was driven by internal heat source or temperature difference. The stratified molten pool heat transfer experiment carried out by Royal Institute of Technology was analyzed in the paper, and the solidified crust, temperature and heat flux distributions were obtained. The simulation results were compared with experimental data. It is shown that this numerical method can be used in the simulation of natural convection and solidification of molten pool, and it will probably be used in the analysis of molten corium behavior in reactor lower head.