The primary goal of material management is to reasonably arrange the use of materials, which is particularly important for the construction industry. In the process of material management, on the premise of meeting the requirements of production and construction materials, try not to increase additional inventory and reduce the amount of capital. In order to explore the method of prefabricated building material management, this paper uses the method of sampling survey and sand table simulation technology to compare the prefabricated building material management based on BIM Technology with the conventional method. We make a comparative study on the procurement, warehouse and material quality of materials, mainly focusing on the production stage and construction stage of the building, and analyze the difference of material management between the two technical methods in different stages. Through experiments, we find that the average inventory turnover times of the BIM based prefabricated building materials management method is 6, and that of the conventional method is 4, but in the construction stage, the gap between the two is narrowed. The turnover times of the prefabricated building material management method based on BIM Technology is reduced to 3, and that of the conventional method is reduced to 2. It can be seen that the prefabricated building material management based on BIM Technology can reduce the capital use and warehouse occupancy rate more than the conventional method, and at the same time, the quality control of materials is also better.