Recycling of construction material is a valuable option for minimizing construction & demolition waste streams to landfills and mitigating primary mineral resource depletion. Material flows in the construction sector are governed by a complex socio-technical system in which awarding authorities decide in interaction with other actors on the use of construction materials. Currently, construction & demolition waste is still mainly deposited in landfills, as construction actors lack the necessary information and training regarding the use of recycled materials, and as a result have low levels of acceptance for them. This paper presents an agent-based model of the Swiss recycled construction material market based on empirical data derived from the agent operationalization approach. It elaborates on how recycling of construction materials can be enhanced by analysing key factors affecting the demand for recycled construction materials and developing scenarios towards a sustainable construction waste management. Doing so it demonstrates how detailed empirical agent decision data were incrementally included in the ABM model. Raising construction actors' awareness of recycled materials as a decision option, in combination with small price incentives was most effective for enhancing the use of recycled materials. This could lead to a 50% reduction of construction & demolition waste streams to landfills, and significantly reduce the environmental impacts related to concrete applications. From a methodological perspective, although the agent operationalization approach provides a large empirical foundation, incremental model development turned out to be particularly important for the traceability of results and a realistic system representation.