Organo-lead halide perovskites have attracted much attention for solar cell applications due to their unique optical and electrical properties. With either low-temperature solution processing or vacuum evaporation, the overall conversion efficiencies of perovskite solar cells with organic hole-transporting material were quickly improved to over 15% during the last 2 years. However, the organic hole-transporting materials used are normally quite expensive due to complicated synthetic procedure or high-purity requirement. Here, we demonstrate the application of an effective and cheap inorganic p-type hole-transporting material, copper thiocyanate, on lead halide perovskite-based devices. With low-temperature solution-process deposition method, a power conversion efficiency of 12.4% was achieved under full sun illumination. This work represents a well-defined cell configuration with optimized perovskite morphology by two times of lead iodide deposition, and opens the door for integration of a class of abundant and inexpensive material for photovoltaic application.