The stochastic collocation method has recently been applied to stochastic problems that can be transformed into parametric systems. Meanwhile, the reduced basis method, primarily developed for solving parametric systems, has been recently used to deal with stochastic problems. In this work, we aim at comparing the performance of the two methods when applied to the solution of linear stochastic elliptic problems. Two important comparison criteria are considered: 1) convergence results of the approximation error; 2) computational costs for both offline construction and online evaluation. Numerical experiments are performed for problems from low dimensions O(1) to moderate dimensions O(10) and to high dimensions O(100). The main result stemming from our comparison is that the reduced basis method converges better in theory and faster in practice than the stochastic collocation method for smooth problems, and is more suitable for large scale and high dimensional stochastic problems when considering computational costs.