We present a versatile high voltage sample stick that fits into all cryomagnets and standard cryostats at the Swiss Spallation Neutron Source, Paul Scherrer Institut, and which provides a low effort route to neutron scattering experiments that combine electric field with low temperature and magnetic field. The stick allows for voltages up to 5 kV and can be easily adapted for different scattering geometries. We discuss the design consideration and thermal behavior of the stick, and give one example to showcase the abilities of the device. (C) 2014 AIP Publishing LLC.