Ion specific effects of ionic liquid (IL) constituents on the surface charge and aggregation properties of two types of particles (positively charged amidine (AL) and polyimidazolium-functionalized sulfate (SL-IP-2) latexes) were investigated in IL solutions containing different anions and the 1-butyl-3-methylimidazolium cation. For the AL systems, the affinity of IL anions to the particle surface followed the sequence chloride < bromide < nitrate < acetate. The critical coagulation concentration values decreased in the same order indicating that ion specific adsorption determines the surface charge density and the extent of the repulsive interparticle forces. In contrast, no tendencies were observed for the SL-IP-2 particles, i.e., both charge and aggregation features were insensitive to the type of anions. This surprising behavior sheds light on that surface functionalization with the polyimidazolium compound effectively masks interfacial ion specific effects. These results indicate new possible routes to the design of processable particle dispersions in ILs irrespective of their composition.