Using classical molecular dynamics simulations, we investigate the dielectric properties at interfaces of water with graphene, graphite, hexane, and water vapor. For graphite, we compare metallic and nonmetallic versions. At the vapor-liquid water and hexane-water interfaces, the laterally averaged dielectric profiles are significantly broadened due to interfacial roughness and only slightly anisotropic. In contrast, at the rigid graphene surface, the dielectric profiles are strongly anisotropic and the perpendicular dielectric profile exhibits pronounced oscillations and sign changes. The interfacial dielectric excess, characterized by the shift of the dielectric dividing surface with respect to the Gibbs dividing surface, is positive for all surfaces, showing that water has an enhanced dielectric response at hydrophobic surfaces. The dielectric dividing surface positions vary significantly among the different surfaces, which points to pronounced surface-specific dielectric behavior. The interfacial repulsion of a chloride ion is shown to be dominated by electrostatic interactions for the soft fluid-fluid interfaces and by non-electrostatic Lennard-Jones interactions for the rigid graphene-water interface. A linear tensorial dielectric model for the ion-interface interaction with sharp dielectric interfaces located on the dielectric dividing surface positions works well for graphene but fails for vapor and hexane, because these interfaces are smeared out. The repulsion of chloride from the metallic and nonmetallic graphite versions differs very little, which reflects the almost identical interfacial water structure and can be understood based on linear continuum dielectric theory. Interface flexibility shows up mostly in the nonlinear Coulomb part of the ion-interface interaction, which changes significantly close to the interfaces and signals the breakdown of linear dielectric continuum theory.