Hydrogen (H) embrittlement in multicomponent austenitic alloys is a serious limitation to their application in many environments. Recent experiments show that the High-Entropy Alloy (HEA) CoCrFeMnNi absorbs more H than 304 Stainless Steel but is less prone to embrittlement while the HEA CoCrFeNi is not embrittled under comparable conditions. As a first step toward understanding H embrittlement, here a comprehensive first-principles study of H absorption, surface, and fracture energies in the presence of H is presented for 304 Stainless Steel, 316 Stainless Steel, CoCrFeNi, and CoCrFeMnNi. A collinear paramagnetic model of the magnetic state is used, which is likely more realistic than previous proposed magnetic states. All alloys have a statistical distribution of H absorption sites. Hence, at low concentrations, H is effectively trapped in the lattice making it more difficult for H to segregate to defects or interfaces. Agreement with experimental H solubilities across a range of chemical potentials can be achieved with minor fitting of the average H absorption energy. The (111) surface energies for 0, 50, and 100% H surface coverage are very similar across all alloys. The fracture energies for two representative thermodynamic conditions are then determined. SS304 and CoCrFeNi are found to have the lowest fracture energies, but experiments suggest rather different embrittlement tendencies. These results indicate that differences in H embrittlement across these austenitic alloys are not due solely to differences in H absorption or H-reduced fracture energy, thus requiring more sophisticated concepts than those recently found successful for fcc Ni.