Recent observations have established that dwarf galaxies can host black holes of intermediate mass (IMBH, 100 M < MIMBH <∼ 105 M). With modern numerical models, we can test the growth of IMBHs as well as their evolutionary impact on the host galaxy. Our novel subsolar-mass (0.8 solar mass) resolution simulations of dwarf galaxies (M∗ = 2 × 107 M) have a resolved three-phase interstellar medium and account for non-equilibrium heating, cooling, and chemistry processes. The stellar initial mass function is fully sampled between 0.08–150 M while massive stars can form HII regions and explode as resolved supernovae. The stellar dynamics around the IMBH is integrated accurately with a regularization scheme. We present a viscous accretion disk model for the IMBH with momentum, energy, and mass conserving wind feedback. We demonstrate how the IMBH can grow from accretion of the cold and warm gas phase and how the presence of the IMBH and its feedback impacts the gas phase structure.