Non-translation invariant Gibbs states with coexisting phases III: Analyticity properties