Modeling with medical images in this context provides both structural and topological information of different elements. In addition to displaying these elements, the interest is in using them for physically based deformation simulation, motion generation and analysis, and model validation. The Visible Human Dataset (VHD) has provided a referential standard as medical image data for modeling. Surface based models fitting to the boundary of the medical image data are extracted and interactive 3D tools are employed for their investigation, analysis and manipulation. A comprehensive database consisting of the structural as well as topological description of a body part (here the upper limb) is built. In addition to the medical field, topological modeling of human anatomy applies to other areas such as sports, education and entertainment involving animation/simulation