Layered transition metal chalcogenides with large spin orbit coupling have recently sparked much interest due to their potential applications for electronic, optoelectronic, spintronics, and valleytronics. However, most current understanding of the electronic structure near band valleys in momentum space is based on either theoretical investigations or optical measurements, leaving the detailed band structure elusive. For example, the exact position of the conduction band valley of bulk MoS2 remains controversial. Here, using angle resolved photoemission spectroscopy with submicron spatial resolution (micro-ARPES), we systematically imaged the conduction/valence band structure evolution across representative chalcogenides MoS2, WS2, and WSe2, well as the thickness dependent electronic structure from bulk to the monolayer limit. These results establish a solid basis to understand the underlying valley physics of these materials, and also provide a link between chalcogenide electronic band structure and their physical properties for potential valleytronics applications.