Winterhold is perhaps the smallest capital in all of Skyrim. If not for the College, it would be smaller even than some towns such as Dragon Bridge and Riverwood. Most of the great city was lost in the Great Collapse, and the dominant feature now is the College of Winterhold. Check below for a map of Winterhold.
Image borrowed from elderscrolls.wikia.com