Update: This post is for the old Blogger classic template which is no longer supported by Blogger.com. Also update at bottom of page.
The HTML for a link list for you to edit as shown below is present in most of the standard Blogger templates (click on the screenshot to enlarge it:
To create links that in your sidebar to actually lead to sites you want, you will have to edit the HTML already in