Why can't I de-friend a friend?

If we accept a person as a friend, we can't de-friend them later on. Whats up with that? What happens if a new user decides to join and friends everyone then he starts posting all over the site and you realize he's an ass? You're stuck with him as your friend forever? This needs to be fixed...