If things end in an amicable, understanding way, then I would say yes, keep them as a friend, unfollow if you must. But things usually end fairly poorly, and if you're at the point of debating unfriending - it's probably not a friendly ending.
Give yourself a few days, to mull it over if you...