For years, Campbeltown residents have watched with frustration as iconic town centre buildings have fallen into disrepair.