Oliver uses his secret persona to right societal wrongs and transform the city to its former glory. He must also contend with outside forces attempting to take over, but he feels its time he left Starling City with the hopes of beginning a new life.
You can only cry wolf so many times and after so many near death-experiences, actual deaths and resurrections, it's kinda hard to take the mid-season cliffhanger seriously.