have other fish to fry To have more important or more interesting things to do or attend to. Watch the video