be on (one's) conscience To be a persistent cause or source of guilt, such as an act of wrongdoing. Watch the video