take the law into your own hands

to punish someone in your own way without involving the police or the courts, often by doing something illegal yourself