Solution for PICKIT 3 Problem (Failed to initialize PICkit 3, Could not connect to tool ) (giasis)

I just want to share the solution I just found for PICKIT3 connection failure problem. I was struggling with this issue for a week and couldn't find any working solution in the Internet, and yesterday I found it.