Three weeks is a short time. Everyone reacts differently.
I'd try taking 0. If you absolutely can't get by on that, break them in half and work your way down.
If you aren't having physical withdrawal; diarrhea, nausea, chills, etc... then I would try to tough out the mental part of it.

Best of luck!
When I broke my hand I was given Vicodin...
I would take one before work "knowing" I would hurt later, well I noticed after awhile that I only hurt IF I took the Vicodin... funny how that worked. I quit taking it.

Sometimes...things aren't as they seem.

At any rate... if you are in pain, I am sorry your doc discontinued your treatment. You may want to try Aleve if you are able to take it safely or ibuprofren.