[Pete]

Your clutch is not releasing completely, especially when everything is hot. Adjust it when everything is hot. If you run out of adjustment range, fix it.
As long as you have proper oil in the box, oil is not the problem.
If everything is adjusted right, idle speed has no effect.

Consider this. It had no problems from the factory. It should have none now if everything is adjusted properly.