I saw on a HK tv program that one of the most downloaded App is the one that finds the closest public toilet to any location in HK. Some of these public toilets are clean enough for a quick dump esp the ones in the Activities Centres. I don't have an I-Phone so I cannot tell you the name of this app.
Or I can suggest you memorize the locations of all the decent hotels in any areas you decide to go punting. You could have gone to City Garden Hotel for a nice comfortable shit as it is close to Fortress Hill MTR. Oh, just remember to tip the attendant if there is one.