In general, 36psi is fine. The 32 is set by car companies who understandably want your driving experience in their car to be as smooth as possible. The load carrying capabilities of modern tyres mean that, at 32 they carry the load (and then some) with no trouble.
Any increase in pressure means a slightly harsher ride but 4 psi would not be noticeable to the average punter.
Now, as to the levels at which uneven wear might begin, that varies with useage.
Someone who does a lot of high speed (motorway/ highway) driving is going to see more centre rib wear because centrifugal force come sinto play. Whilst tyres are designed to distort as little as possible, everything is a compromise because drivers have such varied requirements. Not to mention driving habits.
Conversely, someone who spends most of their time in areas with roundabouts, is going to suffer more shoulder wear - again, pretty obviously because the tyre spends more time distorted by cornering. This can be complicated by the fact that, if you drive on the LHS of the road, simple turns to the right are going to be done at a faster speed than any to the left, because the arc of the turn will be wider. Doing U-turns (pretty much all to the right) will magnify the problem.
There are obvious benefits to cars which spend a lot of time on the motorway as far as wear and tear is concerned, so if those benefits are slightly offset by a bit of centre rib wear, I reckon that's a fair trade-off.
In summary, work on 36 psi and keep a close eye on the front tyres for feathering (which will happen before any serious wear takes place).