i also have a 02 camry LE.
my friend unless you are a technician, i wouldn't recomment messing with lock cylinders. there are very tiny cylinder parts that needs to come apart or it might just have to be replaced. and if it needs replacement, it has to be order by VIN number by a toyota dealer (at least that's my educational guess since i am a VW tech and that's how we do it here)
as far as i know, the door trim doesn't have to come off, the handle trim has to be popped out and for that, you may not have to take the whole door trim apart.
hope this helps you out.
by the way i have a high mileage (160,000) camry and since i am not a Toyota tech, i don't know why my whole car want to swirve on the opposite direction when taking turns. makes me feel like i have no suspension. i checked the sway bar links and they are good. next thing should be the struts, but they seem ok as well.
any suggestions??