Ouch! Yes, unfortunately, many Toyota parts are actually an assembly of parts from one vendor, so it can get expensive. Door panels are like that too...can't just replace the trim usually. I did a quick bit of looking around to see if there were any good used parts places, and this one seemed to have potential:
http://www.toyotasalvage.com/