Reading this thread again,
perhaps since it has doing that since you 1st got it, you might want to check the starter.
Also the 1zz-fe motor is known to have weird idle issues, so it may or may not be related.
I would suggest having the starter checked out 1st.
2nd - have the alternator diagnosed after the starter.
Hope you finally find the issue.