I have a 2008 Corolla s and have the exact same problem. The longer it sits after being driver the harder it is to start, sometimes takes multiple tries.
i have had the throttle body cleaned, maf cleaned, battery replaced and none have helped. The dealer can't figure it out. I'm stumped as well. Also I have no miss firing, codes or lights