Hay is for horses and straw is for houses. This is how I might remember.

Hay sounds like the “Ney” from a horse and has more nutrition then straw.
Straw is hollow like a straw you might use to drink. It is very absorbent. It rhymes with saw which can be used in building a house.

Do you have a better idea to remember? If so, please share.