It will depend where you are going. If you are going to a party a wrap is more appropriate than a cardigan if walking about in town.
What Do You Wear With A Sleeveless Sweater Dress?