Its not harmful, but if you use a really cheap kind, they can crack. I wear nail polish all the time and they are better when I wear nail polish. Mine crack more when I don't have any on. Of course, you could always buy a bottle of liquid nail conditioner or put a coat of nail strengthener on before your color polish.
