If I know I'll be home for a while then yes I am usually without shoes, but always in slippers or socks. For some reason I hate my feet being bare unless outside on grass.
At other people's houses it depends.
I have some friends who I know are clean fanatics and don't wear their shoes inside so at their homes I will always remove mine.
If the host is wearing shoes though mine also stay on.