Is it okay to go out to eat by yourself?
Is it okay to eat by yourself at a restaurant?
It's more than okay. If you want to go and experience a restaurant and you don't have anyone to go with you, don't change your plans. Go and enjoy yourself when you want.