Why must we ask such sacrifices from physicians?
For what aspects of assisted dying do we require the knowledge and abilities of a physician, all by him/herself?

The go-no go decision on assisted dying needs to be examined and made by a group (dare I say team) of informed and skilled professionals. A physician. A psychologist. A social worker. A patient advocate. 

Most critically, someone who is completely and highly skilled in capacity assessment.

Each brings their own expertise. Physicians are not magicians, nor are they the be-all and end-all. In this area of health, most critically, we must not invest them with sole authority for life-and-death decisions in this context.

Perhaps if they didn't feel so singled out for the final decision, they wouldn't be so fearful.

Nor would we.