See this page for a good synopsis of Rosh Hashana observances (and this one for more on erev Rosh Hashana, though the latter page mentions several Chabad-specific customs).
"Although the question characterizes eating apples and honey as a``non-religious""custom, it is mentioned in halacha, which I think qualifies it as``religious""."