**Alignment Criteria.** Recently, there is increasing attention on developing multifarious criteria to regulate the behaviors of LLMs. Here, we take three representative alignment criteria (_i.e._, helpful, honest, and harmless) as examples for discussion, which have been widely adopted in existing literature [66, 368]. In addition, there are other alignment criteria for LLMs from different perspectives including behavior, intent, incentive, and inner aspects [366], which are essentially similar (or at least with similar alignment techniques) to the above three criteria. It is also feasible to modify the three criteria according to specific needs, _e.g._, substituting honesty with correctness [116].