Artificial agents will need to be aware of human moral and social norms, and able to use them in decision-making. In particular, artificial agents will need a principled approach to managing conflicting norms, which are common in human social interactions. Existing logic-based approaches suffer from normative explosion and are typically designed for deterministic environments; reward-based approaches lack principled ways of determining which normative alternatives exist in a given environment. We propose a hybrid approach, using Linear Temporal Logic (LTL) representations in Markov Decision Processes (MDPs), that manages norm conflicts in a systematic manner while accommodating domain stochasticity. We provide a proof-of-concept implementation in a simulated vacuum cleaning domain.
The combination of moral and social norms with Markov Decision Processes is not new. Much of this work, e.g. @cite_12 , tends to emphasize norm emergence, thus lacks explicit representations of norms. Other work @cite_10 considers incorporating deontic logic norms using an agent architecture that reasons about the consequences (in the environment) of violating norms.
@cite_10 @cite_12
2237315243 1495895124 1630986973 2172193467
Norms are an important part of human social systems, governing many aspects of group decision-making. Yet many popularly used social models neglect to model normative effects on human behavior, relying on simple probabilistic and majority voting models of influence diffusion. Within the multi-agent research community, the study of norm emergence, compliance, and adoption has resulted in new architectures and standards for normative agents; however few of these models have been successfully applied to real-world public policy problems. In this paper, we propose a new lightweight architecture for constructing normative agents to model human social systems; the aim of our research is to be able to study the effects of different public policy decisions on a community. Here we present a case study showing the usage of our architecture for predicting trends in smoking cessation resulting from a smoke-free campus initiative. Our agent-based model combines social, environmental, and personal factors to accurately predict smoking trends and attitudes. The performance of both the whole and ablated model is evaluated against statistics from an independent source. Rational self-interested agents, which act so as to achieve the best expected outcome, should violate the norms if the expected rewards obtained with the defections from the norms surpass the expected rewards obtained by being norm-compliant. It means they should estimate the earnings brought about by the violations and the losses caused by their respective reactions. In this paper, we present a rational self-interested agent model that takes into account the possibility of breaking norms. To develop such model, we employ Markov Decision Processes (MDPs). Our approach consists of representing the reactions for norm violations within the MDPs in such a way that the agent is able to reason about how those violations affect her expected utilities and future options. Finally, we perform an experiment in order to establish comparisons between the model presented in this work and its norm-compliant version. Effective norms, emerging from sustained individual interactions over time, can complement societ al rules and significantly enhance performance of individual agents and agent societies. Researchers have used a model that supports the emergence of social norms via learning from interaction experiences where each interaction is viewed as a stage game. In this social learning model, which is distinct from an agent learning from repeated interactions against the same player, an agent learns a policy to play the game from repeated interactions with multiple learning agents. The key research question is to characterize when and how the entire population of homogeneous learners converge to a consistent norm when multiple action combinations yield the same optimal payoff. In this paper we study two extensions to the social learning model that significantly enhances its applicability. We first explore the effects of heterogeneous populations where different agents may be using different learning algorithms. We also investigate norm emergence when agent interactions are physically constrained. We consider agents located on a grid where an agent is more likely to interact with other agents situated closer to it than those that are situated afar. The key new results include the surprising acceleration in learning with limited interaction ranges. We also study the effects of pure-strategy players, i.e., nonlearners in the environment. Social norms play a pivotal role in sustaining social order by regulating individual behaviors in a society. In normative multiagent systems, social norms have been used as an efficient mechanism to govern virtual agent societies towards cooperation and coordination. In this paper, we study the emergence of social norms via learning from repeated local interactions in networked agent societies. We propose a collective learning framework, which imitates the opinion aggregation process in human decision making, to study the impact of agent local collective behaviors on norm emergence in different situations. In the framework, each agent interacts repeatedly with all of its neighbors. At each step, an agent first takes a best-response action towards each of its neighbors and then combines all of these actions into a final action using ensemble learning methods. We conduct extensive experiments to evaluate the framework with respect to different network topologies, learning strategies, numbers of actions, and so on. Experimental results reveal some significant insights into norm emergence in networked agent societies achieved through local collective behaviors.