The philosophical debate on whether AI agents should be given preferences can also draw upon economic insights. In economic theory, preferences are a tool for modeling the motivations and behaviors of individuals. For AI systems, having 'preferences' or objectives is akin to a survival mechanism; without goal-oriented behavior[CB1] , an AI becomes aimless and inefficient (Sutton & Barto, 2018).

 However, the central challenge is not simply about endowing AI with preferences, but determining the nature of these preferences. This question extends beyond technical concerns and delves into ethical territory. Should an AI's preferences reflect those of its human users, or should they represent a broader range of societal values? Questions of fairness, the concentration of power, and protection against manipulation all intersect at this point (Crawford & Calo, 2016).