General issues with LLM-generated summaries:Table 6 summarizes the percentage of summaries affected by specific issues as per annotators' comments.11 Our analysis shows that every LLM makes chronological errors, though these were less pronounced in models with extended context (Claude-3-Opus and GPT-4-Turbo). All models were also criticized for omitting important information, with Claude-3-Opus being the least affected (52%), compared to 80.8% and 84.6% for GPT-4-Turbo and GPT-3.5-Turbo, respectively. The least faithful models, GPT-3.5-Turbo and Mlxtral, also both have a tendency to generate overly generic statements (38.5%). Finally, we look also at cases where the summary was explicitly praised for being good or comprehensive. Claude-3-Opus received the most praise (48% and 54% respectively), while GPT-3.5-Turbo received the least (11.5% and 15.4% respectively).