at first the groups had been small and scattered , the attacks easily fended off , but lately the whisper of conspiracy had grown into a roar , and the groups were larger and more organized and widespread than first thought .