Peter, Mark, Thank you very much for your answer !   Mark and a friend of mine moved me toward the KB16586 and it was the solution. I followed it point to point... well... almost... Regarding my "not full partition", i first try to disable and enable services, as described. > Same issue.   Finally, I disable, kill the process, enable. Something like: isi services -a celog_coalescer disable isi services -a celog_monitor disable isi services -a celog_notification disable   isi_for_array -sX 'pkill isi_celog_'   isi services -a celog_coalescer enable isi services -a celog_monitor enable isi services -a celog_notification enable  and then: isi events sendtest Send test event, instance ID = 1.11990 Yipppi !  I have preferred to try to keep the celog db and I’ve done well I guess, because I keep back all events from the date it stops! I guess that the isi_celog_ was frozen or something like that...  The most important : it works now.  Thant very much for your help, i will keep KB and document you mention in my mind (and in my server [IMAGE])  Kind Regards  Pierre
Hi community,  (I am using this forum for the first time) Well,  I figured out this week end that my Isilon doesn’t log events anymore from May, the 21st ! I tried to send a test email from WebUI and it returns the following error message: “Send test event failed: Error creating event: No space left on device” Regarding this message, I’ve checked the following partition on all the nodes: / /var /var/crash And none is full…  Then I tried to trig an test event through the cli to have more precisions: isi-tvs-1-1# isi events sendtest returns Traceback (most recent call last):   File "/usr/bin/isi", line 9, in      exitCode = onefs.main(True)   File "/usr/local/lib/python2.6/site-packages/isi/ui/shell/onefs.py", line 70, in main  action.run(sys.argv[2:])   File "/usr/local/lib/python2.6/site-packages/isi/ui/shell/registry/events.py", line 14, in run  eventscmd.main(self, argv)   File "/usr/local/lib/python2.6/site-packages/isi/ui/shell/eventscmd.py", line 1562, in main  cmd.parse(argv, args)   File "/usr/local/lib/python2.6/site-packages/isi/ui/shell/cli.py", line 1860, in parse  subcmd.parse(argv[idx:], args, fullname)   File "/usr/local/lib/python2.6/site-packages/isi/ui/shell/cli.py", line 1862, in parse  self.execute(args)   File "/usr/local/lib/python2.6/site-packages/isi/ui/shell/eventscmd.py", line 191, in execute  end_time=start, send_event=True)   File "/usr/local/lib/python2.6/site-packages/isi/celog/event_api.py", line 136, in __init__     self.add()   File "/usr/local/lib/python2.6/site-packages/isi/celog/event_api.py", line 149, in add  self.specifier) SystemError: Error creating event: No space left on device  I feel like I am missing a detail…  You’ll find in PS more details and done things…  Thank you very much for your help. This community is a really good thing!  Best,  Pierre  PS: isi-tvs-1-1# isi version Isilon OneFS v6.5.5.10 B_6_5_5_138(RELEASE): 0x605050000A0008A:Mon Aug 27 16:20:22 PDT 2012 root[NAME]-02.west.isilon.com:/build/mnt/obj.RELEASE/build/mnt/src/sys/IQ.amd64.release  isi_for_array "rm -rf /var/crash/*" isi_for_array "rm -rf /var/spool/clientmqueue/*"  isi-tvs-1-1# isi_for_array -s df -h | grep /dev/ isi-tvs-1-1: /dev/imdd0a    496M    430M 26M    94%    / isi-tvs-1-1: /dev/imdd1a    496M    143M 314M    31%    /var isi-tvs-1-1: /dev/imdd2a    496M    2.0K 457M     0%    /var/crash isi-tvs-1-2: /dev/imdd0a    496M    427M 30M    93%    / isi-tvs-1-2: /dev/imdd1a    496M    101M 356M    22%    /var isi-tvs-1-2: /dev/imdd2a    496M    2.0K 457M     0%    /var/crash isi-tvs-1-3: /dev/imdd0a    496M    427M 30M    94%    / isi-tvs-1-3: /dev/imdd1a    496M     96M 360M    21%    /var isi-tvs-1-3: /dev/imdd2a    496M    2.0K 457M     0%    /var/crash isi-tvs-1-4: /dev/imdd0a    496M    432M 25M    95%    / isi-tvs-1-4: /dev/imdd1a    496M    113M 344M    25%    /var isi-tvs-1-4: /dev/imdd2a    496M    2.0K 457M     0% /var/crash isi-tvs-1-5: /dev/imdd0a    496M    427M 30M    93%    / isi-tvs-1-5: /dev/imdd1a    496M     73M 384M    16%    /var isi-tvs-1-5: /dev/imdd2a    496M    2.0K 457M     0%    /var/crash isi-tvs-1-6: /dev/imdd0a    496M    427M 29M    94%    / isi-tvs-1-6: /dev/imdd1a    496M     95M 361M    21%    /var isi-tvs-1-6: /dev/imdd2a    496M    2.0K 457M     0%    /var/crash isi-tvs-1-7: /dev/imdd0a    496M    428M 29M    94%    / isi-tvs-1-7: /dev/imdd1a    496M    124M 333M    27%    /var isi-tvs-1-7: /dev/imdd2a    496M    2.0K 457M     0%    /var/crash isi-tvs-1-8: /dev/imdd0a    496M    428M 28M    94%    / isi-tvs-1-8: /dev/imdd1a    496M    148M 309M    32%    /var isi-tvs-1-8: /dev/imdd2a    496M 2.0K    457M     0% /var/crash isi-tvs-1-9: /dev/imdd0a    496M    428M 28M    94%    / isi-tvs-1-9: /dev/imdd1a    496M    146M 310M    32%    /var isi-tvs-1-9: /dev/imdd2a    496M    2.0K 457M     0%    /var/crash isi-tvs-1-10: /dev/imdd0a    496M 428M     29M    94% / isi-tvs-1-10: /dev/imdd1a    496M 173M    283M    38% /var isi-tvs-1-10: /dev/imdd2a    496M 2.0K    457M     0% /var/crash isi-tvs-1-11: /dev/mirror/root1        989M 446M    464M    49% / isi-tvs-1-11: /dev/mirror/var1         989M 113M    798M    12% /var isi-tvs-1-11: /dev/mirror/var-crash    1.9G 6.0K    1.8G     0% /var/crash isi-tvs-1-11: /dev/md0                  62M    252K 57M     0%    /tmp/ufp isi-tvs-1-12: /dev/mirror/root1        989M 446M    465M    49% / isi-tvs-1-12: /dev/mirror/var1         989M     91M 819M    10%    /var isi-tvs-1-12: /dev/mirror/var-crash    1.9G 6.0K    1.8G     0% /var/crash isi-tvs-1-12: /dev/md0                  62M    252K 57M     0%    /tmp/ufp isi-tvs-1-13: /dev/mirror/root1        989M 445M    465M    49% / isi-tvs-1-13: /dev/mirror/var1         989M 121M    790M    13% /var isi-tvs-1-13: /dev/mirror/var-crash    1.9G 6.0K    1.8G     0% /var/crash isi-tvs-1-13: /dev/md0                  62M    252K 57M     0%    /tmp/ufp  isi-tvs-1-1# isi events test Same return… Traceback (most recent call last):   File "/usr/bin/isi", line 9, in      exitCode = onefs.main(True)   File "/usr/local/lib/python2.6/site-packages/isi/ui/shell/onefs.py", line 70, in main  action.run(sys.argv[2:])   File "/usr/local/lib/python2.6/site-packages/isi/ui/shell/registry/events.py", line 14, in run     eventscmd.main(self, argv)   File "/usr/local/lib/python2.6/site-packages/isi/ui/shell/eventscmd.py", line 1562, in main  cmd.parse(argv, args)   File "/usr/local/lib/python2.6/site-packages/isi/ui/shell/cli.py", line 1860, in parse  subcmd.parse(argv[idx:], args, fullname)   File "/usr/local/lib/python2.6/site-packages/isi/ui/shell/cli.py", line 1862, in parse  self.execute(args)   File "/usr/local/lib/python2.6/site-packages/isi/ui/shell/eventscmd.py", line 191, in execute  end_time=start, send_event=True)   File "/usr/local/lib/python2.6/site-packages/isi/celog/event_api.py", line 136, in __init__     self.add()   File "/usr/local/lib/python2.6/site-packages/isi/celog/event_api.py", line 149, in add  self.specifier) SystemError: Error creating event: No space left on device  isi-tvs-1-3# isi events sendtest Send test event, instance ID = 3.1148 isi-tvs-1-3# isi events test Send test event, instance ID = 3.1149 (but and don't receive any email) and I'm figuring out that both do the same operation :-\  I have a lot of scripts unsing mail and sendmail fonctions from Isilon shell and they are stiff working
Isilon events no more logged and send test event fails