NasLog – Log your NAS!

[luc]

Here’s NasLog, a (free) service for managing your ReadyNAS logs on the web!

http://www.naslog.org

For the time being, it only manages SMART logs. (Well, that’s not exactly *all* logs, but that’s fairly one of the main logs...) The principle is pretty simple: you download logs from the “Download all logs” menu in FrontView, extract (unzip) the log you want (e.g. disk_smart.log file), upload it. NasLog’s here to handle log files, fire the warnings or the alarms you set, keep trace of logs, etc. Here is a few screenshots:

Main menu:



Main dashboard, with a SMART summary:



Comprehensive SMART menu:



A SMART item history (max. 50 values) – isn’t it a neat way to keep track of HDs temperature? :



You can use NasLog with tools that automatically download/extract/upload logs. Here’s a simple script that uses curl (curl.haxx.se) and unzip (www.info-zip.org/UnZip.html) commands:

Code: Select all

[for RAIDiator 3.x] curl -k -u admin:yourReadyNASadminPassword -o System_log.zip https://yourReadyNASLocalIPaddress/admin/download_file.cgi/System_log.zip
[for RAIDiator 4.x] curl -k -o System_log.zip 'https://yourReadyNASLocalIPaddress/get_handler?PAGE=Status&command=GetZippedLogs&OPERATION=set&download_file_name=System_log.zip'
unzip -o System_log.zip disk_smart.log
curl -F file=@disk_smart.log -F upload="Upload log file & process" "http://www.naslog.org/index.php?m=upload&user=yourNasLogAccount&pwd=yourNasLogPassword"

(Note: you can use ‘user’ and ‘pwd’ variables to post authentication data in the URL; not too secure, though…)

Well, that’s it! I’d really be glad if this tool could fit some of your needs. You can use it as much as you want. Keep in mind, though, that it’s a free service, hosted (but not for free!) on shared platforms, so… just be kind with it!

BTW, I only test it on my own RN configuration: RNX6 rev. B; RAIDiator 2.00c1-p9, 3.00c1-p1, 3.00c1-p2; 4 x ST3300831AS Seagate HDs. Should work on other configs, though...

Ideas and thoughts are welcome.

Enjoy!

Luc.

[chirpa]

I started to do something similar awhile ago, but only for personal use.

I use snmp to poll the NAS box and display the data on a webpage.

http://www.derk.ca/projects/infrant/

[luc]

Funny thing is that I once read your post about your project, and that post gave me the very very first idea to do something by my own about my HDs temperature I wanted to monitor. Then I read that post about wget. Both posts matched by magic and… here is NasLog! Believe me or not, in my todo list, I had an item: "find that post about the guy who put FrontView on the web and post a comment". And here you are… So: thank you, derekg! I owe you something for sure.

Luc.

[luc]

After some months of intensive usage & a few users (thanks to all! ), I added the processing of ecounter.log files to NasLog. This log figures a few error counters (well, I actually just guessed the meaning of the 1st ‘e’ in ecounter… ), among which you can find the network errors you get in FrontView. If you encounter some network errors as I do, and want to monitor them a bit more precisely, NasLog’s here for you!



The log uploads can still be fully automatized w/ a script that uses curl command line on a scheduled basis. An example of such a script is given in the “Welcome” page of NasLog website.

As always, ideas and thoughts are welcome.

Enjoy!

Luc.

[luc]

Short update for those of you who tried to upload SMART logs and received an error such as:

Code: Select all

Unknown log file; no processing performed: datetime string

PHP function that converts time strings to Unix timestamp seems to behave strangely with ‘WEST’ timezone. This has been corrected (SMART timezones are now simply ignored). Sorry for trouble.

BTW, thanks to all of you who tried & use NasLog! As always, ideas of new functions are welcome…

Luc.

[chirpa]

since you keep a history of data, (i havent logged in yet to try it out) can you plot the data on a graph like mrtg does?

[luc]

Hi Derek,

Yeah, sure. Just ask for it… here it comes! While playing around with JpGraph PHP library, I found it so easy to use that I put it straight into NasLog! You’ll get now that kind of graphs along w/ SMART history:



I’ve implemented it in such a way that you can access to the graph itself, w/o navigating through NasLog menus. This can be useful in case you want to monitor some attribute (for instance HD temperatures) directly within your own monitoring page. Just use that kind of link:

Code: Select all

img src='http://www.naslog.org/?m=smartGraph&disk={DISK}&id={SMART}&user={USER}&pwd={PWD}' width=400 height=200

(within '<' and '>', phpBB doesn't allow me to do so in my example), where:

Code: Select all

{DISK}:         NasLog internal HD ID (hint: check SMART history link for #)
{SMART}:        SMART attribute ID; for instance in my picture: 194
{USER} / {PWD}: your login / pwd (not too secure of course…)

… and here you are. Enjoy!

Luc.

[MrCyberdude]

This is very good, just stumbled on it.
I will aim to give it a go when i get time.

Great work by the looks of it.
I am rather surprised that there is not more discussion about it.

[luc]

Thanks for your kind words, Mr Cyberdude!

Well, some of us are already using NasLog every day, every hour of the day, uploading logs and firing alarms (well, not *too* many alarms, fortunately ) But, to be honest, I’m myself a little bit disappointed? surprised? to see that we aren’t that many. An explanation could be that NasLog needs a 24/7 running PC for uploading logs, which may not be that frequent (I thought it was…); or maybe that launching a scheduled task isn’t that obvious; or… maybe that we’re simply not *so* many to look after our ReadyNAS the way I do, keeping an eye every day on HD temperatures and network errors…

Also, as SSH is now available, an idea would be to provide users with a fully packaged add-on that would configure ReadyNAS to automatically upload logs onto NasLog. That’s something I’d like to do as soon as I’ll get RAIDiator 4.00 (stable!) on my box. But is that feasible? I mean: to build our own add-ons for the community? I don’t know. Maybe some beta-testers could answer… or develop it right now!

Luc.

[frejac]

I'd be happy to join in if it was SNMP-based.
All other solutions....just seems messy to me.

[MrCyberdude]

I was using a SNMP based logger about a year ago.... but i cant remember if it was for the NAS or a router....

the following ring some bells, but a year ago is ages
SNMP umm getif
SNMPViewer
wbem

[luc]

SNMP, why not? I’m not an expert, but isn’t Cacti doing it well enough, for instance? I like the idea of sending logs on a website outside my LAN. Maybe a small daemon that gathers SNMP data and uploads them onto NasLog as plain text file or XML file would be an idea. If someone wants to make such a daemon, I’ll do NasLog integration for sure!

BTW: as far as I remember, running RAIDiator 3.01c1-p6, I don’t have HD temps in SNMP data; are those temps now available in RAIDiator 4?

Luc.

[nicolaw]

BTW: as far as I remember, running RAIDiator 3.01c1-p6, I don’t have HD temps in SNMP data; are those temps now available in RAIDiator 4?

I was using Nagios to monitor my 2 ReadNAS NV+ boxes, but since upgrading to RAIDiator 4 today it seems that none of the OIDs I was monitoring exist anymore:

nasMgrGlobalStatus
temperatureValue.0
volumeFreeSpace.1
diskState.1
diskState.2
diskState.3
diskState.4

I don't see anything to do with temperature in the new output.

[sebp]

I was using Nagios to monitor my 2 ReadNAS NV+ boxes, but since upgrading to RAIDiator 4 today it seems that none of the OIDs I was monitoring exist anymore

I answered your question there :
http://www.infrant.com/forum/viewtopic. ... f21a#74619

[luc]

Playing with my brand new ReadyNas Duo, I just realized that RAIDiator 4 had introduced some small differences in SMART & ecounter logs, that weren’t recognized by NasLog anymore. This issue has just been fixed! Everything should work fine now, in RAIDiator 3 or RAIDiator 4. I also updated the help page with the way one can automatically download logs from a ReadyNas in RAIDiator 4 FrontView:

Code: Select all

curl -k -o System_log.zip 'https://yourReadyNASLocalIPaddress/get_handler?PAGE=Status&command=GetZippedLogs&OPERATION=set&download_file_name=System_log.zip'

With SNMP not available for those exciting ReadyNas Duos, feel free to use NasLog for monitoring HD temps & network errors!

As always: suggestions & comments are welcome! Enjoy!

Luc.