|
|
A small package of connection statistics logging/graphing programs has been recently devoloped from the original batch file script versions.
These programs are more robust than the scripted versions and are much quicker in use to boot.
Thanks to RONSKI's efforts, everything can now be set up using a GUI settings editor for fully automated data harvesting & graphing via user-defined scheduled events.
.Net does need to be installed to make full use of RONSKI's settings editor.
.Net version 4 has been used for extensive testing of the programs on systems ranging from XP Home Edition to Windows 7 & related Home Server versions.
However, users can still manually edit a text based configuration ini file if choosing not to install .Net
AFAIK, .Net was already included with Windows versions starting with Vista, so installing it is probably only relevant for the few XP users who don't already have it installed.
Resyncs are now detected (if monitoring 24/7) & the data is immediately logged, along with optional graphing.
The mis-reported FEC/CRC errors issue from the HG612's own buggy GUI has also been dealt with.
The output is almost identical to later scripted versions, just that there is more of it to assist with trouble-shooting problematic connections.
Once a reliable download site has been chosen, I'll post links here accordingly, so watch this space 
At some stage in the not too distant future, these programs are also likely to be converted back to their Linux and ADSL roots as originally developed by Burakkucat, along with asbokid's input.
EDIT:-
As data and/or error/event log files and pictures can be attached, the preferred forum for feedback/queries once the programs have been released is:-
Kitz Forum
Edited by deleted (Sat 02-Mar-13 23:18:36)
|
|
|
I will give webspace if you want, better than rapidshare etc.
If you worried about longevity the files I host for kitz site are still there since 6-7 years ago.
BT Infinity 2 Since Dec 2012 - Estimate 65.9/20 - Attainable peak 110/36 - Current Sync 71/20
|
|
|
For the past two months or so I've been developing a settings editor to set up Bald_Eagles excellent updated logging programs, along with testing them.
To do this I've had to learn VB.Net, and I haven't really programmed since I was a teenager, about 30 years ago.
So take it easy if you find anything not quite right, but please do let us know.
We'll update this thread and the first post on the Kitz thread when it's available for download
Edited by R0NSKI (Sat 02-Mar-13 23:52:04)
|
|
Register (or login) on our website and you will not see this ad.
|
|
|
A small package of connection statistics logging/graphing programs has been recently devoloped from the original batch file script versions.
Great, looking forward to the link 
James BT Infinity 2 19/09/2012 - Estimate 44.6/6.5 - Install 52/12 - Actual 46 / 8 Mbps
Huawei VDSL -> Draytek router -> Apple Airport Extreme -> Belkin Switch -> Windows/Mac/Linux/NAS/Phone
13 years of broadband - 1999 ntl:(512k/1M)/BTbusiness(2M)/Metronet(2M)/Bulldog(8M/16M)/BE(19M/16M)/BT FTTC(46M)
|
|
|
Nice one Bald Eagle. I can attest that they work just fine
|
|
|
Has anyone tried RS? http://sourceforge.net/projects/rsux/
It works on Linux and Windows (and under WINE on OSX).
|
|
|
Has anyone tried RS? http://sourceforge.net/projects/rsux/
It works on Linux and Windows (and under WINE on OSX). Ah, that looks interesting. I think I'll give that a go.
|
|
|
Has anyone tried RS?
Looks interesting, but doesn't seem to keep long term stats unless I have misunderstood it.
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
|
I think you just leave it running. It will take snapshots according to Configuration | Graphs | Snapshots.
|
|
|
But will the data persist over a computer reboot? Other than just the graphs.
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
Has anyone tried RS? http://sourceforge.net/projects/rsux/
It works on Linux and Windows (and under WINE on OSX). You'd need to go an extra mile to have it run as a service but there are ways of doing that under Windows.
Edited by Andrue (Mon 04-Mar-13 09:55:08)
|
|
|
Download is now live at Freewarefiles.com.
Edit: If upgrading to the new version don't forget to backup any logs/graphs just in case. In my experience it is perfectly fine to keep your modem log file, I'm still using the same one I started last August.
Also if you like it then please rate it and leave a review on Freeware files, if you have any problems then let us know.
Edited by R0NSKI (Mon 04-Mar-13 16:40:55)
|
|
|
ok thanks.
BT Infinity 2 Since Dec 2012 - Estimate 65.9/20 - Attainable peak 110/36 - Current Sync 71/20
|
|
|
Just to let everyone know that the editor requires dot.net version 4, or else it won't run.
|
|
|
|
Has anyone tried this out yet?
General constructive feedback/criticism is most welcomed, but I�m particularly interested to hear about how users found the setting up process, any problems & suggestions for potential future improvement and development.
|
|
|
I did a quick test and it is looking promising. I haven't had the time to check it out enough to use it for my regular day to day, I probably will soon.
One issue. I thought it could continue on seamlessly from [a copy of] my old log; but it crashes if I try that.
Log formats are different.
Sample old log entry
10/03/2013 13:23 75260 20000 5.3 15.1 13.6 6.9 85680 23500 G.992.3_Annex_K_PTM) 13259202 0 84087 1167 4981042 0 6918455 0.054 0 0 0 1921.79 926740840 234609 5297 1010675945 3943926 98930 84087 1167 0 776252710 4293687 18994414 13259202 0 0 1193 1
Sample new log entry
04/03/2013 17:41 75260 20000 4.3 15.7 13.9 6.9 82548 24327 PTM 77728 1071 901450671 227170 4579215 0 6415521 0 0 0 0 1782.089 901450671 227170 0 624979056 3943926 88959 77728 1071 0 4031861471 4293687 17080234 12211809 0 0 1193 1 2261 851 101 0 0 0 0 0 0 0 4.6 24.5 37.3 0.0 12.2 30.1 47.2 4.6 23.2 35.5 0.0 12.2 30.1 47.2 15.6 15.7 15.7 0.0 5.3 3.8 3.9 -4.2 -19.3 6.4 0.0 10.6 8.0 7.3 Showtime 0 0 L0 17a ON ON No Showtime 0.0 0.0 63 237 1 1 64 45 16 16 0.0271 0.3782 23651 5373 0 0 0 0 396995161 0 2198442418 0 0 0 0 22 22 3.00 0.00 1.29 4.25 8.00 0.00 129.34 60.17 2629375 86700 VDSL2
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
|
If you do wish to add the new data to your previous log obtained via the script version, it is probably best to start a brand new log using all the extra data as obtained by the new programs.
Then, between each minute's data harvest, copy & paste your old data into the new modem_stats.log BEFORE the new data (don't leave any blank rows though).
The new program version checks the previous row of the log file each time it runs, in order to calculate any differences between data harvests.
If there isn't a corresponding data field from the previous row in the log, you are correct - it will crash.
This is NOT the case with a brand new log file though as the program detects that there is no previous data at all.
Graphing the data shouldn't be a problem though as any missing data (from previous log rows) is simply ignored.
It should be noted though that SOME of the data stored in the scripted version log file was incorrect as it was obtained from the modem's buggy GUI, which as we now know reports FEC/CRC errors incorrectly.
ALL the data (lots of it as you have seen) is now obtained via telnet commands, which IS correct.
Not all of it is yet used for graphing purposes, but subject to sufficient demand, I MIGHT add a few more graphs such as bitswaps each minute etc.
A copy of all the obtained data is updated at each minute's harves & stored in xlogfile.txt (also stored in the Ongoing_Stats folder).
|
|
|
Excellent, thanks. I'll try that when I get a chance.
I'll also update my more dynamic graphing code too.
Just to confirm: the first 40 entries are exactly the same as before, with the remaining 85 or so new?
Do you have a list of what all the columns are, please?
Minor issue with format is the blank in 'No Showtime' means that parsing will be marginally more complicated.
Thanks again for the very useful program.
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
Another issue: I've solved for me but for information. Windows 8.
~~~
The task manager task generated by the Setting Editor was not running. Or rather, a first task it started running and never completed, and the remainder would not start.
The reason turned out to be that Task Manager starts a task using OpenWith, so that the command actually being run was
| Text | 1
| C:\Windows\system32\OpenWith.exe ""D:\Temp\HG612_Modem_Stats\Scripts\HG612_stats.VBS"" |
Testing this out from the command line it asked me 'How do you want to open this kind of file (.VBS)?', with a suggestion ' Continue using Microsoft Console Based Script Host'.
Script host was registered for .VBS, so it ran automatically (without prompt) as a double-click from Explorer, but for some reason not from Task Manager/OpenWith.
Presumably, the hidden task was asking for interaction to tell it what to run, but not getting interaction as it was hidden!?
~~~
What I have done which is working (and neater) is to change the task to run "HG612_stats.exe", and told it to start in the appropriate "HG612_Modem_Stats\Scripts" directory.
I imagine this is avoiding the OpenWith.exe, and certainly avoiding cscript of the .vbs file.
If easy I suggest you change the Settings Editor to generate this variant
~~~
Merging the old and new log files as you suggest has worked fine, and the new version is now my regular version.
Once again, thanks to you both.
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
Just to confirm: the first 40 entries are exactly the same as before, with the remaining 85 or so new?
Do you have a list of what all the columns are, please?
Minor issue with format is the blank in 'No Showtime' means that parsing will be marginally more complicated.
'No' & 'Showtime' are actually 2 separate elements.
Any spaces in the log are used to separate the elements.
If you work your way down xlogfile.txt, you should be able to work out what the abreviations mean.
The modem_stats.log file isn't set out in a particularly logical manner.
That's because the script version was gradually developed, adding extra data bit by bit & the new log was set out the same way, to at least allow older logs to be graphed with the new graphing program (blank or partially blank graphs being generated where the data didn't exist in the older log).
| Text | 1
23
45
67
89
1011
1213
1415
1617
1819
2021
2223
2425
2627
2829
3031
3233
3435
3637
3839
4041
4243
4445
4647
4849
5051
5253
5455
5657
5859
6061
6263
6465
6667
6869
7071
7273
7475
7677
7879
8081
8283
8485
8687
8889
9091
9293
9495
9697
9899
100101
102103
104105
106107
108109
110111
112113
114115
116117
118119
120121
122123
124125
126127
128129
130131
132133
134 | Note:-
"hgs." is from xdslcmd info --stats as harvested"hgp." is from xdslcms info --pbParams
Anthing with a value of N/A (pbParams data) is converted to zero for calculation purposes"log_stats." is either calculated at harvesting time or is from the previous row in the log file
DateTime
hgs.ds_ratehgs.us_rate
hgs.ds_snrhgs.us_snr
hgs.ds_powerhgs.us_power
hgs.ds_max_ratehgs.us_max_rate
hgs.tps_tchgs.ds_cb1_CRC
hgs.us_cb1_CRChgs.ds_cb1_FEC
hgs.us_cb1_FEChgs.ds_HEC
hgs.us_HEChgs.AS
"0 " /* Placeholder for DS_CRC_Errors2 */ This isn't used, so a value of zero is usedlog_stats.ds_CRC_ERRORS_THIS_PERIOD
log_stats.ds_FEC_ERRORS_THIS_PERIODlog_stats.ds_HEC_ERRORS_THIS_PERIOD
((float)hgs.AS / 3600)hgs.ds_RSCorr
hgs.us_RSCorrlog_stats.ds_RSCorr_THIS_PERIOD
hgs.ds_OHFhgs.us_OHF
log_stats.ds_OHF_THIS_PERIODhgs.ds_OHFErr
hgs.us_OHFErrlog_stats.ds_OHFErr_THIS_PERIOD
hgs.ds_RShgs.us_RS
log_stats.ds_RS_THIS_PERIODhgs.ds_RSUnCorr
hgs.us_RSUnCorrlog_stats.ds_RSUnCorr_THIS_PERIOD
hgs.ds_Dhgs.us_D
hgs.ds_EShgs.us_ES
hgs.ds_SEShgs.us_SES
log_stats.ds_ES_THIS_PERIODlog_stats.us_ES_THIS_PERIOD
log_stats.us_RSCorr_THIS_PERIODlog_stats.us_RS_THIS_PERIOD
log_stats.us_OHF_THIS_PERIODlog_stats.us_RSUnCorr_THIS_PERIOD
hgp.us_line_attenuation_U0hgp.us_line_attenuation_U1
hgp.us_line_attenuation_U2hgp.us_line_attenuation_U3
hgp.ds_line_attenuation_D1hgp.ds_line_attenuation_D2
hgp.ds_line_attenuation_D3hgp.us_signal_attenuation_U0
hgp.us_signal_attenuation_U1hgp.us_signal_attenuation_U2
hgp.us_signal_attenuation_U3hgp.ds_signal_attenuation_D1
hgp.ds_signal_attenuation_D2hgp.ds_signal_attenuation_D3
hgp.us_snr_margin_U0hgp.us_snr_margin_U1
hgp.us_snr_margin_U2hgp.us_snr_margin_U3
hgp.ds_snr_margin_D1hgp.ds_snr_margin_D2
hgp.ds_snr_margin_D3hgp.us_tx_power_U0
hgp.us_tx_power_U1hgp.us_tx_power_U2
hgp.us_tx_power_U3hgp.ds_tx_power_D1
hgp.ds_tx_power_D2hgp.ds_tx_power_D3
hgs.statushgs.retrain_r
hgs.pathhgs.link_power_state
hgs.profilehgs.us_trellis
hgs.ds_trellishgs.line_status
hgs.training_statushgs.ds_attn
hgs.us_attnhgs.ds_B
hgs.us_Bhgs.ds_M
hgs.us_Mhgs.ds_T
hgs.us_Thgs.ds_R
hgs.us_Rhgs.ds_S
hgs.us_Shgs.ds_L
hgs.us_Lhgs.ds_OCD
hgs.us_OCDhgs.ds_LCD
hgs.us_LCDhgs.ds_total_cells
hgs.us_total_cellshgs.ds_data_cells
hgs.us_data_cellshgs.drop_cells
hgs.ds_bit_errorshgs.us_bit_errors
hgs.ds_UAShgs.us_UAS
hgs.ds_INPhgs.us_INP
hgs.ds_PERhgs.us_PER
hgs.ds_delayhgs.us_delay
hgs.ds_ORhgs.us_OR
hgs.ds_bitswaphgs.us_bitswap
hgs.mode |
Edited by deleted (Sun 10-Mar-13 22:27:21)
|
|
|
What I have done which is working (and neater) is to change the task to run "HG612_stats.exe", and told it to start in the appropriate "HG612_Modem_Stats\Scripts" directory.
I imagine this is avoiding the OpenWith.exe, and certainly avoiding cscript of the .vbs file.
If easy I suggest you change the Settings Editor to generate this variant
I used a .VBS script mainly for XP users, where I couldn't find any other way to make the .exe program run 100% silently 100% of the time (other than by running a shortcut to a batch file that ran the .exe - phew).
Running the .exe silently can be done in Vista & Windows 7, but I chose to continue with the .VBS script for compatibility reasons.
RONSKI wrote the Settings Editor & included the starting/stopping/disabling of scheduled tasks to replace the previous batch files that used to do that.
He already differentiates between Windows versions (XP uses a different method to automate setting up scheduled tasks), so it MAY be relatively easy for him to change things to suit.
I haven't actually seen his code for the Settings Editor, so I don't really know how easy it would be.
If it's feasible, it could be included in the first release update, as will be the option to disable all the extensive event/error logs data.
We didn't/don't have access to a Windows 8 machine, so our testing didn't extend to W8.
Nonetheless, I'm glad you have sussed out how to make it work.
I believe there is a way to force cscript to run .VBS scripts, but I didn't include that as it didn't seem necessary at the time.
|
|
|
I can very easily change this, if the VBS script is only required for XP, then I can change all later OS's to directly run the exe file from the scheduled task.
Edited by R0NSKI (Mon 11-Mar-13 16:35:20)
|
|
|
What I have done which is working (and neater) is to change the task to run "HG612_stats.exe", and told it to start in the appropriate "HG612_Modem_Stats\Scripts" directory.
I imagine this is avoiding the OpenWith.exe, and certainly avoiding cscript of the .vbs file.
If easy I suggest you change the Settings Editor to generate this variant
Are you logged into Windows 8 using a Username & Password or just a username?
|
|
|
I can very easily change this, if the VBS script is only required for XP, then I can change all later OS's to directly run the exe file from the scheduled task.
Testing this with Windows 7, these are the results:-
Logged in to Windows using Username & Password & the task set to "Run whether user is logged on or not", the exe runs silently.
Logged in to Windows using Username only & the task set to "Run only when user is logged on", the exe runs, but its command window is visible, so in this circumstance running the .VBS script makes it run invisibly.
I imagine it will be the same setup for Vista.
So in summary, depending on Stephen Todd's response about how he logs into Windows 8, it MAY be that it is best to use the .VBS script for everything apart from Windows 8?
|
|
|
I just found that out to, and remember now that programs only run silently when the user supplies a password on Vista onwards.
I've also noticed that the HG612_Stats.exe still takes into account any delay set on the delays tab, do we need to pass an argument to HG612_Stats.exe to tell it to ignore the delay when run from the VBS script?
|
|
|
I login to Windows 8 with username/password.
I have the task manager action logged in with username and password.
If I make a task version with just username, I see the command window.
There is an option 'Configure for' with choices including Vista, Windows 7 and Windows 8.They don't seem to change things. The default seems to be 'Configure for Vista/Windows Server 2008'.
I think it is the same as for Vista and Win7.
~~~~
An experiment you might try to check OS differences:
As I mentioned, an odd thing is that even running my own command line (nothing to do with task manager), the line
C:\Windows\system32\OpenWith.exe ""D:\Temp\HG612_Modem_Stats\Scripts\HG612_stats.VBS""
interacts, saying 'How do you want to open this type of file (.exe)?', with a prompt to 'keep using Cscript?'.
Even though .vbs is registered to open with Cscript.
When I try command line
C:\Windows\system32\OpenWith.exe cscript.exe ""D:\Temp\HG612_Modem_Stats\Scripts\HG612_stats.VBS""
it comes up with the even more improbable 'How do you want to open this type of file (.exe)?' with a prompt 'Look for an App in the App store'
The prompts are Metro style. It may be Metro intercepting old style OpenWith behaviour?
(I use Windows 8 as a pure desktop system, avoiding Metro almost completely, but it still creeps in sometimes.)
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
|
I thought that to make a task silent, you have to run it under the username of SYSTEM.
|
|
|
I just found that out to, and remember now that programs only run silently when the user supplies a password on Vista onwards.
I've also noticed that the HG612_Stats.exe still takes into account any delay set on the delays tab, do we need to pass an argument to HG612_Stats.exe to tell it to ignore the delay when run from the VBS script?
The delay can be set to zero (ideal if only running one instance - i.e. a default installation).
However, for testing purposes (or possibly even used for backup purposes), I usually also have another instance running via a separate ini file, delayed by 30 seconds.
So, for the time being at least, I don't plan to disable or ignore any delay settings as I (& maybe others) have a use for them.
|
|
|
I thought that to make a task silent, you have to run it under the username of SYSTEM.
That seems to work for XP systems (password not needed), but I haven't had much success when previously trying it on Vista/W7 systems.
|
|
|
Maybe the command line could simply consist of something on the lines of:-
cscript ""D:\Temp\HG612_Modem_Stats\Scripts\HG612_stats.VBS""
http://technet.microsoft.com/en-gb/library/bb490816....
|
|
|
|
|
|
|
|
I just get ERROR: Access is denied when using SYSTEM as the username on my W7 system (when already logged in to Windows with username & password).
That looks like the same site that I firstly got the idea to use the shortcut method from, latterly cribbing from & slightly adding to the VBS script method.
|
|
|
I also get the error Access is denied when trying this in W7, I tried this example taken from http://technet.microsoft.com/en-us/library/bb490996....
schtasks /create /tn "My App" /tr c:\apps\myapp.exe /sc monthly /d 1 /ru "System"
I believe I did try using the system account whilst writing the editor, but didn't have any joy.
Googling doesn't reveal an answer, apart from using the old AT command from XP, which I don't think is much use, if any for Vista onwards.
Edit. It must be possible as I do have several scheduled tasks set to run under the system account
Edited by R0NSKI (Mon 11-Mar-13 23:06:40)
|
|
|
Edit. It must be possible as I do have several scheduled tasks set to run under the system account
Quoting myself, how bad is that?
Anyway I have just created a scheduled task to run under the system user account.
I exported the original task, which creates an XML file.
I then edit this line <UserId>Rons-PC\Ron</UserId> and change it to <UserId>S-1-5-18</UserId>
Then delete the <LogonType>Password</LogonType> line and then import it.
Either delete the existing task, or rename the xml file prior to importing it.
I now have a scheduled task to run under the system account
This will take quite a bit of work to implement in the editor, but it should in theory do away with the username and password entry for Vista onwards, and of course means the HG612_Stats.exe can be run directly.
See this article to find out what the S-1-5-18 means.
|
|
|
The delay can be set to zero (ideal if only running one instance - i.e. a default installation).
However, for testing purposes (or possibly even used for backup purposes), I usually also have another instance running via a separate ini file, delayed by 30 seconds.
So, for the time being at least, I don't plan to disable or ignore any delay settings as I (& maybe others) have a use for them.
Ah yes, didn't think of that, although we put in the instructions that the delays were ignored when run from the scheduled task, but it should be that the snapshot delay is ignored.
|
|
|
Ah yes, didn't think of that, although we put in the instructions that the delays were ignored when run from the scheduled task, but it should be that the snapshot delay is ignored.
The snapshot (HG612_current_stats.exe) delay IS ignored if it is being run via HG612_stats.exe.
12/03/2013 06:00:05.120 - After checking for RESYNC or SCHEDULED events, Delay_snapshot_data_harvest_seconds = 0
If it is run manually, it checks if HG612_stats.exe is also running. If it is, it waits for it to complete before continuing, using any delay as intentionally set in the ini file.
**************************************************
* *
* Gathering Snapshot Statistics from the modem *
* *
**************************************************
The local time is: 06:50:00.997
There are 1 instances of HG612_stats.exe running. Please wait for it to complete
*****
HG612_stats.exe has now completed
HG612_stats.exe is NOT running
Temp File CURRENT-ISRUNNING-065003-961 was created
Creating log file Plink_20130312-0650.log
Delaying snapshot data harvesting by 10 seconds to avoid clashes with any other scheduled
data harvesting tasks
|
|
|
Maybe the command line could simply consist of something on the lines of:-
cscript ""D:\Temp\HG612_Modem_Stats\Scripts\HG612_stats.VBS""
That worked for me, but gave a flash of a command prompt when run from Task Scheduler.
The whole thing is certainly quite confusing. b.t.w. the only reason I was testing command lines involving 'OpenWith.exe' is that Task Scheduler was using it to launch 'HG612_stats.VBS' . At least to try to launch it, but failing due to the hidden interaction. I didn't have to be quick to discover that with Process Hacker, as once the first instance was launched it hung around indefinitely.
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
I've worked out how to create a task which runs using the system account, this means we will be able to run the exe, thus not requiring the vbs script for Vista onwards, it also means no need to supply a username or password.
I'll try and alter the editor this week, and then let you have a copy to test if you wouldn't mind?
Edited by R0NSKI (Tue 12-Mar-13 08:09:19)
|
|
|
Maybe a combination of //B & //Nologo in the command line would cure that?
See the info in the link that I provided earlier for details on what these switches do.
Alternatively, RONSKI's method may be the answer.
Edited by deleted (Tue 12-Mar-13 08:20:04)
|
|
|
Well, I've been trying all night, and whilst I can get XP to run the task under the system account. I can not get SCHTasks to import an XML file to run under the system account.
I can do it from a command prompt, starting the cmd window with Run As Administrator, but that cause further problems.
Strange how I can just import the task from within task scheduler and it works fine.
Going to have to find another way around it for Windows 8.
|
|
|
As far as I can see, there isn't any significant benefit of running it under System for Windows 8. The only difference I can see is that it requires you to enter password when you register the task to run it under your own login; nice to avoid but hardly crucial. Probably true for Vista and Windows 7 as well.
But I can see the academic challenge of trying to get it running as you think it ought to. Congratulations on your perseverance.
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
The problem is that users that don't enter a password will see the console window open every minute, hence the vbs script to hide it.
What I've done this morning is compile the vbs script into an exe file, a user on kitz is going to test it for me, if you would like to test it let me.
|
|
|
I'm very happy to test out anything if it will be helpful for you.
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
I'm very happy to test out anything if it will be helpful for you.
Thanks, I've sent you a PM.
|
|
|
Thanks, I've tested that and can confirm it works for me on Windows 8.
It runs silently when run directly from Windows Explorer, or when run from a modified Task Scheduler task.
However, for Windows 8 Task Scheduler, I'm not sure of what the advantage of running your new code is over running 'HG612_stats.exe' directly (making sure Task Scheduler runs it in the appropriate directory). HG612_stats.exe also runs silently when launched from Task Scheduler in Windows 8; though it is non-silent when launched from Windows Explorer.
~~~
Just confirming: this is almost orthogonal to the issue of trying to get it registered with Task Scheduler to run under System; except that if it runs under System it will certainly be silent.
I wasn't expecting a different test final executable, but rather a test for getting it registered under System/
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
Thanks for confirming that works.
Try running the HG612 stats.exe from a scheduled task without entering you're password, does it still run silently?
Can you even have a user account on W8 without a password?
I tried for about 4 hours last night to find a way to create a scheduled task using the system account with schtasks, but I always got access denied errors, unless I ran it with elevated permissions, but that creates further complications . Strangely I could create the task manually in task scheduler without problems though. No end of googling helped either, in fact a lot of forums advised against using the system account.
|
|
|
If I run HG612_stats.exe with setting 'Run only when the user is logged on', it flicks on the screen.
If I run it 'Run whether the user is logged on or not', 'Do not store password' it runs silently.
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
Can you even have a user account on W8 without a password?
I'm not sure. It isn't that the account doesn't have a password.
Rather, I am using the option in Task Scheduler that says 'Do not store password'
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
@Stephen, have you been running the stats program for any length of time with the new exe and scheduled task?
The user on Kitz said the task stops running after a while with no apparent problem or reason.
|
|
|
Hi, yes it's been running fine for me for a couple of days; through both sleeps and restarts which can have bad effects on wrongly set up tasks.
However, I have rather hacked the original setup as part of experiments.
For me it now has:
two triggers: [1] at startup and every minute; [2] at task create/modify and then every minute.
one action: D:\Temp\HG612_Modem_Stats\Scripts\HG612_stats.exe in directory D:\Temp\HG612_Modem_Stats\Scripts
I've still got it in a temp directory even though its my production one now.
I do find TaskScheduler has a pretty irritating interface; with silly details such as fixed panel size and the History view always opening with inappropriate column widths.
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
Thanks Stephen for confirming that, and the information
I installed Windows 8 last night as a virtual machine, and the task did indeed stop, and Korben on Kitz forum setup another task as a test and that appeared to stop as well.
So there does appear to be a problem in the settings somewhere, I'll look at implementing a task as you describe just for W8 and see what happens.
PS. The thing that really annoys me, and always catches me out with task scheduler, even in W7 is that it doesn't auto refresh, I have to hit F5, so I often look at Task Scheduler that's open and see out of date information.
|
|
|
Cheers.
The particular settings I used were the result of slightly random iteration and experimentation.
I won't say they are the most appropriate, though they do look reasonable and seem to work.
I wouldn't expect Windows 8 to be different than Windows 7 in the way task scheduler works. (But then I wouldn't expect it to be different in the way OpenWith launches scripts, and it is.)
As you have seen, I do prefer the idea of launching the 'real' exe direct where possible.
~~~
One thing I have seen was the mechanism getting 'stuck' somehow when one instance tried to run but couldn't because another had the log file open; or similar conflict.
That happened particularly with the older scripts which could take a long time to run; especially during system startup when there was lots of contention for disk.
I'm not sure I've seen it happen with the new exe version.
Sometimes, once that happened things could get locked enough that manual intervention was needed to clear it.
I've got several quite long gaps in my stats because of that: when the internet was running well I didn't notice the missing stats.
Sometimes the result was that task scheduler would launch the task but it wouldn't effectively run.
When task scheduler fails to execute the task, are you sure there isn't a long-running old version still running but doing nothing?
The task scheduler setting 'If the task is already running, stop the existing instance' could help with that, depending what the exact lockup was.
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
When task scheduler fails to execute the task, are you sure there isn't a long-running old version still running but doing nothing?
The task scheduler setting 'If the task is already running, stop the existing instance' could help with that, depending what the exact lockup was.
I did check task manager this morning and nothing related showed, Korben has also done this and found nothing untoward, which does suggest it's a scheduling problem.
When I using the old script versions I once found over 500 instances running on my server, it had even got to the point where the modem had locked up.
I was one of the first to use the newer exe version and have been since September/October time I think, and it's been very reliable.
When using the script versions we did try the option 'If the task is already running, stop the existing instance', but it didn't seem to help.
I agree it's always best to keep fewer links in the chain, so is best to run the logging exe directly, but in writing the programs we've had to try and cater for a very wide range of users and OSes.
I could work out if the task is capable of running the logging exe hidden, and then make it run it directly, but thats more time and lots more testing. As there's no downside to running the launcher exe I'll continue doing that, end users can easily edit the task if they desire, everything else will still work the same as you know.
|
|
|
When I using the old script versions I once found over 500 instances running on my server, it had even got to the point where the modem had locked up.
That was one of the drivers for developing compiled *.exe versions as the script versions were probably being pushed 'too far' for what batch file scripts were intended for.
I was one of the first to use the newer exe version and have been since September/October time I think, and it's been very reliable.
The exe versions are definitely more robust & as they harvest & process the data far quicker than the script versions, are less likely to lock up or struggle for time between samples (even on clapped out PCs with low processing power/RAM).
My virus checker (AVG 2013 - Free Edition) does occasionally cause a couple of minutes of data to be 'lost' when hogging the PC's resources despite being set to low priority, but the programs recover from that & continue logging as intended.
Edited by deleted (Fri 15-Mar-13 16:52:31)
|
|
|
The task scheduling just stopped for me as well. I've made a couple of changes and will see how it goes and report back ....
Certainly looks like a task scheduler problem, but ... Surely Microsoft can get one of those right by now?
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
Was that using your own task created from Task Scheduler or a modified task created by the editor?
|
|
|
Was that using your own task created from Task Scheduler or a modified task created by the editor?
I think it was one I created from scratch, but I am not 100% certain I am afraid.
(It's easy to preach about logging everything you do when making experiments; but very hard to practice.)
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
I know exactly what you mean. Take it you've created a brand new task now?
I'm probably going to get Windows 8 for my laptop, to free up the retail version of W7 that's on it for another PC. I can install the original Vista and then use an upgrade version, unless of course the old upgrade over itself trick still works.
I don't use the laptop very often so it's an ideal candidate for it, and also means I can leave it on for testing without running up the leccy bill like my desktop does.
|
|
|
still using the old script as for me its reliable, with occasional glitches on graphs.
I will switch when I have a reason to tho.
BT Infinity 2 Since Dec 2012 - Estimate 65.9/20 - Attainable peak 110/36 - Current Sync 70/20, Current Attainable 68/23  |
|
|
Just to say that my scheduled task has been working consistently for over a week (Windows 8).
In case it helps anyone, exported XML below (sorry it is a bit long):
I've left the details such as Author, UserId and WorkingDirectory; those will obviously need a change for use by anyone else.
| Text | 1
23
45
67
89
1011
1213
1415
1617
1819
2021
2223
2425
2627
2829
3031
3233
3435
3637
3839
4041
4243
4445
4647
4849
5051
5253
5455
5657
| <?xml version="1.0" encoding="UTF-16"?>
<Task version="1.2" xmlns="http://schemas.microsoft.com/windows/2004/02/mit/task"> <RegistrationInfo>
<Date>2013-03-13T18:45:19.6922848</Date> <Author>Todd\Todds</Author>
</RegistrationInfo> <Triggers>
<BootTrigger> <Repetition>
<Interval>PT1M</Interval> <Duration>P1D</Duration>
<StopAtDurationEnd>false</StopAtDurationEnd> </Repetition>
<Enabled>true</Enabled> </BootTrigger>
<RegistrationTrigger> <Repetition>
<Interval>PT1M</Interval> <Duration>P1D</Duration>
<StopAtDurationEnd>false</StopAtDurationEnd> </Repetition>
<Enabled>true</Enabled> </RegistrationTrigger>
</Triggers> <Principals>
<Principal id="Author"> <UserId>Todd\Todds</UserId>
<LogonType>S4U</LogonType> <RunLevel>LeastPrivilege</RunLevel>
</Principal> </Principals>
<Settings> <MultipleInstancesPolicy>IgnoreNew</MultipleInstancesPolicy>
<DisallowStartIfOnBatteries>true</DisallowStartIfOnBatteries> <StopIfGoingOnBatteries>true</StopIfGoingOnBatteries>
<AllowHardTerminate>true</AllowHardTerminate> <StartWhenAvailable>true</StartWhenAvailable>
<RunOnlyIfNetworkAvailable>false</RunOnlyIfNetworkAvailable> <IdleSettings>
<StopOnIdleEnd>true</StopOnIdleEnd> <RestartOnIdle>false</RestartOnIdle>
</IdleSettings> <AllowStartOnDemand>true</AllowStartOnDemand>
<Enabled>true</Enabled> <Hidden>false</Hidden>
<RunOnlyIfIdle>false</RunOnlyIfIdle> <WakeToRun>false</WakeToRun>
<ExecutionTimeLimit>PT0S</ExecutionTimeLimit> <Priority>7</Priority>
</Settings> <Actions Context="Author">
<Exec> <Command>D:\Temp\HG612_Modem_Stats\Scripts\HG612_stats.exe</Command>
<WorkingDirectory>D:\Temp\HG612_Modem_Stats\Scripts</WorkingDirectory> </Exec>
</Actions></Task> |
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
Thanks for posting the info, I'll give it a try at some point.
|
|
|
Just to say that my scheduled task has been working consistently for over a week (Windows 8).
In case it helps anyone, exported XML below (sorry it is a bit long):
I've left the details such as Author, UserId and WorkingDirectory; those will obviously need a change for use by anyone else.
I'm not familiar with interpreting the xml output, but I can see that you are still directly running the exe rather than the VBS script & that you have specified the working directory:-
<Command>D:\Temp\HG612_Modem_Stats\Scripts\HG612_stats.exe</Command>
<WorkingDirectory>D:\Temp\HG612_Modem_Stats\Scripts</WorkingDirectory>
Are you running the task on a DAILY basis for 24 hours, repeated each day rather than our default of ONCE, indefinitely?
Also, is this the the bit that sets "Do not store password"?:-
<LogonType>S4U</LogonType>
|
|
|
Hi.
First a disclaimer: I'm not saying that this is the way I think it should be done,
just a comment that this is a way that has worked for me and so may help others if they have issues.
Yes, not using the VBS as discussed before. Basically a desire to keep things as stripped down as possible for my environment.
Not sure whether this is appropriate for other environments (though I don't see why it shouldn't be),
and also not sure if all the choices I made can also be made from an automated script as by the Settings Editor.
The VBS seems to have two purposes; to launch quietly and to launch in the correct current directory.
Launching quietly comes from not ticking 'Run only when the user is logged on' (I think), or maybe from the 'Do not store password, ...'
The correct directory is ensured by specifying it in the <WorkingDirectory>
As discussed before, some curiosity of Windows 8 prevents the VBS launching properly; which can be overcome with the extra HG_612_Run.exe that Ronski provided.
My use of a different directory was just experimental setup which I haven't been bothered to change.
I changed the scheduling as it wasn't working smoothly while I was experimenting.
Sometimes it didn't retake after I had made an experimental change.
That was why I added the 'At task creation/modification' trigger (<RegistrationTrigger> in the XML).
I think that the use of 'At startup' (<BootTrigger>) rather than 'On a schedule: one time' was random experimentation rather than informed intent.
So the main trigger is the one that starts at boot time and repeats every minute. Should have the same effect as a 'once' and repeat every minute.
The other is to make sure it keeps working if I make an experimental change.
Just checked and yes the S4U (service for user) is the 'Do not store password' bit.
See http://msdn.microsoft.com/en-gb/library/windows/desk...
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
Hi.
First a disclaimer: I'm not saying that this is the way I think it should be done,
just a comment that this is a way that has worked for me and so may help others if they have issues.
Yes, not using the VBS as discussed before. Basically a desire to keep things as stripped down as possible for my environment.
Not sure whether this is appropriate for other environments (though I don't see why it shouldn't be),
The VBS is there mainly just to ensure invisibilty regardless of user login settings.
Depending whether users need to enter their login password or not, running the exe directly can cause cmd.exe to flash up briefly, also seeing it minimised briefly in the task bar on Windows 7 & Vista.
XP has different requirements again to a) ensure it keeps running & b) to ensure it is invisible.
and also not sure if all the choices I made can also be made from an automated script as by the Settings Editor.
RONSKI's the man who can confirm that one way or the other.
The Do not store password part was to combat a known Vista bug where tasks sometimes stop running after a couple of hours, sometimes days & didn't always restart again following a PC reboot.
Thanks for all the other detail.
Most interesting & useful indeed.
Edited by deleted (Tue 26-Mar-13 20:39:00)
|
|
|
Not all options are available from the the command line via SCHTasks, in theory I should be able to do it via the XML export/import options though. I'll need to find some time to make the modifications and try it though, at least with my laptop running W8 I'll be able to test it.
|
|
|
Once again, for those interested (not many were before), alternative more interactive graphing at
http://www.programbits.co.uk/modemGraph/plotstats.html
Requires modern browser (latest Chrome, IE, Opera and Firefox all work for me).
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
Just noticed that task scheduler forgot to schedule stats collection from 16:51 on 28 March until this morning.
I can't see any reason; just seems to be a typical task scheduler failure?
I'm 99% sure that this is a task scheduler problem and not to do with the stats program.
No particular issue for me as my Internet has been reasonably steady over that time,
just reporting for reference after commenting before how it had been behaving correctly.
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
Thanks for the update, it's certainly nothing to do with the program, I've tested it with another scheduled task just updating a text file and it failed.
I'm surprised I've not had any replies to my threads on various Ms forums.
perhaps the only way around it on W8 would be to run it as a service with it's own built in time trigger.
|
|
|
Thanks for the response. I'm not sure Task Scheduler is any worse on Windows 8 than other windows: I think it has always been a bit iffy. I had lots of gaps in my stats pre Windows 8; using the 'standard' scheduling. I know some of these were due to the old script getting a bit confused and locking itself out, but I'm pretty sure some were just Task Scheduler errors.
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
|
|
|
Running as a service would be a very good idea.
|
|
|
It was iffy on Vista, but is not a problem on XP, W7 or WHS2011. In fact I've been running it 24/7 on my server since August, and the only time it's missed a beat is when I was using the old scripts, been using the exe since September and it's been totally reliable. I'm certain it's a W8 problem.
|
|
|
Running as a service would be a very good idea.
That was always my opinion to, but to keep it standalone without an installation program, and to keep the programming simple the Bald_Eagle decided not to pursue that avenue.
When I get time I'll see if I can produce a service to run the program every minute.
|
|
|
When I get time I'll see if I can produce a service to run the program every minute.
If you sorted out how to set it up as a service that runs 24/7, I could add the code to the existing program to trigger the harvesting every minute (if that seems to be a viable option).
TBH, I don't have the foggiest idea how to simply set anything up to run as a service ("simply" being the operative word).
|
|
|
Could you add code to run it every [user defined] interval?
oh, and here's some example code for a service http://www.devx.com/cplus/Article/9857
Edited by deleted (Tue 02-Apr-13 22:33:45)
|
|
|
Could you add code to run it every [user defined] interval?
I presume you mean to run the harvesting more frequently than every minute?
If that's why you ask, how do you see it being beneficial?
I could do that, but would then also have to amend the graphing elements to accommodate more frequent data harvests.
So, at the moment, I don't intend to do that.
I'm still adding subtle tweaks here & there & once I've finished, I'll release an update, probably also including the 'C' code for others to pick up & 'enhance' as they see fit.
oh, and here's some example code for a service http://www.devx.com/cplus/Article/9857
Thanks for the link. I'll have a look at that as soon as I get chance.
|
|
|
Update on failing task manager, Windows 8.
I still get the task scheduler failing to work properly, just forgetting to run the task.
I'm amazed Microsoft still can't provide a task scheduler that doesn't make glaring mistakes.
I also got the HG612_stats.exe still running issue yesterday.
That is very rare with the new code; I think it was because of a modem reset (something to do only very occasionally).
I changed my tasks in Task Manager so that under 'settings' it says 'Stop the task if it runs longer than: 30 seconds'
I needed to type '30 seconds' in explicitly, it wasn't offered on the dropdown.
If you look in task manager history for the task you can tell the difference between the two cases above.
For the first, there won't be regular entries in the log at all.
For the second, there will be entries saying something like
Task Scheduler did not launch task "\testhg2" because instance "{6ae24bde-a441-4554-80dc-f0f358c6176d}" of the same task is already running.
Lack of filtering and slow sorting in the Task Scheduler history window is another task scheduler issue.
--
Moved (with trepidation turned relief) to BT Infinity 2 for upload speed. Happy BE user for several years.
|
Pages in this thread: 
Print Thread
