WhiteICE version information

WhiteICE v1.39b (in development)

New version with improved RL algorithm that SHOULD give more often positive results (in many hours long stimulation). Stimulation interval is 1000ms. Effect seem to be only about 1% with this new code.

Program learns very slowly, 3h 20minutes (300 models) didn’t show big improvements. Try to increase tau from 0.02 to 0.1 and see if it still increases performance a bit. => tau increase seem to give worse results???

Added forgetting to reinforcemen learning, now 30 minutes older measurements are not used. TODO: increase tau from 0.02 to 0.1 (for testing) so model can learn temporal dynamics better.

DONE: Added additional measurements to RL's state vector.

NOW: 5000 msecs stimulation time seems to give much better results than 1000 ms (2-3% effect). However, forgetting time should be maybe increased from 30minutes to 60minutes? (TODO: test it)

WhiteICE v1.38b

This version re-enabled longer stimulation interval 5000ms which seem to have positive effect to "episodes-result.txt" average reinforcement value time-series when stimulatio is run for many hours. Typical effect seem to be 5% (versus random stimulation)

WhiteICE v1.37b

This experimental version used very short stimulation interval 500ms.