#include <PExperiment.h>
Inheritance diagram for PLearn::PTester:
Public Types | |
typedef Object | inherited |
Public Member Functions | |
PTester () | |
virtual void | build () |
Should call simply inherited::build(), then this class's build_(). | |
PLEARN_DECLARE_OBJECT (PTester) | |
Declares name and deepCopy methods. | |
void | setExperimentDirectory (const string &the_expdir) |
The experiment directory is the directory in which files related to this model are to be saved. | |
string | getExperimentDirectory () const |
This returns the currently set expdir (see setExperimentDirectory). | |
virtual void | run () |
runs the experiment | |
Vec | perform (bool dont_set_training_set=false) |
performs the experiment, and returns the global stats specified in statnames If dont_set_training_set is set to true AND the splitter returns only one split, then we *don't* call setTrainingSet() and a forget() on the learner prior to training it: we assume the training set is already set. | |
PTester () | |
virtual void | build () |
Should call simply inherited::build(), then this class's build_(). | |
PLEARN_DECLARE_OBJECT (PTester) | |
Declares name and deepCopy methods. | |
void | setExperimentDirectory (const string &the_expdir) |
The experiment directory is the directory in which files related to this model are to be saved. | |
string | getExperimentDirectory () const |
This returns the currently set expdir (see setExperimentDirectory). | |
TVec< string > | getStatNames () |
Return the statnames (potentially modified by statmask, if provided). | |
virtual void | run () |
runs the tester | |
Vec | perform (bool call_forget=true) |
performs the test, and returns the global stats specified in statnames If call_forget is set to false then the call to setTrainingSet() won't call forget and build. | |
virtual void | makeDeepCopyFromShallowCopy (map< const void *, void * > &copies) |
Transforms a shallow copy into a deep copy. | |
Public Attributes | |
bool | save_initial_experiment |
string | expdir |
Path of this experiment's directory in which to save all experiment results (will be created if it does not already exist). | |
PP< PLearner > | learner |
PP< Splitter > | splitter |
TVec< string > | statnames |
bool | report_stats |
bool | save_stat_collectors |
bool | save_learners |
bool | save_initial_learners |
bool | save_data_sets |
bool | save_test_outputs |
bool | save_test_costs |
bool | provide_learner_expdir |
VMat | dataset |
Path of this tester's experiment directory in which to save all tester results (will be created if it does not already exist). | |
TVec< string > | final_commands |
PP< VecStatsCollector > | global_template_stats_collector |
PP< PLearner > | learner |
bool | save_initial_tester |
PP< Splitter > | splitter |
TVec< TVec< string > > | statmask |
PP< VecStatsCollector > | template_stats_collector |
bool | train |
TVec< string > | statnames |
Static Protected Member Functions | |
void | declareOptions (OptionList &ol) |
Declares this class' options. | |
void | declareOptions (OptionList &ol) |
Declares this class' options. | |
Protected Attributes | |
TVec< string > | statnames_processed |
The 'real' statnames: these are obtained from 'statnames' by a processing at build time, taking into account the 'statmask' option. | |
Private Types | |
typedef Object | inherited |
Private Member Functions | |
void | build_ () |
This does the actual building. | |
void | build_ () |
This does the actual building. |
Definition at line 52 of file PExperiment.h.
|
Reimplemented from PLearn::Object. |
|
Reimplemented from PLearn::Object. Definition at line 56 of file PExperiment.h. |
|
Definition at line 72 of file PExperiment.cc. |
|
|
|
Should call simply inherited::build(), then this class's build_(). This method should be callable again at later times, after modifying some option fields to change the "architecture" of the object. Reimplemented from PLearn::Object. |
|
Should call simply inherited::build(), then this class's build_(). This method should be callable again at later times, after modifying some option fields to change the "architecture" of the object. Reimplemented from PLearn::Object. Definition at line 151 of file PExperiment.cc. References build_(). |
|
This does the actual building.
Reimplemented from PLearn::Object. |
|
This does the actual building.
Reimplemented from PLearn::Object. Definition at line 138 of file PExperiment.cc. References PLearn::abspath(), expdir, PLearn::force_mkdir(), PLearn::pathexists(), and PLERROR. Referenced by build(). |
|
Declares this class' options.
Reimplemented from PLearn::Object. |
|
Declares this class' options.
Reimplemented from PLearn::Object. Definition at line 92 of file PExperiment.cc. References PLearn::declareOption(), and PLearn::OptionList. |
|
This returns the currently set expdir (see setExperimentDirectory).
Definition at line 133 of file PTester.h. References expdir. |
|
This returns the currently set expdir (see setExperimentDirectory).
Definition at line 115 of file PExperiment.h. References expdir. |
|
Return the statnames (potentially modified by statmask, if provided).
Definition at line 438 of file PTester.cc. |
|
Transforms a shallow copy into a deep copy.
Definition at line 547 of file PTester.cc. References dataset, PLearn::deepCopyField(), final_commands, global_template_stats_collector, learner, splitter, statmask, and template_stats_collector. |
|
performs the test, and returns the global stats specified in statnames If call_forget is set to false then the call to setTrainingSet() won't call forget and build. This is useful for continuation of an incremental training (such as after increasing the number of epochs (nstages) ), or generally when trying different option values that don't require the learning to be restarted from scratch. However call_forget will be forced to true (even if passed as false) if the splitter returns more than one split. Returns a vector of test statistics corresponding to the requested statnames |
|
performs the experiment, and returns the global stats specified in statnames If dont_set_training_set is set to true AND the splitter returns only one split, then we *don't* call setTrainingSet() and a forget() on the learner prior to training it: we assume the training set is already set. This is useful for continuation of an incremental training (such as after increasing the number of epochs (nstages) ). Definition at line 261 of file PExperiment.cc. References PLearn::append_slash(), PLearn::StatSpec::costindex, dataset, expdir, PLearn::StatSpec::intstat, PLearn::join(), k, learner, PLearn::VMat::length(), PLearn::TVec< string >::length(), PLERROR, provide_learner_expdir, report_stats, PLearn::save(), save_data_sets, save_initial_experiment, save_initial_learners, save_learners, save_stat_collectors, save_test_costs, save_test_outputs, PLearn::saveStringInFile(), PLearn::StatSpec::setnum, PLearn::TVec< T >::size(), slash, splitter, statnames, PLearn::TVec< T >::subVec(), and PLearn::tostring(). Referenced by run(). |
|
Declares name and deepCopy methods.
|
|
Declares name and deepCopy methods.
|
|
runs the tester
Reimplemented from PLearn::Object. |
|
runs the experiment
Reimplemented from PLearn::Object. Definition at line 157 of file PExperiment.cc. References perform(). |
|
The experiment directory is the directory in which files related to this model are to be saved. If it is an empty string, it is understood to mean that the user doesn't want any file created by this learner. |
|
The experiment directory is the directory in which files related to this model are to be saved. If it is an empty string, it is understood to mean that the user doesn't want any file created by this learner. Definition at line 249 of file PExperiment.cc. References PLearn::abspath(), expdir, PLearn::force_mkdir(), and PLERROR. |
|
Path of this tester's experiment directory in which to save all tester results (will be created if it does not already exist).
Definition at line 73 of file PTester.h. Referenced by makeDeepCopyFromShallowCopy(), and perform(). |
|
Path of this experiment's directory in which to save all experiment results (will be created if it does not already exist).
Definition at line 74 of file PTester.h. Referenced by build_(), getExperimentDirectory(), perform(), and setExperimentDirectory(). |
|
Definition at line 75 of file PTester.h. Referenced by makeDeepCopyFromShallowCopy(). |
|
Definition at line 76 of file PTester.h. Referenced by makeDeepCopyFromShallowCopy(). |
|
|
|
Definition at line 66 of file PExperiment.h. Referenced by makeDeepCopyFromShallowCopy(), and perform(). |
|
Definition at line 78 of file PTester.h. Referenced by perform(). |
|
Definition at line 79 of file PTester.h. Referenced by perform(). |
|
Definition at line 80 of file PTester.h. Referenced by perform(). |
|
Definition at line 55 of file PExperiment.h. Referenced by perform(). |
|
Definition at line 81 of file PTester.h. Referenced by perform(). |
|
|
|
Definition at line 83 of file PTester.h. Referenced by perform(). |
|
Definition at line 84 of file PTester.h. Referenced by perform(). |
|
Definition at line 85 of file PTester.h. Referenced by perform(). |
|
Definition at line 86 of file PTester.h. Referenced by perform(). |
|
|
|
Definition at line 67 of file PExperiment.h. Referenced by makeDeepCopyFromShallowCopy(), and perform(). |
|
Definition at line 88 of file PTester.h. Referenced by makeDeepCopyFromShallowCopy(). |
|
|
|
Definition at line 68 of file PExperiment.h. Referenced by perform(). |
|
The 'real' statnames: these are obtained from 'statnames' by a processing at build time, taking into account the 'statmask' option.
|
|
Definition at line 89 of file PTester.h. Referenced by makeDeepCopyFromShallowCopy(). |
|
|