Run Experiments is a Java Class used to automatically run different information retrieval Experiments Automatically based on different input variables in different XML Files. In addition , It accepts a range of values to run Ex : BRange = 1:10:2 >>> will run 5 experiments of B (1,3,5,7,9).
Read the attached pdf for details here
The Main input parameters are :
- Experiment parameter files . (used to identify the values for each experiment run)
- Indexes ( It is preferable to create the index using IndexerApp from Lucene4IR in order to match token filters with the run experiments
- Query Files
- Qrel Files
- Token Filters . Token Filters used for creating the index and retrieval experiment should be the same
-
Bash Scripts : a generated file that includes trec_eval commands for all experiments grouped by experiment file
-
Params : list of XML parameter files generated to be passed to RetrievalApp from Lucene4Air
-
Performance : list of files that contain trec_eval results for each experiment
-
Results : result files the contain the results of running RetrievaApp for each experiment
-
Rertrieval Scripts : Java Scripts used to directly run RetrievalApp class using its associated retrieval parameter File
