You are here: Foswiki>AtlasSingleTop Web>AnalysisVersion1405006TMVA (revision 2)EditAttach

Analysis Comparisons for Code Version 14.05.006

Run Over D3PDs using the MSU analysis code

The DPDPs are stored on the CERN cluster in the directory /rooms/living/ntuples/single_top/TopPhysDPDMaker/14.05.006/ The following samples were included in the analysis:

Signal: 5500, 5502 (note that there is no 5501 sample for v14.05.006)

Background: 5200, 5204, 6280, 6281, 6282, 6283, 7680, 7681, 7682, 7683, 7684==, 7685, 7690, 7691, 7692, 7693, 7694, 7695, 7700, 7701, 7702, 7703, 7704, 7705

Unlike v13.0.30, all input files ran without crashing and it was not necessary to comment out any of them in the list files.

The output files from the MSU analysis code are stored in the CERN cluster in the directory /home/root_files/single_top/TopPhysDPDMaker/14.05.006/EarlyData/ The samples in the directory unweighted were processed without an event weight. The samples in the directory weighted were weighted so that the number of events corresponds to a luminosity of 100 pb-1. The weighted samples were used for this analysis.

Merge Signal and Background Files

This comparison was done for the electrons chain. Note that "Electron" is replaced by "Muon" in the file names for the muon chain.

The merging was done using the !MergeTrees.C routine located in the macros/TreeManiuplation in the MSU analysis package and the merged files are in the directory /home/root_files/single_top/TopPhysDPDMaker/14.05.006/EarlyData/merged/.

The 2 signal files were combined into a single signal file called Topology.!SingleTop.1405006.FDR2.Electron.Signal.root. The 24 background files were combined into a signal background file called Topology.!SingleTop.1405006.FDR2.Electron.Background.root. The merged files were then divided into training, validation, and yield samples, which was achieved by setting the Split flag to 1 in the config file. The events were split according to their order in the merged file. For example, the first event was categorized as training, the second as validation, the third as yield, the fourth as training, and so on. Functionality to randomly assign variables to the different categories will be added in the future.

Events with negative weights were excluded from the Training sample to retain compatibility with SPR, which cannot handle negative weights. Validation samples both with and without events with negative weights were made. The files without events having negative weights are signified by the label NoNeg.

Run TMVAnalysis over Training files

For comparison purposes, only the following variables were considered for training: HT, Jet1Pt =, =DeltaRJet1Jet2, WTransverseMass.

TMVAnalysis.py was run over the Training sample of the merged root files. The following command was used to execute the python script:
 
python TMVAnalysis.py \
   -S /home/root_files/single_top/TopPhysDPDMaker/14.05.006/EarlyData/merged/Topology.SingleTop.1405006.FDR2.Electron.Signal.Training.NoNeg.root \
   -B /home/root_files/single_top/TopPhysDPDMaker/14.05.006/EarlyData/merged/Topology.SingleTop.1405006.FDR2.Electron.Background.Training.NoNeg.root \
   -t "TopTree TopTree" \
   -o TMVAout.1405006.root \
Other methods will be used in the future. Also, 1 signal event was used for signal validation and 1 background event was used for background validation. This was achieved by the following line in TMVAnalysis.py:
factory.PrepareTrainingAndTestTree( mycutSig, mycutBkg, "NSigTrain=10000000000:NBkgTrain=100000000000::NSigTest=1:NBkgTest=1:SplitMode=Alternate:NormMode=NumEvents:!V" )
Using 0 or 1 NTest events instead of 2 events caused the program to crash. I'm not sure why using only 1 caused it to crash.

TMVAnalysis outputs the root file TMVAout.1405006.root and information in the weights directory.

The text output from running the program can be found here: AnalysisTxt1405006

Run TMVApplication over Validation files

TMVApplication.py was run over the Validation samples (with events having negative weights). Signal and background samples were run separately using the following commands.

Signal:
 python TMVApplication.py \
   -i /home/root_files/single_top/TopPhysDPDMaker/13.0.30/FDR2/merged/Topology.SingleTop.13030.FDR2.Electron.Signal.Validation.root \
   -o Signal.root 

Background:
 python TMVApplication.py \
   -i /home/root_files/single_top/TopPhysDPDMaker/13.0.30/FDR2/merged/Topology.SingleTop.13030.FDR2.Electron.Background.Validation.root \
   -o Background.root 

Note that the number of bins in the classifier outputs is 50. This is set by nbin = 50.

Calculate Significance

Significance.py was run in order to calculate the significance. For now, the significance was taken as Signal/sqrt(Background). A more accurate, and complicated, calculation of the significance will be performed in the future. Events were weighted by a factor of 3 to account for the splitting into training, validation, and yield samples.

The classifier output distributions are shown below for signal and background.
BDT.png

The significance was calculated for different cuts on the classifier output. This was done in two ways, by cutting as you move right across the values on x-axis and by cutting as you move left across the values on the x-axis. Both are shown below.
significanceBDT.Hist.Right.png significanceBDT.Hist.Left.png

Comparisons with Jenny


compare.png

-- PatRyan - 03 Mar 2009
Edit | Attach | Print version | History: r13 | r4 < r3 < r2 < r1 | Backlinks | View wiki text | Edit WikiText | More topic actions...
Topic revision: r2 - 04 Mar 2009, PatRyan
 

This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback