Difference: LogBookTCR (r6 vs. r5)

r6 - 18 Sep 2017 - 21:22 - TomasCap r5 - 18 Sep 2017 - 18:25 - TomasCap

-- TomasCap - 25 Aug 2017 This is my logbook

-- TomasCap - 25 Aug 2017 This is my logbook

August

Week 1

• Check in at MSU office.
• Get the Spartan card. It helps me to access to building and office.
• AERIE installation (in my personal computer) was solved.
• First presentation: What things I did and the future work.
• Check in at MSU office.
• Get the Spartan card. It helps me to access to building and office.
• AERIE installation (in my personal computer) was solved.
• First presentation: What things I did and the future work.

Week 2

• A network with 15 inputs was trained for distinguishing from gamma to hadrons.
• Choose the best variables and use them as input (variable importance analysis).
• Create a module that computes the network's output.
• A network with 15 inputs was trained for distinguishing from gamma to hadrons.
• Choose the best variables and use them as input (variable importance analysis).
• Create a module that computes the network's output.

Goals from August, 14th to August 25th (Week 3 & 4)

1. Create a Foswiki
2. Made an analysis with the most important variable (ranking).
3. Choose the most significant variables and use them as inputs to the network.
4. Make a Crab maps with the networks trained
5. Train a network using real data as Background and MC as Signal. Compare the results
1. Create a Foswiki
2. Made an analysis with the most important variable (ranking).
3. Choose the most significant variables and use them as inputs to the network.
4. Make a Crab maps with the networks trained
5. Train a network using real data as Background and MC as Signal. Compare the results

Week 4

• A network was trained with all variables of HAWC data stream in order to obtain the ranking of these variables (MC were used).
• The best variables were chosen and fed as inputs to the networks.
• Create a Crab Map with the new networks trained.
• Obtain the ranking (variable importance) using real data.
• A network was trained with all variables of HAWC data stream in order to obtain the ranking of these variables (MC were used).
• The best variables were chosen and fed as inputs to the networks.
• Create a Crab Map with the new networks trained.
• Obtain the ranking (variable importance) using real data.

Goal from August 28th to September 1st

1. Work on a new version of disMax.
3. Train a BDT with 15 features.
4. Check why don't have good results when real data are used.
1. Work on a new version of disMax.
3. Train a BDT with 15 features.
4. Check why don't have good results when real data are used.

Week 5

• I've read the Chapter 11 "Decision Tree" in order to understand how to work it.
• A BDT was trained with Real data as BKG and MC as Signal. But It doesn't answer that I've expected.
• A BDT was trained with only MC as BKG and Signal. It has a good performance in the bins 4,5,6.
• Presentation of the MSU meeting (Tuesday, September 5th,2017): The first result using BDT.
• I've read the Chapter 11 "Decision Tree" in order to understand how to work it.
• A BDT was trained with Real data as BKG and MC as Signal. But It doesn't answer that I've expected.
• A BDT was trained with only MC as BKG and Signal. It has a good performance in the bins 4,5,6.
• Presentation of the MSU meeting (Tuesday, September 5th,2017): The first result using BDT.

September

Goal from September 5th to 8th

• Make the plot of Energy Vs Q factor of BDT and NN.
• Repeat the analysis of variable importance but now with the BDT.
• Train other BDT.
• Make the plot of Energy Vs Q factor of BDT and NN.
• Repeat the analysis of variable importance but now with the BDT.
• Train other BDT.

Week 1

• Explain how to training and verification
• Make an analysis between Training data vs. Verification data.
• Create a code that can make Crab map using different months of the year.
• Using the NN that was trained with MC data, Significance maps were done with data of 2015 and 2017.
• Explain how to training and verification
• Make a faster analysis between Training data vs. Verification data.
• With the NN trained with MC data, Significance maps were done with data of 2015 and 2017. *

Goal from September 11th to 15th

IAttachmentActionSizeDateWhoComment
pdf20170818_ChooseFeatures.pdfmanage 2570.3 K 25 Aug 2017 - 22:06TomasCap
pdf20170905BDT.pdfmanage 3085.9 K 05 Sep 2017 - 15:50TomasCap The first results using Boost Decision Tree
pdfBringingToTheTable.pdfmanage 1100.3 K 25 Aug 2017 - 21:31TomasCap What things I did about gamma/hadron separation using neural network

• Compare the variable between Training data set vs. Testing data set in oder to look for which variable use as input of the machine learning.
• Train a NN and BDT, using MC as signal and real data as Bkg.

Week2

• Crab maps in the Bin 0 using NN (with 15 inputs) that was trained with MC data.
• A NN and simple BDT was trained with 10 inputs: Compactness, rec.PINCness, rec.planeChi2, rec.SFCFChi2, rec.logNPE, rec.CxPE40SPTime, rec.LDFAge, rec.LDFAmp, rec.LDFChi2 and rec.disMax
• Make some Crab maps to check if the NN or BDT has a good performance.
• In the comparation of Training and verification data. On one hand we compara Bkg vs. Bkg, we need to exclude the data around the crab nebula, and the other hand, the data around the crab nebula are used to compare with signal (MC)

Goal from September 18 to 22

• Doing an analysis in order to choose which variables will be used to G/H sep
• Train a NN and BDT.

Week 3

• Slide of the compare Training and verification data. Result of a NN and BDT trained: 09/19/2017

IAttachmentActionSizeDateWhoComment
pdf20170818_ChooseFeatures.pdfmanage 2570.3 K 25 Aug 2017 - 22:06TomasCap
pdf20170905BDT.pdfmanage 3085.9 K 05 Sep 2017 - 15:50TomasCap The first results using Boost Decision Tree
pdf20170912_MapsBin0And1.pdfmanage 1811.7 K 18 Sep 2017 - 21:08TomasCap Maps of the Crab nebula in Bin 0 and 1. Compare the maps of Standartd cut vs NN that was trained using MC data
pdfBringingToTheTable.pdfmanage 1100.3 K 25 Aug 2017 - 21:31TomasCap What things I did about gamma/hadron separation using neural network
r6 - 18 Sep 2017 - 21:22 - TomasCap r5 - 18 Sep 2017 - 18:25 - TomasCap

View topic | View difference interwoven |  | More topic actions

Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback