Mr. Pritam Palit

DQM tool / Tracking data/MC comaprison for Run2 :  Latest Data/MC Campaigns (Done by ppalit ) : http://sarkar.web.cern.ch/sarkar/datamc/ Past Data/MC Campaigns ( Done by kmondal & ppalit )   : http://kmondal.web.cern.ch/kmondal/datamc/datamc.html https://twiki.cern.ch/twiki/bin/viewauth/CMS/DQMContacts#Tracking Twiki page : https://twiki.cern.ch/twiki/bin/viewauth/CMS/TkDataMCTool Previous AN : CMS AN-2016/056 -- Tool to compare track properties between Data and Monte-Carlo events Good lumi json files : https://cms-service-dqm.web.cern.ch/cms-service-dqm/CAF/certification/ Useful commands :  1. to get dataset :  dasgoclient --query="file dataset=/ZeroBias/Run2018A-PromptReco-v1/AOD" | grep 316/060 > filelist.txt 2. to initialize voms : voms-proxy-init --voms cms --valid 192:00 https://das.readthedocs.io/en/latest/das_queries.html https://twiki.cern.ch/twiki/bin/view/CMSPublic/Rucio https://twiki.cern.ch/twiki/bin/view/CMS/PhedexUserDocsSubscribeData Validation for Legacy2016 (Strip APV gain):  Link to Tracking POG talks (given by ppalit) : 26/11/19 - https://indico.cern.ch/event/841670/?showDate=all&showSession=6#42-datamc-comparison-for-ultra 25/02/20 - https://indico.cern.ch/event/879468/?showDate=all&showSession=6#49-status-report-on-2016-ul-va PPD Meetings (given by ppalit) : 28/11/19 - https://indico.cern.ch/event/862282/ 27/02/20 - https://indico.cern.ch/event/891420/#13-tracker-for-legacy-2016 Validation for UL2017 : Link to Tracking POG talks (given by ppalit) : 10/10/18 - https://indico.cern.ch/event/750053/#33-datamc-comparisons-in-2018 26/06/19 - https://indico.cern.ch/event/829858/ 02/07/19 - https://indico.cern.ch/event/808407/#24-datamc-comparison-for-ultra 15/07/19 - https://indico.cern.ch/event/834791/ 16/07/19 - https://indico.cern.ch/event/808408/ PPD meeting (given by ppalit) : 18/07/19 - https://indico.cern.ch/event/834609/ Validation for UL2018 :  Twiki : https://twiki.cern.ch/twiki/bin/viewauth/CMS/HSRelvalsForUL#UL2018 Tracking POG talks (given by ppalit) : 05/11/19 - https://indico.cern.ch/event/841677/#29-data-vs-mc-comparisons-for PPD meetings (given by ppalit) : 07/11/19 - https://indico.cern.ch/event/856064/ Validation for Fall 2021 beam test : 13/12/21 - https://indico.cern.ch/event/1104176/#2-datamc-comparison-for-fall-2 14/12/21 - https://indico.cern.ch/event/1000824/#10-datamc-comparison-for-fall Final 2019 year ending Validation report at Tracker DQM meeting (given by ppalit) : https://indico.cern.ch/event/841680/ PreApproval 1 : https://indico.cern.ch/event/934824/?showDate=all&showSession=6#55-pre-approval-comparison-of PreApproval 2 : https://indico.cern.ch/event/934827/#53-comparison-of-run2-legacy-d Minutes :   https://indico.cern.ch/event/934827/sessions/356618/note/ PreApproval : https://indico.cern.ch/event/934828/#52-pre-approval-comparison-of Preapproval reprise : https://indico.cern.ch/event/992900/#5-pre-approval-comparison-of-r Talk in Alignment Meeting for Run2 Paper : https://indico.cern.ch/event/934814/#55-datamc-performance-run2-leg https://indico.cern.ch/event/992934/#b-403992-tracker-alignment-tra https://indico.cern.ch/event/992934/#sc-13-6-tracking-datamc-compar https://indico.cern.ch/event/1108971/#sc-8-1-track-chi2s (reviewer comment) https://indico.cern.ch/event/1119477/#18-trk-20-001-datamc-performan (chi2 prob investigation) https://cms.cern.ch/iCMS/analysisadmin/cadi?ancode=TRK-20-001  Alignment paper Run2 https://twiki.cern.ch/twiki/bin/viewauth/CMS/TRK-20-001 Alignment paper Twiki https://indico.cern.ch/event/1031204/ Alignment paper approval https://indico.cern.ch/event/992960/#sc-9-1-dmr-and-drnrs-for-cross DRNR check https://cds.cern.ch/record/1426576/files/LHCb-TALK-2007-031.pdf (Important material) https://indico.nbi.ku.dk/event/758/attachments/1684/2344/trackingnote.pdf CRAB TWIKI :  https://twiki.cern.ch/twiki/bin/view/CMSPublic/WorkBookCRAB3Tutorial https://twiki.cern.ch/twiki/bin/view/CMSPublic/CRAB3CheatSheet https://twiki.cern.ch/twiki/bin/view/CMSPublic/CRAB3ConfigurationFile#CRAB_configuration_parameters https://twiki.cern.ch/twiki/bin/view/CMSPublic/CRAB3Commands#crab_checkwrite https://root-forum.cern.ch/t/thstack-what-is-the-correct-way-to-set-the-y-axis-limits/41851/16 Useful documentations for Condor :  https://indico.cern.ch/event/635217/attachments/1458551/2252370/HTCondor-Presentation.pdf https://twiki.cern.ch/twiki/bin/view/CMSPublic/CompOpsGlideinWMSCondorCommands Useful codes & docs for Tracker :  https://github.com/cms-sw/cmssw/blob/master/DataFormats/TrackReco/interface/TrackBase.h https://github.com/cms-sw/cmssw/blob/master/DataFormats/TrackReco/interface/HitPattern.h https://twiki.cern.ch/twiki/bin/view/CMSPublic/WorkBookTrackAnalysis https://hepweb.ucsd.edu/~bmangano/CMS_talks/ByBoris/TrackingAtFirstPhysicsWorkshop.11-10-2007.pdf  (description of lost hits) Useful docs for Tracker parameters associated to the 5D curvilinear covariance matrix :   1. CMS Note 2006/001 2. P. Billoir and S. Qian, Fast vertex fitting with a local parametrization of track DiHiggs to bbZZ to bb4l Analysis for Run2 :  Twiki page : https://twiki.cern.ch/twiki/bin/viewauth/CMS/HiggsZZ4l2017 (Old one, not used now) Twiki page : https://twiki.cern.ch/twiki/bin/viewauth/CMS/HiggsZZ4lRunIILegacy (Latest) Twiki page about the variables : https://twiki.cern.ch/twiki/bin/viewauth/CMS/HZZ4lnTupleDescription Pre-approval of non-reso : https://indico.cern.ch/event/904971/contributions/3859662/attachments/2035786/3415624/Pre_approval_bb4l_Taliercio.pdf Approval of Non-Resonant : https://indico.cern.ch/event/938597/timetable/#8-approval-hig-20-004-search-f HZZ4l : run2 : https://indico.cern.ch/event/801335/contributions/3351399/attachments/1810251/2961425/HIG19001_ApprovalTalk_Sculac.pdf FR (Talk by Alessandra for non-reso) : https://indico.cern.ch/event/890827/contributions/3777208/attachments/1999630/3337527/HHbb4l_update.pdf Talk by Angela : https://indico.cern.ch/event/873817/contributions/3702222/attachments/1968996/3274847/HH_14Jan_bb4l.pdf https://indico.cern.ch/event/963616/#b-396569-hh-meeting  (non-reso signal modelling) https://indico.cern.ch/event/1053529/contributions/4500508/attachments/2299257/3910740/270821_HZZ_ULUpdate.pdf (EOY vs UL comp.) Talks : https://indico.cern.ch/event/922772/#21-bb-zz4l (Talk given by Ilirjan) https://indico.cern.ch/event/1071732/?showDate=all&showSession=64#168-tools-for-resonant-and-bsm (Xanda) Important Talks :   https://indico.cern.ch/event/788747/?showDate=all&showSession=7 https://indico.cern.ch/event/850507/?showDate=2019-10-22&showSession=35 https://indico.cern.ch/event/867116/#b-356819-hh-working-meeting https://indico.cern.ch/event/577649/#b-229590-higgs-combine-tool-mi Talks : https://indico.cern.ch/event/969504/#24-hextended Materials : https://indico.cern.ch/event/904969/#b-370973-higgs-meeting-off-wee https://indico.cern.ch/event/943919/#b-385212-extended-higgs-sector https://cms-analysis.github.io/HiggsAnalysis-CombinedLimit/part2/settinguptheanalysis/ https://indico.cern.ch/event/732971/contributions/3022864/attachments/1658765/2656595/180530_egamma.pdf https://twiki.cern.ch/twiki/bin/viewauth/CMS/BTagShapeCalibration Useful Commands for getting the difference in event yield :  grep 'Format=' 4mu_orig.txt | awk -F= '{print $NF}' > 4mu.txt  grep -B 1 'Event Candidate:4mu' all.txt | grep -v '--' | grep -v Even > 4mu.txt perl -w diff.pl nicola/4mu.txt suvankar/4mu.txt > diff_4mu.txt awk '{print $NF}' diff_4e_new_v1.txt | awk -F: '{print "eventID", $1,$2,$3}' H/Z to gamma & J/Psi ( J/Psi -> mu mu ) Analysis for Run2:  Reference :  http://cms-results.web.cern.ch/cms-results/public-results/publications/SMP-17-012/ https://link.springer.com/content/pdf/10.1140%2Fepjc%2Fs10052-019-6562-5.pdf https://twiki.cern.ch/twiki/bin/view/CMS/SMP17012ReviewTwiki http://cds.cern.ch/record/2624882 https://indico.cern.ch/event/1051224/contributions/4534936/attachments/2337533/3985575/AdeWit_PHYstat_2021.pdf Talk : https://indico.cern.ch/event/950509/#2-hz-jpsi-gamma https://indico.cern.ch/event/950510/#6-hz-jpsi-gamma  by Alberto Zucchetta https://indico.cern.ch/event/988475/#3-hz-jpsi-gamma-update by Rocco Ardino https://indico.cern.ch/event/993294/ by Rocco https://indico.cern.ch/event/1069310/#3-h-jpsi-gamma https://indico.cern.ch/event/993300/ (Y+G : important) Materials : https://github.com/sroychow/nanoAOD-tools/tree/zjpsi/python/postprocessing https://cms-analysis.github.io/HiggsAnalysis-CombinedLimit/part3/nonstandard/#discrete-profiling https://arxiv.org/pdf/1408.6865.pdf L1 TrackTrigger for Phase2 Upgrade of CMS:  Main doc : CMS DN-2014/002 -- Use of tracking in the CMS L1 trigger for the phase-2 upgrade Useful docs : https://indico.cern.ch/event/293354/contributions/672340/attachments/549122/756773/skinnari_WIT2014.pdf Talk in India-CMS friday meeting : https://indico.cern.ch/event/743277/ Talks (given by Suchandra Dutta):  https://indico.cern.ch/event/792992/ https://indico.cern.ch/event/803630/ https://indico.cern.ch/event/807402/ https://indico.cern.ch/event/817116/ https://indico.cern.ch/event/827500/ https://indico.cern.ch/event/852233/ https://indico.cern.ch/event/854469/   (important for documentation - new dEta-dPhi matching) https://indico.cern.ch/event/980760/ updates of present phase 1 and phase 2 e-gamma https://indico.cern.ch/event/995146/ L1 track quality by ML ( https://pypi.org/project/ntupledicts/ ) ML4DQM-DC on behalf of Tracker for 2017-18 data: Materials : https://twiki.cern.ch/twiki/bin/viewauth/CMS/ML4DQM https://gitlab.cern.ch/fiori/sql_to_dataframe https://github.com/mniedzie/ML4DQM-DC_SharedTools https://github.com/mniedzie/ML4DQM-DC_SharedTools/tree/master/DatasetCrafting https://indico.cern.ch/event/920855/contributions/3905376/attachments/2060058/3455251/CMSWeekJune_ML4DC.pdf https://indico.cern.ch/event/947799/ https://indico.cern.ch/event/938608/ https://indico.cern.ch/event/921028/#2-labeled-data-generation-for https://twiki.cern.ch/twiki/bin/viewauth/CMS/PPDOpenTasksDQMDC https://indico.cern.ch/event/977433/contributions/4117464/attachments/2147350/3619764/ml4dqm_201120.pdf  (by Luka) https://indico.cern.ch/event/1103515/#23-ml4dqmdc-summary-and-plans (by Luka) Talks : https://indico.cern.ch/event/914929/ https://indico.cern.ch/event/958876/ https://indico.cern.ch/event/942593/ https://indico.cern.ch/event/934825/#60-roundtable     (Tracker DQM) https://indico.cern.ch/event/941227/#75-dqm-dc-run3-preparation    (Talk by Rosamaria in PPD workshop) https://indico.cern.ch/event/977838/ (Tk DQM ML Chat) https://indico.cern.ch/event/992861/#b-407703-tracker-dqm (Tk DQM meeting) https://indico.cern.ch/event/1030681/ (tkdqm chat) https://indico.cern.ch/event/1118026/#sc-1-4-resnet-on-pixel-2d-hist (by Vicha) Interest :  https://cms.cern/news/cms-releases-open-data-machine-learning https://github.com/scikit-hep/uproot https://towardsdatascience.com/how-does-xgboost-work-748bc75c58aa https://xgboost.readthedocs.io/en/latest/python/python_api.html#module-xgboost.sklearn https://www.analyticsvidhya.com/blog/2016/03/complete-guide-parameter-tuning-xgboost-with-codes-python/ https://towardsdatascience.com/extreme-rare-event-classification-using-autoencoders-in-keras-a565b386f098 machinelearningmastery.com/lstm-autoencoders/ https://arxiv.org/pdf/1808.08992.pdf https://indico.cern.ch/event/897064/ https://indico.cern.ch/event/920855/timetable/#b-376093-cms-plenary-cms-plena  (CMS ML group and HtoZGamma) https://indico.cern.ch/event/852553/overview (IML Workshop) https://indico.cern.ch/event/995154/ (IML) Pheno : https://indico.cern.ch/event/831669/contributions/3483740/attachments/1870947/3080396/2019_07_01_HH_bb2l2q_approval_present.pdf https://indico.cern.ch/event/831669/#1-approval-hig-18-013-search-f https://arxiv.org/pdf/1404.0102.pdf (Xanda paper) https://www.pp.rhul.ac.uk/~cowan/stat/roostats/SimpleCLs/SimpleCLs.cc https://indico.cern.ch/event/637941/contributions/2606105/attachments/1510179/2358420/limits_statistics_201708_sonneveld.pdf https://indico.cern.ch/event/126652/contributions/1343592/attachments/80222/115004/Frequentist_Limit_Recommendation.pdf Interest : https://indico.cern.ch/event/963422/ chi2 : https://sphweb.bumc.bu.edu/otlt/MPH-Modules/BS/BS704_HypothesisTesting-ChiSquare/BS704_HypothesisTesting-ChiSquare_print.html http://maxwell.ucsc.edu/~drip/133/ch4.pdf https://www.itl.nist.gov/div898/handbook/eda/section3/eda3666.htm ML interest : https://xgboost.readthedocs.io/en/latest/python/python_api.html#module-xgboost.sklearn https://github.com/dmlc/xgboost/blob/master/doc/parameter.rst https://www.analyticsvidhya.com/blog/2016/03/complete-guide-parameter-tuning-xgboost-with-codes-python/ https://towardsdatascience.com/interpretable-machine-learning-with-xgboost-9ec80d148d27 https://www.datacamp.com/community/tutorials/autoencoder-keras-tutorial https://www.geeksforgeeks.org/building-an-auto-encoder-using-keras/ https://medium.com/datadriveninvestor/deep-autoencoder-using-keras-b77cd3e8be95 https://arxiv.org/abs/1903.10709 https://www.geeksforgeeks.org/ml-classifying-data-using-an-auto-encoder/ https://arxiv.org/pdf/1808.08992.pdf https://betatim.github.io/posts/sklearn-for-TMVA-users/ https://gabrieltseng.github.io/appendix/2018-02-25-XGB.html    (decision tree tutorial) https://heartbeat.fritz.ai/feature-ranking-with-recursive-feature-elimination-3e22db639208 https://towardsdatascience.com/deep-few-shot-anomaly-detection-b33f130d1f80 https://towardsdatascience.com/deep-neural-networks-for-regression-problems-81321897ca33 https://blog.keras.io/building-autoencoders-in-keras.html L1 Trigger implementation of BstoPhiPhi : Vivado HLS General BstoPhiPhi reference : /afs/cern.ch/user/s/sarkar/workspace/public/BsToPhiPhi4K/CMSSW_10_6_0_pre4/src/AnalysisSpace/BsOffline/plugins/BsAnalysis.cc https://docs.google.com/presentation/d/1IBjyaHcklL2FlbgWk6KSQBEi-5Q8L0LffVd5Rak9jxo/edit?ts=60113941#slide=id.gc6f73a04f_0_0 Suggestion by Alex Installation https://www.xilinx.com/products/design-tools/vivado/integration/esl-design.html https://www.xilinx.com/support/documentation/sw_manuals/xilinx2020_1/ug973-vivado-release-notes-install-license.pdf Documentaion https://www.xilinx.com/support/documentation/sw_manuals/xilinx2020_2/ug902-vivado-high-level-synthesis.pdf (Though to get started I recommend reading pages 5-18, 37-65, 535-577) https://www.xilinx.com/html_docs/xilinx2018_2/sdaccel_doc/hls-pragmas-okr1504034364623.html (Pragma statement) Tutorials https://github.com/Xilinx/HLS-Tiny-Tutorials (more basic) https://github.com/Xilinx/HLS_arbitrary_Precision_Types https://github.com/Xilinx/HLx_Examples https://github.com/p2l1pfp/GlobalCorrelator/tree/master/pulsar_devkit/simple_examples/HLSIPs (by CMS people) Existing GTT HLS Framework "Our group at Colorado has put together LibHLS, a repository of HLS firmware which will go into the GTT. There was one specific block I was talking about today which had to do with selecting for specific tracks from the entire list of tracks. This TrackSelection module would be a good example or place to start when designing your own module. In many respects, the two will be similar." https://gitlab.cern.ch/GTT/LibHLS/ (LibHLS) https://gitlab.cern.ch/GTT/LibHLS/-/tree/master/Modules/TrackSelection (Track selection) https://twiki.cern.ch/twiki/bin/viewauth/CMS/HybridDataFormat (For track parameters) Invariant Mass Calculation "I mentioned today that I believe the workflow should be broken into three stages: track selection, invariant mass computation, and candidate selection or other operations. I also mentioned that there is existing VHDL code (written by Andy Rose and Sioni Summers) for doing a similar computation for stage 2. The goal of the code was to calculate the DR of PFParticles as quickly as possible. This is easily mapped from calculating DR to calculating invariant mass of tracks. I was very impressed with this module and it’s performance. Here is a presentation given by Sioni which describes the module" https://indico.cern.ch/event/827511/contributions/3466916/attachments/1862158/3060739/StreamingAssociation.pdf https://indico.cern.ch/event/995146/contributions/4182801/attachments/2172913/3668680/L1EG_1_18_20.pdf https://www.ipht.fr/Images/astImg/684/RFranceschini_2.pdf (Invairant mass) Also, see wikipedia : Invariant Mass, section-Collider experiments