{"id":13,"date":"2020-01-12T15:13:15","date_gmt":"2020-01-12T15:13:15","guid":{"rendered":"http:\/\/131.215.207.206\/?page_id=13"},"modified":"2022-09-02T04:41:57","modified_gmt":"2022-09-02T04:41:57","slug":"monitoring","status":"publish","type":"page","link":"https:\/\/tier2.hep.caltech.edu\/?page_id=13","title":{"rendered":"Monitoring"},"content":{"rendered":"\r\n<h3 class=\"wp-block-heading\" id=\"local-monitoring\">Local monitoring<\/h3>\r\n\r\n\r\n\r\n<p>On most of the T2 nodes, a service called &#8220;telegraf&#8221; is running and collecting various metrics into a time series database. Telegraf collects information on the CPU and memory usage of the machines and can also analyze log files for events. There are more detailed graphs available on sensei3 (You need to be present in cmscaltech GitHub<strong> repo users to access monitoring URLs)<\/strong>.<\/p>\r\n\r\n\r\n\r\n<p><strong>General T2 dashboards:<\/strong>\u00a0<a href=\"https:\/\/sensei3.hep.caltech.edu:3000\/d\/iQICM3dmk\/jooseps-dashboard\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/sensei3.hep.caltech.edu:3000\/d\/iQICM3dmk\/jooseps-dashboard<\/a><br \/><strong>HDFS and Transfer Services:<\/strong>\u00a0<a href=\"https:\/\/sensei3.hep.caltech.edu:3000\/d\/000000035\/hdfs-mon?refresh=5m&amp;orgId=1\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/sensei3.hep.caltech.edu:3000\/d\/000000035\/hdfs-mon?refresh=5m&amp;orgId=1<\/a><br \/><strong>Condor monitoring:\u00a0<\/strong><a href=\"https:\/\/sensei3.hep.caltech.edu:3000\/d\/jL88TdcWz\/condor?orgId=1\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/sensei3.hep.caltech.edu:3000\/d\/jL88TdcWz\/condor?orgId=1<\/a><br \/><strong>GPU Monitoring:<\/strong>\u00a0<a href=\"https:\/\/sensei3.hep.caltech.edu:3000\/d\/XNi-A4Gik\/gpus-mon?orgId=1\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/sensei3.hep.caltech.edu:3000\/d\/XNi-A4Gik\/gpus-mon?orgId=1<\/a><\/p>\r\n\r\n\r\n\r\n<h3 class=\"wp-block-heading\" id=\"cmscernside-monitoring\">CMS\/CERN-side monitoring<\/h3>\r\n\r\n\r\n\r\n<p>Every site has a number of monitors running from CMS\/CERN. Most of these require a valid grid proxy in the browser. The central entry point for these dashboards is\u00a0<a href=\"https:\/\/monit-grafana.cern.ch\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/monit-grafana.cern.ch\/<\/a><\/p>\r\n\r\n\r\n\r\n<p>Site Readiness: <a href=\"https:\/\/test-cmssst.web.cern.ch\/sitereadiness\/report.html#T2_US_Caltech\">https:\/\/test-cmssst.web.cern.ch\/sitereadiness\/report.html#T2_US_Caltech<\/a><br \/><strong>Site Availability<\/strong>:\u00a0<a href=\"http:\/\/wlcg-sam-cms.cern.ch\/templates\/ember\/#\/historicalsmry\/heatMap?profile=CMS_CRITICAL_FULL&amp;site=T2_US_Caltech&amp;time=24h&amp;view=Test%20History\" target=\"_blank\" rel=\"noreferrer noopener\">http:\/\/wlcg-sam-cms.cern.ch\/templates\/ember\/#\/historicalsmry\/heatMap?profile=CMS_CRITICAL_FULL&amp;site=T2_US_Caltech&amp;time=24h<\/a><br \/><strong>HammerCloud (HC)<\/strong>: simple end-to-end CMS jobs are automatically submitted to the site:\u00a0<a href=\"https:\/\/monit-grafana.cern.ch\/d\/cmsTMGlobal\/cms-tasks-monitoring-globalview?orgId=11\">https:\/\/monit-grafana.cern.ch\/d\/cmsTMGlobal\/cms-tasks-monitoring-globalview?from=now-24h&amp;orgId=11&amp;to=now&amp;var-user=sciaba&amp;var-site=All<\/a><br \/><strong>Global pool (glidein-WMS):\u00a0<\/strong><a href=\"https:\/\/cms-gwmsmon.cern.ch\/totalview\/T2_US_Caltech\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/cms-gwmsmon.cern.ch\/totalview\/T2_US_Caltech<\/a><br \/><strong>Phedex<\/strong>:\u00a0<a href=\"https:\/\/cmsweb.cern.ch\/phedex\/prod\/Activity::QualityPlots?graph=quality_all&amp;entity=dest&amp;src_filter=T2_US_Caltech&amp;dest_filter=.*&amp;no_mss=true&amp;period=l96h&amp;upto=&amp;.submit=Update\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/cmsweb.cern.ch\/phedex\/prod\/Activity::QualityPlots<\/a><br \/><strong>XRoot<\/strong>D: <a href=\"https:\/\/monit-grafana.cern.ch\/d\/000000422\/xrootd-transfers-30-days\">https:\/\/monit-grafana.cern.ch\/d\/000000422\/xrootd-transfers-30-days<\/a><br \/><strong>FTS dashboard<\/strong>: in case of issues with transfers:\u00a0<br \/><a href=\"https:\/\/monit-grafana.cern.ch\/d\/000000420\/fts-transfers-30-days?orgId=20&amp;from=now-7d&amp;to=now&amp;var-group_by=src_site&amp;var-vo=cms&amp;var-src_country=All&amp;var-dst_country=All&amp;var-src_site=All&amp;var-dst_site=CIT_CMS_T2&amp;var-fts_server=All\">https:\/\/monit-grafana.cern.ch\/d\/000000420\/fts-transfers-30-days<\/a><br \/><strong>CERN FTS3:<\/strong>\u00a0<a href=\"https:\/\/fts3.cern.ch:8449\/fts3\/ftsmon\/#\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/fts3.cern.ch:8449\/fts3\/ftsmon\/#\/<\/a><br \/><strong>FNAL FTS3:<\/strong>\u00a0<a href=\"https:\/\/cmsfts3.fnal.gov:8449\/fts3\/ftsmon\/#\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/cmsfts3.fnal.gov:8449\/fts3\/ftsmon\/#\/<\/a><br \/><strong>UK-RAL FTS3:<\/strong>\u00a0<a href=\"https:\/\/lcgfts3.gridpp.rl.ac.uk:8449\/fts3\/ftsmon\/#\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/lcgfts3.gridpp.rl.ac.uk:8449\/fts3\/ftsmon\/#\/<\/a><\/p>\r\n\r\n\r\n\r\n<p>&nbsp;<\/p>\r\n<div id=\"envira-gallery-wrap-195\" class=\"envira-gallery-wrap envira-gallery-theme-base envira-lightbox-theme-base\" itemscope itemtype=\"https:\/\/schema.org\/ImageGallery\"><div data-row-height=\"150\" data-gallery-theme=\"normal\" id=\"envira-gallery-195\" class=\"envira-gallery-public envira-gallery-justified-public envira-gallery-0-columns envira-clear enviratope envira-gallery-css-animations\" data-envira-columns=\"0\"><div id=\"envira-gallery-item-196\" class=\"envira-gallery-item enviratope-item envira-gallery-item-1 envira-lazy-load\" style=\"padding-left: 5px; padding-bottom: 10px; padding-right: 5px;\"  itemscope itemtype=\"https:\/\/schema.org\/ImageObject\"><div class=\"envira-gallery-item-inner\"><div class=\"envira-gallery-position-overlay  envira-gallery-top-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-top-right\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-right\"><\/div><a href=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/C47A1OEVYAAAN8P.jpg\" class=\"envira-gallery-195 envira-gallery-link\" rel=\"enviragallery195\" title=\"C47A1OEVYAAAN8P\" data-envira-caption=\"C47A1OEVYAAAN8P\" data-envira-retina=\"\" data-thumbnail=\"\"  itemprop=\"contentUrl\"><img decoding=\"async\" id=\"envira-gallery-image-196\" class=\"envira-gallery-image envira-gallery-image-1 envira-normal envira-lazy\" data-envira-index=\"1\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/C47A1OEVYAAAN8P.jpg\" data-envira-src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/C47A1OEVYAAAN8P.jpg\" data-envira-gallery-id=\"195\" data-envira-item-id=\"196\" data-envira-caption=\"C47A1OEVYAAAN8P\" alt=\"\" title=\"C47A1OEVYAAAN8P\"  itemprop=\"thumbnailUrl\" data-envira-srcset=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/C47A1OEVYAAAN8P.jpg 400w,https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/C47A1OEVYAAAN8P.jpg 2x\" data-envira-width=\"300\" data-envira-height=\"250\" srcset=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" data-safe-src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" \/><\/a><\/div><\/div><div id=\"envira-gallery-item-198\" class=\"envira-gallery-item enviratope-item envira-gallery-item-2 envira-lazy-load\" style=\"padding-left: 5px; padding-bottom: 10px; padding-right: 5px;\"  itemscope itemtype=\"https:\/\/schema.org\/ImageObject\"><div class=\"envira-gallery-item-inner\"><div class=\"envira-gallery-position-overlay  envira-gallery-top-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-top-right\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-right\"><\/div><a href=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed.jpeg\" class=\"envira-gallery-195 envira-gallery-link\" rel=\"enviragallery195\" title=\"processed\" data-envira-caption=\"processed\" data-envira-retina=\"\" data-thumbnail=\"\"  itemprop=\"contentUrl\"><img decoding=\"async\" id=\"envira-gallery-image-198\" class=\"envira-gallery-image envira-gallery-image-2 envira-normal envira-lazy\" data-envira-index=\"2\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed.jpeg\" data-envira-src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed.jpeg\" data-envira-gallery-id=\"195\" data-envira-item-id=\"198\" data-envira-caption=\"processed\" alt=\"\" title=\"processed\"  itemprop=\"thumbnailUrl\" data-envira-srcset=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed.jpeg 400w,https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed.jpeg 2x\" data-envira-width=\"300\" data-envira-height=\"200\" srcset=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" data-safe-src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" \/><\/a><\/div><\/div><div id=\"envira-gallery-item-199\" class=\"envira-gallery-item enviratope-item envira-gallery-item-3 envira-lazy-load\" style=\"padding-left: 5px; padding-bottom: 10px; padding-right: 5px;\"  itemscope itemtype=\"https:\/\/schema.org\/ImageObject\"><div class=\"envira-gallery-item-inner\"><div class=\"envira-gallery-position-overlay  envira-gallery-top-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-top-right\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-right\"><\/div><a href=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed1.jpeg\" class=\"envira-gallery-195 envira-gallery-link\" rel=\"enviragallery195\" title=\"processed1\" data-envira-caption=\"processed1\" data-envira-retina=\"\" data-thumbnail=\"\"  itemprop=\"contentUrl\"><img decoding=\"async\" id=\"envira-gallery-image-199\" class=\"envira-gallery-image envira-gallery-image-3 envira-normal envira-lazy\" data-envira-index=\"3\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed1.jpeg\" data-envira-src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed1.jpeg\" data-envira-gallery-id=\"195\" data-envira-item-id=\"199\" data-envira-caption=\"processed1\" alt=\"\" title=\"processed1\"  itemprop=\"thumbnailUrl\" data-envira-srcset=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed1.jpeg 400w,https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed1.jpeg 2x\" data-envira-width=\"300\" data-envira-height=\"200\" srcset=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" data-safe-src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" \/><\/a><\/div><\/div><div id=\"envira-gallery-item-200\" class=\"envira-gallery-item enviratope-item envira-gallery-item-4 envira-lazy-load\" style=\"padding-left: 5px; padding-bottom: 10px; padding-right: 5px;\"  itemscope itemtype=\"https:\/\/schema.org\/ImageObject\"><div class=\"envira-gallery-item-inner\"><div class=\"envira-gallery-position-overlay  envira-gallery-top-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-top-right\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-right\"><\/div><a href=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed2.jpeg\" class=\"envira-gallery-195 envira-gallery-link\" rel=\"enviragallery195\" title=\"processed2\" data-envira-caption=\"processed2\" data-envira-retina=\"\" data-thumbnail=\"\"  itemprop=\"contentUrl\"><img decoding=\"async\" id=\"envira-gallery-image-200\" class=\"envira-gallery-image envira-gallery-image-4 envira-normal envira-lazy\" data-envira-index=\"4\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed2.jpeg\" data-envira-src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed2.jpeg\" data-envira-gallery-id=\"195\" data-envira-item-id=\"200\" data-envira-caption=\"processed2\" alt=\"\" title=\"processed2\"  itemprop=\"thumbnailUrl\" data-envira-srcset=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed2.jpeg 400w,https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed2.jpeg 2x\" data-envira-width=\"201\" data-envira-height=\"300\" srcset=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" data-safe-src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" \/><\/a><\/div><\/div><div id=\"envira-gallery-item-201\" class=\"envira-gallery-item enviratope-item envira-gallery-item-5 envira-lazy-load\" style=\"padding-left: 5px; padding-bottom: 10px; padding-right: 5px;\"  itemscope itemtype=\"https:\/\/schema.org\/ImageObject\"><div class=\"envira-gallery-item-inner\"><div class=\"envira-gallery-position-overlay  envira-gallery-top-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-top-right\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-right\"><\/div><a href=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed3.jpeg\" class=\"envira-gallery-195 envira-gallery-link\" rel=\"enviragallery195\" title=\"processed3\" data-envira-caption=\"processed3\" data-envira-retina=\"\" data-thumbnail=\"\"  itemprop=\"contentUrl\"><img decoding=\"async\" id=\"envira-gallery-image-201\" class=\"envira-gallery-image envira-gallery-image-5 envira-normal envira-lazy\" data-envira-index=\"5\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed3.jpeg\" data-envira-src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed3.jpeg\" data-envira-gallery-id=\"195\" data-envira-item-id=\"201\" data-envira-caption=\"processed3\" alt=\"\" title=\"processed3\"  itemprop=\"thumbnailUrl\" data-envira-srcset=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed3.jpeg 400w,https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed3.jpeg 2x\" data-envira-width=\"300\" data-envira-height=\"200\" srcset=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" data-safe-src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" \/><\/a><\/div><\/div><div id=\"envira-gallery-item-202\" class=\"envira-gallery-item enviratope-item envira-gallery-item-6 envira-lazy-load\" style=\"padding-left: 5px; padding-bottom: 10px; padding-right: 5px;\"  itemscope itemtype=\"https:\/\/schema.org\/ImageObject\"><div class=\"envira-gallery-item-inner\"><div class=\"envira-gallery-position-overlay  envira-gallery-top-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-top-right\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-right\"><\/div><a href=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed4.jpeg\" class=\"envira-gallery-195 envira-gallery-link\" rel=\"enviragallery195\" title=\"processed4\" data-envira-caption=\"processed4\" data-envira-retina=\"\" data-thumbnail=\"\"  itemprop=\"contentUrl\"><img decoding=\"async\" id=\"envira-gallery-image-202\" class=\"envira-gallery-image envira-gallery-image-6 envira-normal envira-lazy\" data-envira-index=\"6\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed4.jpeg\" data-envira-src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed4.jpeg\" data-envira-gallery-id=\"195\" data-envira-item-id=\"202\" data-envira-caption=\"processed4\" alt=\"\" title=\"processed4\"  itemprop=\"thumbnailUrl\" data-envira-srcset=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed4.jpeg 400w,https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed4.jpeg 2x\" data-envira-width=\"300\" data-envira-height=\"200\" srcset=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" data-safe-src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" \/><\/a><\/div><\/div><div id=\"envira-gallery-item-203\" class=\"envira-gallery-item enviratope-item envira-gallery-item-7 envira-lazy-load\" style=\"padding-left: 5px; padding-bottom: 10px; padding-right: 5px;\"  itemscope itemtype=\"https:\/\/schema.org\/ImageObject\"><div class=\"envira-gallery-item-inner\"><div class=\"envira-gallery-position-overlay  envira-gallery-top-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-top-right\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-right\"><\/div><a href=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed5.jpeg\" class=\"envira-gallery-195 envira-gallery-link\" rel=\"enviragallery195\" title=\"processed5\" data-envira-caption=\"processed5\" data-envira-retina=\"\" data-thumbnail=\"\"  itemprop=\"contentUrl\"><img decoding=\"async\" id=\"envira-gallery-image-203\" class=\"envira-gallery-image envira-gallery-image-7 envira-normal envira-lazy\" data-envira-index=\"7\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed5.jpeg\" data-envira-src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed5.jpeg\" data-envira-gallery-id=\"195\" data-envira-item-id=\"203\" data-envira-caption=\"processed5\" alt=\"\" title=\"processed5\"  itemprop=\"thumbnailUrl\" data-envira-srcset=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed5.jpeg 400w,https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed5.jpeg 2x\" data-envira-width=\"300\" data-envira-height=\"200\" srcset=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" data-safe-src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" \/><\/a><\/div><\/div><div id=\"envira-gallery-item-204\" class=\"envira-gallery-item enviratope-item envira-gallery-item-8 envira-lazy-load\" style=\"padding-left: 5px; padding-bottom: 10px; padding-right: 5px;\"  itemscope itemtype=\"https:\/\/schema.org\/ImageObject\"><div class=\"envira-gallery-item-inner\"><div class=\"envira-gallery-position-overlay  envira-gallery-top-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-top-right\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-right\"><\/div><a href=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed6.jpeg\" class=\"envira-gallery-195 envira-gallery-link\" rel=\"enviragallery195\" title=\"processed6\" data-envira-caption=\"processed6\" data-envira-retina=\"\" data-thumbnail=\"\"  itemprop=\"contentUrl\"><img decoding=\"async\" id=\"envira-gallery-image-204\" class=\"envira-gallery-image envira-gallery-image-8 envira-normal envira-lazy\" data-envira-index=\"8\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed6.jpeg\" data-envira-src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed6.jpeg\" data-envira-gallery-id=\"195\" data-envira-item-id=\"204\" data-envira-caption=\"processed6\" alt=\"\" title=\"processed6\"  itemprop=\"thumbnailUrl\" data-envira-srcset=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed6.jpeg 400w,https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed6.jpeg 2x\" data-envira-width=\"300\" data-envira-height=\"200\" srcset=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" data-safe-src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" \/><\/a><\/div><\/div><div id=\"envira-gallery-item-205\" class=\"envira-gallery-item enviratope-item envira-gallery-item-9 envira-lazy-load\" style=\"padding-left: 5px; padding-bottom: 10px; padding-right: 5px;\"  itemscope itemtype=\"https:\/\/schema.org\/ImageObject\"><div class=\"envira-gallery-item-inner\"><div class=\"envira-gallery-position-overlay  envira-gallery-top-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-top-right\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-right\"><\/div><a href=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed7.jpeg\" class=\"envira-gallery-195 envira-gallery-link\" rel=\"enviragallery195\" title=\"processed7\" data-envira-caption=\"processed7\" data-envira-retina=\"\" data-thumbnail=\"\"  itemprop=\"contentUrl\"><img decoding=\"async\" id=\"envira-gallery-image-205\" class=\"envira-gallery-image envira-gallery-image-9 envira-normal envira-lazy\" data-envira-index=\"9\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed7.jpeg\" data-envira-src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed7.jpeg\" data-envira-gallery-id=\"195\" data-envira-item-id=\"205\" data-envira-caption=\"processed7\" alt=\"\" title=\"processed7\"  itemprop=\"thumbnailUrl\" data-envira-srcset=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed7.jpeg 400w,https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed7.jpeg 2x\" data-envira-width=\"300\" data-envira-height=\"200\" srcset=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" data-safe-src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" \/><\/a><\/div><\/div><div id=\"envira-gallery-item-206\" class=\"envira-gallery-item enviratope-item envira-gallery-item-10 envira-lazy-load\" style=\"padding-left: 5px; padding-bottom: 10px; padding-right: 5px;\"  itemscope itemtype=\"https:\/\/schema.org\/ImageObject\"><div class=\"envira-gallery-item-inner\"><div class=\"envira-gallery-position-overlay  envira-gallery-top-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-top-right\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-right\"><\/div><a href=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed8.jpeg\" class=\"envira-gallery-195 envira-gallery-link\" rel=\"enviragallery195\" title=\"processed8\" data-envira-caption=\"processed8\" data-envira-retina=\"\" data-thumbnail=\"\"  itemprop=\"contentUrl\"><img decoding=\"async\" id=\"envira-gallery-image-206\" class=\"envira-gallery-image envira-gallery-image-10 envira-normal envira-lazy\" data-envira-index=\"10\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed8.jpeg\" data-envira-src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed8.jpeg\" data-envira-gallery-id=\"195\" data-envira-item-id=\"206\" data-envira-caption=\"processed8\" alt=\"\" title=\"processed8\"  itemprop=\"thumbnailUrl\" data-envira-srcset=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed8.jpeg 400w,https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed8.jpeg 2x\" data-envira-width=\"300\" data-envira-height=\"200\" srcset=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" data-safe-src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" \/><\/a><\/div><\/div><div id=\"envira-gallery-item-207\" class=\"envira-gallery-item enviratope-item envira-gallery-item-11 envira-lazy-load\" style=\"padding-left: 5px; padding-bottom: 10px; padding-right: 5px;\"  itemscope itemtype=\"https:\/\/schema.org\/ImageObject\"><div class=\"envira-gallery-item-inner\"><div class=\"envira-gallery-position-overlay  envira-gallery-top-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-top-right\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-right\"><\/div><a href=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed9.jpeg\" class=\"envira-gallery-195 envira-gallery-link\" rel=\"enviragallery195\" title=\"processed9\" data-envira-caption=\"processed9\" data-envira-retina=\"\" data-thumbnail=\"\"  itemprop=\"contentUrl\"><img decoding=\"async\" id=\"envira-gallery-image-207\" class=\"envira-gallery-image envira-gallery-image-11 envira-normal envira-lazy\" data-envira-index=\"11\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed9.jpeg\" data-envira-src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed9.jpeg\" data-envira-gallery-id=\"195\" data-envira-item-id=\"207\" data-envira-caption=\"processed9\" alt=\"\" title=\"processed9\"  itemprop=\"thumbnailUrl\" data-envira-srcset=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed9.jpeg 400w,https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed9.jpeg 2x\" data-envira-width=\"300\" data-envira-height=\"200\" srcset=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" data-safe-src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" \/><\/a><\/div><\/div><div id=\"envira-gallery-item-208\" class=\"envira-gallery-item enviratope-item envira-gallery-item-12 envira-lazy-load\" style=\"padding-left: 5px; padding-bottom: 10px; padding-right: 5px;\"  itemscope itemtype=\"https:\/\/schema.org\/ImageObject\"><div class=\"envira-gallery-item-inner\"><div class=\"envira-gallery-position-overlay  envira-gallery-top-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-top-right\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-left\"><\/div><div class=\"envira-gallery-position-overlay  envira-gallery-bottom-right\"><\/div><a href=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed10.jpeg\" class=\"envira-gallery-195 envira-gallery-link\" rel=\"enviragallery195\" title=\"processed10\" data-envira-caption=\"processed10\" data-envira-retina=\"\" data-thumbnail=\"\"  itemprop=\"contentUrl\"><img decoding=\"async\" id=\"envira-gallery-image-208\" class=\"envira-gallery-image envira-gallery-image-12 envira-normal envira-lazy\" data-envira-index=\"12\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed10.jpeg\" data-envira-src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed10.jpeg\" data-envira-gallery-id=\"195\" data-envira-item-id=\"208\" data-envira-caption=\"processed10\" alt=\"\" title=\"processed10\"  itemprop=\"thumbnailUrl\" data-envira-srcset=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed10.jpeg 400w,https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed10.jpeg 2x\" data-envira-width=\"300\" data-envira-height=\"200\" srcset=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" data-safe-src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAP\/\/\/\/\/\/\/yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" \/><\/a><\/div><\/div><\/div><\/div><noscript><img decoding=\"async\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/C47A1OEVYAAAN8P.jpg\" alt=\"\" \/><img decoding=\"async\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed.jpeg\" alt=\"\" \/><img decoding=\"async\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed1.jpeg\" alt=\"\" \/><img decoding=\"async\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed2.jpeg\" alt=\"\" \/><img decoding=\"async\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed3.jpeg\" alt=\"\" \/><img decoding=\"async\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed4.jpeg\" alt=\"\" \/><img decoding=\"async\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed5.jpeg\" alt=\"\" \/><img decoding=\"async\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed6.jpeg\" alt=\"\" \/><img decoding=\"async\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed7.jpeg\" alt=\"\" \/><img decoding=\"async\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed8.jpeg\" alt=\"\" \/><img decoding=\"async\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed9.jpeg\" alt=\"\" \/><img decoding=\"async\" src=\"https:\/\/tier2.hep.caltech.edu\/wp-content\/uploads\/2022\/09\/processed10.jpeg\" alt=\"\" \/><\/noscript>\r\n","protected":false},"excerpt":{"rendered":"<p>Local monitoring On most of the T2 nodes, a service called &#8220;telegraf&#8221; is running and collecting various metrics into a time series database. Telegraf collects information on the CPU and memory usage of the machines and can also analyze log files for events. There are more detailed graphs available on sensei3 (You need to be [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"_links":{"self":[{"href":"https:\/\/tier2.hep.caltech.edu\/index.php?rest_route=\/wp\/v2\/pages\/13"}],"collection":[{"href":"https:\/\/tier2.hep.caltech.edu\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/tier2.hep.caltech.edu\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/tier2.hep.caltech.edu\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/tier2.hep.caltech.edu\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=13"}],"version-history":[{"count":6,"href":"https:\/\/tier2.hep.caltech.edu\/index.php?rest_route=\/wp\/v2\/pages\/13\/revisions"}],"predecessor-version":[{"id":197,"href":"https:\/\/tier2.hep.caltech.edu\/index.php?rest_route=\/wp\/v2\/pages\/13\/revisions\/197"}],"wp:attachment":[{"href":"https:\/\/tier2.hep.caltech.edu\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=13"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}