You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 07:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot8.osadl.org (updated Mon Dec 01, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2652799892841,26cyclictest0-21swapper/119:10:041
2652699455399,19cyclictest32600-21irqstats19:25:160
263062425400,16sleep00-21swapper/019:08:090
2652799403369,16cyclictest0-21swapper/119:25:161
1192621010,16sleep12652799cyclictest00:10:091
2652699855,64cyclictest0-21swapper/019:45:010
26526998263,14cyclictest0-21swapper/022:23:590
216899790,4rtkit-daemon2167-21rtkit-daemon00:31:511
2652699775,66cyclictest0-21swapper/023:48:480
2652699775,66cyclictest0-21swapper/023:19:550
2652699763,7cyclictest1819-21ssh22:55:020
2652699745,63cyclictest0-21swapper/022:12:540
234432740,5sleep041ktimersoftd/000:30:150
2652699735,62cyclictest0-21swapper/022:26:270
2652699735,62cyclictest0-21swapper/021:18:500
2652699735,62cyclictest0-21swapper/021:18:500
2652699733,7cyclictest19645-21munin-node20:20:130
2652699733,7cyclictest11598-21munin-node22:15:170
26526997325,42cyclictest78950irq/46-eth0-tx-00:00:240
2652699729,55cyclictest0-21swapper/021:35:210
2652699728,58cyclictest0-21swapper/021:30:150
2652699725,61cyclictest0-21swapper/022:30:290
2652699724,61cyclictest0-21swapper/023:06:020
2652699723,62cyclictest6011-21runrttasks23:56:550
26526997221,45cyclictest78950irq/46-eth0-tx-22:58:510
2652699722,7cyclictest25102-21sh21:41:420
26526997216,50cyclictest78950irq/46-eth0-tx-23:24:370
2616927232,29sleep10-21swapper/119:06:461
2652699716,59cyclictest0-21swapper/023:13:430
2652699715,60cyclictest0-21swapper/023:51:390
2652699715,60cyclictest0-21swapper/023:00:530
2652699714,41cyclictest28513-21munin-run20:45:010
2652699713,7cyclictest27856-21ssh00:36:330
2652699713,7cyclictest15349-21ssh21:25:260
26526997127,38cyclictest78950irq/46-eth0-tx-23:25:270
26526997120,36cyclictest78950irq/46-eth0-tx-23:34:500
2652699712,7cyclictest430-21ssh21:55:260
26526997119,46cyclictest78950irq/46-eth0-tx-23:36:500
2652699705,58cyclictest0-21swapper/000:26:380
2652699704,8cyclictest0-21swapper/021:47:560
2652699704,8cyclictest0-21swapper/020:13:530
2652699703,7cyclictest13608-21yum20:00:270
2652699702,7cyclictest3684-21ssh22:00:260
26526997018,39cyclictest78950irq/46-eth0-tx-00:08:370
26526997018,32cyclictest5248-21sh21:10:010
26526997017,47cyclictest78950irq/46-eth0-tx-22:46:220
2652699694,8cyclictest0-21swapper/019:21:220
2652699693,7cyclictest18829-21ssh00:20:310
2652699693,60cyclictest10463-21idleruntime-cro19:54:590
2652699692,6cyclictest5604-21cut19:40:170
26526996913,50cyclictest78950irq/46-eth0-tx-22:06:470
26526996910,34cyclictest2296-21iostat21:00:180
2652799685,42cyclictest0-21swapper/123:16:591
2652699685,55cyclictest0-21swapper/020:55:400
2652699684,8cyclictest0-21swapper/019:11:220
2652699683,7cyclictest26989-21ssh22:40:400
2652699683,56cyclictest28662-21munin-node20:45:200
2652699675,56cyclictest0-21swapper/000:15:010
2652699674,43cyclictest1427-21runrttasks22:35:200
2652699673,7cyclictest30840-21ssh21:51:380
2652699673,7cyclictest13065-21ssh21:21:420
2652699673,57cyclictest4438-21kworker/0:100:14:470
2652699672,59cyclictest29724-21ssh23:42:060
216899670,3rtkit-daemon2167-21rtkit-daemon23:47:151
2652699665,55cyclictest0-21swapper/020:19:540
2652699652,7cyclictest6985-21ssh21:11:290
2652799644,53cyclictest0-21swapper/119:38:591
2652699646,51cyclictest0-21swapper/019:35:130
2652699643,52cyclictest23248-21munin-node20:30:200
2652699642,7cyclictest22003-21latency20:25:200
2652699642,6cyclictest32115-21latency_hist20:55:020
2652699636,52cyclictest0-21swapper/019:19:230
2652699633,49cyclictest1554-21munin-node19:30:160
26526996316,40cyclictest26702-21crond20:40:010
2652699623,8cyclictest14230-21munin-node20:05:240
26526996122,34cyclictest78950irq/46-eth0-tx-19:56:300
2652799595,36cyclictest0-21swapper/120:06:591
2652799595,34cyclictest0-21swapper/122:32:581
2652799575,37cyclictest0-21swapper/120:54:591
2652799575,34cyclictest0-21swapper/122:50:001
26527995722,28cyclictest20355-21ssh21:35:001
216899570,5rtkit-daemon2167-21rtkit-daemon23:22:341
2652799565,35cyclictest0-21swapper/122:59:591
26527995621,29cyclictest20992-21irqstats00:25:181
26527995621,28cyclictest30068-21proc_pri21:50:231
26527995614,36cyclictest0-21swapper/122:24:491
216899560,4rtkit-daemon2167-21rtkit-daemon23:52:451
216899560,4rtkit-daemon2167-21rtkit-daemon22:17:381
216899560,4rtkit-daemon2167-21rtkit-daemon22:03:171
2652799555,32cyclictest0-21swapper/120:55:581
26527995520,29cyclictest9130-21sh23:05:431
26527995520,28cyclictest20384-21munin-node20:20:241
2652799545,32cyclictest0-21swapper/119:32:591
2652799545,31cyclictest0-21swapper/121:16:591
2652799545,31cyclictest0-21swapper/121:16:581
2652799545,31cyclictest0-21swapper/121:05:581
2652799544,31cyclictest0-21swapper/122:52:581
2652799544,30cyclictest0-21swapper/119:55:591
216899540,3rtkit-daemon2167-21rtkit-daemon20:28:261
2652799535,32cyclictest0-21swapper/119:45:591
2652799535,31cyclictest0-21swapper/123:27:001
26527995320,27cyclictest5212-21processes23:55:241
2652799525,33cyclictest0-21swapper/100:05:591
2652799525,32cyclictest0-21swapper/100:35:581
26527995221,24cyclictest5411-21munin-node19:40:151
26527995219,27cyclictest18651-21sh22:26:341
216899520,5rtkit-daemon2167-21rtkit-daemon00:00:151
2652799515,39cyclictest0-21swapper/121:00:151
2652799515,34cyclictest0-21swapper/119:21:591
2652799515,32cyclictest0-21swapper/120:43:591
2652799515,31cyclictest0-21swapper/121:36:591
2652799515,30cyclictest0-21swapper/121:56:001
2652799515,29cyclictest0-21swapper/120:05:001
26527995130,15cyclictest13294-21ssh23:14:431
26527995129,16cyclictest12660-21ssh21:20:281
26527995127,12cyclictest29031-21latency_hist21:50:011
26527995119,26cyclictest6995-21ssh23:02:591
26527995118,26cyclictest9526-21ssh22:10:241
216899510,4rtkit-daemon2167-21rtkit-daemon20:15:161
2652799505,29cyclictest0-21swapper/100:18:591
2652799505,28cyclictest0-21swapper/120:45:591
26527995031,13cyclictest6643-21timerwakeupswit22:05:271
26527995028,16cyclictest24028-21munin-node21:40:181
26527995022,23cyclictest24225-21ssh22:36:031
26527995022,23cyclictest22262-21telnet23:30:121
216899500,5rtkit-daemon2167-21rtkit-daemon22:44:581
216899500,5rtkit-daemon2167-21rtkit-daemon20:40:011
2652799495,31cyclictest0-21swapper/119:15:591
2652799494,31cyclictest0-21swapper/123:39:591
26527994930,13cyclictest29950-21ssh23:42:531
26527994929,15cyclictest6046-21memory21:10:201
26527994925,18cyclictest9976-21munin-node19:50:291
26527994917,26cyclictest1427-21runrttasks20:32:131
216899490,5rtkit-daemon2167-21rtkit-daemon20:15:011
26527994833,10cyclictest15976-21sh21:26:271
26527994623,17cyclictest78850irq/45-eth0-rx-00:20:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional