You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 18:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Sun Nov 23, 2025 12:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
283572215158,46sleep30-21swapper/307:06:403
265082209158,25sleep20-21swapper/207:05:102
283742201163,26sleep00-21swapper/007:06:530
283032199162,24sleep10-21swapper/107:05:571
28726991918,0cyclictest28-21ksoftirqd/212:25:142
28731991818,0cyclictest35-21ksoftirqd/310:15:163
28731991817,1cyclictest35-21ksoftirqd/310:55:163
28726991817,1cyclictest28-21ksoftirqd/210:31:272
2873199178,6cyclictest35-21ksoftirqd/308:45:253
28731991717,0cyclictest35-21ksoftirqd/311:55:163
28731991717,0cyclictest35-21ksoftirqd/309:59:203
28731991717,0cyclictest35-21ksoftirqd/309:31:323
28726991716,1cyclictest28-21ksoftirqd/212:02:472
28726991716,1cyclictest28-21ksoftirqd/209:15:182
2872699170,17cyclictest0-21swapper/209:51:092
40962160,0sleep30-21swapper/309:29:343
28731991616,0cyclictest35-21ksoftirqd/311:37:223
28731991616,0cyclictest35-21ksoftirqd/311:23:083
28731991616,0cyclictest35-21ksoftirqd/311:06:393
28731991616,0cyclictest35-21ksoftirqd/310:22:593
28731991616,0cyclictest35-21ksoftirqd/310:14:113
2872699163,13cyclictest28-21ksoftirqd/208:55:152
28726991615,1cyclictest28-21ksoftirqd/212:24:352
28726991615,1cyclictest28-21ksoftirqd/211:49:532
28731991515,0cyclictest35-21ksoftirqd/309:50:183
28731991515,0cyclictest35-21ksoftirqd/309:22:393
28726991514,1cyclictest28-21ksoftirqd/212:32:252
28726991514,1cyclictest28-21ksoftirqd/211:52:032
28726991514,1cyclictest28-21ksoftirqd/210:15:192
28726991514,1cyclictest28-21ksoftirqd/209:45:152
28726991514,1cyclictest28-21ksoftirqd/208:15:192
31832140,0sleep10-21swapper/111:42:051
28731991413,1cyclictest35-21ksoftirqd/311:25:293
2872699147,4cyclictest28-21ksoftirqd/211:20:162
28726991414,0cyclictest28-21ksoftirqd/211:41:292
28726991414,0cyclictest28-21ksoftirqd/209:33:072
28726991413,1cyclictest28-21ksoftirqd/212:13:402
28726991413,1cyclictest28-21ksoftirqd/211:05:522
28726991413,1cyclictest28-21ksoftirqd/209:26:442
28726991413,1cyclictest28-21ksoftirqd/207:55:152
28726991412,1cyclictest28-21ksoftirqd/212:10:002
28726991412,1cyclictest28-21ksoftirqd/211:00:002
28726991412,1cyclictest28-21ksoftirqd/210:40:002
28731991313,0cyclictest35-21ksoftirqd/311:11:373
28731991313,0cyclictest35-21ksoftirqd/309:16:163
28731991312,1cyclictest35-21ksoftirqd/311:30:213
28731991311,1cyclictest35-21ksoftirqd/312:40:003
28731991311,1cyclictest35-21ksoftirqd/312:10:233
28731991311,1cyclictest35-21ksoftirqd/309:10:003
2872699139,4cyclictest0-21swapper/208:10:272
2872699138,4cyclictest554-21in:imuxsock11:13:072
28726991313,0cyclictest28-21ksoftirqd/212:37:092
28726991313,0cyclictest28-21ksoftirqd/209:12:262
28726991312,1cyclictest28-21ksoftirqd/212:00:002
28726991312,1cyclictest28-21ksoftirqd/211:20:012
28726991312,1cyclictest28-21ksoftirqd/211:00:172
28726991312,1cyclictest28-21ksoftirqd/209:37:362
28726991312,1cyclictest28-21ksoftirqd/208:10:002
28726991311,1cyclictest28-21ksoftirqd/209:20:112
28726991311,1cyclictest28-21ksoftirqd/207:24:592
28726991311,1cyclictest28-21ksoftirqd/207:20:002
28726991311,1cyclictest28-21ksoftirqd/207:14:592
2871199132,5cyclictest30277-21perf08:20:000
28731991212,0cyclictest35-21ksoftirqd/310:38:103
28731991212,0cyclictest35-21ksoftirqd/310:26:403
28731991212,0cyclictest35-21ksoftirqd/310:06:593
28731991211,1cyclictest35-21ksoftirqd/309:43:444
28731991211,1cyclictest35-21ksoftirqd/308:40:003
28731991211,1cyclictest35-21ksoftirqd/307:39:593
28731991211,1cyclictest35-21ksoftirqd/307:30:003
28731991210,1cyclictest35-21ksoftirqd/312:32:533
28731991210,1cyclictest35-21ksoftirqd/312:05:123
28731991210,1cyclictest35-21ksoftirqd/311:00:183
28731991210,1cyclictest35-21ksoftirqd/310:45:013
28731991210,1cyclictest35-21ksoftirqd/310:05:013
28731991210,1cyclictest35-21ksoftirqd/309:35:193
28731991210,1cyclictest35-21ksoftirqd/308:35:003
28726991212,0cyclictest28-21ksoftirqd/212:15:042
28726991212,0cyclictest28-21ksoftirqd/210:29:102
28726991212,0cyclictest28-21ksoftirqd/210:20:402
28726991212,0cyclictest28-21ksoftirqd/210:05:112
28726991212,0cyclictest28-21ksoftirqd/209:40:083
28726991212,0cyclictest28-21ksoftirqd/208:40:122
28726991212,0cyclictest28-21ksoftirqd/208:20:132
28726991211,1cyclictest28-21ksoftirqd/211:30:182
28726991211,1cyclictest28-21ksoftirqd/210:40:012
28726991210,1cyclictest28-21ksoftirqd/211:35:142
28726991210,1cyclictest28-21ksoftirqd/210:45:092
28726991210,1cyclictest28-21ksoftirqd/210:00:102
28726991210,1cyclictest28-21ksoftirqd/209:00:152
28726991210,1cyclictest28-21ksoftirqd/208:40:002
28726991210,1cyclictest28-21ksoftirqd/208:35:002
28726991210,1cyclictest28-21ksoftirqd/208:30:002
28726991210,1cyclictest28-21ksoftirqd/207:50:012
28711991211,1cyclictest9-21ksoftirqd/009:09:590
28711991210,1cyclictest9-21ksoftirqd/008:35:000
28711991210,1cyclictest9-21ksoftirqd/007:15:000
2871199120,0cyclictest0-21swapper/007:50:120
2873199119,1cyclictest35-21ksoftirqd/312:15:003
2873199119,1cyclictest35-21ksoftirqd/311:40:163
2873199119,1cyclictest35-21ksoftirqd/310:50:193
2873199119,1cyclictest35-21ksoftirqd/310:30:123
2873199119,1cyclictest35-21ksoftirqd/308:50:113
2873199119,1cyclictest35-21ksoftirqd/308:30:003
2873199119,1cyclictest35-21ksoftirqd/307:55:213
2873199119,1cyclictest35-21ksoftirqd/307:35:003
2873199119,1cyclictest35-21ksoftirqd/307:15:003
28731991111,0cyclictest35-21ksoftirqd/312:25:103
28731991111,0cyclictest35-21ksoftirqd/312:00:483
28731991111,0cyclictest35-21ksoftirqd/311:17:533
28731991111,0cyclictest35-21ksoftirqd/310:45:103
28731991110,1cyclictest35-21ksoftirqd/312:20:213
28731991110,1cyclictest35-21ksoftirqd/311:50:233
28731991110,1cyclictest35-21ksoftirqd/311:45:183
28731991110,1cyclictest35-21ksoftirqd/309:45:203
28731991110,1cyclictest35-21ksoftirqd/308:15:133
28731991110,1cyclictest35-21ksoftirqd/308:15:003
28731991110,1cyclictest35-21ksoftirqd/308:10:003
28731991110,1cyclictest35-21ksoftirqd/307:45:003
28731991110,1cyclictest35-21ksoftirqd/307:20:143
2872699119,1cyclictest28-21ksoftirqd/210:50:222
2872699119,1cyclictest28-21ksoftirqd/210:10:152
2872699119,1cyclictest28-21ksoftirqd/209:55:132
2872699119,1cyclictest28-21ksoftirqd/209:05:132
2872699119,1cyclictest28-21ksoftirqd/208:50:112
2872699119,1cyclictest28-21ksoftirqd/208:00:182
2872699119,1cyclictest28-21ksoftirqd/207:25:002
2872699117,3cyclictest28-21ksoftirqd/207:40:162
28726991110,1cyclictest28-21ksoftirqd/208:45:232
28726991110,1cyclictest28-21ksoftirqd/207:40:002
28726991110,0cyclictest28-21ksoftirqd/211:27:472
2871199119,1cyclictest9-21ksoftirqd/009:05:000
28711991110,1cyclictest9-21ksoftirqd/009:50:180
2873199109,1cyclictest35-21ksoftirqd/309:10:113
2873199109,1cyclictest35-21ksoftirqd/309:00:123
2873199109,1cyclictest35-21ksoftirqd/308:55:163
2873199109,1cyclictest35-21ksoftirqd/308:40:153
2873199109,1cyclictest35-21ksoftirqd/308:20:163
2873199109,1cyclictest35-21ksoftirqd/307:50:193
2873199108,1cyclictest35-21ksoftirqd/308:00:123
2873199108,1cyclictest35-21ksoftirqd/307:45:143
2873199108,1cyclictest35-21ksoftirqd/307:10:213
2872699109,1cyclictest28-21ksoftirqd/207:35:002
2872699108,1cyclictest28-21ksoftirqd/207:50:162
2871199109,1cyclictest9-21ksoftirqd/012:30:230
2871199109,1cyclictest9-21ksoftirqd/012:05:150
2871199109,1cyclictest9-21ksoftirqd/011:50:010
2871199109,1cyclictest9-21ksoftirqd/011:35:190
2871199109,1cyclictest9-21ksoftirqd/011:25:000
2871199109,1cyclictest9-21ksoftirqd/010:25:160
2871199109,1cyclictest9-21ksoftirqd/008:40:000
2871199108,1cyclictest8296-21sort07:30:290
2871199102,4cyclictest8105-21perf09:35:000
28711991010,0cyclictest9-21ksoftirqd/012:00:200
2871199100,7cyclictest31283-21munin-node10:22:070
2871199100,2cyclictest254-21systemd-journal10:59:550
287189990,6cyclictest0-21swapper/111:45:181
287189990,5cyclictest0-21swapper/110:55:131
287119999,0cyclictest9-21ksoftirqd/009:40:170
287119998,1cyclictest9-21ksoftirqd/012:25:110
287119998,1cyclictest9-21ksoftirqd/011:10:140
287119998,1cyclictest9-21ksoftirqd/010:30:130
287119998,1cyclictest9-21ksoftirqd/010:15:230
287119998,1cyclictest9-21ksoftirqd/009:10:130
287119998,1cyclictest28616-21ssh11:32:290
287119996,1cyclictest21828-21diskmemload11:08:500
287119991,8cyclictest31283-21munin-node08:21:260
287189981,4cyclictest0-21swapper/108:50:001
287119987,1cyclictest9-21ksoftirqd/009:55:130
287119987,1cyclictest9-21ksoftirqd/009:45:200
287119987,1cyclictest9-21ksoftirqd/009:35:150
287119987,1cyclictest9-21ksoftirqd/008:50:120
287119987,1cyclictest9-21ksoftirqd/008:05:000
287119987,1cyclictest10204-21ssh11:51:410
287119986,1cyclictest9-21ksoftirqd/009:22:580
287119986,1cyclictest25279-21ssh10:42:040
287119984,3cyclictest17312-21ssh11:15:340
287119983,3cyclictest19428-21kworker/0:212:38:130
287119980,7cyclictest31970-21ssh10:50:460
287119980,7cyclictest28133-21rm10:45:190
287189971,3cyclictest0-21swapper/109:10:131
287189970,4cyclictest0-21swapper/112:15:041
287189970,4cyclictest0-21swapper/111:20:021
287119976,1cyclictest9-21ksoftirqd/010:35:140
287119976,1cyclictest9-21ksoftirqd/007:15:000
287119976,1cyclictest26616-21cat08:10:170
287119976,1cyclictest22205-21rm12:10:050
287119973,1cyclictest13918-21apt-get07:45:120
287119973,0cyclictest0-21swapper/007:35:160
287119971,6cyclictest24918-1kworker/u9:112:16:400
287119970,6cyclictest6524-21grep11:00:230
287119970,6cyclictest26627-21ssh10:00:040
287119970,6cyclictest21828-21diskmemload11:25:220
287119970,6cyclictest21828-21diskmemload10:11:100
287119970,6cyclictest12355-21hddtemp_smartct11:55:150
287119970,4cyclictest30252-21apt-get10:05:110
287119970,1cyclictest2877-21ssh09:26:060
287119970,1cyclictest21828-21diskmemload12:22:450
287119970,1cyclictest0-21swapper/011:40:130
287119970,1cyclictest0-21swapper/009:15:130
287189966,0cyclictest0-21swapper/111:56:001
287189966,0cyclictest0-21swapper/110:45:151
287189961,2cyclictest0-21swapper/110:06:071
287189960,6cyclictest0-21swapper/109:20:151
287189960,4cyclictest0-21swapper/111:02:121
287189960,4cyclictest0-21swapper/109:37:521
287189960,3cyclictest0-21swapper/111:17:021
287189960,3cyclictest0-21swapper/110:54:061
287189960,0cyclictest0-21swapper/111:07:091
287189960,0cyclictest0-21swapper/110:13:331
287189960,0cyclictest0-21swapper/109:40:102
287119965,1cyclictest9-21ksoftirqd/008:57:380
287119965,1cyclictest9-21ksoftirqd/008:45:160
287119965,1cyclictest9-21ksoftirqd/007:55:160
287119964,1cyclictest9-21ksoftirqd/008:05:130
287119963,1cyclictest254-21systemd-journal08:28:480
287119960,6cyclictest0-21swapper/007:25:300
287119960,5cyclictest0-21swapper/007:20:290
287119960,0cyclictest0-21swapper/007:40:130
287189953,1cyclictest0-21swapper/108:20:161
287189952,2cyclictest0-21swapper/111:10:151
287189952,1cyclictest0-21swapper/107:55:211
287189951,1cyclictest0-21swapper/112:25:111
287189951,1cyclictest0-21swapper/109:00:171
287189950,5cyclictest0-21swapper/111:25:151
287189950,5cyclictest0-21swapper/108:56:221
287189950,5cyclictest0-21swapper/108:53:001
287189950,5cyclictest0-21swapper/108:26:121
287189950,5cyclictest0-21swapper/107:35:151
287189950,5cyclictest0-21swapper/107:21:221
287189950,3cyclictest0-21swapper/112:35:141
287189950,3cyclictest0-21swapper/112:33:171
287189950,3cyclictest0-21swapper/112:00:091
287189950,3cyclictest0-21swapper/111:35:211
287189950,3cyclictest0-21swapper/111:31:391
287189950,3cyclictest0-21swapper/110:40:141
287189950,3cyclictest0-21swapper/109:51:081
287189950,3cyclictest0-21swapper/109:47:131
287189950,3cyclictest0-21swapper/109:33:501
287189950,3cyclictest0-21swapper/109:15:131
287189950,3cyclictest0-21swapper/108:15:131
287189950,2cyclictest0-21swapper/112:11:141
287189950,2cyclictest0-21swapper/109:59:181
287189950,2cyclictest0-21swapper/109:26:461
287189950,1cyclictest0-21swapper/110:30:491
287189950,1cyclictest0-21swapper/110:03:011
287189950,0cyclictest0-21swapper/110:28:451
287189950,0cyclictest0-21swapper/110:22:341
287189950,0cyclictest0-21swapper/107:26:221
287119951,1cyclictest0-21swapper/008:40:120
17125250,0sleep10-21swapper/107:50:161
287189942,1cyclictest79852sleep111:50:101
287189941,2cyclictest0-21swapper/110:15:141
287189940,4cyclictest0-21swapper/107:30:281
287189940,3cyclictest0-21swapper/112:05:381
287189940,3cyclictest0-21swapper/108:40:121
287189940,2cyclictest0-21swapper/110:36:041
287189940,2cyclictest0-21swapper/108:35:131
287189940,2cyclictest0-21swapper/107:15:131
287189940,1cyclictest0-21swapper/112:20:481
287189940,1cyclictest0-21swapper/109:05:011
287189940,1cyclictest0-21swapper/107:45:171
287189940,0cyclictest0-21swapper/107:13:151
287189931,1cyclictest0-21swapper/108:30:111
287189931,1cyclictest0-21swapper/108:05:111
287189931,1cyclictest0-21swapper/107:44:591
287189930,1cyclictest0-21swapper/108:10:131
287189930,1cyclictest0-21swapper/108:00:181
14:50:471
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional