You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 15:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri Jun 19, 2026 12:52:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8299983570,762cyclictest0-21swapper/311:31:493
829997630,127cyclictest0-21swapper/312:10:563
82899705236,296cyclictest5348-21kworker/u16:310:50:522
8299968042,169cyclictest0-21swapper/312:03:083
83099669115,338cyclictest0-21swapper/411:23:384
8299966427,634cyclictest0-21swapper/312:34:503
8299965560,380cyclictest0-21swapper/310:05:593
8329965259,84cyclictest121rcu_preempt11:21:506
82899648264,126cyclictest0-21swapper/209:21:392
8299963181,126cyclictest121rcu_preempt11:55:153
8299963139,126cyclictest121rcu_preempt11:54:433
8299962831,126cyclictest0-21swapper/309:51:453
83199627116,381cyclictest0-21swapper/511:21:505
83399626373,83cyclictest0-21swapper/712:14:107
83199619190,380cyclictest561ktimersoftd/509:52:195
8269961969,126cyclictest0-21swapper/011:55:010
82999615103,381cyclictest0-21swapper/309:23:003
83299614146,295cyclictest0-21swapper/611:01:346
8299961419,388cyclictest0-21swapper/310:30:413
8299961258,381cyclictest0-21swapper/311:42:103
8289961259,388cyclictest24961-21rm11:23:342
8279960614,126cyclictest0-21swapper/109:22:421
8269960652,338cyclictest0-21swapper/009:51:360
82899604135,296cyclictest14150-21sh12:34:502
8339958677,211cyclictest73-21ksoftirqd/711:51:437
8279958637,296cyclictest0-21swapper/112:25:331
8289957824,127cyclictest0-21swapper/211:51:362
8269957666,338cyclictest0-21swapper/011:43:090
8329957063,42cyclictest0-21swapper/612:33:256
8279956916,338cyclictest0-21swapper/112:34:071
83099566271,84cyclictest64450irq/122-eth012:34:244
830995578,338cyclictest27244-21ssh12:04:454
83399555260,214cyclictest721ktimersoftd/709:22:097
8329954983,85cyclictest121rcu_preempt12:13:446
8329954879,338cyclictest0-21swapper/611:42:376
8299954679,465cyclictest824-21cyclictest10:51:563
8319954534,84cyclictest0-21swapper/509:41:095
8269954534,381cyclictest0-21swapper/010:16:290
8339954474,295cyclictest0-21swapper/712:34:087
8339954374,296cyclictest0-21swapper/712:02:477
8309954334,126cyclictest0-21swapper/411:51:594
8269954332,126cyclictest0-21swapper/009:21:190
8339954276,126cyclictest121rcu_preempt11:22:207
83099542200,338cyclictest10588-21rm12:13:594
8279954175,84cyclictest121rcu_preempt11:22:001
8269954027,296cyclictest0-21swapper/012:13:470
8319953772,126cyclictest0-21swapper/512:01:085
8319953731,84cyclictest0-21swapper/510:51:095
8329953671,126cyclictest8543-21ssh11:51:556
8269953626,380cyclictest824-21cyclictest11:45:070
8299953523,127cyclictest0-21swapper/312:15:123
8279953528,89cyclictest0-21swapper/111:44:101
8339953324,84cyclictest0-21swapper/712:05:047
8299953323,340cyclictest121rcu_preempt10:55:113
8279953062,380cyclictest0-21swapper/110:09:591
8279952920,87cyclictest824-21cyclictest12:03:131
8339952817,295cyclictest0-21swapper/710:52:577
8319952859,211cyclictest0-21swapper/511:55:255
83199528101,296cyclictest0-21swapper/511:41:195
8299952820,126cyclictest0-21swapper/310:10:243
8269952820,84cyclictest0-21swapper/012:02:440
8269952720,126cyclictest0-21swapper/011:23:050
8279952619,87cyclictest0-21swapper/111:54:441
8269952620,126cyclictest0-21swapper/012:35:100
8329952557,295cyclictest0-21swapper/612:04:386
83099525437,86cyclictest471rcuc/409:22:094
82899525356,41cyclictest0-21swapper/210:30:502
8289952518,85cyclictest0-21swapper/212:03:082
8269952518,212cyclictest0-21swapper/010:30:220
8289952095,127cyclictest0-21swapper/209:52:182
8289952013,84cyclictest0-21swapper/212:15:032
8279951953,127cyclictest0-21swapper/109:51:481
829995121,127cyclictest0-21swapper/311:35:063
831995091,211cyclictest0-21swapper/511:55:025
8339950637,211cyclictest15850irq/123-ahci[0010:30:517
8289950478,253cyclictest0-21swapper/210:10:012
8319950233,126cyclictest0-21swapper/512:13:585
82799502416,84cyclictest241ktimersoftd/111:01:131
8279950233,126cyclictest0-21swapper/112:11:141
8289950135,84cyclictest0-21swapper/211:15:502
8269950133,342cyclictest0-21swapper/010:53:000
8339949974,84cyclictest0-21swapper/711:42:257
82899499123,373cyclictest0-21swapper/212:35:122
83099498114,211cyclictest0-21swapper/410:35:234
8269949834,41cyclictest0-21swapper/009:41:050
8269949832,84cyclictest0-21swapper/011:15:550
8289949727,297cyclictest0-21swapper/211:44:002
8279949733,253cyclictest0-21swapper/111:31:421
8269949628,295cyclictest0-21swapper/012:31:160
8289949531,84cyclictest0-21swapper/211:31:452
8279949426,465cyclictest0-21swapper/110:51:091
8269949325,295cyclictest0-21swapper/010:35:230
8299949122,466cyclictest0-21swapper/311:22:343
8289949024,84cyclictest0-21swapper/211:01:202
8319948964,211cyclictest0-21swapper/512:25:345
83199489233,253cyclictest561ktimersoftd/512:33:105
8279948925,84cyclictest0-21swapper/112:05:011
8309948617,127cyclictest24690-21taskset09:52:464
8279948619,127cyclictest5348-21kworker/u16:310:30:511
8339948518,380cyclictest0-21swapper/711:01:287
8329948217,386cyclictest0-21swapper/609:22:576
8319948216,126cyclictest0-21swapper/511:45:095
8309948012,126cyclictest0-21swapper/410:08:444
8319947915,83cyclictest0-21swapper/509:22:015
8309947753,210cyclictest0-21swapper/410:54:174
829994778,169cyclictest0-21swapper/312:25:323
8299947711,84cyclictest0-21swapper/310:16:283
830994726,84cyclictest0-21swapper/411:41:424
829994711,42cyclictest0-21swapper/311:01:193
832994702,297cyclictest0-21swapper/610:52:066
828994681,421cyclictest0-21swapper/209:41:082
830994672,295cyclictest0-21swapper/410:34:504
830994671,126cyclictest0-21swapper/411:01:304
8269946787,84cyclictest0-21swapper/012:25:340
826994661,126cyclictest22361-21ssh10:09:590
8309946539,253cyclictest0-21swapper/411:45:094
8299946379,296cyclictest5648-21ssh09:41:043
82999461120,127cyclictest121rcu_preempt11:45:063
8329946038,84cyclictest121rcu_preempt10:30:546
8299945876,127cyclictest0-21swapper/312:35:123
83399457115,169cyclictest24168-21ssh09:51:447
83099456116,338cyclictest1165-21ssh12:25:324
8329945570,126cyclictest0-21swapper/610:35:246
8299945575,296cyclictest0-21swapper/311:15:563
8329945330,256cyclictest0-21swapper/609:52:056
82699453196,84cyclictest0-21swapper/011:01:300
8329945129,256cyclictest0-21swapper/610:16:416
8319944561,211cyclictest57-21ksoftirqd/511:31:435
8339944318,210cyclictest0-21swapper/711:31:437
8329944216,85cyclictest0-21swapper/610:55:136
8269944220,92cyclictest0-21swapper/011:31:380
8329944161,127cyclictest0-21swapper/612:35:126
8339943917,256cyclictest0-21swapper/710:10:227
8339943915,42cyclictest0-21swapper/710:05:587
8309943863,120cyclictest0-21swapper/409:41:084
831994347,212cyclictest18343-21ssh10:06:045
827994297,85cyclictest0-21swapper/109:41:031
832994274,256cyclictest0-21swapper/610:10:226
8339942544,211cyclictest73-21ksoftirqd/710:16:277
8289942482,339cyclictest0-21swapper/210:55:122
828994241,256cyclictest0-21swapper/210:10:232
826994241,83cyclictest0-21swapper/010:55:060
826994241,126cyclictest0-21swapper/011:55:250
830994231,3cyclictest0-21swapper/410:10:224
8329942280,339cyclictest0-21swapper/612:05:046
8309942283,84cyclictest0-21swapper/410:55:124
8329942181,338cyclictest0-21swapper/610:05:586
83199421122,168cyclictest30525-21rm10:30:465
8319941982,253cyclictest0-21swapper/512:35:135
8339941778,84cyclictest0-21swapper/711:55:277
8319941776,338cyclictest0-21swapper/511:01:325
8279941637,295cyclictest0-21swapper/110:16:411
8279941636,212cyclictest0-21swapper/111:15:501
8279941535,296cyclictest0-21swapper/111:55:141
8309941432,127cyclictest0-21swapper/411:55:234
82899414115,126cyclictest33-21ksoftirqd/211:45:072
8339941374,84cyclictest0-21swapper/709:55:107
8339941373,84cyclictest0-21swapper/709:40:557
8299941331,379cyclictest0-21swapper/312:05:053
8279941333,296cyclictest0-21swapper/110:35:231
82799412114,126cyclictest6869-21ssh10:55:131
8289941069,211cyclictest33-21ksoftirqd/210:35:232
8279941071,85cyclictest0-21swapper/112:35:131
8309940970,84cyclictest0-21swapper/411:31:494
8269940928,84cyclictest1651-21ntpd11:35:070
8279940727,295cyclictest0-21swapper/111:35:081
8289940665,338cyclictest0-21swapper/211:55:262
8289940626,3cyclictest0-21swapper/210:16:402
83399405106,126cyclictest32136-21kworker/7:011:15:487
8279940564,338cyclictest0-21swapper/110:10:241
8309940424,42cyclictest0-21swapper/410:16:274
8279940425,49cyclictest0-21swapper/111:45:041
8329940364,126cyclictest0-21swapper/612:25:386
8299940323,302cyclictest0-21swapper/310:35:203
8329940261,338cyclictest0-21swapper/611:55:276
8319940260,339cyclictest0-21swapper/511:15:495
8319940223,296cyclictest3936-21ssh10:16:405
83299401108,121cyclictest121rcu_preempt11:45:096
8319940160,338cyclictest0-21swapper/512:05:045
8269939915,168cyclictest0-21swapper/010:10:230
8339939859,84cyclictest0-21swapper/710:55:137
8319939818,296cyclictest0-21swapper/510:35:245
8309939613,126cyclictest0-21swapper/411:15:524
82899394141,84cyclictest1553-21runrttasks09:55:222
8329939353,126cyclictest0-21swapper/609:41:086
8339939152,84cyclictest0-21swapper/712:35:137
83299391218,43cyclictest11921-21ssh11:35:086
8319939110,42cyclictest0-21swapper/509:55:215
8289939112,85cyclictest121rcu_preempt12:25:402
8319938389,41cyclictest0-21swapper/511:35:075
83399379211,3cyclictest711rcuc/712:25:337
8319937537,254cyclictest24305-21latency10:10:205
8309937534,85cyclictest0-21swapper/412:35:094
83099371114,254cyclictest64450irq/122-eth011:35:094
8289937029,84cyclictest0-21swapper/212:15:122
8289936526,84cyclictest0-21swapper/211:35:062
8279936527,171cyclictest0-21swapper/112:15:121
8329936427,171cyclictest0-21swapper/611:15:496
8319936322,168cyclictest57-21ksoftirqd/510:55:125
8309936331,248cyclictest27785-21ssh12:05:044
8329935617,84cyclictest0-21swapper/611:31:416
82899354103,125cyclictest0-21swapper/212:05:042
8329934911,84cyclictest0-21swapper/609:55:106
833993446,126cyclictest0-21swapper/711:45:097
8269933681,253cyclictest0-21swapper/012:05:030
83299332117,127cyclictest11936-21apt-get12:15:136
8309933235,84cyclictest0-21swapper/409:55:094
8319933034,126cyclictest0-21swapper/512:15:125
8299932831,260cyclictest0-21swapper/309:55:213
8269932530,211cyclictest0-21swapper/012:15:120
8279932425,296cyclictest0-21swapper/109:55:221
8269932425,168cyclictest29030-21memory09:55:220
8309932020,211cyclictest49-21ksoftirqd/412:15:114
8339931217,84cyclictest0-21swapper/711:35:097
8339931153,126cyclictest73-21ksoftirqd/710:35:227
8339927114,84cyclictest0-21swapper/712:15:127
3256829652,28sleep30-21swapper/307:09:243
3256829652,28sleep30-21swapper/307:09:243
3257929147,8sleep50-21swapper/507:09:345
3257929147,8sleep50-21swapper/507:09:335
3239228944,41sleep10-21swapper/107:06:571
3239228944,41sleep10-21swapper/107:06:571
3236628553,28sleep20-21swapper/207:06:352
3236628553,28sleep20-21swapper/207:06:342
3259628453,28sleep40-21swapper/407:09:494
3259628453,28sleep40-21swapper/407:09:484
3257228452,28sleep70-21swapper/707:09:277
3257228452,28sleep70-21swapper/707:09:277
3256228351,28sleep60-21swapper/607:09:186
3256228351,28sleep60-21swapper/607:09:186
3237327948,27sleep00-21swapper/007:06:400
3237327948,27sleep00-21swapper/007:06:400
213762690,0sleep00-21swapper/012:20:120
13092680,0sleep30-21swapper/311:29:003
82799521,47cyclictest28724-21ssh11:07:151
83399517,6cyclictest73-21ksoftirqd/709:25:027
826995119,29cyclictest10411-21ssh09:45:080
82799501,45cyclictest0-21swapper/111:25:091
827994521,21cyclictest7895-21sh09:25:591
827994519,22cyclictest11626-21cut09:45:171
828994312,5cyclictest4627-21ssh09:25:032
831994135,4cyclictest561ktimersoftd/511:05:105
82899412,34cyclictest8656-21diskmemload10:20:182
83399402,34cyclictest0-21swapper/710:20:187
83099409,3cyclictest0-21swapper/409:25:034
833993913,18cyclictest73-21ksoftirqd/711:05:497
833993910,21cyclictest73-21ksoftirqd/709:45:157
832993911,4cyclictest3824-21munin-node09:25:116
82799392,33cyclictest0-21swapper/110:20:021
82699392,33cyclictest0-21swapper/011:25:070
833993811,19cyclictest0-21swapper/711:25:307
832993831,4cyclictest8656-21diskmemload10:20:206
83199382,31cyclictest0-21swapper/509:45:095
83099382,32cyclictest0-21swapper/410:20:094
830993813,5cyclictest0-21swapper/411:25:124
830993810,18cyclictest0-21swapper/411:05:194
82699382,32cyclictest0-21swapper/010:20:230
82999371,32cyclictest0-21swapper/310:20:033
832993629,4cyclictest0-21swapper/609:45:046
831993627,5cyclictest4769-21apt-get09:25:115
83199362,30cyclictest26855-21rm11:25:085
830993612,12cyclictest0-21swapper/409:45:164
828993629,4cyclictest10315-21ssh09:45:022
82699362,5cyclictest0-21swapper/011:05:040
832993529,3cyclictest0-21swapper/611:25:016
83299352,30cyclictest0-21swapper/611:05:036
829993425,5cyclictest5012-21tr09:25:123
82999342,29cyclictest0-21swapper/311:05:263
82899331,2cyclictest24065-21ssh11:05:022
826993329,2cyclictest0-21swapper/009:25:080
831993226,3cyclictest9730-21ssh10:20:235
829993228,2cyclictest0-21swapper/309:45:093
828992921,5cyclictest27880-21grep11:25:162
829992810,18cyclictest0-21swapper/307:37:353
829992810,18cyclictest0-21swapper/307:13:303
828992810,0cyclictest0-21swapper/207:13:252
826992810,0cyclictest0-21swapper/007:13:180
833992727,0cyclictest0-21swapper/707:37:367
833992710,17cyclictest0-21swapper/707:13:177
831992710,17cyclictest0-21swapper/507:13:215
831992710,0cyclictest0-21swapper/507:37:365
830992727,0cyclictest0-21swapper/407:13:194
830992710,17cyclictest0-21swapper/407:37:444
828992710,17cyclictest0-21swapper/207:37:422
827992727,0cyclictest0-21swapper/107:13:261
827992710,0cyclictest0-21swapper/107:38:021
826992727,0cyclictest0-21swapper/007:37:560
832992525,0cyclictest0-21swapper/607:13:236
82899241,22cyclictest0-21swapper/208:35:142
83099200,19cyclictest6025-21apt-get09:05:024
832991919,0cyclictest0-21swapper/607:37:406
239372190,1sleep60-21swapper/610:27:546
82799180,10cyclictest0-21swapper/108:00:171
143312170,0sleep30-21swapper/307:30:143
833991614,1cyclictest721ktimersoftd/710:25:167
833991614,1cyclictest0-21swapper/708:55:187
830991614,1cyclictest0-21swapper/410:25:164
82699161,7cyclictest13828-21latency_hist08:25:010
830991513,1cyclictest0-21swapper/408:55:174
82699152,6cyclictest0-21swapper/008:55:000
82699150,7cyclictest31737-21perf10:50:000
289742150,1sleep20-21swapper/212:42:112
83399142,8cyclictest73-21ksoftirqd/710:45:017
83399140,10cyclictest28884-21perf09:19:597
831991412,1cyclictest487-21ssh09:39:305
831991410,3cyclictest22305-21basename07:45:005
83099142,7cyclictest7318-21turbostat07:19:594
83099141,7cyclictest49-21ksoftirqd/409:30:124
830991412,1cyclictest49-21ksoftirqd/412:43:324
830991411,2cyclictest481ktimersoftd/410:40:124
830991410,3cyclictest24386-21tr09:35:114
829991410,3cyclictest23617-21grep07:45:153
826991412,1cyclictest27558-21ssh09:19:070
826991412,1cyclictest0-21swapper/008:55:220
83399131,6cyclictest121rcu_preempt08:00:127
833991311,1cyclictest73-21ksoftirqd/710:47:487
833991311,1cyclictest73-21ksoftirqd/710:01:397
833991311,1cyclictest721ktimersoftd/708:50:147
833991311,1cyclictest0-21swapper/711:13:447
833991311,1cyclictest0-21swapper/709:14:477
833991311,1cyclictest0-21swapper/707:15:187
833991310,2cyclictest73-21ksoftirqd/709:32:327
83399130,12cyclictest8649-21cut07:20:147
832991311,1cyclictest22775-21latency_hist08:40:006
832991310,2cyclictest641ktimersoftd/607:30:166
832991310,2cyclictest21953-21head09:15:246
83299130,12cyclictest10841-21cat08:20:006
831991311,1cyclictest6055-21missed_timers07:15:185
83199131,11cyclictest0-21swapper/510:46:525
831991310,2cyclictest561ktimersoftd/510:40:115
831991310,2cyclictest561ktimersoftd/509:19:185
831991310,2cyclictest29253-21grep08:50:125
83099131,8cyclictest49-21ksoftirqd/408:50:234
83099131,7cyclictest49-21ksoftirqd/411:10:184
830991311,1cyclictest481ktimersoftd/412:20:294
830991310,2cyclictest481ktimersoftd/408:20:134
82999139,3cyclictest27061-21rm09:18:483
82999139,3cyclictest19727-21grep10:25:213
829991311,1cyclictest310022sleep312:43:343
829991311,1cyclictest24093-21taskset12:20:503
82899139,3cyclictest9146-21sh10:01:492
828991311,1cyclictest26918-21ssh12:22:462
828991311,1cyclictest23270-21ssh09:34:482
828991311,1cyclictest153932sleep207:30:222
828991311,1cyclictest0-21swapper/211:11:262
828991311,1cyclictest0-21swapper/210:49:222
828991311,1cyclictest0-21swapper/207:50:192
82799139,3cyclictest10920-21grep07:25:091
827991311,1cyclictest18298-21if_eth008:30:181
827991311,1cyclictest0-21swapper/112:44:111
827991311,1cyclictest0-21swapper/110:46:131
827991311,1cyclictest0-21swapper/110:28:211
827991311,1cyclictest0-21swapper/109:05:141
827991311,1cyclictest0-21swapper/108:05:231
827991310,2cyclictest15659-21ntpq08:25:171
82699139,2cyclictest5358-21cut08:10:120
826991311,1cyclictest8195-21ssh11:13:350
826991311,1cyclictest21441-21ssh10:26:140
826991311,1cyclictest17585-21ssh09:31:000
83399129,2cyclictest6309-21tr09:05:137
83399129,2cyclictest27906-21sh12:41:297
83399129,2cyclictest25856-21cut07:50:137
83399129,2cyclictest20533-21cat08:35:137
83399129,2cyclictest14371-21cut08:25:117
83399128,3cyclictest10823-21tr07:25:097
833991210,1cyclictest73-21ksoftirqd/709:35:217
833991210,1cyclictest0-21swapper/712:20:097
833991210,1cyclictest0-21swapper/708:42:037
833991210,1cyclictest0-21swapper/708:31:367
833991210,1cyclictest0-21swapper/708:20:197
833991210,1cyclictest0-21swapper/708:15:177
833991210,1cyclictest0-21swapper/708:12:107
833991210,1cyclictest0-21swapper/708:06:557
833991210,1cyclictest0-21swapper/707:55:167
833991210,1cyclictest0-21swapper/707:45:137
833991210,1cyclictest0-21swapper/707:40:437
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional