You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-08 - 10:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Aug 08, 2026 00:55:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
285799789151,84cyclictest8133-21cstates20:10:180
28629977957,84cyclictest121rcu_preempt00:14:095
28589974325,84cyclictest0-21swapper/100:40:211
28629973413,550cyclictest0-21swapper/500:35:555
28599968913,126cyclictest0-21swapper/222:26:292
28649968796,126cyclictest0-21swapper/700:17:107
28579968611,464cyclictest0-21swapper/000:08:220
28599967941,84cyclictest121rcu_preempt23:50:552
28629967277,380cyclictest0-21swapper/522:22:205
28629966024,633cyclictest0-21swapper/523:10:155
286099658102,339cyclictest0-21swapper/322:20:393
28619965762,211cyclictest0-21swapper/400:09:104
28609965198,126cyclictest2855-21cyclictest00:08:473
28579965120,416cyclictest0-21swapper/022:47:320
286099647139,296cyclictest9060-21latency20:10:453
2862996406,2cyclictest10851-21diskmemload22:39:485
2863996395,2cyclictest0-21swapper/622:39:496
285999638172,126cyclictest6211-1kworker/u17:222:20:262
2863996351,383cyclictest0-21swapper/600:13:546
28579963481,295cyclictest0-21swapper/021:05:200
28589963379,338cyclictest0-21swapper/121:57:081
28629963279,381cyclictest0-21swapper/521:57:575
286399631123,126cyclictest0-21swapper/623:09:296
285799631121,258cyclictest121rcu_preempt21:10:370
28579962333,380cyclictest0-21swapper/023:43:540
286199622113,128cyclictest0-21swapper/421:41:124
28609962268,423cyclictest0-21swapper/321:27:003
28599962229,126cyclictest0-21swapper/223:14:092
28629962168,550cyclictest0-21swapper/521:39:435
285799617148,254cyclictest0-21swapper/000:39:430
286499616105,338cyclictest0-21swapper/721:43:407
28629961420,169cyclictest0-21swapper/523:24:165
28619961262,126cyclictest0-21swapper/423:08:134
286099610141,296cyclictest0-21swapper/322:08:033
28599960916,126cyclictest0-21swapper/222:37:392
28629960553,549cyclictest0-21swapper/523:50:405
28629960412,338cyclictest0-21swapper/523:30:005
28599960310,126cyclictest0-21swapper/223:25:392
2859995997,127cyclictest0-21swapper/223:09:062
2864995950,84cyclictest0-21swapper/723:11:177
2859995950,84cyclictest0-21swapper/200:13:332
2864995940,84cyclictest0-21swapper/723:25:217
285999594123,296cyclictest0-21swapper/223:30:362
285799593169,8cyclictest21716-21nscd22:20:320
2857995931,126cyclictest0-21swapper/021:45:090
2857995931,126cyclictest0-21swapper/021:45:090
2857995930,211cyclictest0-21swapper/000:14:090
28609959282,296cyclictest0-21swapper/323:31:063
2858995920,127cyclictest0-21swapper/123:34:561
28619959138,253cyclictest29064-21ssh23:24:164
286299588121,295cyclictest0-21swapper/500:04:195
286299588121,295cyclictest0-21swapper/500:04:195
286499587120,296cyclictest0-21swapper/700:39:327
286499586117,296cyclictest0-21swapper/721:36:057
28629958532,550cyclictest0-21swapper/523:15:565
28619958535,126cyclictest121rcu_preempt22:22:214
28609958375,126cyclictest0-21swapper/323:13:033
285899583114,296cyclictest0-21swapper/121:36:201
28629958132,84cyclictest0-21swapper/500:15:195
285999581324,126cyclictest0-21swapper/221:59:522
286299580408,83cyclictest0-21swapper/523:38:005
28619958069,380cyclictest0-21swapper/423:10:174
28579958031,126cyclictest0-21swapper/023:14:400
28589957971,126cyclictest0-21swapper/100:36:051
2861995785,2cyclictest0-21swapper/400:13:544
28589957769,126cyclictest0-21swapper/123:12:181
28589957669,47cyclictest121rcu_preempt21:43:481
28589957665,126cyclictest0-21swapper/119:45:181
285799576197,84cyclictest121rcu_preempt23:25:320
28629957523,549cyclictest30850-21ssh23:43:125
28619957565,340cyclictest0-21swapper/421:10:484
286199573104,338cyclictest0-21swapper/400:39:494
28629957118,550cyclictest0-21swapper/520:50:195
28589956962,253cyclictest0-21swapper/122:20:431
28639956798,295cyclictest0-21swapper/621:56:406
28629956613,380cyclictest0-21swapper/522:27:145
28629956516,465cyclictest0-21swapper/500:25:095
28599956516,125cyclictest0-21swapper/223:16:092
28579956457,296cyclictest0-21swapper/022:36:490
28579956414,84cyclictest0-21swapper/023:08:050
28599956352,338cyclictest0-21swapper/222:08:182
28589956293,296cyclictest0-21swapper/120:17:581
28589956213,84cyclictest0-21swapper/100:25:151
28599955948,296cyclictest0-21swapper/200:18:532
28629955846,466cyclictest2855-21cyclictest00:44:155
2862995584,42cyclictest0-21swapper/500:09:435
28589955810,168cyclictest0-21swapper/120:50:201
28649955689,126cyclictest0-21swapper/723:31:067
28639955648,126cyclictest0-21swapper/623:30:396
28639955645,84cyclictest0-21swapper/600:15:376
285899555298,126cyclictest0-21swapper/123:08:051
2859995532,84cyclictest0-21swapper/220:53:562
2858995532,126cyclictest0-21swapper/100:16:401
28629955244,463cyclictest121rcu_preempt22:10:095
28609955240,211cyclictest41-21ksoftirqd/321:10:273
286099552124,299cyclictest0-21swapper/300:13:323
2859995521,84cyclictest0-21swapper/221:36:452
28599955185,84cyclictest121rcu_preempt00:44:472
28649955085,256cyclictest0-21swapper/700:13:537
28649955083,84cyclictest0-21swapper/723:44:117
28639955038,381cyclictest0-21swapper/621:40:146
2863995501,84cyclictest0-21swapper/623:16:286
285799550124,211cyclictest0-21swapper/000:28:020
28589954934,254cyclictest0-21swapper/100:04:541
28589954934,254cyclictest0-21swapper/100:04:541
28619954881,380cyclictest0-21swapper/423:19:054
28579954886,126cyclictest121rcu_preempt21:43:080
28599954740,44cyclictest0-21swapper/200:09:312
285899547120,296cyclictest0-21swapper/123:38:491
286499546120,295cyclictest0-21swapper/722:25:487
28609954677,84cyclictest0-21swapper/300:40:133
28599954632,338cyclictest0-21swapper/219:43:302
28649954478,126cyclictest0-21swapper/723:19:597
286499543116,296cyclictest0-21swapper/723:38:427
28619954375,126cyclictest0-21swapper/400:24:044
28599954334,84cyclictest0-21swapper/223:40:122
285899543504,37cyclictest241ktimersoftd/122:28:061
28589954273,295cyclictest0-21swapper/123:25:481
286499541282,84cyclictest0-21swapper/722:23:187
28639954134,42cyclictest0-21swapper/600:09:316
28579954130,338cyclictest0-21swapper/021:59:500
28599954031,84cyclictest0-21swapper/221:43:402
28629953933,425cyclictest0-21swapper/500:22:545
285999539112,296cyclictest0-21swapper/221:05:272
28579953931,84cyclictest121rcu_preempt20:17:590
28609953827,126cyclictest0-21swapper/300:16:073
28629953726,508cyclictest0-21swapper/520:10:155
28609953769,296cyclictest0-21swapper/323:20:083
28589953729,84cyclictest0-21swapper/119:40:231
28579953731,338cyclictest0-21swapper/023:21:410
285799537237,169cyclictest9885-21chrt23:30:420
28589953628,84cyclictest0-21swapper/123:19:051
28629953425,506cyclictest0-21swapper/522:08:065
28609953468,126cyclictest0-21swapper/321:37:203
28599953322,338cyclictest4916-21rm00:23:342
28589953325,126cyclictest0-21swapper/122:40:131
28589953320,296cyclictest0-21swapper/123:20:431
28619953265,126cyclictest0-21swapper/423:25:594
28579953124,84cyclictest0-21swapper/020:46:060
286499530104,211cyclictest0-21swapper/723:45:277
28639953021,169cyclictest0-21swapper/621:36:216
28609953066,126cyclictest121rcu_preempt23:39:373
28609953022,296cyclictest0-21swapper/321:05:223
286199529274,253cyclictest64450irq/122-eth022:27:154
286099529106,257cyclictest30186-21nscd23:44:043
28589952921,84cyclictest0-21swapper/121:05:201
28579952921,84cyclictest18976-21sh23:17:250
28639952859,253cyclictest121rcu_preempt23:25:406
28629952859,295cyclictest0-21swapper/523:08:365
28579952715,296cyclictest0-21swapper/021:36:380
28619952662,84cyclictest121rcu_preempt00:44:254
28619952618,126cyclictest0-21swapper/400:04:194
28619952618,126cyclictest0-21swapper/400:04:194
28629952557,423cyclictest0-21swapper/523:34:565
28609952516,126cyclictest0-21swapper/300:32:363
28579952418,126cyclictest0-21swapper/022:08:410
28609952354,299cyclictest0-21swapper/323:19:493
28599952316,84cyclictest0-21swapper/200:36:102
28579952315,84cyclictest0-21swapper/023:38:370
28649952295,296cyclictest0-21swapper/722:36:307
28579952296,169cyclictest9-21ksoftirqd/022:28:080
28619952157,295cyclictest121rcu_preempt00:19:074
28589952198,259cyclictest121rcu_preempt19:57:031
28589952110,126cyclictest12646-21taskset21:10:401
2857995198,84cyclictest0-21swapper/000:03:000
2857995198,84cyclictest0-21swapper/000:03:000
28619951711,84cyclictest0-21swapper/419:42:494
28599951344,381cyclictest0-21swapper/223:38:152
28609951189,126cyclictest0-21swapper/300:23:293
2861995102,126cyclictest0-21swapper/421:37:174
28629950940,466cyclictest0-21swapper/521:10:295
2858995091,84cyclictest0-21swapper/122:07:301
2858995091,126cyclictest0-21swapper/100:08:121
28649950881,296cyclictest0-21swapper/723:22:157
28609950739,465cyclictest96392sleep321:45:013
2857995071,42cyclictest0-21swapper/000:16:300
286499506122,211cyclictest0-21swapper/700:23:277
2857995066,290cyclictest0-21swapper/021:32:190
28579950639,127cyclictest0-21swapper/000:44:110
28609950579,211cyclictest41-21ksoftirqd/323:50:223
285999504120,253cyclictest0-21swapper/223:49:382
286399502122,84cyclictest0-21swapper/622:22:086
28629950233,466cyclictest0-21swapper/519:44:015
28589950279,88cyclictest121rcu_preempt23:49:331
28639950031,296cyclictest0-21swapper/623:10:206
28619950075,422cyclictest0-21swapper/421:58:124
286499499115,254cyclictest0-21swapper/721:58:287
28639949932,126cyclictest22392-21ntp_states22:25:196
286199499119,84cyclictest0-21swapper/421:05:194
28609949971,127cyclictest2855-21cyclictest00:04:453
28609949971,127cyclictest2855-21cyclictest00:04:453
28599949833,84cyclictest0-21swapper/220:10:252
28609949768,296cyclictest0-21swapper/321:59:183
286099497117,126cyclictest10851-21diskmemload22:00:233
28599949732,126cyclictest0-21swapper/223:23:522
28649949630,84cyclictest0-21swapper/720:10:457
286499496117,295cyclictest0-21swapper/719:41:447
286299496240,126cyclictest0-21swapper/520:48:175
286299496116,84cyclictest8327-21chrt21:43:495
28599949631,85cyclictest0-21swapper/200:34:472
28589949631,126cyclictest0-21swapper/123:43:091
28649949573,84cyclictest0-21swapper/700:09:517
286199495197,211cyclictest121rcu_preempt22:36:354
285799495321,84cyclictest0-21swapper/019:44:580
28579949531,84cyclictest0-21swapper/000:24:050
28579949530,84cyclictest0-21swapper/023:04:420
285799495115,123cyclictest9-21ksoftirqd/023:50:390
28619949469,210cyclictest0-21swapper/423:30:454
28619949430,298cyclictest0-21swapper/423:50:224
28589949424,338cyclictest0-21swapper/100:14:041
28619949329,219cyclictest0-21swapper/400:25:084
28589949228,42cyclictest121rcu_preempt23:50:401
28589949226,84cyclictest0-21swapper/122:39:391
28639949125,43cyclictest0-21swapper/623:05:006
286099491277,126cyclictest0-21swapper/320:49:283
285999491111,126cyclictest33-21ksoftirqd/222:47:332
285999491110,211cyclictest0-21swapper/223:57:562
28639949024,127cyclictest0-21swapper/621:45:026
28639949024,127cyclictest0-21swapper/621:45:026
28629949026,380cyclictest0-21swapper/519:45:175
28619949021,338cyclictest0-21swapper/420:45:554
285899490106,253cyclictest0-21swapper/121:45:101
285899490106,253cyclictest0-21swapper/121:45:101
28629948820,465cyclictest0-21swapper/522:00:085
28599948824,2cyclictest0-21swapper/221:15:152
285899488105,211cyclictest0-21swapper/123:04:381
28609948720,85cyclictest0-21swapper/322:35:473
28639948660,338cyclictest121rcu_preempt23:50:106
28609948659,296cyclictest0-21swapper/319:40:223
28609948457,296cyclictest0-21swapper/320:50:193
285899484274,48cyclictest0-21swapper/120:46:071
28639948359,127cyclictest0-21swapper/600:03:426
28639948359,127cyclictest0-21swapper/600:03:426
28579948315,126cyclictest0-21swapper/022:30:080
28629948213,338cyclictest0-21swapper/523:49:465
28579948218,84cyclictest0-21swapper/020:50:110
286099481313,48cyclictest0-21swapper/322:29:153
28639948013,84cyclictest0-21swapper/600:28:026
285799480227,84cyclictest0-21swapper/021:21:590
28579947915,3cyclictest0-21swapper/022:40:140
28629947853,295cyclictest0-21swapper/521:05:195
28629947814,219cyclictest0-21swapper/523:01:095
28599947713,253cyclictest0-21swapper/223:04:422
2859994766,296cyclictest0-21swapper/200:25:142
28619947550,337cyclictest0-21swapper/421:45:024
28619947550,337cyclictest0-21swapper/421:45:014
28589947511,2cyclictest0-21swapper/120:10:451
28629947495,126cyclictest0-21swapper/521:27:005
2860994749,126cyclictest0-21swapper/323:45:043
28639947347,338cyclictest0-21swapper/620:48:186
2857994727,84cyclictest0-21swapper/000:33:570
2861994717,296cyclictest0-21swapper/420:10:314
2859994717,126cyclictest0-21swapper/221:22:072
2858994701,84cyclictest0-21swapper/100:23:291
28589946942,296cyclictest0-21swapper/122:30:251
2859994682,127cyclictest0-21swapper/221:01:592
2859994682,126cyclictest0-21swapper/220:45:462
2864994661,84cyclictest0-21swapper/721:32:197
286499466125,218cyclictest1551-21snmpd20:45:467
285999466124,211cyclictest0-21swapper/200:03:422
285999466124,211cyclictest0-21swapper/200:03:422
286499465124,338cyclictest0-21swapper/719:16:017
28639946582,380cyclictest0-21swapper/623:43:106
2862994651,84cyclictest0-21swapper/522:47:315
2861994651,385cyclictest0-21swapper/423:44:044
28649946483,85cyclictest0-21swapper/700:44:257
28619946476,296cyclictest0-21swapper/400:33:394
28599946478,253cyclictest0-21swapper/221:45:102
28599946478,253cyclictest0-21swapper/221:45:102
28649946383,84cyclictest0-21swapper/723:08:287
28649946340,211cyclictest0-21swapper/720:53:557
286499463124,84cyclictest0-21swapper/723:04:507
285999463252,46cyclictest0-21swapper/220:41:242
28639946240,177cyclictest0-21swapper/600:24:056
28619946279,126cyclictest30524-21ssh22:30:254
28639946135,220cyclictest0-21swapper/600:44:016
28639946134,211cyclictest0-21swapper/623:45:086
28599946134,254cyclictest0-21swapper/222:10:102
28599946077,85cyclictest0-21swapper/222:40:082
28599946034,89cyclictest0-21swapper/222:00:172
28619945835,126cyclictest121rcu_preempt21:21:594
285999458116,169cyclictest11414-21apt-get21:10:202
28589945874,211cyclictest25-21ksoftirqd/120:58:141
285799458114,84cyclictest121rcu_preempt23:57:450
28629945676,135cyclictest0-21swapper/520:18:125
28619945630,337cyclictest0-21swapper/420:50:254
2860994561,3cyclictest0-21swapper/323:08:173
28579945634,84cyclictest0-21swapper/022:00:300
286499455112,212cyclictest73-21ksoftirqd/721:10:467
28639945532,256cyclictest0-21swapper/600:36:056
28609945531,84cyclictest0-21swapper/300:36:163
28639945431,256cyclictest0-21swapper/619:41:106
28619945428,84cyclictest7941-21ssh22:00:224
28599945474,84cyclictest0-21swapper/222:30:172
285899454196,126cyclictest0-21swapper/100:32:341
28579945469,253cyclictest0-21swapper/019:45:180
28639945369,211cyclictest0-21swapper/621:05:196
28639945331,84cyclictest0-21swapper/620:10:456
28619945373,84cyclictest0-21swapper/423:57:464
28619945331,42cyclictest0-21swapper/421:32:144
28639945226,169cyclictest0-21swapper/621:15:176
28629945230,343cyclictest24583-21ssh23:57:265
28609945230,84cyclictest0-21swapper/323:01:093
28579945226,84cyclictest0-21swapper/019:20:100
28579945129,2cyclictest0-21swapper/023:49:510
28629945068,296cyclictest0-21swapper/522:30:165
286199450110,337cyclictest0-21swapper/423:01:154
28629944924,422cyclictest0-21swapper/521:45:095
28629944924,422cyclictest0-21swapper/521:45:095
286399448110,172cyclictest14396-21taskset22:40:156
28629944822,253cyclictest0-21swapper/519:20:055
285899448111,254cyclictest2855-21cyclictest21:15:151
28649944624,84cyclictest0-21swapper/723:50:297
286399445103,170cyclictest0-21swapper/600:34:306
285899445106,126cyclictest0-21swapper/122:00:091
28639944460,211cyclictest23383-21ssh23:39:346
28619944465,127cyclictest121rcu_preempt23:39:204
28589944418,253cyclictest29229-21sh22:47:331
28639944317,177cyclictest0-21swapper/621:10:426
28639944220,126cyclictest0-21swapper/622:33:236
28629944220,2cyclictest0-21swapper/521:22:105
28639944197,341cyclictest22333-21ssh22:08:186
28639944119,256cyclictest0-21swapper/621:32:006
285799441231,7cyclictest0-21swapper/019:16:000
28619944014,126cyclictest121rcu_preempt22:08:464
28589943999,338cyclictest0-21swapper/123:57:461
28649943814,84cyclictest0-21swapper/721:05:267
28629943815,256cyclictest0-21swapper/522:40:135
28599943815,211cyclictest0-21swapper/222:56:372
28589943854,254cyclictest0-21swapper/120:32:331
28609943715,256cyclictest0-21swapper/321:15:163
28629943510,126cyclictest0-21swapper/500:34:425
28609943553,126cyclictest41-21ksoftirqd/323:57:203
28649943497,171cyclictest0-21swapper/722:40:137
28639943393,338cyclictest2855-21cyclictest22:00:216
286099433175,126cyclictest0-21swapper/322:30:253
2861994314,338cyclictest0-21swapper/423:49:514
2859994319,84cyclictest0-21swapper/219:19:232
2862994304,42cyclictest0-21swapper/519:19:065
2859994293,209cyclictest321ktimersoftd/219:20:062
2863994274,256cyclictest0-21swapper/623:22:026
2861994265,255cyclictest0-21swapper/422:40:144
286199426130,293cyclictest64450irq/122-eth022:10:084
28639942583,339cyclictest0-21swapper/619:20:056
2859994240,84cyclictest0-21swapper/221:53:012
2864994231,84cyclictest3485-21ssh00:03:467
2864994231,84cyclictest3485-21ssh00:03:467
286299423209,211cyclictest561ktimersoftd/521:32:035
28609942379,169cyclictest41-21ksoftirqd/319:19:473
28649942283,84cyclictest0-21swapper/700:33:517
2861994221,256cyclictest0-21swapper/421:15:164
28609942135,127cyclictest0-21swapper/320:58:143
286499420120,84cyclictest0-21swapper/719:45:167
28609942080,338cyclictest0-21swapper/321:45:163
28609942080,338cyclictest0-21swapper/321:45:153
28649941980,84cyclictest0-21swapper/722:00:177
28619941940,295cyclictest0-21swapper/419:15:594
28649941879,84cyclictest0-21swapper/722:08:307
28599941879,84cyclictest0-21swapper/219:45:182
28619941737,295cyclictest0-21swapper/422:47:324
28629941675,338cyclictest0-21swapper/521:53:025
28639941432,298cyclictest0-21swapper/621:53:026
28609941434,296cyclictest0-21swapper/322:40:133
28589941427,84cyclictest0-21swapper/121:21:541
28649941374,84cyclictest0-21swapper/721:21:547
28649941273,84cyclictest0-21swapper/719:20:057
28649941231,84cyclictest2561-21kworker/7:223:55:017
28639941232,134cyclictest19983-21ssh23:55:136
28619941271,338cyclictest0-21swapper/419:45:074
28609941271,338cyclictest0-21swapper/323:30:023
28639941131,257cyclictest704-21nscd22:55:496
28639941030,296cyclictest0-21swapper/620:50:186
28639940928,296cyclictest0-21swapper/622:47:326
28649940869,84cyclictest0-21swapper/722:30:107
285899408236,41cyclictest0-21swapper/121:26:591
286099407108,126cyclictest41-21ksoftirqd/300:25:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional