You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-17 - 07:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri Apr 17, 2026 00:56:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
42379977051,641cyclictest0-21swapper/223:09:122
42379977051,641cyclictest0-21swapper/223:09:122
42379977051,641cyclictest0-21swapper/223:09:122
4237997661,762cyclictest0-21swapper/222:59:412
42369975479,126cyclictest0-21swapper/123:53:491
42379973454,677cyclictest0-21swapper/223:55:022
42419972794,417cyclictest0-21swapper/622:56:066
42379971375,84cyclictest0-21swapper/221:23:412
42379970223,676cyclictest0-21swapper/223:13:562
4241996811,592cyclictest0-21swapper/621:48:576
423999672587,83cyclictest471rcuc/422:34:494
423599667114,380cyclictest0-21swapper/000:21:060
423599667114,380cyclictest0-21swapper/000:21:060
42369966024,127cyclictest0-21swapper/122:31:361
423599652103,126cyclictest4233-21cyclictest00:30:040
423899646559,84cyclictest391rcuc/323:54:033
4240996395,2cyclictest0-21swapper/523:56:235
4236996395,2cyclictest0-21swapper/123:56:241
4236996360,84cyclictest0-21swapper/123:23:211
4236996350,84cyclictest0-21swapper/122:54:571
4239996341,383cyclictest0-21swapper/423:56:244
42399963180,84cyclictest0-21swapper/400:00:094
42379963178,550cyclictest0-21swapper/223:59:382
42359963136,295cyclictest9-21ksoftirqd/022:43:280
423899629117,338cyclictest0-21swapper/323:11:183
424299628206,338cyclictest4233-21cyclictest00:18:217
424199628118,380cyclictest4233-21cyclictest00:43:186
423699626116,380cyclictest0-21swapper/123:06:561
423699626116,380cyclictest0-21swapper/123:06:551
423699626116,380cyclictest0-21swapper/123:06:551
42359962575,126cyclictest121rcu_preempt23:54:590
42369962226,380cyclictest0-21swapper/100:08:231
42399962167,466cyclictest0-21swapper/423:30:184
42399962167,466cyclictest0-21swapper/423:30:184
42379961158,550cyclictest0-21swapper/223:29:422
42409961056,338cyclictest0-21swapper/500:29:165
42429960754,380cyclictest0-21swapper/722:58:217
42379960754,550cyclictest0-21swapper/222:42:062
42409960655,126cyclictest0-21swapper/523:22:255
42389960655,466cyclictest0-21swapper/300:27:323
42389960655,126cyclictest0-21swapper/321:24:453
42379960493,508cyclictest0-21swapper/221:38:192
4237995961,592cyclictest0-21swapper/200:30:282
4240995950,85cyclictest0-21swapper/500:20:375
4240995950,85cyclictest0-21swapper/500:20:375
4238995940,169cyclictest0-21swapper/323:37:573
4240995930,84cyclictest0-21swapper/500:44:165
4239995930,84cyclictest64450irq/122-eth022:55:014
4239995930,84cyclictest0-21swapper/423:37:134
4239995930,84cyclictest0-21swapper/421:37:534
4239995930,84cyclictest0-21swapper/400:20:374
4239995930,84cyclictest0-21swapper/400:20:374
4236995930,84cyclictest0-21swapper/121:23:411
42379958978,508cyclictest0-21swapper/222:54:572
42379958936,423cyclictest0-21swapper/221:48:452
42379958833,552cyclictest0-21swapper/223:37:562
423699587122,126cyclictest0-21swapper/100:29:171
42429958270,210cyclictest0-21swapper/723:26:057
424099582116,211cyclictest0-21swapper/523:40:025
42419958068,338cyclictest0-21swapper/623:29:526
42429957929,261cyclictest0-21swapper/723:08:507
42429957929,261cyclictest0-21swapper/723:08:507
42429957929,261cyclictest0-21swapper/723:08:507
42409957969,295cyclictest0-21swapper/521:25:375
42379957970,472cyclictest0-21swapper/219:30:172
423999578110,465cyclictest0-21swapper/423:53:514
42409957668,126cyclictest11203-21ssh22:33:055
42369957526,84cyclictest0-21swapper/123:15:141
42369957526,84cyclictest0-21swapper/123:15:141
42419957421,339cyclictest0-21swapper/623:30:186
42419957421,339cyclictest0-21swapper/623:30:176
42379957319,127cyclictest10334-21ls00:10:202
42359957322,211cyclictest0-21swapper/023:14:040
42359957222,84cyclictest0-21swapper/000:25:100
42419957121,126cyclictest0-21swapper/600:22:566
42419957121,126cyclictest0-21swapper/600:22:556
42429957064,422cyclictest0-21swapper/721:22:167
42389957020,126cyclictest0-21swapper/323:29:513
424099569103,211cyclictest0-21swapper/522:57:575
42359956917,2cyclictest0-21swapper/023:26:320
42359956916,253cyclictest6855-21sh23:09:370
42359956916,253cyclictest6855-21sh23:09:370
42359956916,253cyclictest6855-21sh23:09:360
423999567184,380cyclictest481ktimersoftd/400:30:424
423899567226,338cyclictest6997-1kworker/u17:022:51:503
42419956616,126cyclictest4785-21taskset23:06:566
42419956616,126cyclictest4785-21taskset23:06:566
42419956616,126cyclictest4785-21taskset23:06:566
423999565227,83cyclictest64450irq/122-eth023:23:274
42379956411,550cyclictest0-21swapper/200:22:592
42379956411,550cyclictest0-21swapper/200:22:592
42359956415,2cyclictest0-21swapper/021:49:500
42419956393,338cyclictest8808-21fschecks_time23:10:246
42399956353,380cyclictest0-21swapper/423:00:104
42389956314,7cyclictest0-21swapper/322:24:593
42379956310,550cyclictest0-21swapper/200:17:252
42369956312,126cyclictest0-21swapper/122:44:151
42379956250,509cyclictest0-21swapper/222:35:232
42419956152,126cyclictest23322-21ssh00:16:516
423999560265,89cyclictest0-21swapper/422:59:364
4237995607,550cyclictest0-21swapper/200:27:412
42359955590,293cyclictest0-21swapper/000:08:210
4240995520,84cyclictest3030-21ssh23:27:095
423999552212,338cyclictest64450irq/122-eth023:27:204
4238995521,384cyclictest0-21swapper/323:56:243
423699551124,296cyclictest0-21swapper/123:28:551
4236995510,84cyclictest0-21swapper/123:38:571
4235995510,84cyclictest0-21swapper/023:21:330
4235995510,84cyclictest0-21swapper/022:54:570
42419955084,126cyclictest121rcu_preempt21:23:376
4235995501,383cyclictest0-21swapper/023:56:240
424299549466,3cyclictest711rcuc/700:44:297
42419954980,296cyclictest0-21swapper/600:30:506
423999549505,42cyclictest471rcuc/400:26:264
4235995490,84cyclictest0-21swapper/019:30:170
42419954840,219cyclictest0-21swapper/600:27:106
42379954735,381cyclictest0-21swapper/223:23:032
42389954677,211cyclictest41-21ksoftirqd/323:40:053
42409954577,295cyclictest0-21swapper/523:53:235
42369954537,126cyclictest4233-21cyclictest00:00:301
42419954377,84cyclictest0-21swapper/622:52:476
424099543121,210cyclictest0-21swapper/523:36:215
42429954234,126cyclictest0-21swapper/723:53:437
42399954274,295cyclictest121rcu_preempt00:44:004
42399954173,465cyclictest0-21swapper/423:07:504
42399954173,465cyclictest0-21swapper/423:07:494
42399954173,465cyclictest0-21swapper/423:07:494
424099540283,126cyclictest723-21nscd22:53:275
42419953830,253cyclictest0-21swapper/620:03:296
423999537114,84cyclictest121rcu_preempt23:13:364
42379953769,465cyclictest0-21swapper/221:40:122
423599537110,211cyclictest9-21ksoftirqd/022:25:250
42429953626,383cyclictest0-21swapper/723:56:247
42379953625,508cyclictest0-21swapper/200:06:212
42389953571,126cyclictest0-21swapper/321:39:413
42389953526,84cyclictest0-21swapper/300:09:123
42429953469,211cyclictest0-21swapper/722:52:087
42389953467,211cyclictest0-21swapper/322:43:093
42419953364,295cyclictest0-21swapper/622:25:346
42429953264,465cyclictest0-21swapper/722:43:207
42419953123,84cyclictest0-21swapper/623:56:286
42409953122,84cyclictest0-21swapper/523:30:185
42409953122,84cyclictest0-21swapper/523:30:185
424299528102,211cyclictest73-21ksoftirqd/700:08:217
42359952862,84cyclictest0-21swapper/021:24:280
42429952657,126cyclictest0-21swapper/721:25:267
42419952618,126cyclictest0-21swapper/623:53:446
42369952419,45cyclictest0-21swapper/123:30:261
42369952419,45cyclictest0-21swapper/123:30:261
42429952396,211cyclictest73-21ksoftirqd/723:12:457
424099522266,253cyclictest561ktimersoftd/521:49:205
42359951911,84cyclictest0-21swapper/019:29:570
4241995167,127cyclictest0-21swapper/600:09:406
42409951487,339cyclictest0-21swapper/520:03:355
42379951345,465cyclictest0-21swapper/223:15:282
42379951345,465cyclictest0-21swapper/223:15:282
42379951345,211cyclictest5380-21cron20:05:002
4236995124,126cyclictest0-21swapper/123:15:011
4240995100,84cyclictest0-21swapper/521:37:535
42399951042,253cyclictest5405-21perf20:05:024
4237995102,126cyclictest0-21swapper/223:40:182
42389950980,211cyclictest0-21swapper/323:23:483
4236995090,84cyclictest0-21swapper/100:17:251
4241995081,261cyclictest0-21swapper/622:24:596
42399950883,422cyclictest0-21swapper/420:05:104
4236995080,84cyclictest0-21swapper/119:30:171
42359950882,211cyclictest9-21ksoftirqd/000:42:480
4236995070,41cyclictest121rcu_preempt00:10:231
423599506123,168cyclictest0-21swapper/022:33:230
4235995060,2cyclictest0-21swapper/022:56:530
42389950537,465cyclictest0-21swapper/300:18:403
42359950541,253cyclictest0-21swapper/023:46:550
423899504460,42cyclictest401ktimersoftd/322:25:263
42369950482,256cyclictest704-21nscd22:24:591
42429950380,168cyclictest0-21swapper/700:26:417
42379950380,84cyclictest0-21swapper/200:42:322
423899502419,2cyclictest391rcuc/321:47:183
42379950233,466cyclictest0-21swapper/221:50:232
4236995022,331cyclictest0-21swapper/100:20:551
4236995022,331cyclictest0-21swapper/100:20:551
42359950280,84cyclictest0-21swapper/000:16:350
42419950174,211cyclictest30416-21ssh23:23:566
42399950174,211cyclictest0-21swapper/400:17:044
42389950174,211cyclictest1553-21runrttasks20:03:323
42389950132,380cyclictest0-21swapper/300:30:403
42359950173,380cyclictest0-21swapper/023:30:210
42359950173,380cyclictest0-21swapper/023:30:210
423999500203,295cyclictest64450irq/122-eth022:44:464
42399949873,422cyclictest0-21swapper/400:08:124
42419949770,211cyclictest65-21ksoftirqd/623:00:176
42399949671,338cyclictest0-21swapper/422:35:074
42359949673,42cyclictest0-21swapper/023:38:100
423799495281,126cyclictest33-21ksoftirqd/223:46:372
423799495114,126cyclictest11174-21ssh22:33:032
42369949572,84cyclictest0-21swapper/121:25:111
42419949470,211cyclictest0-21swapper/622:32:336
424099494110,127cyclictest5599-21sh21:21:585
42369949472,84cyclictest0-21swapper/121:49:061
42409949364,380cyclictest0-21swapper/500:00:295
42359949328,84cyclictest0-21swapper/021:50:180
424199492107,211cyclictest24288-21tail23:40:176
424099492109,380cyclictest0-21swapper/522:25:015
42389949227,299cyclictest4233-21cyclictest22:59:263
42429949068,419cyclictest0-21swapper/721:50:267
42409949024,85cyclictest121rcu_preempt23:12:505
42429948966,256cyclictest4233-21cyclictest00:00:157
423799489109,296cyclictest694-21irqbalance00:00:192
423599489107,126cyclictest121rcu_preempt20:04:380
42379948828,3cyclictest0-21swapper/220:05:112
42419948765,255cyclictest30231-21ssh22:44:416
423899487103,381cyclictest0-21swapper/300:21:063
423899487103,381cyclictest0-21swapper/300:21:063
42429948558,211cyclictest73-21ksoftirqd/721:47:167
42419948521,254cyclictest0-21swapper/623:38:546
42399948521,43cyclictest0-21swapper/421:24:454
42389948521,298cyclictest0-21swapper/321:25:383
42409948420,126cyclictest0-21swapper/523:10:025
42409948420,126cyclictest0-21swapper/523:10:015
42409948420,126cyclictest0-21swapper/523:10:015
424299483142,338cyclictest11536-21sh22:33:277
42429948218,298cyclictest0-21swapper/700:25:007
42429948218,298cyclictest0-21swapper/700:24:597
423999481102,127cyclictest0-21swapper/421:47:344
42359948158,84cyclictest9594-21fschecks_count21:25:140
42429948056,126cyclictest0-21swapper/721:39:357
42419948015,304cyclictest0-21swapper/621:25:106
4236994789,84cyclictest0-21swapper/120:03:251
42369947810,168cyclictest25-21ksoftirqd/122:59:011
4238994778,338cyclictest0-21swapper/322:33:273
42359947710,83cyclictest0-21swapper/021:37:410
424299475136,84cyclictest698-21ptp4l23:39:297
4236994759,84cyclictest121rcu_preempt00:44:201
42369947553,84cyclictest0-21swapper/123:00:141
4238994701,211cyclictest0-21swapper/323:09:253
4238994701,211cyclictest0-21swapper/323:09:253
4238994701,211cyclictest0-21swapper/323:09:253
4236994673,3cyclictest0-21swapper/121:39:431
424099466124,339cyclictest16448-21switchtime23:15:285
424099466124,339cyclictest16448-21switchtime23:15:285
423699466125,338cyclictest0-21swapper/122:35:141
42409946582,210cyclictest0-21swapper/500:19:095
4240994651,42cyclictest0-21swapper/523:47:045
423899465124,338cyclictest0-21swapper/319:30:173
424299464124,84cyclictest0-21swapper/723:22:247
424199464124,338cyclictest26802-21kworker/u16:121:39:126
423899464124,338cyclictest23276-21fschecks_count23:00:153
424199463123,338cyclictest4233-21cyclictest19:29:436
42409946382,84cyclictest0-21swapper/519:29:505
423899463123,338cyclictest0-21swapper/300:10:203
4237994631,459cyclictest0-21swapper/223:00:132
42409946240,338cyclictest0-21swapper/522:42:515
424099462123,336cyclictest0-21swapper/500:07:595
423899462123,83cyclictest0-21swapper/319:29:163
42359946281,84cyclictest0-21swapper/021:40:130
424099461120,338cyclictest0-21swapper/522:25:295
42389946139,255cyclictest0-21swapper/300:00:153
42379946135,423cyclictest0-21swapper/222:24:262
42359946178,84cyclictest121rcu_preempt22:24:140
424299460119,338cyclictest0-21swapper/723:15:187
424299460119,338cyclictest0-21swapper/723:15:187
42399946038,47cyclictest0-21swapper/423:46:354
423599460160,126cyclictest121rcu_preempt23:40:220
423599460118,339cyclictest0-21swapper/023:00:160
42429945937,256cyclictest0-21swapper/720:02:397
424299459119,338cyclictest0-21swapper/723:40:237
424299458116,339cyclictest0-21swapper/700:10:107
42399945876,296cyclictest0-21swapper/421:40:104
42379945875,211cyclictest6640-21cut23:30:192
42379945875,211cyclictest6640-21cut23:30:192
42379945835,256cyclictest0-21swapper/221:25:282
423699458116,339cyclictest1551-21snmpd19:28:461
42359945837,255cyclictest0-21swapper/000:00:140
424099457114,340cyclictest837-21kworker/u16:200:30:225
423699457116,338cyclictest0-21swapper/100:30:221
42399945676,377cyclictest24041-21/usr/sbin/munin21:50:214
424299455115,84cyclictest0-21swapper/719:29:347
424299455115,84cyclictest0-21swapper/700:30:257
42389945533,255cyclictest0-21swapper/300:43:043
42369945571,211cyclictest25-21ksoftirqd/121:40:121
423699455114,338cyclictest0-21swapper/123:46:461
42389945431,256cyclictest0-21swapper/323:15:193
42389945431,256cyclictest0-21swapper/323:15:183
424299453114,84cyclictest0-21swapper/723:00:097
424299453113,338cyclictest837-21kworker/u16:223:30:207
424299453113,338cyclictest837-21kworker/u16:223:30:207
424299453112,338cyclictest0-21swapper/723:46:557
42399945332,2cyclictest0-21swapper/421:25:094
42419945267,211cyclictest16442-21ssh23:15:286
42419945267,211cyclictest16442-21ssh23:15:286
424099451110,338cyclictest0-21swapper/500:10:135
42379945024,423cyclictest0-21swapper/222:25:142
42359945029,255cyclictest0-21swapper/023:15:190
42359945029,255cyclictest0-21swapper/023:15:180
423999449109,338cyclictest0-21swapper/423:15:224
423999449109,338cyclictest0-21swapper/423:15:214
424299447107,84cyclictest0-21swapper/722:45:057
424099446104,339cyclictest0-21swapper/521:50:245
423699446106,337cyclictest0-21swapper/121:50:251
42419944363,211cyclictest0-21swapper/621:40:046
42419944360,175cyclictest1551-21snmpd21:50:316
423999443357,84cyclictest481ktimersoftd/422:25:004
424299442143,126cyclictest121rcu_preempt22:35:167
42399943918,84cyclictest0-21swapper/419:30:164
42399943917,255cyclictest0-21swapper/400:10:224
42419943798,84cyclictest0-21swapper/600:00:116
42379943798,83cyclictest0-21swapper/219:29:332
42399943653,380cyclictest0-21swapper/419:28:134
42389943613,84cyclictest0-21swapper/321:50:253
4240994348,295cyclictest0-21swapper/519:30:055
42429943393,338cyclictest0-21swapper/721:40:127
42369943312,213cyclictest1551-21snmpd22:25:261
42379943046,254cyclictest0-21swapper/222:45:022
4236994304,211cyclictest0-21swapper/123:40:231
42359942646,169cyclictest9897-21ssh00:10:160
4235994251,84cyclictest31054-21ssh22:45:020
42429942383,338cyclictest0-21swapper/722:25:337
42429942382,338cyclictest0-21swapper/719:30:177
424199423121,84cyclictest121rcu_preempt23:46:556
42369942384,84cyclictest0-21swapper/122:45:031
42399942242,84cyclictest0-21swapper/422:45:034
42389942281,339cyclictest0-21swapper/323:47:093
42409942182,84cyclictest0-21swapper/522:35:095
42419942082,83cyclictest0-21swapper/600:10:266
42419942080,338cyclictest0-21swapper/619:30:176
42389941978,339cyclictest0-21swapper/320:05:103
423899419122,85cyclictest5490-21ssh23:30:093
423899419122,85cyclictest5490-21ssh23:30:083
42429941774,340cyclictest15850irq/123-ahci[0022:24:247
42389941776,339cyclictest0-21swapper/322:35:153
42419941676,338cyclictest0-21swapper/622:35:176
42399941676,337cyclictest0-21swapper/422:25:324
42419941575,338cyclictest0-21swapper/622:45:036
42409941576,84cyclictest0-21swapper/523:00:225
42359941473,338cyclictest0-21swapper/022:35:120
423899413118,84cyclictest121rcu_preempt21:40:063
42399941233,295cyclictest0-21swapper/423:40:134
42389941171,338cyclictest0-21swapper/322:45:013
42429940665,338cyclictest0-21swapper/720:05:117
424099399101,295cyclictest0-21swapper/521:40:135
42359939453,338cyclictest0-21swapper/020:05:110
42409939310,295cyclictest0-21swapper/522:45:055
42369935619,44cyclictest0-21swapper/120:05:111
42419933641,211cyclictest0-21swapper/620:05:106
42409933175,84cyclictest121rcu_preempt20:05:105
272429995,2sleep30-21swapper/319:05:183
352528942,8sleep50-21swapper/519:06:015
318912890,0sleep70-21swapper/719:55:017
352928554,27sleep00-21swapper/019:06:040
353628447,33sleep70-21swapper/719:06:117
351528352,27sleep40-21swapper/419:05:524
350828351,28sleep60-21swapper/619:05:466
358828250,28sleep10-21swapper/119:06:531
353128251,28sleep20-21swapper/219:06:052
151742750,0sleep10-21swapper/122:18:151
144392700,0sleep40-21swapper/422:17:454
37592690,0sleep10-21swapper/122:12:211
311632640,0sleep00-21swapper/019:50:210
4238992910,18cyclictest0-21swapper/321:19:433
4238992910,18cyclictest0-21swapper/319:50:583
4235992910,18cyclictest0-21swapper/022:10:480
4242992828,0cyclictest0-21swapper/720:58:027
4242992828,0cyclictest0-21swapper/720:38:027
4242992810,18cyclictest0-21swapper/722:11:037
4242992810,18cyclictest0-21swapper/720:47:237
4239992810,18cyclictest0-21swapper/420:19:414
4238992827,1cyclictest0-21swapper/322:10:463
4238992810,18cyclictest0-21swapper/320:58:053
4238992810,18cyclictest0-21swapper/320:19:383
4238992810,0cyclictest0-21swapper/320:38:013
4238992810,0cyclictest0-21swapper/320:28:053
4238992810,0cyclictest0-21swapper/319:18:403
4238992810,0cyclictest0-21swapper/319:14:113
4237992810,18cyclictest0-21swapper/221:07:192
4237992810,18cyclictest0-21swapper/221:07:192
4235992810,18cyclictest0-21swapper/019:18:470
4242992727,0cyclictest0-21swapper/721:19:307
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional