You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 00:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed Jun 17, 2026 12:54:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
159319977654,719cyclictest21725-21ssh09:41:000
15932996780,126cyclictest0-21swapper/109:44:251
15938996771,41cyclictest0-21swapper/709:44:487
159319967580,592cyclictest0-21swapper/009:57:100
159379965054,381cyclictest121rcu_preempt11:34:186
1593399643133,253cyclictest33-21ksoftirqd/209:38:542
15937996360,85cyclictest18958-21ssh09:59:376
159319963540,465cyclictest0-21swapper/011:32:360
1593199629121,126cyclictest0-21swapper/012:07:090
159349960311,383cyclictest0-21swapper/309:44:473
15931996039,507cyclictest0-21swapper/012:21:310
159379960211,2cyclictest0-21swapper/609:44:316
159369960094,125cyclictest0-21swapper/510:52:495
159389959483,296cyclictest0-21swapper/709:58:167
159369959486,126cyclictest0-21swapper/509:41:215
15933995931,384cyclictest0-21swapper/209:44:472
15931995880,41cyclictest0-21swapper/011:06:490
159369958435,127cyclictest0-21swapper/511:35:125
159389957522,380cyclictest0-21swapper/711:42:047
159319957522,338cyclictest0-21swapper/009:39:370
159319957219,465cyclictest0-21swapper/011:11:150
159319956719,84cyclictest0-21swapper/008:04:470
15931995599,126cyclictest0-21swapper/011:35:140
15931995560,42cyclictest0-21swapper/011:56:420
1593599555129,211cyclictest0-21swapper/409:56:534
159329955544,338cyclictest0-21swapper/108:05:221
15931995530,42cyclictest0-21swapper/007:37:130
15934995520,127cyclictest3682-21chrt11:34:213
15931995520,42cyclictest0-21swapper/011:21:490
159339954639,42cyclictest121rcu_preempt11:33:412
159329954335,126cyclictest0-21swapper/111:56:491
159379954235,84cyclictest121rcu_preempt11:12:546
1593299541200,126cyclictest121rcu_preempt09:39:571
1593699540200,338cyclictest15929-21cyclictest08:04:355
159319954030,507cyclictest0-21swapper/012:31:590
159319954030,507cyclictest0-21swapper/012:31:580
159369953729,126cyclictest0-21swapper/511:12:425
159379953672,126cyclictest12742-21ssh10:28:196
159349953166,127cyclictest0-21swapper/309:38:073
159329952717,126cyclictest0-21swapper/111:40:431
159339952497,254cyclictest0-21swapper/208:05:212
159369952010,42cyclictest0-21swapper/511:34:365
159339951913,83cyclictest0-21swapper/212:32:032
159339951913,83cyclictest0-21swapper/212:32:022
1593599517177,338cyclictest64450irq/122-eth009:42:394
15931995120,42cyclictest0-21swapper/011:40:450
1593299510125,211cyclictest18537-21ssh09:58:491
15938995090,81cyclictest0-21swapper/707:38:137
15936995090,84cyclictest0-21swapper/509:59:375
15934995090,84cyclictest0-21swapper/309:59:383
15933995090,84cyclictest0-21swapper/209:59:382
1593299509256,83cyclictest0-21swapper/110:52:481
15932995081,84cyclictest0-21swapper/112:21:291
159369950683,381cyclictest0-21swapper/511:56:495
1593599502287,84cyclictest0-21swapper/411:32:544
1593599502122,257cyclictest64450irq/122-eth009:38:244
159349950233,84cyclictest0-21swapper/311:35:153
1593799501246,253cyclictest641ktimersoftd/611:35:116
1593699499371,126cyclictest561ktimersoftd/509:38:535
159339949930,84cyclictest0-21swapper/211:35:142
159319949931,465cyclictest32221-21sensors_temp10:05:240
159359949834,43cyclictest0-21swapper/411:40:364
159339949834,42cyclictest121rcu_preempt11:10:532
159339949833,298cyclictest0-21swapper/212:21:412
159379949672,127cyclictest0-21swapper/609:37:516
159359949632,43cyclictest0-21swapper/412:32:164
159359949632,43cyclictest0-21swapper/412:32:164
1593499495238,127cyclictest0-21swapper/308:03:233
159339949529,127cyclictest12177-21sh10:27:422
159379949467,212cyclictest65-21ksoftirqd/607:38:226
159349949062,211cyclictest0-21swapper/312:06:513
159339948924,126cyclictest0-21swapper/211:40:392
159329948920,296cyclictest0-21swapper/111:34:161
159329948862,295cyclictest0-21swapper/112:06:461
159329948723,42cyclictest0-21swapper/111:07:121
159379948522,205cyclictest0-21swapper/610:52:516
1593599485143,126cyclictest121rcu_preempt11:35:164
159349948355,296cyclictest0-21swapper/311:56:333
159319948214,42cyclictest0-21swapper/010:52:500
159359948117,41cyclictest121rcu_preempt11:11:134
159339948159,169cyclictest0-21swapper/208:04:512
159379948011,211cyclictest0-21swapper/612:31:426
159379948011,211cyclictest0-21swapper/612:31:416
159349948014,84cyclictest0-21swapper/312:32:163
159349948014,84cyclictest0-21swapper/312:32:153
15938994799,212cyclictest0-21swapper/709:38:347
159379947956,256cyclictest0-21swapper/612:21:426
159349947913,42cyclictest0-21swapper/311:10:563
159339947913,84cyclictest121rcu_preempt07:38:162
159369947610,170cyclictest0-21swapper/512:06:465
15932994756,338cyclictest0-21swapper/111:12:101
159359947349,126cyclictest0-21swapper/412:21:404
159389947190,337cyclictest0-21swapper/711:34:367
15931994670,42cyclictest0-21swapper/010:27:570
1593499464334,84cyclictest20825-21sh10:00:143
1593799463124,84cyclictest0-21swapper/608:03:576
159389946240,256cyclictest0-21swapper/711:12:387
159389946135,423cyclictest0-21swapper/712:21:307
1593699461246,84cyclictest15929-21cyclictest11:40:345
159359945874,253cyclictest0-21swapper/412:07:114
1593899457119,127cyclictest23534-21diskmemload10:28:007
159329945734,84cyclictest0-21swapper/112:32:051
159329945734,84cyclictest0-21swapper/112:32:051
1593299457116,126cyclictest4588-21cat11:35:141
1593699455114,338cyclictest0-21swapper/510:05:205
1593599455114,338cyclictest11948-21sh10:27:274
1593699454372,3cyclictest551rcuc/507:38:505
159329945424,84cyclictest0-21swapper/108:03:141
159349945228,126cyclictest0-21swapper/310:52:523
159369945129,255cyclictest0-21swapper/512:21:425
159359945024,84cyclictest0-21swapper/407:39:354
1593899449108,338cyclictest0-21swapper/710:52:477
159339944822,254cyclictest0-21swapper/211:21:562
159319944722,337cyclictest0-21swapper/009:45:110
159369944620,253cyclictest0-21swapper/510:27:275
159359944666,42cyclictest0-21swapper/408:02:174
159359944219,84cyclictest0-21swapper/410:00:144
159339944018,84cyclictest0-21swapper/212:07:092
159389943911,296cyclictest0-21swapper/709:45:117
159339943915,127cyclictest0-21swapper/210:52:392
159329943710,211cyclictest25-21ksoftirqd/111:22:041
159319943610,84cyclictest0-21swapper/010:00:180
159379943511,84cyclictest0-21swapper/608:05:226
1593499430135,127cyclictest0-21swapper/311:40:573
1593399430261,42cyclictest0-21swapper/211:56:542
159329943046,254cyclictest0-21swapper/107:39:451
15933994285,43cyclictest0-21swapper/210:00:192
15933994281,84cyclictest23206-21ssh11:07:052
159359942643,211cyclictest0-21swapper/411:56:334
1593699424211,125cyclictest0-21swapper/512:32:085
1593699424211,125cyclictest0-21swapper/512:32:085
15931994240,42cyclictest18823-21memory08:05:220
159379942382,338cyclictest0-21swapper/610:00:146
15937994231,2cyclictest0-21swapper/611:22:056
159389942282,338cyclictest0-21swapper/711:35:177
159389942040,296cyclictest0-21swapper/712:07:007
159389942040,296cyclictest0-21swapper/708:05:177
159349941934,126cyclictest0-21swapper/307:37:253
159379941877,338cyclictest0-21swapper/611:56:436
159369941838,3cyclictest0-21swapper/509:45:065
159379941775,339cyclictest0-21swapper/610:05:326
159349941778,84cyclictest0-21swapper/310:05:323
1593499417245,124cyclictest0-21swapper/311:07:273
1593299417245,84cyclictest0-21swapper/110:28:061
159389941676,338cyclictest0-21swapper/711:56:497
159349941677,84cyclictest0-21swapper/312:21:313
159389941535,296cyclictest0-21swapper/710:05:197
159379941574,338cyclictest0-21swapper/611:07:056
159369941575,338cyclictest0-21swapper/511:21:575
159389941434,296cyclictest0-21swapper/708:03:387
159389941433,296cyclictest0-21swapper/711:07:327
1593599414245,42cyclictest0-21swapper/408:05:164
159319941477,253cyclictest0-21swapper/007:40:040
159389941372,338cyclictest0-21swapper/711:21:477
159389941333,214cyclictest20796-21fschecks_time10:00:147
159389941233,295cyclictest0-21swapper/707:40:067
159359941172,84cyclictest0-21swapper/409:45:124
159349941172,84cyclictest0-21swapper/310:27:303
159369940929,127cyclictest0-21swapper/510:00:145
159339940923,254cyclictest0-21swapper/209:45:112
159329940829,84cyclictest0-21swapper/110:00:061
159359940566,84cyclictest0-21swapper/410:05:214
159359940362,253cyclictest0-21swapper/411:21:464
159379940117,169cyclictest0-21swapper/611:40:526
1593599401229,84cyclictest0-21swapper/411:07:134
159359939960,84cyclictest0-21swapper/410:52:484
159329939716,126cyclictest0-21swapper/110:05:241
159389939617,176cyclictest0-21swapper/712:32:097
159389939617,176cyclictest0-21swapper/712:32:097
159339938690,84cyclictest0-21swapper/210:05:242
159349937839,126cyclictest0-21swapper/311:21:393
159379937740,253cyclictest0-21swapper/609:45:066
159369937636,85cyclictest0-21swapper/508:05:225
159379937229,340cyclictest0-21swapper/612:06:396
159349936930,84cyclictest0-21swapper/309:45:123
159379936873,211cyclictest15929-21cyclictest07:40:046
159339936830,84cyclictest0-21swapper/207:40:022
159349936523,211cyclictest0-21swapper/308:05:163
159369936223,84cyclictest0-21swapper/511:07:205
1593499348262,84cyclictest23272sleep307:40:063
1593599335167,41cyclictest0-21swapper/407:40:114
159369933173,42cyclictest121rcu_preempt07:40:065
159329932872,84cyclictest121rcu_preempt09:45:071
1593299320234,84cyclictest241ktimersoftd/107:40:111
1547329160,27sleep20-21swapper/207:09:362
1550228847,37sleep10-21swapper/107:09:591
1533528546,35sleep60-21swapper/607:07:406
1542428452,28sleep00-21swapper/007:08:530
1532228453,28sleep30-21swapper/307:07:293
1529428250,28sleep40-21swapper/407:07:044
1525928049,27sleep50-21swapper/507:06:345
1527927847,28sleep70-21swapper/707:06:517
146232770,0sleep40-21swapper/410:45:224
94232560,0sleep10-21swapper/112:13:341
15934995329,17cyclictest121rcu_preempt12:35:063
1593299505,5cyclictest0-21swapper/112:35:081
1593599483,35cyclictest121rcu_preempt12:35:124
15935994410,7cyclictest15128-21cpuspeed_turbos10:30:124
1593599432,5cyclictest0-21swapper/412:25:154
15931994235,4cyclictest18699-21sh12:00:220
1593599402,32cyclictest2754-21cpuspeed_turbos11:15:114
1593499409,18cyclictest41-21ksoftirqd/310:31:343
15934994022,5cyclictest31017-21ssh10:55:093
15934994022,5cyclictest31017-21ssh10:55:083
1593399402,34cyclictest0-21swapper/210:30:112
1593299402,33cyclictest21899-21runrttasks11:25:181
1593899392,5cyclictest0-21swapper/711:25:137
1593399392,33cyclictest0-21swapper/212:35:102
15932993932,4cyclictest0-21swapper/112:25:121
1593899382,32cyclictest0-21swapper/711:45:017
1593799382,32cyclictest0-21swapper/611:25:106
15936993831,4cyclictest31885-21sh12:25:175
1593499382,32cyclictest0-21swapper/312:25:123
1593399382,32cyclictest0-21swapper/212:25:152
1593399382,32cyclictest0-21swapper/211:15:132
1593299388,18cyclictest25-21ksoftirqd/111:46:441
1593299386,21cyclictest25-21ksoftirqd/110:30:091
1593199382,32cyclictest0-21swapper/010:30:220
1593899372,32cyclictest0-21swapper/712:00:137
1593899372,31cyclictest0-21swapper/712:10:067
15936993730,4cyclictest15401-21expr10:30:125
1593699372,31cyclictest0-21swapper/511:25:035
1593699371,3cyclictest2669-21ssh12:10:045
1593699371,33cyclictest0-21swapper/512:00:105
1593599372,31cyclictest0-21swapper/412:00:064
1593499372,31cyclictest0-21swapper/311:25:213
1593499371,33cyclictest0-21swapper/311:15:143
1593299377,18cyclictest25-21ksoftirqd/110:55:011
1593299377,18cyclictest25-21ksoftirqd/110:55:011
15932993729,4cyclictest0-21swapper/111:15:061
1593199372,4cyclictest0-21swapper/011:25:110
15938993630,3cyclictest4181-21sed11:15:217
15937993629,4cyclictest0-21swapper/611:15:176
15937993625,7cyclictest22851-21grep11:45:156
1593799361,31cyclictest17926-21ssh12:00:156
1593699361,31cyclictest2765-21cpuspeed_turbos11:15:125
1593599362,30cyclictest0-21swapper/412:10:014
1593499362,4cyclictest0-21swapper/312:00:053
1593399362,4cyclictest0-21swapper/212:00:062
1593299368,17cyclictest25-21ksoftirqd/112:00:501
15931993629,4cyclictest0-21swapper/012:10:060
1593199362,31cyclictest0-21swapper/011:15:010
1593199361,32cyclictest30481-21apt-config12:25:010
15938993531,2cyclictest0-21swapper/710:30:207
1593899352,30cyclictest30557-21rm12:25:027
15937993528,4cyclictest0-21swapper/612:10:046
1593799352,29cyclictest0-21swapper/610:30:166
1593699352,30cyclictest0-21swapper/512:35:125
1593499356,18cyclictest41-21ksoftirqd/312:10:183
1593499355,20cyclictest41-21ksoftirqd/311:46:033
1593199352,4cyclictest0-21swapper/011:45:030
1593599341,29cyclictest0-21swapper/410:55:094
1593599341,29cyclictest0-21swapper/410:55:084
1593399341,30cyclictest0-21swapper/210:55:092
1593399341,30cyclictest0-21swapper/210:55:082
1593899331,28cyclictest32175-21cut10:55:157
1593899331,28cyclictest32175-21cut10:55:157
15937993325,5cyclictest18257-21grep12:35:316
1593599334,16cyclictest49-21ksoftirqd/411:25:164
15933993324,6cyclictest22895-21grep11:45:162
1593399331,29cyclictest2584-21chmod12:10:022
15938993223,5cyclictest15719-21chrt12:35:097
1593799321,2cyclictest30480-21apt-config12:25:016
1593599321,19cyclictest49-21ksoftirqd/411:45:134
15931993123,5cyclictest19591-21ssh12:36:420
15936993022,5cyclictest22019-21grep11:45:115
15936993022,5cyclictest1042-21cat10:55:275
15936993022,5cyclictest1042-21cat10:55:275
15933993022,5cyclictest22591-21swap11:25:262
15931993023,4cyclictest30989-21ssh10:55:060
15931993023,4cyclictest30989-21ssh10:55:060
270122290,3sleep665-21ksoftirqd/612:40:216
15937992922,4cyclictest31951-21cut10:55:146
15937992922,4cyclictest31951-21cut10:55:146
15938992828,0cyclictest0-21swapper/708:24:427
15938992810,0cyclictest0-21swapper/707:23:577
15938992810,0cyclictest0-21swapper/707:23:567
15937992810,17cyclictest0-21swapper/609:27:546
15937992810,0cyclictest0-21swapper/607:34:396
15935992810,17cyclictest0-21swapper/409:27:344
15934992810,18cyclictest0-21swapper/309:07:363
15934992810,18cyclictest0-21swapper/307:23:573
15934992810,18cyclictest0-21swapper/307:23:573
15934992810,18cyclictest0-21swapper/307:13:343
15934992810,0cyclictest0-21swapper/308:38:153
15933992810,0cyclictest0-21swapper/209:27:372
15933992810,0cyclictest0-21swapper/207:23:592
15933992810,0cyclictest0-21swapper/207:23:582
15931992810,18cyclictest0-21swapper/009:28:120
15938992727,0cyclictest0-21swapper/709:07:387
15938992727,0cyclictest0-21swapper/707:59:537
15938992727,0cyclictest0-21swapper/707:59:537
15938992710,17cyclictest0-21swapper/707:13:307
15938992710,0cyclictest0-21swapper/709:27:327
15938992710,0cyclictest0-21swapper/708:38:247
15937992727,0cyclictest0-21swapper/608:53:106
15937992727,0cyclictest0-21swapper/608:38:126
15937992727,0cyclictest0-21swapper/607:13:286
15937992710,17cyclictest0-21swapper/609:07:356
15937992710,17cyclictest0-21swapper/608:24:416
15937992710,17cyclictest0-21swapper/607:59:586
15937992710,17cyclictest0-21swapper/607:59:576
15937992710,17cyclictest0-21swapper/607:23:246
15937992710,17cyclictest0-21swapper/607:23:236
15936992710,17cyclictest0-21swapper/509:27:355
15936992710,17cyclictest0-21swapper/508:00:015
15936992710,17cyclictest0-21swapper/508:00:005
15936992710,17cyclictest0-21swapper/507:34:355
15936992710,17cyclictest0-21swapper/507:23:485
15936992710,17cyclictest0-21swapper/507:23:475
15936992710,0cyclictest0-21swapper/508:52:485
15935992727,0cyclictest0-21swapper/408:38:344
15935992710,17cyclictest0-21swapper/409:07:514
15935992710,17cyclictest0-21swapper/408:24:284
15935992710,17cyclictest0-21swapper/407:59:494
15935992710,17cyclictest0-21swapper/407:59:484
15935992710,17cyclictest0-21swapper/407:34:384
15935992710,17cyclictest0-21swapper/407:23:254
15935992710,17cyclictest0-21swapper/407:23:254
15935992710,17cyclictest0-21swapper/407:13:234
15935992710,0cyclictest0-21swapper/408:52:464
15934992710,0cyclictest0-21swapper/309:27:393
15934992710,0cyclictest0-21swapper/308:52:483
15934992710,0cyclictest0-21swapper/307:34:403
15933992727,0cyclictest0-21swapper/208:53:122
15933992710,17cyclictest0-21swapper/208:38:132
15933992710,17cyclictest0-21swapper/207:34:542
15933992710,0cyclictest0-21swapper/209:07:432
15933992710,0cyclictest0-21swapper/208:24:432
15933992710,0cyclictest0-21swapper/207:59:492
15933992710,0cyclictest0-21swapper/207:59:492
15932992727,0cyclictest0-21swapper/108:24:271
15932992727,0cyclictest0-21swapper/107:23:271
15932992727,0cyclictest0-21swapper/107:23:261
15932992727,0cyclictest0-21swapper/107:13:251
15932992726,1cyclictest0-21swapper/109:27:431
15932992710,0cyclictest0-21swapper/108:52:521
15932992710,0cyclictest0-21swapper/108:38:101
15931992727,0cyclictest0-21swapper/009:07:380
15931992727,0cyclictest0-21swapper/007:34:370
15931992710,17cyclictest0-21swapper/007:23:270
15931992710,17cyclictest0-21swapper/007:23:260
15931992710,17cyclictest0-21swapper/007:13:280
15931992710,0cyclictest0-21swapper/008:52:440
15931992710,0cyclictest0-21swapper/008:38:200
15931992710,0cyclictest0-21swapper/008:24:280
15931992710,0cyclictest0-21swapper/007:59:510
15931992710,0cyclictest0-21swapper/007:59:510
15938992626,0cyclictest0-21swapper/707:34:367
15936992626,0cyclictest0-21swapper/509:07:395
15936992610,0cyclictest0-21swapper/508:38:105
15936992610,0cyclictest0-21swapper/508:24:335
15934992626,0cyclictest0-21swapper/308:24:423
15934992626,0cyclictest0-21swapper/307:59:583
15934992626,0cyclictest0-21swapper/307:59:583
15933992626,0cyclictest0-21swapper/207:13:292
15932992626,0cyclictest0-21swapper/109:07:321
15932992626,0cyclictest0-21swapper/107:59:481
15932992626,0cyclictest0-21swapper/107:59:481
15932992626,0cyclictest0-21swapper/107:34:351
139942260,2sleep31593499cyclictest09:20:203
36872250,0sleep70-21swapper/710:23:437
15938992525,0cyclictest0-21swapper/708:52:427
15936992525,0cyclictest0-21swapper/507:13:365
218132220,0sleep20-21swapper/209:25:012
15932992018,1cyclictest0-21swapper/107:15:161
245992170,0sleep30-21swapper/312:40:033
1593699161,14cyclictest0-21swapper/510:13:155
15938991512,2cyclictest4515-21unixbench-2d10:40:217
1593199156,8cyclictest0-21swapper/009:20:000
15938991411,2cyclictest357-21ls11:50:167
15936991412,1cyclictest561ktimersoftd/509:20:125
15935991410,2cyclictest4831-21head09:50:244
15934991412,1cyclictest0-21swapper/310:10:373
15934991410,2cyclictest27797-21perf10:20:003
1593399140,12cyclictest22021-21head07:15:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional