You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 15:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon Mar 23, 2026 12:56:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
122799117474,211cyclictest26102-21kworker/u16:012:06:151
1226999380,84cyclictest0-21swapper/011:45:100
1226998470,84cyclictest0-21swapper/011:26:470
1226998470,84cyclictest0-21swapper/011:26:470
1226998450,84cyclictest0-21swapper/011:52:140
122699789110,676cyclictest23057-21ssh09:50:110
1226997630,84cyclictest30082-21ssh09:55:100
1226997630,84cyclictest25284-21diskmemload12:04:300
12269976041,84cyclictest0-21swapper/009:33:350
1226997200,84cyclictest0-21swapper/010:30:260
12269969157,84cyclictest0-21swapper/012:35:050
12289967882,465cyclictest7952-21sh10:38:352
122699676339,168cyclictest0-21swapper/012:30:010
122699676339,168cyclictest0-21swapper/012:30:010
12269966226,84cyclictest29625-21ssh12:44:560
123099658107,126cyclictest1872-21gltestperf12:10:194
12269965764,84cyclictest0-21swapper/010:36:070
123299654101,380cyclictest9028-21diskmemload12:06:146
12299963581,380cyclictest0-21swapper/311:42:143
1226996350,84cyclictest0-21swapper/012:09:100
12269962832,86cyclictest0-21swapper/012:10:120
12299962570,338cyclictest31434-21taskset11:30:083
12279962576,337cyclictest0-21swapper/110:32:111
12279962471,380cyclictest0-21swapper/111:43:311
12279962226,126cyclictest0-21swapper/111:28:541
12279962226,126cyclictest0-21swapper/111:28:541
12329962167,381cyclictest1563-21snmpd12:28:566
12279962167,380cyclictest0-21swapper/109:51:481
12329961926,296cyclictest0-21swapper/610:59:466
12339961560,381cyclictest0-21swapper/710:35:307
122999610101,126cyclictest0-21swapper/309:48:453
12299960896,381cyclictest0-21swapper/310:38:513
12279960758,465cyclictest0-21swapper/110:08:581
12279960758,465cyclictest0-21swapper/110:08:571
12269960614,126cyclictest0-21swapper/009:35:010
12339960554,126cyclictest121rcu_preempt10:33:307
122699605310,175cyclictest0-21swapper/010:25:410
122699605310,175cyclictest0-21swapper/010:25:410
12269960411,127cyclictest0-21swapper/012:29:050
12279960211,84cyclictest0-21swapper/110:35:461
12299960192,126cyclictest0-21swapper/309:34:093
12289960189,381cyclictest0-21swapper/210:09:222
12289960189,381cyclictest0-21swapper/210:09:222
123299600135,84cyclictest27138-1kworker/u17:011:17:346
12319959947,338cyclictest121rcu_preempt12:30:235
12319959947,338cyclictest121rcu_preempt12:30:235
1230995960,422cyclictest0-21swapper/412:44:194
12329959540,423cyclictest0-21swapper/612:31:266
12329959540,423cyclictest0-21swapper/612:31:266
1233995940,84cyclictest0-21swapper/712:27:077
1233995940,83cyclictest0-21swapper/709:59:427
1232995940,84cyclictest0-21swapper/611:40:276
1229995940,84cyclictest0-21swapper/311:22:023
1226995943,47cyclictest0-21swapper/009:48:460
1230995930,84cyclictest0-21swapper/412:28:144
1230995930,84cyclictest0-21swapper/410:34:544
1228995930,84cyclictest0-21swapper/210:30:272
1226995911,41cyclictest0-21swapper/011:17:410
122999588119,253cyclictest0-21swapper/312:33:393
122999588119,253cyclictest0-21swapper/312:33:393
12279958776,296cyclictest121rcu_preempt11:58:091
12319958575,380cyclictest0-21swapper/510:30:375
12279958534,380cyclictest0-21swapper/111:15:311
12299958472,381cyclictest0-21swapper/312:07:073
12299958435,84cyclictest121rcu_preempt12:27:493
122799583242,338cyclictest26102-21kworker/u16:012:04:381
12289958274,465cyclictest0-21swapper/212:30:512
12289958274,465cyclictest0-21swapper/212:30:512
122799582113,296cyclictest26427-21ssh09:35:011
12319958170,380cyclictest0-21swapper/509:35:035
12329958030,338cyclictest0-21swapper/609:54:576
122699580242,127cyclictest0-21swapper/011:20:540
12289957973,422cyclictest0-21swapper/211:57:342
12309957871,84cyclictest0-21swapper/409:33:204
122999578108,296cyclictest0-21swapper/310:30:033
12319957626,126cyclictest0-21swapper/512:05:555
12279957626,126cyclictest0-21swapper/112:10:181
123099575107,338cyclictest0-21swapper/410:42:334
122999573105,296cyclictest0-21swapper/311:14:113
123099572106,126cyclictest0-21swapper/411:54:354
122999571314,126cyclictest0-21swapper/310:43:023
122999570101,296cyclictest0-21swapper/309:51:443
12279957017,126cyclictest0-21swapper/111:22:331
12319956856,296cyclictest57-21ksoftirqd/512:04:375
12299956397,126cyclictest0-21swapper/310:30:193
12279956311,338cyclictest0-21swapper/109:31:511
12279956293,296cyclictest0-21swapper/109:58:051
122699561224,176cyclictest0-21swapper/011:14:530
123199559475,3cyclictest551rcuc/511:17:405
1228995577,126cyclictest0-21swapper/209:55:582
1228995543,127cyclictest0-21swapper/212:28:562
1230995520,84cyclictest9028-21diskmemload10:36:544
1228995522,89cyclictest0-21swapper/209:51:222
1232995511,466cyclictest1224-21cyclictest10:08:576
1232995511,466cyclictest1224-21cyclictest10:08:576
122999551470,78cyclictest391rcuc/312:01:293
1226995510,42cyclictest0-21swapper/011:56:540
1233995501,127cyclictest0-21swapper/711:57:237
1233995500,84cyclictest0-21swapper/711:53:267
1230995501,88cyclictest0-21swapper/412:30:594
1230995501,88cyclictest0-21swapper/412:30:594
12299955082,465cyclictest0-21swapper/311:25:343
12299955082,465cyclictest0-21swapper/311:25:333
122899550166,381cyclictest0-21swapper/210:41:342
12339954983,126cyclictest0-21swapper/711:20:257
12319954943,422cyclictest0-21swapper/510:08:585
12319954943,422cyclictest0-21swapper/510:08:575
12339954836,296cyclictest0-21swapper/710:28:097
12339954836,296cyclictest0-21swapper/710:28:097
123199548122,295cyclictest0-21swapper/510:37:435
123099546460,84cyclictest481ktimersoftd/409:57:554
122899546121,295cyclictest0-21swapper/211:21:452
12339954538,126cyclictest121rcu_preempt10:08:077
12339954538,126cyclictest121rcu_preempt10:08:077
12309954436,126cyclictest0-21swapper/411:38:474
122899544117,338cyclictest0-21swapper/211:18:522
12289954373,296cyclictest0-21swapper/211:43:272
12289954336,423cyclictest0-21swapper/209:34:212
12299954276,211cyclictest0-21swapper/309:55:533
123399541458,3cyclictest711rcuc/711:18:137
122799541120,42cyclictest11214-21sed10:40:221
12319954034,338cyclictest0-21swapper/511:27:445
12319954034,338cyclictest0-21swapper/511:27:445
12279954071,296cyclictest0-21swapper/111:14:251
12279954071,296cyclictest0-21swapper/109:49:231
12319953873,211cyclictest0-21swapper/510:42:175
12289953829,85cyclictest0-21swapper/211:53:272
12319953768,338cyclictest0-21swapper/509:51:215
122899537197,337cyclictest26102-21kworker/u16:010:29:442
122899537197,337cyclictest26102-21kworker/u16:010:29:442
12269953773,84cyclictest0-21swapper/010:08:580
12269953773,84cyclictest0-21swapper/010:08:570
12309953524,338cyclictest0-21swapper/410:09:384
12309953524,338cyclictest0-21swapper/410:09:374
12279953529,253cyclictest0-21swapper/111:38:031
12289953430,122cyclictest121rcu_preempt11:14:252
12329953367,85cyclictest0-21swapper/610:34:436
12309953271,124cyclictest121rcu_preempt09:55:014
123299531232,126cyclictest6728-21grep10:00:306
12269953120,84cyclictest0-21swapper/010:40:530
122899530188,127cyclictest31522-21ssh12:08:422
12299952963,211cyclictest0-21swapper/311:45:063
12289952817,380cyclictest653-21nscd11:25:192
12289952817,380cyclictest653-21nscd11:25:192
122799528107,338cyclictest0-21swapper/112:32:431
122799528107,338cyclictest0-21swapper/112:32:431
12309952762,84cyclictest121rcu_preempt09:49:504
122999527269,85cyclictest0-21swapper/309:35:043
122999527227,85cyclictest0-21swapper/311:39:233
12279952511,338cyclictest0-21swapper/111:53:071
12319952416,84cyclictest0-21swapper/509:49:015
123299523139,169cyclictest121rcu_preempt10:39:176
12289952355,211cyclictest33-21ksoftirqd/212:04:182
12299952194,211cyclictest27916-21idleruntime-cro10:30:013
12299951811,42cyclictest121rcu_preempt11:57:243
1230995147,127cyclictest0-21swapper/411:18:134
1233995134,127cyclictest0-21swapper/709:50:127
1232995100,84cyclictest0-21swapper/611:26:506
1232995100,84cyclictest0-21swapper/611:26:506
1233995090,84cyclictest0-21swapper/712:03:267
1230995090,84cyclictest21814-21ssh11:22:034
12319950840,465cyclictest0-21swapper/511:44:515
12279950882,211cyclictest25-21ksoftirqd/112:25:441
123099507122,254cyclictest0-21swapper/411:43:314
1230995070,83cyclictest0-21swapper/411:29:434
1230995070,83cyclictest0-21swapper/411:29:424
122799506166,338cyclictest1608-1kworker/u17:010:27:361
122799506166,338cyclictest1608-1kworker/u17:010:27:361
12309950581,84cyclictest0-21swapper/412:02:294
122699505423,79cyclictest0-21swapper/011:39:550
12319950437,84cyclictest121rcu_preempt10:29:405
12319950437,84cyclictest121rcu_preempt10:29:405
12319950381,338cyclictest0-21swapper/511:57:345
12319950377,211cyclictest0-21swapper/512:28:025
12319950335,210cyclictest57-21ksoftirqd/512:44:145
12329950137,253cyclictest9028-21diskmemload10:25:426
12329950137,253cyclictest9028-21diskmemload10:25:426
12269950175,295cyclictest0-21swapper/010:59:440
12269950133,380cyclictest20738-21cron10:25:000
122699501119,42cyclictest646-21nscd11:43:320
123099500117,84cyclictest121rcu_preempt12:06:074
12329949971,211cyclictest0-21swapper/611:53:406
12309949827,42cyclictest0-21swapper/411:55:124
12339949732,127cyclictest0-21swapper/709:49:137
12289949526,295cyclictest0-21swapper/209:47:452
12279949468,168cyclictest25-21ksoftirqd/110:59:401
12309949267,210cyclictest49-21ksoftirqd/410:27:194
12309949267,210cyclictest49-21ksoftirqd/410:27:194
123399490191,84cyclictest121rcu_preempt11:39:157
12329948925,218cyclictest0-21swapper/611:38:016
122999489147,211cyclictest13288-21ssh10:59:473
12319948863,210cyclictest0-21swapper/512:10:195
12269948825,295cyclictest0-21swapper/010:00:140
123299487106,212cyclictest22323-21chrt11:22:326
12329948517,338cyclictest0-21swapper/609:34:356
12329948462,41cyclictest23932-21sh12:03:036
12289948457,211cyclictest33-21ksoftirqd/210:59:082
123399482141,338cyclictest1224-21cyclictest12:05:547
12299948215,84cyclictest0-21swapper/311:16:073
123399481437,42cyclictest711rcuc/712:44:277
123399481437,42cyclictest711rcuc/711:41:037
123399480226,83cyclictest721ktimersoftd/711:26:157
123399480226,83cyclictest721ktimersoftd/711:26:147
12309948015,218cyclictest0-21swapper/411:15:014
12319947910,338cyclictest0-21swapper/509:20:115
1228994789,258cyclictest15445-21ssh11:38:112
12329947754,85cyclictest0-21swapper/610:41:596
12309947510,126cyclictest0-21swapper/410:59:464
12299947452,338cyclictest0-21swapper/311:54:543
1231994715,211cyclictest0-21swapper/510:25:015
122699471130,126cyclictest121rcu_preempt10:45:020
1228994701,211cyclictest33-21ksoftirqd/212:43:052
122799470172,126cyclictest121rcu_preempt10:45:021
1229994695,126cyclictest0-21swapper/312:43:353
12279946782,126cyclictest121rcu_preempt10:00:081
122899466125,338cyclictest1563-21snmpd09:35:132
123399465124,338cyclictest0-21swapper/712:33:067
123399465124,338cyclictest0-21swapper/712:33:067
12329946583,380cyclictest0-21swapper/609:56:556
123299464123,339cyclictest0-21swapper/609:48:466
12319946481,210cyclictest0-21swapper/511:52:295
12279946480,381cyclictest0-21swapper/112:44:561
12339946341,85cyclictest0-21swapper/710:44:247
12329946340,297cyclictest0-21swapper/611:58:216
12319946380,380cyclictest0-21swapper/509:56:405
12299946383,295cyclictest0-21swapper/310:08:573
12299946383,295cyclictest0-21swapper/310:08:573
122899463123,338cyclictest13846-21taskset12:35:232
123399462122,338cyclictest0-21swapper/709:20:047
12339946175,254cyclictest0-21swapper/711:14:107
12289946139,255cyclictest0-21swapper/210:45:032
123199460121,337cyclictest13877-21sed12:35:245
122899460121,126cyclictest20287-21sh10:24:342
12319945980,295cyclictest21807-1kworker/u17:211:22:095
12319945875,380cyclictest0-21swapper/510:10:115
123199458164,83cyclictest654-21nscd09:34:425
122899458114,169cyclictest1224-21cyclictest10:00:302
123299457116,338cyclictest0-21swapper/610:10:116
12319945734,127cyclictest0-21swapper/509:19:065
12309945776,86cyclictest0-21swapper/409:20:114
123099457243,84cyclictest0-21swapper/410:24:564
12279945773,211cyclictest25-21ksoftirqd/111:45:101
122799457116,338cyclictest28134-21ssh12:23:481
12309945674,210cyclictest23813-21ssh10:10:114
12299945674,84cyclictest121rcu_preempt12:23:473
12329945569,211cyclictest27164-21df09:35:156
123099455115,338cyclictest0-21swapper/409:19:064
12329945372,220cyclictest0-21swapper/612:44:306
122699453116,334cyclictest0-21swapper/012:24:090
12309945231,41cyclictest0-21swapper/411:45:104
123099452111,338cyclictest0-21swapper/409:35:064
122999452111,338cyclictest0-21swapper/308:16:463
123299451110,338cyclictest28314-21diskmemload09:19:056
12319945126,169cyclictest121rcu_preempt11:38:195
122699451111,338cyclictest9606-21kworker/u16:109:19:050
12339945065,211cyclictest0-21swapper/709:33:467
123299450115,80cyclictest0-21swapper/612:35:086
122899450109,338cyclictest652-21nscd09:19:422
12339944964,212cyclictest0-21swapper/710:25:027
12319944826,85cyclictest1751-21ntpd11:45:125
12289944821,254cyclictest0-21swapper/211:00:032
12309944666,84cyclictest0-21swapper/410:00:234
12289944359,381cyclictest0-21swapper/211:45:112
123299442186,254cyclictest641ktimersoftd/612:10:216
12269944118,84cyclictest0-21swapper/010:10:110
12289943999,338cyclictest0-21swapper/212:10:152
12339943696,338cyclictest0-21swapper/711:00:157
12319943513,255cyclictest0-21swapper/511:14:235
1230994284,126cyclictest0-21swapper/410:45:024
1231994251,84cyclictest0-21swapper/511:00:065
1232994240,84cyclictest0-21swapper/611:14:506
12299942483,338cyclictest0-21swapper/309:19:043
122999424206,126cyclictest121rcu_preempt12:10:213
12289942383,338cyclictest0-21swapper/212:23:482
12319942282,338cyclictest0-21swapper/510:00:235
12319942282,337cyclictest0-21swapper/510:59:085
12309942280,210cyclictest49-21ksoftirqd/412:23:484
12279942181,338cyclictest0-21swapper/110:24:481
12329942081,84cyclictest0-21swapper/612:23:486
12329942080,338cyclictest0-21swapper/610:45:056
12329942080,338cyclictest0-21swapper/610:24:506
12319942078,211cyclictest57-21ksoftirqd/508:30:165
12309942083,84cyclictest0-21swapper/411:30:104
12309942082,84cyclictest0-21swapper/412:35:064
12309942082,84cyclictest0-21swapper/411:00:094
12299942079,338cyclictest0-21swapper/312:35:223
12339941978,338cyclictest0-21swapper/712:35:067
12319941980,84cyclictest0-21swapper/508:16:455
12319941979,338cyclictest0-21swapper/510:45:045
12279941877,338cyclictest0-21swapper/109:19:431
12299941777,338cyclictest0-21swapper/310:00:243
12339941675,339cyclictest9028-21diskmemload12:10:157
123399416245,84cyclictest5085-21cstates10:00:157
12329941674,339cyclictest0-21swapper/608:30:166
123299416161,253cyclictest641ktimersoftd/611:45:076
12279941474,338cyclictest0-21swapper/112:35:221
12279941473,338cyclictest0-21swapper/110:10:051
12329941232,296cyclictest0-21swapper/611:00:146
12279941233,41cyclictest0-21swapper/111:00:071
12329941071,84cyclictest0-21swapper/608:16:456
12299941069,338cyclictest0-21swapper/310:45:093
12319940969,84cyclictest0-21swapper/512:23:475
12339940866,339cyclictest0-21swapper/710:59:077
12339940666,338cyclictest0-21swapper/710:10:067
12339940665,338cyclictest0-21swapper/709:35:057
122699405106,126cyclictest121rcu_preempt11:00:090
12319940426,212cyclictest21807-1kworker/u17:211:30:095
12279940464,338cyclictest0-21swapper/108:16:451
12279940161,209cyclictest0-21swapper/109:20:101
12309939758,84cyclictest0-21swapper/408:16:454
12289939718,213cyclictest0-21swapper/211:30:092
1226993855,169cyclictest0-21swapper/011:30:090
123299380123,254cyclictest0-21swapper/609:20:116
12299937840,172cyclictest0-21swapper/310:24:373
12279937840,172cyclictest0-21swapper/111:30:091
12339937535,84cyclictest0-21swapper/709:20:127
12299937537,171cyclictest0-21swapper/310:10:043
12299937433,338cyclictest0-21swapper/308:30:183
12289937378,126cyclictest121rcu_preempt10:10:042
122899370114,253cyclictest0-21swapper/208:16:462
12339936933,82cyclictest0-21swapper/711:45:117
12279936826,339cyclictest0-21swapper/108:30:161
12339936728,84cyclictest0-21swapper/708:17:107
12339936628,2cyclictest0-21swapper/711:30:097
12339936526,84cyclictest0-21swapper/712:23:587
12339936526,84cyclictest0-21swapper/710:45:047
12299936223,84cyclictest0-21swapper/309:20:123
12289936019,338cyclictest0-21swapper/208:30:162
12329935615,338cyclictest0-21swapper/611:30:106
12339935516,84cyclictest0-21swapper/708:30:167
12269935426,41cyclictest0-21swapper/008:16:460
12269935315,84cyclictest0-21swapper/008:30:160
12309935296,253cyclictest0-21swapper/408:30:174
12299935112,84cyclictest0-21swapper/311:00:083
1228993421,338cyclictest0-21swapper/209:20:102
12269933679,127cyclictest29942-21ssh09:20:110
77028755,28sleep20-21swapper/207:09:372
67528654,28sleep10-21swapper/107:08:241
53828542,39sleep50-21swapper/507:06:515
75128453,27sleep30-21swapper/307:09:213
79528352,28sleep70-21swapper/707:09:597
43828251,27sleep60-21swapper/607:05:326
77228049,28sleep40-21swapper/407:09:384
76827946,29sleep00-21swapper/007:09:340
1232993110,20cyclictest0-21swapper/607:32:166
1232993110,20cyclictest0-21swapper/607:32:166
1232993010,19cyclictest0-21swapper/608:01:426
1233992910,18cyclictest0-21swapper/709:11:527
1233992910,18cyclictest0-21swapper/708:48:097
1233992910,18cyclictest0-21swapper/708:25:157
1233992910,18cyclictest0-21swapper/708:06:177
1232992927,2cyclictest0-21swapper/607:15:056
1232992926,2cyclictest0-21swapper/609:01:176
1227992927,1cyclictest0-21swapper/108:10:511
1233992810,18cyclictest0-21swapper/708:01:187
1233992810,17cyclictest0-21swapper/709:28:467
1233992810,0cyclictest0-21swapper/708:41:277
1233992810,0cyclictest0-21swapper/708:10:397
1233992810,0cyclictest0-21swapper/707:31:497
1233992810,0cyclictest0-21swapper/707:31:487
1233992810,0cyclictest0-21swapper/707:27:297
1232992828,0cyclictest0-21swapper/609:28:546
1232992826,2cyclictest0-21swapper/609:45:006
1232992810,1cyclictest0-21swapper/608:48:246
1232992810,18cyclictest0-21swapper/608:41:246
1232992810,18cyclictest0-21swapper/608:25:466
1232992810,18cyclictest0-21swapper/608:06:246
1232992810,18cyclictest0-21swapper/607:56:436
1231992810,18cyclictest0-21swapper/507:15:135
1230992810,18cyclictest0-21swapper/408:25:374
1229992828,0cyclictest0-21swapper/309:29:083
1229992828,0cyclictest0-21swapper/307:45:323
1229992810,18cyclictest0-21swapper/309:11:503
1229992810,18cyclictest0-21swapper/308:48:373
1228992810,18cyclictest0-21swapper/209:12:012
1228992810,18cyclictest0-21swapper/207:15:082
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional