You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-07 - 23:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri Aug 07, 2026 12:56:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
173779980382,507cyclictest22998-21apt-get09:45:134
173759974767,84cyclictest0-21swapper/210:10:222
173759973917,719cyclictest0-21swapper/212:40:182
17375997266,685cyclictest0-21swapper/210:34:392
173759971375,635cyclictest0-21swapper/211:30:162
173759971173,635cyclictest0-21swapper/211:03:522
1737399692224,295cyclictest1534-21rm12:21:460
17377996856,676cyclictest0-21swapper/411:44:224
17379996821,593cyclictest0-21swapper/609:56:026
1737599677166,508cyclictest0-21swapper/211:52:082
173789965518,92cyclictest28664-21ssh11:03:575
173739964954,380cyclictest0-21swapper/011:38:200
173779963888,127cyclictest24827-21ssh10:04:474
1737999632121,508cyclictest0-21swapper/611:52:086
173759963140,507cyclictest0-21swapper/209:30:342
173759962631,592cyclictest0-21swapper/210:28:142
173759962631,592cyclictest0-21swapper/210:28:142
173799962533,513cyclictest0-21swapper/612:05:006
1737699624284,338cyclictest32005-21kworker/u16:012:22:033
1737499624113,380cyclictest0-21swapper/111:09:261
173799962327,472cyclictest0-21swapper/611:09:496
1737799623113,338cyclictest0-21swapper/411:10:054
1737899620112,126cyclictest22896-21ssh10:03:065
173759962029,501cyclictest0-21swapper/210:05:462
1737799618107,126cyclictest0-21swapper/412:31:594
1737799618107,126cyclictest0-21swapper/412:31:594
173739961519,385cyclictest0-21swapper/010:48:440
173759961216,380cyclictest0-21swapper/211:19:482
173769961117,127cyclictest0-21swapper/312:28:283
173769960956,126cyclictest121rcu_preempt11:38:143
1737599609522,85cyclictest311rcuc/209:29:322
173739960914,380cyclictest0-21swapper/011:45:280
173759960817,507cyclictest0-21swapper/210:00:042
173759960715,3cyclictest0-21swapper/212:31:182
173759960715,3cyclictest0-21swapper/212:31:172
173809960494,507cyclictest0-21swapper/709:11:437
173779960394,127cyclictest0-21swapper/412:12:374
173749960253,380cyclictest0-21swapper/111:39:161
173799960110,84cyclictest0-21swapper/608:40:176
173749960093,126cyclictest0-21swapper/110:04:471
17377995989,82cyclictest121rcu_preempt11:30:154
17376995940,84cyclictest0-21swapper/312:34:043
17376995940,84cyclictest0-21swapper/312:34:043
17376995940,84cyclictest0-21swapper/311:25:093
17374995940,84cyclictest0-21swapper/111:52:251
1738099593124,127cyclictest0-21swapper/711:23:387
173779959382,508cyclictest0-21swapper/411:52:094
1737799593209,211cyclictest187-21md0_raid107:25:374
173759959381,510cyclictest0-21swapper/209:11:432
17375995910,126cyclictest0-21swapper/209:37:232
1738099590168,257cyclictest0-21swapper/708:56:347
173789959080,507cyclictest0-21swapper/509:11:445
173799958979,507cyclictest0-21swapper/609:11:446
173799958978,381cyclictest0-21swapper/610:00:166
173789958878,507cyclictest23188-21ssh11:39:025
173759958735,549cyclictest0-21swapper/211:14:372
173799958534,84cyclictest0-21swapper/610:53:206
173759958532,550cyclictest0-21swapper/211:37:492
173789958473,338cyclictest0-21swapper/510:51:455
173759958432,86cyclictest0-21swapper/210:51:062
1737799582242,338cyclictest64450irq/122-eth009:11:394
173759958170,508cyclictest0-21swapper/208:38:372
1737499581116,84cyclictest121rcu_preempt10:08:411
173759957826,549cyclictest0-21swapper/210:42:342
173739957830,41cyclictest121rcu_preempt09:56:030
173749957724,338cyclictest30989-21sh10:45:221
173789957524,127cyclictest20373-21munin-node11:08:435
1737899575109,126cyclictest0-21swapper/510:09:335
173749957525,126cyclictest0-21swapper/112:21:091
173769957466,211cyclictest0-21swapper/311:57:223
1737699574109,84cyclictest121rcu_preempt10:36:563
173809957362,338cyclictest0-21swapper/711:52:267
173749957324,50cyclictest1551-21snmpd12:28:591
173779957219,337cyclictest2657-21runrttasks11:45:244
1737999571102,466cyclictest0-21swapper/608:55:406
173779957117,339cyclictest0-21swapper/411:03:554
173749956958,381cyclictest0-21swapper/107:37:221
173739956959,254cyclictest121rcu_preempt10:00:120
173789956553,339cyclictest0-21swapper/511:57:545
1737799564180,380cyclictest25156-21diskmemload10:46:114
173739956456,126cyclictest0-21swapper/012:11:560
173779956355,126cyclictest0-21swapper/409:39:254
173759956216,3cyclictest0-21swapper/211:22:382
1737999561221,338cyclictest1826-1kworker/u17:110:48:456
173759956151,508cyclictest0-21swapper/209:59:542
173809956052,126cyclictest0-21swapper/709:39:257
173739956048,422cyclictest1553-21runrttasks07:26:070
173789955990,344cyclictest121rcu_preempt09:42:025
173779955955,80cyclictest121rcu_preempt10:08:134
173769955947,296cyclictest0-21swapper/310:43:413
17376995587,126cyclictest0-21swapper/307:37:233
17375995586,549cyclictest0-21swapper/210:45:202
173759955850,84cyclictest0-21swapper/212:05:272
173739955892,168cyclictest0-21swapper/009:42:050
17373995551,126cyclictest0-21swapper/009:45:110
17380995521,167cyclictest0-21swapper/711:38:307
173739955243,507cyclictest0-21swapper/009:39:250
1737599551125,423cyclictest0-21swapper/210:58:232
1738099550124,253cyclictest0-21swapper/712:18:517
173799955041,127cyclictest0-21swapper/609:39:246
173769955081,296cyclictest0-21swapper/309:57:473
173809954836,127cyclictest0-21swapper/709:29:497
1738099548207,338cyclictest12828-21kworker/u16:309:57:237
1737999548122,84cyclictest0-21swapper/610:41:526
1737799547124,126cyclictest457-21ssh12:20:454
173799954635,338cyclictest0-21swapper/611:38:276
173789954640,337cyclictest0-21swapper/510:30:455
173779954534,339cyclictest0-21swapper/410:30:414
1737999544122,338cyclictest0-21swapper/612:34:066
1737999544122,338cyclictest0-21swapper/612:34:066
1738099543202,338cyclictest704-21nscd11:49:507
1737799543120,88cyclictest121rcu_preempt11:23:544
1737399543117,254cyclictest121rcu_preempt11:14:440
173809954273,296cyclictest0-21swapper/712:04:457
1737799542116,253cyclictest121rcu_preempt10:15:244
1737699542119,211cyclictest41-21ksoftirqd/309:43:373
173759954272,296cyclictest0-21swapper/210:15:182
173739954130,211cyclictest0-21swapper/011:30:150
173779954075,253cyclictest0-21swapper/410:11:424
1737399540200,338cyclictest17371-21cyclictest11:04:020
173809953974,84cyclictest0-21swapper/712:05:267
173769953872,211cyclictest0-21swapper/309:30:043
1737499537112,126cyclictest121rcu_preempt09:40:061
173769953670,211cyclictest0-21swapper/310:57:593
173799953427,338cyclictest0-21swapper/612:29:006
173779953424,296cyclictest0-21swapper/410:41:534
173759953423,508cyclictest0-21swapper/209:42:282
173789953368,211cyclictest0-21swapper/511:54:065
173759953225,423cyclictest0-21swapper/212:15:262
173759953225,295cyclictest0-21swapper/212:22:172
173749953225,127cyclictest0-21swapper/111:59:521
1737499532107,210cyclictest770-21ssh11:44:491
173809953162,380cyclictest0-21swapper/712:39:557
173789953123,84cyclictest121rcu_preempt09:39:305
173809952919,507cyclictest0-21swapper/710:03:057
173769952819,127cyclictest0-21swapper/309:35:203
173759952716,508cyclictest0-21swapper/212:12:502
173739952557,260cyclictest0-21swapper/011:22:460
173759952316,169cyclictest0-21swapper/212:29:002
1738099521138,126cyclictest0-21swapper/709:40:287
173749952011,84cyclictest0-21swapper/111:22:461
173759951916,37cyclictest1765-21memory11:25:212
173809951811,127cyclictest0-21swapper/707:52:257
173809951811,127cyclictest0-21swapper/707:52:247
17376995189,84cyclictest0-21swapper/311:09:453
173739951810,84cyclictest121rcu_preempt10:10:150
17377995179,126cyclictest8001-21runrttasks10:51:444
17376995174,296cyclictest0-21swapper/312:12:543
173739951711,294cyclictest1553-21runrttasks10:37:500
17373995151,345cyclictest0-21swapper/011:57:250
173809951243,466cyclictest0-21swapper/712:40:127
173759951044,84cyclictest121rcu_preempt09:45:142
17377995091,126cyclictest698-21ptp4l11:35:394
17376995091,126cyclictest0-21swapper/310:04:473
173759950941,465cyclictest5818-21seq11:09:302
17373995092,3cyclictest0-21swapper/011:19:540
1737399509126,211cyclictest121rcu_preempt10:07:190
173809950843,339cyclictest0-21swapper/710:28:127
173809950843,339cyclictest0-21swapper/710:28:127
173779950882,423cyclictest0-21swapper/409:59:124
173779950882,211cyclictest0-21swapper/410:57:454
1737799508123,254cyclictest121rcu_preempt07:37:044
173759950839,465cyclictest28469-21python12:00:242
1737499508125,126cyclictest25-21ksoftirqd/109:45:141
1737699507122,338cyclictest121rcu_preempt11:51:293
1737499507124,380cyclictest0-21swapper/108:55:391
17379995061,44cyclictest0-21swapper/607:35:596
1737999505166,337cyclictest17371-21cyclictest12:14:486
173759950582,168cyclictest0-21swapper/211:59:352
1737799504204,297cyclictest64450irq/122-eth012:27:244
173759950477,254cyclictest0-21swapper/212:35:412
173779950378,422cyclictest0-21swapper/408:35:294
173809950234,84cyclictest0-21swapper/707:35:457
1737999502118,381cyclictest15441-21/usr/sbin/munin11:15:116
173739950236,84cyclictest121rcu_preempt08:35:220
173809950136,343cyclictest0-21swapper/710:08:457
173749950174,211cyclictest17371-21cyclictest12:18:511
173809950034,296cyclictest0-21swapper/710:14:407
173809950034,126cyclictest0-21swapper/710:37:247
173809949976,381cyclictest0-21swapper/711:04:197
173779949973,423cyclictest0-21swapper/408:56:004
173769949977,84cyclictest0-21swapper/310:30:453
1737699499119,168cyclictest0-21swapper/311:03:203
173759949935,253cyclictest0-21swapper/209:23:532
173749949977,338cyclictest0-21swapper/108:40:161
173739949972,211cyclictest9-21ksoftirqd/011:50:480
1737999498114,338cyclictest0-21swapper/609:40:056
173789949829,466cyclictest0-21swapper/512:40:135
173749949874,84cyclictest1553-21runrttasks10:12:561
173749949871,211cyclictest25-21ksoftirqd/110:15:261
173809949771,423cyclictest0-21swapper/709:30:217
1737999497114,380cyclictest0-21swapper/611:14:326
173789949729,338cyclictest0-21swapper/512:34:115
173789949729,338cyclictest0-21swapper/512:34:115
173809949673,84cyclictest0-21swapper/710:52:367
173799949626,467cyclictest0-21swapper/612:40:126
1737899496156,338cyclictest9291-1kworker/u17:112:13:555
173749949631,381cyclictest0-21swapper/109:29:431
173809949526,380cyclictest0-21swapper/710:47:347
173779949570,422cyclictest0-21swapper/409:29:464
1737799495114,126cyclictest49-21ksoftirqd/410:27:384
1737799495114,126cyclictest49-21ksoftirqd/410:27:374
173759949569,423cyclictest0-21swapper/211:49:272
173749949530,126cyclictest0-21swapper/111:19:321
173779949468,423cyclictest0-21swapper/412:05:194
173769949427,83cyclictest0-21swapper/310:53:533
1737699494113,126cyclictest121rcu_preempt10:47:263
173769949324,211cyclictest0-21swapper/312:05:193
173739949329,42cyclictest0-21swapper/010:52:590
173799949223,338cyclictest0-21swapper/610:13:286
173789949169,338cyclictest0-21swapper/512:05:075
173769949169,84cyclictest0-21swapper/311:15:073
173739949123,84cyclictest121rcu_preempt07:36:350
1737999490106,84cyclictest22848-21smart_sda12:15:306
173769949064,211cyclictest0-21swapper/311:30:283
1737399490407,4cyclictest101ktimersoftd/008:40:140
1738099489108,84cyclictest9787-1kworker/7:1H12:21:307
173759948921,465cyclictest0-21swapper/207:36:562
173749948924,298cyclictest0-21swapper/112:13:001
173809948873,293cyclictest0-21swapper/711:29:557
173789948820,84cyclictest0-21swapper/509:45:135
1737899488103,382cyclictest0-21swapper/508:55:405
1737599488105,381cyclictest0-21swapper/208:55:402
1737499488147,126cyclictest25-21ksoftirqd/111:03:471
173809948765,84cyclictest0-21swapper/711:10:057
1737899487148,84cyclictest0-21swapper/511:30:465
1737699487105,84cyclictest121rcu_preempt08:35:223
173759948718,466cyclictest0-21swapper/209:50:162
173739948723,42cyclictest0-21swapper/012:40:050
1737499486102,381cyclictest0-21swapper/109:11:441
1737999485187,295cyclictest3788-21nscd11:21:146
173789948563,256cyclictest1540-21rm12:21:485
173779948522,168cyclictest0-21swapper/411:19:054
1737999484106,81cyclictest0-21swapper/610:15:156
173789948398,253cyclictest0-21swapper/507:36:435
173779948323,78cyclictest0-21swapper/412:15:314
1737399483316,41cyclictest0-21swapper/010:15:240
173749948218,42cyclictest0-21swapper/110:52:591
173749948218,126cyclictest0-21swapper/109:39:431
1737499482103,295cyclictest0-21swapper/112:06:091
173799948015,127cyclictest65-21ksoftirqd/612:21:306
173799947995,381cyclictest0-21swapper/609:29:586
1737699479136,127cyclictest121rcu_preempt10:09:093
173769947812,84cyclictest121rcu_preempt12:35:413
173739947713,84cyclictest0-21swapper/012:15:290
173789947697,83cyclictest0-21swapper/511:19:205
173769947693,381cyclictest0-21swapper/309:11:433
17380994757,465cyclictest0-21swapper/710:42:027
17373994737,127cyclictest0-21swapper/010:34:240
173749947247,210cyclictest0-21swapper/112:35:371
17374994723,211cyclictest0-21swapper/110:37:181
1737499472135,84cyclictest121rcu_preempt11:14:481
173739947187,211cyclictest9-21ksoftirqd/012:36:130
1737399471427,42cyclictest111rcuc/009:26:490
1737799470132,83cyclictest17371-21cyclictest11:10:074
17375994701,338cyclictest0-21swapper/211:44:042
173739946944,253cyclictest121rcu_preempt07:40:130
173809946783,211cyclictest6183-21ntp_offset08:35:317
17377994671,211cyclictest0-21swapper/412:40:134
17376994661,210cyclictest0-21swapper/310:28:563
17376994661,210cyclictest0-21swapper/310:28:563
1737499466125,338cyclictest0-21swapper/110:28:071
1737499466125,338cyclictest0-21swapper/110:28:071
173799946584,84cyclictest2067-21df_abs11:45:146
1737999465124,338cyclictest0-21swapper/609:30:126
1737999465123,339cyclictest22187-21taskset11:56:166
173769946536,126cyclictest121rcu_preempt12:40:403
1737699465124,338cyclictest0-21swapper/310:13:343
1737999464124,84cyclictest0-21swapper/608:35:236
1737999464124,338cyclictest0-21swapper/612:05:466
17379994640,3cyclictest0-21swapper/610:31:496
1737499464124,338cyclictest0-21swapper/111:45:161
1737499464123,338cyclictest0-21swapper/111:30:261
1737399464124,338cyclictest0-21swapper/012:05:390
1737999463123,338cyclictest0-21swapper/609:45:146
1737999463123,338cyclictest0-21swapper/607:40:216
1737999463123,337cyclictest15623-21runrttasks10:36:286
1737999463123,337cyclictest0-21swapper/611:44:566
173789946380,380cyclictest0-21swapper/509:56:485
173779946380,380cyclictest0-21swapper/407:51:004
173779946380,380cyclictest0-21swapper/407:50:594
173779946379,211cyclictest5239-21needreboot07:40:204
173749946341,337cyclictest0-21swapper/112:04:551
173809946278,381cyclictest0-21swapper/711:14:327
173799946239,257cyclictest0-21swapper/607:54:336
173799946239,257cyclictest0-21swapper/607:54:326
1737999462123,84cyclictest0-21swapper/611:30:286
1737999462123,84cyclictest0-21swapper/610:58:456
1737999462122,84cyclictest0-21swapper/611:04:116
173789946280,338cyclictest13319-21nscd10:42:145
173749946278,211cyclictest25-21ksoftirqd/107:25:261
173749946278,126cyclictest25-21ksoftirqd/110:30:541
173809946179,84cyclictest0-21swapper/712:32:177
173809946179,84cyclictest0-21swapper/712:32:177
1737999461121,337cyclictest0-21swapper/607:29:186
173789946180,210cyclictest0-21swapper/507:52:035
173789946180,210cyclictest0-21swapper/507:52:025
1737899461121,338cyclictest0-21swapper/510:11:025
173759946135,423cyclictest0-21swapper/207:30:232
1737399461120,338cyclictest0-21swapper/011:09:450
173809946081,42cyclictest15850irq/123-ahci[0012:11:597
1738099460119,338cyclictest32005-21kworker/u16:012:28:497
1737999460114,85cyclictest0-21swapper/610:08:126
173789946077,126cyclictest121rcu_preempt10:36:285
1737899460119,338cyclictest0-21swapper/511:14:235
1737899460118,168cyclictest31825-21latency_hist12:40:035
173779946080,295cyclictest0-21swapper/411:58:414
1737699460121,172cyclictest0-21swapper/308:56:343
1737499460119,338cyclictest0-21swapper/108:37:461
1737399460121,337cyclictest0-21swapper/012:28:290
1738099459203,253cyclictest11864-21cat11:30:447
1737999459118,84cyclictest0-21swapper/609:50:146
173789945931,296cyclictest0-21swapper/511:43:585
173779945978,126cyclictest0-21swapper/411:25:094
173769945934,85cyclictest0-21swapper/311:44:143
173809945878,84cyclictest0-21swapper/710:32:597
1737899458118,127cyclictest0-21swapper/510:28:555
1737899458118,127cyclictest0-21swapper/510:28:555
173769945878,84cyclictest0-21swapper/309:27:443
1737499458118,338cyclictest0-21swapper/109:55:441
173739945873,211cyclictest0-21swapper/010:58:380
1737399458116,339cyclictest0-21swapper/007:50:450
1737399458116,339cyclictest0-21swapper/007:50:450
1737899457118,84cyclictest0-21swapper/512:04:455
1737899457117,338cyclictest0-21swapper/510:15:095
173779945731,295cyclictest0-21swapper/410:37:184
1737799457116,338cyclictest0-21swapper/409:50:134
1737599457116,339cyclictest0-21swapper/210:37:512
1737999456118,84cyclictest0-21swapper/610:27:426
1737999456118,84cyclictest0-21swapper/610:27:426
173749945634,256cyclictest0-21swapper/110:58:481
1737999455110,126cyclictest65-21ksoftirqd/611:25:106
1737699455114,338cyclictest1553-21runrttasks10:15:163
1737699455114,126cyclictest14970-21turbostat.cron11:15:003
173759945570,211cyclictest0-21swapper/207:28:322
173759945533,3cyclictest0-21swapper/207:54:332
173759945533,3cyclictest0-21swapper/207:54:322
173749945534,337cyclictest0-21swapper/110:41:581
1737899454115,336cyclictest0-21swapper/509:27:065
1737899454113,338cyclictest20373-21munin-node11:45:165
173779945475,131cyclictest0-21swapper/409:41:194
1737699454112,211cyclictest41-21ksoftirqd/311:49:343
173809945331,256cyclictest0-21swapper/711:19:137
1737799453112,169cyclictest0-21swapper/407:55:094
173739945371,169cyclictest0-21swapper/008:56:330
173739945331,255cyclictest0-21swapper/010:42:420
1737399453112,338cyclictest0-21swapper/009:30:070
1737999452111,338cyclictest0-21swapper/612:39:546
1737799452112,337cyclictest0-21swapper/412:36:234
1737699452112,338cyclictest0-21swapper/311:23:243
173739945269,211cyclictest0-21swapper/009:11:530
1737899451110,338cyclictest0-21swapper/511:30:005
173759945125,423cyclictest0-21swapper/207:55:062
1737899450109,338cyclictest0-21swapper/510:48:315
173739945065,125cyclictest9-21ksoftirqd/011:44:370
173789944927,256cyclictest0-21swapper/511:22:515
173809944825,339cyclictest0-21swapper/708:40:177
173789944826,175cyclictest0-21swapper/510:57:555
1737899448108,337cyclictest12437-21runrttasks12:28:225
173749944866,380cyclictest0-21swapper/112:31:361
173749944866,380cyclictest0-21swapper/112:31:361
173749944763,211cyclictest0-21swapper/109:30:361
173809944619,211cyclictest73-21ksoftirqd/711:58:107
1737899446105,126cyclictest57-21ksoftirqd/507:25:415
173779944624,255cyclictest0-21swapper/412:05:014
173779944523,42cyclictest0-21swapper/409:30:054
173769944421,256cyclictest0-21swapper/312:18:523
1738099443103,85cyclictest390-21ssh11:44:207
1737599443103,338cyclictest0-21swapper/207:40:142
173739944317,126cyclictest0-21swapper/012:32:140
173739944317,126cyclictest0-21swapper/012:32:140
173769944215,127cyclictest41-21ksoftirqd/312:00:173
173789944119,42cyclictest0-21swapper/509:30:045
173789944099,339cyclictest0-21swapper/512:19:055
173789943896,339cyclictest0-21swapper/508:37:465
173739943753,169cyclictest0-21swapper/012:04:420
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional