You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 22:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed Jul 22, 2026 12:55:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
200599983976,760cyclictest0-21swapper/408:51:134
200599973513,719cyclictest31879-21sshd09:45:254
2005799709113,296cyclictest0-21swapper/211:25:282
2005999706114,211cyclictest0-21swapper/410:04:424
200569970532,503cyclictest0-21swapper/111:24:281
2005599678209,296cyclictest0-21swapper/010:23:540
200599967075,84cyclictest0-21swapper/412:04:374
2005899667112,296cyclictest31779-21fschecks_time09:45:173
200599966023,507cyclictest0-21swapper/410:16:524
2005699643519,40cyclictest231rcuc/112:15:321
2005699643519,40cyclictest231rcuc/112:15:321
2005699643519,40cyclictest231rcuc/112:15:321
2005799637551,84cyclictest311rcuc/211:08:562
20063996360,211cyclictest0-21swapper/609:21:026
200569963035,380cyclictest0-21swapper/110:17:441
200599962875,550cyclictest0-21swapper/410:21:054
200569962874,465cyclictest0-21swapper/110:23:081
200599962673,550cyclictest0-21swapper/407:27:034
200569962434,382cyclictest0-21swapper/111:50:051
200599962227,592cyclictest0-21swapper/410:56:504
200599961827,514cyclictest0-21swapper/411:33:534
2006299615108,127cyclictest11221-21ssh10:09:165
2005999613105,506cyclictest0-21swapper/411:29:174
2005599613271,126cyclictest0-21swapper/011:58:460
200569960853,169cyclictest25-21ksoftirqd/111:45:141
200599960312,507cyclictest0-21swapper/412:20:054
200589960248,127cyclictest0-21swapper/310:19:193
2006399601556,42cyclictest631rcuc/610:54:486
20059996003,594cyclictest64450irq/122-eth012:19:574
20059996003,594cyclictest64450irq/122-eth012:19:574
20059996003,594cyclictest64450irq/122-eth012:19:574
20058995960,84cyclictest0-21swapper/307:45:013
20057995960,84cyclictest0-21swapper/211:33:292
20062995953,84cyclictest0-21swapper/510:03:585
20058995940,85cyclictest0-21swapper/309:21:013
20058995940,84cyclictest0-21swapper/311:13:343
20063995930,84cyclictest0-21swapper/611:13:336
20063995930,84cyclictest0-21swapper/607:45:016
20058995930,84cyclictest0-21swapper/310:53:423
20057995930,84cyclictest0-21swapper/211:13:332
20057995930,84cyclictest0-21swapper/209:21:022
200559958938,126cyclictest0-21swapper/011:24:010
200599958734,84cyclictest0-21swapper/411:44:214
200579958734,84cyclictest0-21swapper/209:00:162
200559958635,127cyclictest0-21swapper/011:13:380
2005599585117,295cyclictest0-21swapper/011:26:170
200629957926,379cyclictest0-21swapper/511:08:155
200589957867,126cyclictest0-21swapper/308:20:333
200569957665,211cyclictest18637-21runrttasks08:51:581
200579957524,127cyclictest0-21swapper/210:05:222
200559957522,338cyclictest0-21swapper/012:04:250
200599957219,550cyclictest0-21swapper/409:54:514
200639957019,126cyclictest0-21swapper/611:58:466
200599957026,163cyclictest0-21swapper/409:25:184
2005999570231,337cyclictest64450irq/122-eth011:02:074
200579956960,126cyclictest0-21swapper/211:49:592
200599956813,126cyclictest0-21swapper/408:39:124
2005799568141,261cyclictest0-21swapper/211:43:572
200629956758,127cyclictest121rcu_preempt09:45:225
200629956756,381cyclictest0-21swapper/508:50:455
2005899567141,169cyclictest0-21swapper/312:20:523
200579956717,296cyclictest0-21swapper/210:31:362
200599956613,550cyclictest0-21swapper/410:50:454
200569956516,125cyclictest0-21swapper/111:58:221
200639956495,295cyclictest9771-21rm12:15:336
200639956495,295cyclictest9771-21rm12:15:336
200639956495,295cyclictest9771-21rm12:15:336
200589956495,296cyclictest0-21swapper/311:50:003
200599956352,508cyclictest0-21swapper/411:23:484
200599956314,253cyclictest0-21swapper/411:07:394
200599956193,295cyclictest0-21swapper/412:11:264
200579956112,127cyclictest0-21swapper/210:22:232
200569956010,211cyclictest0-21swapper/112:20:161
20057995566,301cyclictest25249-21ssh11:50:052
2005999555176,295cyclictest0-21swapper/410:35:244
2005799554339,84cyclictest0-21swapper/210:15:332
20063995530,85cyclictest19239-21ssh11:27:426
200599954635,508cyclictest0-21swapper/408:57:254
200599954635,508cyclictest0-21swapper/408:57:254
2005599546209,84cyclictest0-21swapper/008:20:140
200579954433,126cyclictest0-21swapper/212:42:272
200629954335,84cyclictest0-21swapper/510:23:485
200599954341,118cyclictest0-21swapper/409:23:464
200559954375,295cyclictest0-21swapper/008:54:340
200639954277,167cyclictest32445-21chrt07:26:206
200569954232,380cyclictest0-21swapper/112:11:031
200649954172,295cyclictest0-21swapper/709:54:557
200589954170,211cyclictest41-21ksoftirqd/312:32:443
200559954176,126cyclictest0-21swapper/010:53:440
200559954133,84cyclictest0-21swapper/010:15:340
200629954072,465cyclictest0-21swapper/510:35:225
2006499539495,42cyclictest721ktimersoftd/708:20:317
200629953932,297cyclictest0-21swapper/511:03:555
2005699539116,85cyclictest121rcu_preempt07:26:141
200599953628,42cyclictest0-21swapper/410:14:424
200599953626,507cyclictest0-21swapper/411:49:414
2005999535113,256cyclictest64450irq/122-eth010:45:254
2006399534448,83cyclictest631rcuc/610:34:196
200569953427,338cyclictest0-21swapper/111:33:451
200599953321,508cyclictest27839-21diskmemload11:58:414
200579953325,125cyclictest0-21swapper/211:35:162
200559953367,126cyclictest0-21swapper/012:11:400
200639953023,295cyclictest0-21swapper/611:08:096
200599952918,508cyclictest0-21swapper/412:33:034
200579952858,254cyclictest0-21swapper/212:15:332
200579952858,254cyclictest0-21swapper/212:15:332
200579952858,254cyclictest0-21swapper/212:15:332
2005799528101,296cyclictest0-21swapper/210:38:392
200649952618,211cyclictest0-21swapper/711:14:447
200569952615,381cyclictest0-21swapper/111:25:191
200599952515,507cyclictest0-21swapper/410:05:144
200599952514,126cyclictest0-21swapper/410:34:564
2005899523223,127cyclictest0-21swapper/311:26:583
200569952316,295cyclictest0-21swapper/110:05:221
200579952257,84cyclictest0-21swapper/210:58:332
200639952152,296cyclictest0-21swapper/612:21:126
200559952113,84cyclictest0-21swapper/011:40:130
200639952013,255cyclictest0-21swapper/608:58:206
200639952013,255cyclictest0-21swapper/608:58:206
200599952014,341cyclictest0-21swapper/412:05:154
200629951911,126cyclictest0-21swapper/511:25:535
20059995198,508cyclictest0-21swapper/411:39:024
200559951810,84cyclictest0-21swapper/011:33:410
200629951791,126cyclictest25226-21ssh10:53:075
200629951548,256cyclictest0-21swapper/510:44:515
20059995155,507cyclictest0-21swapper/409:44:204
200639951387,253cyclictest968-21ssh10:21:046
20059995132,507cyclictest0-21swapper/411:13:464
20059995121,508cyclictest0-21swapper/408:20:324
20055995125,256cyclictest0-21swapper/011:50:050
200559951247,126cyclictest31781-21fschecks_time09:45:180
200559951083,211cyclictest9-21ksoftirqd/011:49:120
20064995091,2cyclictest0-21swapper/711:50:067
20064995090,84cyclictest0-21swapper/711:27:417
20064995090,84cyclictest0-21swapper/710:52:307
20063995092,126cyclictest0-21swapper/610:04:246
20057995090,84cyclictest0-21swapper/210:53:412
200649950882,423cyclictest0-21swapper/709:44:037
20058995081,256cyclictest0-21swapper/311:50:063
20057995071,44cyclictest0-21swapper/209:51:322
20057995070,41cyclictest121rcu_preempt12:20:302
2005699507208,126cyclictest121rcu_preempt12:26:351
200629950640,212cyclictest20053-21cyclictest11:33:125
200559950642,126cyclictest0-21swapper/012:20:450
2006399505123,380cyclictest0-21swapper/611:24:326
2006299505122,295cyclictest0-21swapper/512:20:165
200579950582,126cyclictest0-21swapper/209:45:272
200569950537,296cyclictest0-21swapper/111:38:501
200649950483,85cyclictest31661-21rm10:20:157
200649950481,84cyclictest0-21swapper/711:07:097
200639950480,84cyclictest20053-21cyclictest12:11:506
200629950436,253cyclictest121rcu_preempt10:16:285
200599950335,465cyclictest0-21swapper/409:07:104
200589950338,127cyclictest0-21swapper/308:50:283
2005699503125,375cyclictest0-21swapper/109:20:351
200639950278,126cyclictest0-21swapper/609:44:266
200629950276,211cyclictest57-21ksoftirqd/512:15:155
200629950276,211cyclictest57-21ksoftirqd/512:15:155
200629950276,211cyclictest57-21ksoftirqd/512:15:155
200639950179,84cyclictest0-21swapper/608:36:146
200599950136,383cyclictest27241-21taskset08:13:044
200629950075,210cyclictest57-21ksoftirqd/510:33:205
2005699500163,83cyclictest121rcu_preempt11:02:491
2005699500115,211cyclictest25-21ksoftirqd/109:45:161
200649949933,126cyclictest0-21swapper/711:33:187
2005599499413,84cyclictest111rcuc/007:28:050
200559949933,126cyclictest0-21swapper/011:02:310
200639949673,84cyclictest0-21swapper/610:09:166
2006299496112,126cyclictest0-21swapper/511:44:135
200599949569,211cyclictest49-21ksoftirqd/409:55:144
200579949525,296cyclictest0-21swapper/211:24:382
200559949425,126cyclictest0-21swapper/011:06:280
2005799493151,127cyclictest121rcu_preempt11:02:452
200649949228,84cyclictest0-21swapper/710:58:347
200589949264,211cyclictest27839-21diskmemload10:58:113
200569949127,297cyclictest0-21swapper/111:40:321
2005899489105,381cyclictest0-21swapper/310:14:153
200559948923,84cyclictest26533-21kworker/u16:009:22:020
200649948822,211cyclictest0-21swapper/709:20:357
200599948768,209cyclictest1553-21runrttasks09:31:454
200559948761,211cyclictest0-21swapper/010:44:500
200579948620,126cyclictest0-21swapper/212:32:422
200639948517,387cyclictest0-21swapper/609:54:496
200559948558,296cyclictest0-21swapper/010:05:230
200569948419,298cyclictest0-21swapper/109:07:251
2005899483143,338cyclictest20053-21cyclictest11:09:273
200579948318,126cyclictest0-21swapper/212:26:212
200569948319,298cyclictest0-21swapper/110:02:331
2005699483100,211cyclictest19530-21cstates08:55:171
2005699483100,211cyclictest19530-21cstates08:55:171
200639948218,295cyclictest0-21swapper/610:45:256
2005799482145,175cyclictest0-21swapper/210:14:412
200569948116,298cyclictest0-21swapper/112:04:291
200589947913,84cyclictest0-21swapper/307:29:103
200649947796,378cyclictest31786-21ssh09:45:177
200629947711,335cyclictest0-21swapper/511:58:455
200639947654,84cyclictest0-21swapper/611:33:236
200639947611,4cyclictest698-21ptp4l08:53:266
200569947611,296cyclictest25-21ksoftirqd/111:18:571
200639947413,288cyclictest0-21swapper/611:01:256
200639947410,7cyclictest0-21swapper/610:56:166
200629947498,373cyclictest0-21swapper/509:20:355
200589947451,126cyclictest0-21swapper/310:33:483
200589947392,212cyclictest0-21swapper/310:39:423
20058994738,2cyclictest0-21swapper/311:33:253
200569947351,253cyclictest0-21swapper/110:58:241
2006499472130,127cyclictest14662-1kworker/u17:211:49:077
200599947291,126cyclictest0-21swapper/409:35:264
200579947248,84cyclictest0-21swapper/210:44:402
20055994726,84cyclictest0-21swapper/012:15:320
20055994726,84cyclictest0-21swapper/012:15:320
20055994726,84cyclictest0-21swapper/012:15:320
200639947145,297cyclictest27839-21diskmemload11:35:166
200589947149,84cyclictest0-21swapper/310:03:443
20057994701,254cyclictest0-21swapper/209:28:002
20056994701,211cyclictest0-21swapper/110:48:551
20064994692,211cyclictest73-21ksoftirqd/710:02:467
200569946943,295cyclictest0-21swapper/112:05:081
2006499467125,126cyclictest27839-21diskmemload12:04:597
200649946643,84cyclictest0-21swapper/710:45:067
2005699466125,126cyclictest25-21ksoftirqd/110:33:421
2006499465124,338cyclictest0-21swapper/711:58:577
200579946543,299cyclictest21154-21sh12:05:082
2006399464209,253cyclictest641ktimersoftd/609:25:216
2006399464123,338cyclictest21303-21ssh10:14:236
200589946441,256cyclictest0-21swapper/311:03:353
2005899464209,253cyclictest30569-21kworker/u16:011:24:213
2005899464122,339cyclictest20053-21cyclictest09:25:183
2006399463123,338cyclictest0-21swapper/612:26:356
200589946336,211cyclictest0-21swapper/312:11:533
2006399462122,337cyclictest0-21swapper/611:50:056
200629946277,338cyclictest0-21swapper/512:33:015
200629946241,255cyclictest0-21swapper/512:04:285
200569946235,169cyclictest0-21swapper/111:07:071
2005599462123,337cyclictest0-21swapper/010:03:150
2006499461125,166cyclictest17334-21grep09:55:147
200629946140,255cyclictest0-21swapper/507:26:135
2005699461124,84cyclictest0-21swapper/110:51:031
200649946080,84cyclictest0-21swapper/708:40:087
200649946072,338cyclictest0-21swapper/710:38:457
2006399460416,42cyclictest631rcuc/611:44:296
2006399460120,338cyclictest0-21swapper/610:18:276
200599946038,256cyclictest0-21swapper/410:44:484
2005599460374,84cyclictest111rcuc/008:58:370
2005599460374,84cyclictest111rcuc/008:58:370
2005599460122,336cyclictest0-21swapper/009:25:180
200599945978,126cyclictest0-21swapper/411:54:184
200599945976,211cyclictest0-21swapper/407:23:124
2005999459121,84cyclictest0-21swapper/412:26:064
2005599459119,337cyclictest0-21swapper/009:54:270
200649945879,83cyclictest0-21swapper/712:10:537
2006399458204,84cyclictest27839-21diskmemload12:05:086
200579945836,2cyclictest0-21swapper/211:58:302
200569945835,256cyclictest0-21swapper/112:32:311
200559945837,3cyclictest0-21swapper/010:57:580
200649945776,84cyclictest0-21swapper/711:03:127
200649945775,84cyclictest0-21swapper/710:31:307
200649945735,126cyclictest0-21swapper/712:27:007
200589945735,255cyclictest0-21swapper/309:54:263
200579945734,126cyclictest121rcu_preempt12:11:252
200629945634,255cyclictest0-21swapper/509:35:285
200589945675,338cyclictest0-21swapper/308:40:083
200559945634,84cyclictest0-21swapper/010:49:300
200639945573,84cyclictest121rcu_preempt12:04:406
200629945574,126cyclictest121rcu_preempt11:54:045
200629945534,2cyclictest0-21swapper/512:10:525
200629945534,255cyclictest0-21swapper/509:53:285
200589945532,3cyclictest0-21swapper/311:43:543
200569945532,256cyclictest0-21swapper/111:14:441
2005599455114,339cyclictest20053-21cyclictest10:38:400
200649945432,84cyclictest0-21swapper/708:38:467
200629945432,256cyclictest0-21swapper/511:24:515
2005799454113,338cyclictest0-21swapper/211:18:572
200569945432,256cyclictest0-21swapper/110:44:471
200569945427,254cyclictest0-21swapper/110:38:461
200559945432,3cyclictest0-21swapper/012:32:430
2005799453113,338cyclictest0-21swapper/208:36:092
200559945372,126cyclictest0-21swapper/010:33:480
200629945268,211cyclictest57-21ksoftirqd/507:45:015
200629945231,255cyclictest0-21swapper/509:27:595
2006299452113,84cyclictest0-21swapper/508:08:185
2005899452195,126cyclictest0-21swapper/310:24:033
200649945171,84cyclictest0-21swapper/708:55:357
200649945171,84cyclictest0-21swapper/708:55:357
2005899451407,42cyclictest391rcuc/312:15:323
2005899451407,42cyclictest391rcuc/312:15:323
2005899451407,42cyclictest391rcuc/312:15:323
200579945125,127cyclictest0-21swapper/210:02:462
200569945129,255cyclictest0-21swapper/109:31:341
200569945028,295cyclictest0-21swapper/109:51:261
200569945028,256cyclictest0-21swapper/108:42:591
200649944927,42cyclictest0-21swapper/710:05:347
200629944923,301cyclictest0-21swapper/511:13:125
200639944824,293cyclictest0-21swapper/610:44:566
200589944826,84cyclictest0-21swapper/310:05:223
200589944724,3cyclictest0-21swapper/308:55:153
200589944724,3cyclictest0-21swapper/308:55:153
200579944725,3cyclictest0-21swapper/210:49:122
200559944725,3cyclictest0-21swapper/009:07:250
2006399446108,171cyclictest0-21swapper/608:20:306
2005799446104,126cyclictest121rcu_preempt12:04:432
2006499445107,171cyclictest15850irq/123-ahci[0012:32:317
200639944565,256cyclictest7932-21ssh12:33:076
200649944464,84cyclictest0-21swapper/707:59:597
2006499444106,171cyclictest0-21swapper/712:20:137
200629944422,256cyclictest0-21swapper/510:55:535
200589944420,170cyclictest20053-21cyclictest12:09:353
2006499443106,170cyclictest0-21swapper/710:15:487
2006499443105,171cyclictest0-21swapper/709:31:337
200569944319,84cyclictest0-21swapper/108:08:231
200649944262,84cyclictest0-21swapper/708:08:237
2006499442105,170cyclictest0-21swapper/709:07:257
200629944220,256cyclictest0-21swapper/508:20:335
200589944261,169cyclictest0-21swapper/312:42:313
200569944219,256cyclictest0-21swapper/109:35:281
2005799441142,126cyclictest121rcu_preempt08:40:082
2005599441273,126cyclictest0-21swapper/012:26:190
200559944119,84cyclictest0-21swapper/008:38:460
200559944115,253cyclictest0-21swapper/009:35:290
200639944060,84cyclictest20053-21cyclictest08:47:096
200629944017,259cyclictest0-21swapper/511:38:485
200589944018,256cyclictest0-21swapper/310:45:263
200579944099,126cyclictest17707-21missed_timers08:50:252
200649943915,84cyclictest0-21swapper/708:50:347
200629943959,296cyclictest0-21swapper/508:38:465
200599943813,126cyclictest0-21swapper/407:59:494
200569943817,255cyclictest0-21swapper/109:27:591
200629943711,253cyclictest18653-21sh10:49:125
200629943611,125cyclictest121rcu_preempt12:09:405
200599943610,423cyclictest0-21swapper/409:00:204
200569943652,169cyclictest25-21ksoftirqd/108:37:371
200589943519,77cyclictest5914-1kworker/u17:109:44:033
200589943513,3cyclictest0-21swapper/309:35:143
20056994348,126cyclictest25-21ksoftirqd/109:44:411
200639943394,84cyclictest0-21swapper/610:39:316
200589943392,126cyclictest121rcu_preempt12:04:273
200589943310,169cyclictest0-21swapper/310:45:023
20064994324,254cyclictest0-21swapper/711:19:137
20057994325,380cyclictest0-21swapper/209:35:592
20064994319,2cyclictest0-21swapper/709:27:597
200629943147,211cyclictest26424-21ssh12:42:315
20062994308,255cyclictest0-21swapper/511:49:015
200649942990,84cyclictest0-21swapper/710:28:207
200579942881,84cyclictest0-21swapper/208:08:242
200649942786,84cyclictest1553-21runrttasks07:26:557
20057994260,84cyclictest0-21swapper/207:45:012
200629942539,212cyclictest0-21swapper/508:55:235
200629942539,212cyclictest0-21swapper/508:55:235
200599942540,256cyclictest0-21swapper/408:42:594
2005599424125,126cyclictest9-21ksoftirqd/009:00:120
200649942384,84cyclictest17002-21diskmemload12:37:387
200589942383,338cyclictest0-21swapper/311:39:183
200569942339,211cyclictest25-21ksoftirqd/108:20:221
200559942382,338cyclictest0-21swapper/009:55:140
200639942282,85cyclictest0-21swapper/611:49:046
200629942282,338cyclictest0-21swapper/512:26:325
200629942281,338cyclictest0-21swapper/509:43:575
200599942282,337cyclictest0-21swapper/407:30:044
200649942182,84cyclictest0-21swapper/711:43:347
200649942182,84cyclictest0-21swapper/711:35:137
200649942140,43cyclictest0-21swapper/709:35:507
200639942182,84cyclictest0-21swapper/612:42:266
200579942182,84cyclictest0-21swapper/209:44:322
200559942141,84cyclictest0-21swapper/011:19:080
200629942080,338cyclictest0-21swapper/510:14:265
200629942040,255cyclictest0-21swapper/510:28:205
200599942079,338cyclictest0-21swapper/411:18:574
200579942082,84cyclictest0-21swapper/208:57:452
200579942082,84cyclictest0-21swapper/208:57:452
200579941981,84cyclictest0-21swapper/208:12:592
200599941878,338cyclictest0-21swapper/408:31:354
200599941878,338cyclictest0-21swapper/408:31:354
2005899418119,127cyclictest0-21swapper/312:26:183
200649941778,84cyclictest0-21swapper/712:42:437
200639941778,84cyclictest0-21swapper/611:18:576
200629941777,338cyclictest0-21swapper/509:31:305
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional