You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 15:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Jun 13, 2026 12:57:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
253409969618,127cyclictest121rcu_preempt11:00:230
253449967134,634cyclictest0-21swapper/412:16:594
253419965160,295cyclictest0-21swapper/109:43:421
253449964612,86cyclictest0-21swapper/411:41:104
253449963238,591cyclictest0-21swapper/410:47:494
253449963140,380cyclictest0-21swapper/412:04:154
253449962976,550cyclictest0-21swapper/410:18:464
253449961865,84cyclictest0-21swapper/411:00:164
253449961322,554cyclictest0-21swapper/410:08:584
2534299613101,380cyclictest0-21swapper/209:23:132
25344996049,592cyclictest0-21swapper/410:30:234
25342995943,2cyclictest0-21swapper/210:17:282
25347995930,84cyclictest0-21swapper/711:45:177
25347995930,84cyclictest0-21swapper/711:44:497
253439958940,253cyclictest17323-21ssh12:37:413
25346995854,2cyclictest0-21swapper/610:08:076
253449958134,166cyclictest0-21swapper/411:36:494
253449957729,164cyclictest0-21swapper/410:26:594
253449957729,164cyclictest0-21swapper/410:26:594
2534399576236,338cyclictest17105-21ssh10:49:013
253449957325,337cyclictest0-21swapper/409:41:364
253479956819,169cyclictest0-21swapper/710:32:517
253419956415,380cyclictest0-21swapper/112:05:201
253419956415,380cyclictest0-21swapper/112:05:201
253429956110,48cyclictest121rcu_preempt11:41:422
25344995542,549cyclictest0-21swapper/412:06:574
25344995542,549cyclictest0-21swapper/412:06:564
253479955081,211cyclictest73-21ksoftirqd/712:38:167
25341995501,42cyclictest121rcu_preempt10:32:241
2534799545462,3cyclictest721ktimersoftd/711:36:467
253479954436,83cyclictest121rcu_preempt11:00:537
253459954434,425cyclictest0-21swapper/512:17:065
253449954438,429cyclictest0-21swapper/411:45:304
2534599542119,295cyclictest0-21swapper/512:08:085
2534599542119,295cyclictest0-21swapper/512:08:085
253449954134,166cyclictest0-21swapper/410:56:524
253449954134,165cyclictest0-21swapper/410:10:164
253449954133,337cyclictest0-21swapper/409:21:564
253449953932,423cyclictest0-21swapper/411:14:514
253449953929,127cyclictest0-21swapper/409:39:374
253469953832,86cyclictest0-21swapper/611:41:096
253409953724,2cyclictest0-21swapper/010:17:420
2534399536196,338cyclictest25338-21cyclictest11:45:183
2534399535194,338cyclictest31776-1kworker/u17:111:42:163
2534799534112,340cyclictest0-21swapper/710:07:557
253449953228,336cyclictest0-21swapper/412:26:474
253429953225,125cyclictest0-21swapper/209:40:152
253449953023,504cyclictest28353-21ssh10:00:054
253449953023,504cyclictest0-21swapper/409:59:144
253439952918,508cyclictest0-21swapper/312:06:153
253439952918,508cyclictest0-21swapper/312:06:153
2534299529229,211cyclictest19085-21sed10:50:172
2534099527444,3cyclictest101ktimersoftd/010:49:400
253459952498,295cyclictest19908-21missed_timers10:50:325
253409952317,126cyclictest0-21swapper/012:05:080
253409952317,126cyclictest0-21swapper/012:05:070
2534099523101,3cyclictest0-21swapper/010:07:130
2534399522439,3cyclictest391rcuc/310:32:233
253419952215,2cyclictest0-21swapper/108:54:471
2534599520179,338cyclictest14161-1kworker/u17:012:03:135
253459952011,126cyclictest0-21swapper/509:23:135
253419951913,303cyclictest0-21swapper/111:45:311
253419951695,83cyclictest0-21swapper/110:07:551
2534699512426,84cyclictest631rcuc/612:03:566
25345995100,85cyclictest0-21swapper/511:37:255
2534399510170,338cyclictest23146-21kworker/u16:312:17:183
25347995090,84cyclictest0-21swapper/712:03:297
25346995090,84cyclictest0-21swapper/611:37:256
25345995091,126cyclictest981-21diskmemload10:10:045
253449950841,464cyclictest0-21swapper/412:37:474
25341995081,43cyclictest121rcu_preempt10:00:051
25344995071,425cyclictest0-21swapper/410:20:194
25344995071,2cyclictest0-21swapper/408:29:214
25340995071,128cyclictest0-21swapper/011:43:540
2534099506462,41cyclictest111rcuc/009:44:510
253479950435,84cyclictest0-21swapper/711:15:057
253449950440,383cyclictest0-21swapper/411:15:064
2534799503420,2cyclictest721ktimersoftd/712:07:407
2534799503420,2cyclictest721ktimersoftd/712:07:407
2534699503119,211cyclictest1551-21snmpd09:23:076
2534599503120,126cyclictest121rcu_preempt10:34:495
253439950338,299cyclictest0-21swapper/311:00:193
253429950381,84cyclictest0-21swapper/210:26:212
253429950381,84cyclictest0-21swapper/210:26:212
253419950381,84cyclictest0-21swapper/112:03:351
2534599502121,126cyclictest121rcu_preempt10:16:565
253409950276,253cyclictest0-21swapper/010:27:280
253409950276,253cyclictest0-21swapper/010:27:280
2534599500121,295cyclictest0-21swapper/510:26:215
2534599500121,295cyclictest0-21swapper/510:26:205
253449950034,167cyclictest0-21swapper/408:52:334
25342995004,3cyclictest0-21swapper/208:54:462
253429949978,257cyclictest25338-21cyclictest09:59:062
2534699498116,296cyclictest12359-21sh10:26:216
2534699498116,296cyclictest12359-21sh10:26:216
2534299498113,210cyclictest0-21swapper/211:00:312
2534599496239,93cyclictest21917-21ssh11:27:065
253439949670,211cyclictest41-21ksoftirqd/309:23:353
253419949674,84cyclictest0-21swapper/112:17:531
2534099496112,259cyclictest0-21swapper/012:03:090
253459949430,126cyclictest25338-21cyclictest10:56:235
253439949471,84cyclictest23432-21runrttasks12:03:353
253419949472,84cyclictest0-21swapper/109:24:191
253469949327,84cyclictest0-21swapper/612:17:266
253429949367,168cyclictest321ktimersoftd/212:20:172
253449949223,466cyclictest0-21swapper/411:26:574
2534399492107,211cyclictest41-21ksoftirqd/309:43:153
2534699491448,41cyclictest631rcuc/610:18:436
2534399491108,380cyclictest0-21swapper/309:59:243
253429949164,295cyclictest0-21swapper/211:13:582
253469949025,2cyclictest0-21swapper/608:54:476
2534399490110,211cyclictest27227-21sh10:16:073
253449948923,462cyclictest721-21nscd12:10:274
253439948664,84cyclictest0-21swapper/310:26:213
253439948664,84cyclictest0-21swapper/310:26:213
253429948621,261cyclictest0-21swapper/211:45:082
253469948415,261cyclictest0-21swapper/610:33:296
253479948316,84cyclictest0-21swapper/710:59:237
253419948218,344cyclictest0-21swapper/110:27:031
253419948218,344cyclictest0-21swapper/110:27:021
253459948112,338cyclictest0-21swapper/511:41:595
2534199481107,78cyclictest0-21swapper/110:48:001
2534699480138,126cyclictest19084-21ssh10:50:196
253439948015,256cyclictest0-21swapper/310:08:113
253419948015,295cyclictest0-21swapper/109:59:591
253429947918,295cyclictest0-21swapper/212:40:012
253409947955,381cyclictest0-21swapper/009:59:040
253469947713,84cyclictest0-21swapper/612:38:476
253429947713,42cyclictest121rcu_preempt10:10:012
2534799474174,126cyclictest121rcu_preempt12:20:207
253469947410,261cyclictest0-21swapper/610:59:396
25344994713,465cyclictest0-21swapper/410:50:214
253479947089,126cyclictest0-21swapper/709:59:247
2534199470129,338cyclictest704-21nscd11:44:581
25342994695,85cyclictest0-21swapper/212:04:032
2534299468125,340cyclictest0-21swapper/209:38:462
253459946740,338cyclictest0-21swapper/512:40:255
2534099467167,126cyclictest121rcu_preempt10:59:470
253439946681,211cyclictest31143-21pmu-power09:25:283
25343994661,172cyclictest121rcu_preempt10:50:253
2534299466124,339cyclictest17915-21ssh10:50:042
2534299466124,211cyclictest981-21diskmemload10:56:582
25341994661,43cyclictest121rcu_preempt12:10:161
253459946539,338cyclictest0-21swapper/509:41:185
2534299465124,338cyclictest0-21swapper/212:06:512
2534299465124,338cyclictest0-21swapper/212:06:512
2534199465125,338cyclictest0-21swapper/111:14:511
253439946437,339cyclictest0-21swapper/311:27:123
2534399464124,338cyclictest32402-21ssh10:57:153
2534299464123,338cyclictest0-21swapper/212:16:352
253409946479,84cyclictest24428-21perf08:55:020
253479946340,3cyclictest0-21swapper/710:16:227
2534799463379,3cyclictest721ktimersoftd/710:30:007
2534799463379,3cyclictest721ktimersoftd/710:29:597
2534299463122,338cyclictest0-21swapper/210:30:142
253469946282,84cyclictest0-21swapper/609:58:006
2534699462121,338cyclictest0-21swapper/609:40:596
253459946240,169cyclictest0-21swapper/508:54:105
2534599462122,338cyclictest0-21swapper/512:38:355
253439946239,254cyclictest0-21swapper/311:13:043
253419946235,211cyclictest25-21ksoftirqd/112:26:331
253459946138,292cyclictest0-21swapper/511:00:155
253419946182,84cyclictest1551-21snmpd10:18:021
253479946038,2cyclictest0-21swapper/710:10:117
253479946037,3cyclictest0-21swapper/711:14:277
253479945937,3cyclictest0-21swapper/709:24:027
2534699459122,82cyclictest13891-21cstates10:10:146
2534699459118,338cyclictest0-21swapper/609:38:466
2534599459120,336cyclictest0-21swapper/511:45:085
253409945982,162cyclictest24850-21taskset09:39:060
253479945832,211cyclictest73-21ksoftirqd/710:50:297
2534099458374,4cyclictest101ktimersoftd/010:10:130
2534699457116,338cyclictest0-21swapper/610:50:016
253479945634,3cyclictest0-21swapper/712:10:307
253479945633,3cyclictest0-21swapper/710:48:527
2534799456115,338cyclictest0-21swapper/709:40:187
253449945680,84cyclictest1553-21runrttasks09:25:184
253439945633,256cyclictest0-21swapper/310:00:063
2534299456373,3cyclictest311rcuc/210:10:132
253409945634,256cyclictest0-21swapper/012:17:430
253409945633,256cyclictest0-21swapper/011:14:580
2534699455114,127cyclictest65-21ksoftirqd/609:25:016
253459945427,295cyclictest0-21swapper/510:20:145
253459945331,254cyclictest25635-21ssh09:39:515
253459945330,256cyclictest0-21swapper/508:28:575
2534399453113,338cyclictest0-21swapper/311:36:473
253419945368,211cyclictest25-21ksoftirqd/111:36:131
253469945270,380cyclictest65-21ksoftirqd/611:45:126
2534699452113,337cyclictest29330-21sshd12:08:326
2534699452113,337cyclictest29330-21sshd12:08:316
253459945230,253cyclictest0-21swapper/512:10:105
2534199452112,338cyclictest0-21swapper/110:59:391
2534199452110,211cyclictest0-21swapper/112:38:501
253469945129,255cyclictest0-21swapper/610:20:196
253459945124,295cyclictest0-21swapper/510:47:375
2534199451110,338cyclictest0-21swapper/111:27:191
253409945171,135cyclictest0-21swapper/009:24:470
253479945027,3cyclictest0-21swapper/712:16:067
253419945026,84cyclictest0-21swapper/110:10:161
2534199450109,338cyclictest0-21swapper/110:50:161
253409944928,255cyclictest0-21swapper/011:26:590
253409944922,303cyclictest0-21swapper/012:39:310
2534399448106,127cyclictest0-21swapper/310:10:103
2534099448361,84cyclictest101ktimersoftd/012:25:400
253479944725,3cyclictest0-21swapper/710:20:117
253479944719,84cyclictest0-21swapper/710:00:057
253449944766,84cyclictest0-21swapper/408:30:124
253449944766,84cyclictest0-21swapper/408:30:114
253419944725,256cyclictest0-21swapper/110:20:191
253479944624,256cyclictest0-21swapper/708:54:477
2534699446147,126cyclictest121rcu_preempt12:10:276
253459944623,3cyclictest0-21swapper/509:58:135
253439944522,3cyclictest0-21swapper/309:39:293
253449944321,84cyclictest0-21swapper/412:20:164
2534299443100,212cyclictest0-21swapper/209:45:052
253429944219,127cyclictest1551-21snmpd11:36:572
253439944161,84cyclictest121rcu_preempt12:10:163
253439944119,2cyclictest0-21swapper/310:20:103
253429944117,126cyclictest0-21swapper/209:25:302
2534699440100,337cyclictest0-21swapper/611:15:116
253479943916,256cyclictest0-21swapper/711:26:597
2534199439144,211cyclictest241ktimersoftd/108:55:121
2534099439100,85cyclictest0-21swapper/010:30:120
253439943852,169cyclictest0-21swapper/308:53:203
253459943595,338cyclictest13899-21runrttasks10:10:155
2534099434351,3cyclictest111rcuc/011:45:320
253409943412,253cyclictest0-21swapper/010:50:310
253459943210,255cyclictest0-21swapper/511:14:185
253429943218,246cyclictest0-21swapper/212:25:502
253409943146,211cyclictest9-21ksoftirqd/011:37:200
253469942788,84cyclictest0-21swapper/611:13:476
253419942746,84cyclictest0-21swapper/109:38:101
253409942642,126cyclictest32183-21ssh10:20:190
253439942381,339cyclictest0-21swapper/312:26:353
25342994231,2cyclictest0-21swapper/211:26:592
25342994231,2cyclictest0-21swapper/210:20:192
253479942281,338cyclictest0-21swapper/709:39:367
253469942283,84cyclictest0-21swapper/611:27:196
253419942237,211cyclictest0-21swapper/111:00:541
253479942179,211cyclictest0-21swapper/709:25:347
253469942182,84cyclictest0-21swapper/611:00:176
2534399421122,126cyclictest121rcu_preempt08:29:563
253409942183,84cyclictest0-21swapper/008:55:120
253459942040,295cyclictest0-21swapper/511:15:055
253449942040,211cyclictest0-21swapper/412:40:054
253439942081,84cyclictest0-21swapper/311:15:113
253419942082,84cyclictest0-21swapper/111:15:101
253409942082,84cyclictest0-21swapper/012:20:190
253409942082,84cyclictest0-21swapper/008:30:120
253409942082,84cyclictest0-21swapper/008:30:120
253479941978,338cyclictest0-21swapper/708:30:127
253479941978,338cyclictest0-21swapper/708:30:127
2534699419122,295cyclictest698-21ptp4l08:29:556
253459941880,211cyclictest24530-21kworker/5:008:55:075
253459941839,216cyclictest0-21swapper/509:25:045
253439941878,338cyclictest0-21swapper/309:45:123
253439941878,337cyclictest0-21swapper/312:40:223
253429941779,84cyclictest0-21swapper/211:15:032
253459941636,254cyclictest0-21swapper/510:00:105
253479941574,338cyclictest0-21swapper/712:26:217
253469941534,84cyclictest0-21swapper/612:20:176
253429941577,84cyclictest0-21swapper/212:10:302
2534199415116,126cyclictest16146-21ssh12:20:121
253469941475,85cyclictest0-21swapper/608:30:126
253469941475,85cyclictest0-21swapper/608:30:126
253459941476,84cyclictest0-21swapper/508:30:125
253459941476,84cyclictest0-21swapper/508:30:125
253439941474,84cyclictest0-21swapper/308:30:123
253439941474,84cyclictest0-21swapper/308:30:123
253439941333,259cyclictest0-21swapper/312:20:303
253459941232,295cyclictest0-21swapper/509:45:055
253419941233,255cyclictest0-21swapper/109:25:191
253409941071,84cyclictest0-21swapper/011:15:110
253449940727,253cyclictest0-21swapper/409:45:124
2534099407107,211cyclictest0-21swapper/010:00:090
253409940627,255cyclictest30514-21hddtemp_smartct09:25:190
253479940323,3cyclictest0-21swapper/712:40:067
2534299403106,126cyclictest121rcu_preempt08:29:122
253429940263,84cyclictest0-21swapper/208:55:132
2534199402110,40cyclictest0-21swapper/108:29:051
253419940118,260cyclictest0-21swapper/108:30:061
253419940118,260cyclictest0-21swapper/108:30:061
253459940020,296cyclictest0-21swapper/512:20:305
253459939919,296cyclictest0-21swapper/512:26:115
253429939957,126cyclictest121rcu_preempt08:30:122
253429939957,126cyclictest121rcu_preempt08:30:112
253479939754,211cyclictest73-21ksoftirqd/709:45:117
253429939414,261cyclictest0-21swapper/212:40:042
25344993939,211cyclictest0-21swapper/408:55:064
253419939354,84cyclictest0-21swapper/109:45:111
253479938849,84cyclictest0-21swapper/708:55:057
253409938551,212cyclictest0-21swapper/012:10:100
253469937839,84cyclictest0-21swapper/612:40:226
253439937739,254cyclictest0-21swapper/308:55:133
253429937741,81cyclictest0-21swapper/210:00:112
253469937331,83cyclictest0-21swapper/612:26:366
253409937334,84cyclictest0-21swapper/012:40:220
253479937272,84cyclictest1551-21snmpd08:29:307
253469937234,82cyclictest0-21swapper/610:00:116
253469937028,90cyclictest0-21swapper/609:45:086
2534199364107,126cyclictest0-21swapper/112:40:241
253409936321,296cyclictest0-21swapper/008:29:170
253409936165,84cyclictest0-21swapper/009:45:100
253469931514,257cyclictest0-21swapper/608:55:076
2245021200,3sleep50-21swapper/507:05:135
1298521160,0sleep40-21swapper/411:05:174
23053210196,2sleep70-21swapper/707:05:167
2476528858,27sleep60-21swapper/607:07:556
2483528554,28sleep20-21swapper/207:08:562
2478928452,28sleep30-21swapper/307:08:153
2481928251,27sleep40-21swapper/407:08:414
2468528149,28sleep10-21swapper/107:06:461
2489027949,27sleep00-21swapper/007:09:420
188582760,0sleep50-21swapper/511:08:295
116322620,2sleep62534699cyclictest11:05:116
25345994219,20cyclictest4602-21taskset12:30:455
2534299428,22cyclictest33-21ksoftirqd/212:30:312
2534199429,22cyclictest25-21ksoftirqd/112:30:381
25340994212,19cyclictest9-21ksoftirqd/012:30:460
2534699414,26cyclictest65-21ksoftirqd/612:31:036
2534799331,2cyclictest0-21swapper/712:30:077
25343993324,5cyclictest1985-21tr12:30:133
25344993225,6cyclictest0-21swapper/409:19:524
25344993210,21cyclictest0-21swapper/408:02:104
25344993210,21cyclictest0-21swapper/407:46:494
25344993210,0cyclictest0-21swapper/408:18:564
25343993226,5cyclictest0-21swapper/309:19:473
25345993110,21cyclictest0-21swapper/508:11:215
25345993110,20cyclictest0-21swapper/507:13:595
25345993026,3cyclictest0-21swapper/509:19:485
25344993022,5cyclictest2397-21expr12:30:144
25343993026,4cyclictest0-21swapper/308:18:523
25345992910,2cyclictest0-21swapper/507:46:465
25345992910,19cyclictest0-21swapper/508:02:085
25345992910,18cyclictest0-21swapper/507:53:445
25343992922,6cyclictest0-21swapper/307:46:493
25342992910,18cyclictest0-21swapper/208:01:512
25347992810,18cyclictest0-21swapper/708:42:077
25347992810,0cyclictest0-21swapper/709:19:447
25347992810,0cyclictest0-21swapper/709:08:107
25346992810,18cyclictest0-21swapper/607:54:146
25345992810,17cyclictest0-21swapper/508:18:285
25345992810,17cyclictest0-21swapper/507:38:265
25345992810,17cyclictest0-21swapper/507:29:445
25344992826,2cyclictest0-21swapper/408:42:054
25343992824,3cyclictest0-21swapper/308:02:103
25343992810,18cyclictest0-21swapper/307:29:133
25343992810,0cyclictest0-21swapper/309:07:383
25343992810,0cyclictest0-21swapper/308:41:383
25343992810,0cyclictest0-21swapper/308:11:023
25343992810,0cyclictest0-21swapper/307:13:383
25342992810,18cyclictest0-21swapper/208:18:332
25342992810,17cyclictest0-21swapper/208:41:362
25341992810,17cyclictest0-21swapper/109:19:451
25347992727,0cyclictest0-21swapper/708:11:297
25347992727,0cyclictest0-21swapper/707:13:317
25347992710,17cyclictest0-21swapper/708:18:347
25347992710,17cyclictest0-21swapper/707:53:497
25347992710,17cyclictest0-21swapper/707:46:177
25347992710,17cyclictest0-21swapper/707:29:117
25347992710,17cyclictest0-21swapper/707:21:427
25347992710,0cyclictest0-21swapper/708:01:417
25346992727,0cyclictest0-21swapper/609:07:416
25346992727,0cyclictest0-21swapper/607:21:546
25346992727,0cyclictest0-21swapper/607:13:496
25346992710,17cyclictest0-21swapper/609:19:396
25346992710,17cyclictest0-21swapper/608:42:026
25346992710,17cyclictest0-21swapper/608:01:506
25346992710,17cyclictest0-21swapper/607:46:206
25346992710,0cyclictest0-21swapper/608:18:336
25346992710,0cyclictest0-21swapper/608:11:176
25346992710,0cyclictest0-21swapper/607:38:556
25346992710,0cyclictest0-21swapper/607:29:156
25345992726,1cyclictest0-21swapper/507:21:305
25345992710,0cyclictest0-21swapper/509:08:065
25345992710,0cyclictest0-21swapper/508:41:255
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional