You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 23:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Apr 21, 2026 12:55:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
209729983934,84cyclictest0-21swapper/212:22:012
2097299803124,84cyclictest20968-21cyclictest11:07:362
209749976956,414cyclictest121rcu_preempt11:07:374
209729974522,127cyclictest0-21swapper/212:10:432
2097199674588,84cyclictest231rcuc/110:23:051
209719966569,380cyclictest0-21swapper/111:36:281
209719966367,465cyclictest0-21swapper/112:05:491
2097399661110,126cyclictest0-21swapper/310:55:043
2097299656102,380cyclictest0-21swapper/210:55:252
2097199656104,126cyclictest0-21swapper/112:31:441
209729965517,635cyclictest0-21swapper/212:04:252
209719965299,380cyclictest0-21swapper/111:25:071
209739962574,84cyclictest28557-21diskmemload11:25:073
209719962532,84cyclictest0-21swapper/111:08:481
209729962328,592cyclictest0-21swapper/211:13:262
2097199612271,338cyclictest4294-21kworker/u16:310:55:201
209749960396,126cyclictest0-21swapper/412:13:234
20970996008,383cyclictest0-21swapper/011:33:010
20971995996,127cyclictest0-21swapper/112:24:181
20972995971,593cyclictest0-21swapper/211:25:252
20972995964,383cyclictest0-21swapper/211:33:022
20977995940,84cyclictest0-21swapper/711:32:007
20976995940,83cyclictest0-21swapper/612:09:166
20973995940,84cyclictest0-21swapper/312:09:173
209709959340,338cyclictest0-21swapper/011:07:350
209739959280,381cyclictest0-21swapper/312:04:463
2097299592125,126cyclictest33-21ksoftirqd/211:35:302
209759958877,380cyclictest0-21swapper/510:39:465
2097399588120,295cyclictest0-21swapper/311:22:513
2097699585502,3cyclictest631rcuc/612:11:586
209729958473,508cyclictest0-21swapper/212:07:302
2097199584116,296cyclictest0-21swapper/111:42:491
209729958330,126cyclictest12542-21rm10:54:502
209729958330,126cyclictest12542-21rm10:54:502
209709958031,130cyclictest0-21swapper/012:12:390
209729957929,381cyclictest0-21swapper/208:49:312
209729957926,550cyclictest0-21swapper/210:24:412
2097699577494,3cyclictest631rcuc/612:24:006
209709957727,84cyclictest0-21swapper/011:10:370
2097199576111,126cyclictest0-21swapper/112:25:561
209719957565,295cyclictest14131-21ssh12:11:191
209749957367,253cyclictest0-21swapper/412:04:054
2097099572528,42cyclictest111rcuc/011:35:590
2097799569487,3cyclictest711rcuc/711:13:087
209709956760,89cyclictest121rcu_preempt11:01:550
209709956618,43cyclictest6565-21diskmemload11:47:430
2097399558217,338cyclictest28557-21diskmemload12:44:563
2097099556131,295cyclictest0-21swapper/011:42:220
20973995555,126cyclictest0-21swapper/311:42:223
209739954981,465cyclictest0-21swapper/311:07:373
2097399549250,126cyclictest0-21swapper/312:32:173
209759954882,84cyclictest121rcu_preempt12:04:335
209779954778,296cyclictest0-21swapper/712:22:027
2097699547248,126cyclictest3925-21kworker/u16:211:10:366
209729954682,126cyclictest18987-21sshd08:00:042
209729954635,508cyclictest0-21swapper/210:13:352
209739954579,126cyclictest0-21swapper/312:13:443
209729954580,210cyclictest0-21swapper/210:15:152
209759954479,127cyclictest0-21swapper/511:35:005
209719954478,126cyclictest0-21swapper/111:24:431
2097099544115,84cyclictest2129-21ps10:15:290
209729954333,126cyclictest30731-21taskset11:24:382
209719954231,126cyclictest0-21swapper/112:04:261
209749953827,254cyclictest20968-21cyclictest11:23:204
209719953832,126cyclictest14811-21ssh11:33:171
209749953671,126cyclictest0-21swapper/408:24:474
2097599534236,296cyclictest3925-21kworker/u16:211:25:245
209729953428,427cyclictest0-21swapper/212:34:242
209729953262,297cyclictest0-21swapper/211:01:562
2097699530145,254cyclictest0-21swapper/611:37:086
209709953061,380cyclictest0-21swapper/010:55:040
209769952916,381cyclictest0-21swapper/612:32:166
209759952921,84cyclictest0-21swapper/512:07:165
2097499529188,338cyclictest64450irq/122-eth008:48:154
2097799528106,211cyclictest0-21swapper/712:10:487
2097699528484,42cyclictest631rcuc/612:03:166
209749952817,168cyclictest0-21swapper/411:46:234
209729952816,126cyclictest0-21swapper/211:46:402
2097299527270,126cyclictest28557-21diskmemload12:44:302
209749952615,338cyclictest0-21swapper/412:08:204
2097199524140,295cyclictest0-21swapper/111:10:161
209739952355,253cyclictest0-21swapper/311:31:443
209719952355,296cyclictest0-21swapper/110:14:391
20970995219,296cyclictest0-21swapper/012:02:130
2097399520222,126cyclictest0-21swapper/311:36:563
209739951710,254cyclictest0-21swapper/310:23:543
20975995169,341cyclictest0-21swapper/511:08:035
20974995168,84cyclictest0-21swapper/411:10:164
209729951648,465cyclictest0-21swapper/211:41:042
20974995154,126cyclictest0-21swapper/410:13:134
20976995130,84cyclictest12618-21awk10:55:006
20976995130,84cyclictest12618-21awk10:55:006
20975995121,387cyclictest0-21swapper/512:12:545
20970995101,127cyclictest0-21swapper/011:21:460
209759950983,254cyclictest0-21swapper/508:50:065
2097299509257,42cyclictest0-21swapper/211:57:332
209719950943,84cyclictest121rcu_preempt10:39:461
20970995091,126cyclictest0-21swapper/012:32:150
2097699508166,338cyclictest17438-21df_abs08:50:146
2097499506251,253cyclictest64450irq/122-eth012:25:284
209779950540,338cyclictest0-21swapper/711:46:077
209769950478,126cyclictest121rcu_preempt10:23:546
209749950478,295cyclictest0-21swapper/412:24:534
209779950380,84cyclictest0-21swapper/712:03:317
209759950375,126cyclictest31876-21kworker/5:011:35:235
209779950135,296cyclictest0-21swapper/708:24:327
209769950179,84cyclictest31064-21munin-run11:25:036
209749950174,295cyclictest0-21swapper/410:54:344
209749950174,295cyclictest0-21swapper/410:54:344
209749950075,211cyclictest0-21swapper/410:25:024
209729950035,84cyclictest0-21swapper/208:00:122
209719950035,296cyclictest0-21swapper/111:46:561
209739949933,127cyclictest121rcu_preempt11:11:213
209739949933,127cyclictest0-21swapper/311:46:453
209779949876,84cyclictest0-21swapper/710:25:237
209779949833,381cyclictest0-21swapper/712:26:037
209769949872,211cyclictest65-21ksoftirqd/611:02:046
2097399497117,296cyclictest14646-21kworker/u16:212:22:173
209779949672,211cyclictest0-21swapper/710:14:017
209759949674,126cyclictest0-21swapper/511:10:365
209709949529,295cyclictest0-21swapper/012:22:180
209759949436,374cyclictest0-21swapper/512:32:155
209739949227,84cyclictest0-21swapper/312:26:143
209749949171,377cyclictest0-21swapper/410:24:324
209729949122,466cyclictest0-21swapper/212:26:252
2097799490106,211cyclictest4821-21ssh11:07:277
209729949022,465cyclictest0-21swapper/210:25:022
209749948822,126cyclictest0-21swapper/411:33:154
2097099488106,84cyclictest9312-21sh12:08:260
209719948764,84cyclictest0-21swapper/111:57:251
209719948723,219cyclictest1551-21snmpd12:44:561
2097599485229,254cyclictest561ktimersoftd/511:23:505
2097799484146,253cyclictest7449-21rm12:05:587
209709948419,8cyclictest121rcu_preempt12:44:120
209779948315,295cyclictest0-21swapper/711:40:427
209749948357,423cyclictest0-21swapper/412:32:094
209769948154,211cyclictest0-21swapper/608:47:266
2097099481182,169cyclictest0-21swapper/010:25:200
209759947915,126cyclictest0-21swapper/510:55:215
209749947913,169cyclictest0-21swapper/411:42:204
2097399476262,85cyclictest0-21swapper/310:54:173
2097399476262,85cyclictest0-21swapper/310:54:173
20977994756,126cyclictest0-21swapper/711:37:027
20975994759,211cyclictest0-21swapper/512:44:555
2097599475392,81cyclictest551rcuc/512:24:555
209729947149,84cyclictest0-21swapper/211:15:112
2097199470215,253cyclictest1031-21forks10:15:131
2097799466124,339cyclictest0-21swapper/710:24:137
2097399466340,42cyclictest401ktimersoftd/310:15:073
209779946583,84cyclictest0-21swapper/708:50:137
209739946541,84cyclictest121rcu_preempt10:25:173
20971994651,84cyclictest0-21swapper/110:25:211
209779946483,296cyclictest0-21swapper/711:25:037
209769946483,84cyclictest0-21swapper/611:47:386
209759946439,126cyclictest0-21swapper/510:22:055
209739946438,126cyclictest121rcu_preempt11:57:513
2097799463123,84cyclictest1038-21ssh10:15:147
209759946340,256cyclictest0-21swapper/511:42:425
2097099463208,253cyclictest7290-21sh12:27:120
209779946282,84cyclictest0-21swapper/708:48:497
209769946278,211cyclictest65-21ksoftirqd/611:07:316
209769946277,211cyclictest65-21ksoftirqd/611:34:586
209759946279,168cyclictest57-21ksoftirqd/511:47:105
2097599462123,337cyclictest0-21swapper/511:01:365
209709946241,255cyclictest0-21swapper/010:23:300
2097799461122,84cyclictest13416-21diskmemload10:55:177
2097799460119,338cyclictest0-21swapper/712:33:117
209709946035,126cyclictest704-21nscd11:15:070
209749945937,255cyclictest0-21swapper/410:39:424
209709945933,298cyclictest0-21swapper/012:15:190
209719945834,84cyclictest0-21swapper/111:02:121
2097099458119,84cyclictest0-21swapper/011:25:070
209769945733,211cyclictest0-21swapper/612:25:276
209769945633,3cyclictest0-21swapper/611:40:436
209779945532,219cyclictest0-21swapper/707:59:057
209779945470,381cyclictest0-21swapper/712:44:057
209769945473,85cyclictest0-21swapper/610:25:256
209759945431,257cyclictest0-21swapper/510:53:435
209759945431,257cyclictest0-21swapper/510:53:435
209709945332,2cyclictest0-21swapper/010:54:580
209709945332,2cyclictest0-21swapper/010:54:570
209709945332,134cyclictest0-21swapper/010:14:310
209709945331,2cyclictest0-21swapper/011:57:420
209749945230,2cyclictest0-21swapper/411:35:454
209759945168,381cyclictest0-21swapper/510:15:305
2097599451111,338cyclictest0-21swapper/512:25:585
209719945127,126cyclictest0-21swapper/107:59:171
209759945071,295cyclictest0-21swapper/508:48:065
209739945067,169cyclictest0-21swapper/310:14:413
209779944964,212cyclictest28557-21diskmemload11:01:507
209749944965,253cyclictest0-21swapper/412:15:204
209719944928,259cyclictest16313-21taskset08:49:061
209749944822,298cyclictest0-21swapper/410:55:204
2097399448231,84cyclictest0-21swapper/308:50:023
209779944723,169cyclictest12593-21cron10:55:007
209779944723,169cyclictest12593-21cron10:55:007
209769944725,2cyclictest0-21swapper/610:55:066
209759944768,84cyclictest0-21swapper/511:15:055
209749944726,251cyclictest0-21swapper/408:50:074
2097499446189,126cyclictest121rcu_preempt11:01:374
209749944321,255cyclictest303-21systemd-journal08:00:014
209709944199,126cyclictest121rcu_preempt08:49:410
209749944018,169cyclictest0-21swapper/410:15:274
209729944017,256cyclictest0-21swapper/210:39:412
2097799439100,84cyclictest1187-21ssh11:25:327
209719943812,253cyclictest0-21swapper/111:15:201
209749943697,84cyclictest0-21swapper/411:25:314
209719943652,296cyclictest11641-21sh10:53:571
209719943652,296cyclictest11641-21sh10:53:571
20970994359,253cyclictest0-21swapper/008:24:460
2097399434263,46cyclictest0-21swapper/308:00:033
20976994326,259cyclictest5950-21sh12:44:386
209749943093,131cyclictest5958-21ssh12:44:384
20972994281,254cyclictest0-21swapper/208:24:022
209709942788,84cyclictest0-21swapper/010:39:460
209779942483,339cyclictest0-21swapper/711:57:357
20976994243,2cyclictest0-21swapper/611:57:426
209719942483,338cyclictest0-21swapper/112:15:131
209779942383,338cyclictest0-21swapper/712:15:017
20976994231,2cyclictest0-21swapper/611:25:116
20975994231,84cyclictest0-21swapper/508:00:045
20974994221,2cyclictest0-21swapper/411:57:434
209729942282,338cyclictest0-21swapper/208:50:172
209709942246,246cyclictest18937-21perf08:00:020
209769942183,83cyclictest0-21swapper/610:13:556
209769942136,211cyclictest65-21ksoftirqd/610:15:076
209739942180,338cyclictest0-21swapper/312:15:083
209739942180,338cyclictest0-21swapper/311:15:063
2097199421164,84cyclictest121rcu_preempt08:25:011
209769942082,84cyclictest0-21swapper/612:15:066
209759942079,338cyclictest0-21swapper/508:00:105
209729942040,295cyclictest0-21swapper/208:25:122
209779941978,338cyclictest0-21swapper/711:15:087
209769941976,211cyclictest65-21ksoftirqd/607:58:456
209759941939,295cyclictest0-21swapper/510:15:015
209739941977,169cyclictest0-21swapper/311:01:393
209779941877,338cyclictest0-21swapper/708:25:157
209759941877,338cyclictest0-21swapper/511:57:365
209739941877,338cyclictest0-21swapper/308:00:113
209709941839,295cyclictest1851-21runrttasks08:25:120
209769941779,171cyclictest0-21swapper/610:39:416
209759941774,169cyclictest0-21swapper/510:25:265
209709941776,338cyclictest0-21swapper/008:00:100
209759941632,212cyclictest0-21swapper/512:15:085
209729941676,338cyclictest0-21swapper/212:15:062
2097199415289,42cyclictest231rcuc/108:50:051
209779941433,297cyclictest0-21swapper/708:00:117
209779941333,296cyclictest0-21swapper/710:39:417
209769941173,84cyclictest0-21swapper/611:15:096
209769941072,84cyclictest0-21swapper/608:25:156
209759941069,338cyclictest0-21swapper/508:25:145
209719941071,84cyclictest0-21swapper/108:25:131
209709941069,338cyclictest0-21swapper/008:50:090
209739940867,338cyclictest0-21swapper/308:50:143
209739940727,3cyclictest0-21swapper/308:25:013
209739940626,296cyclictest0-21swapper/308:25:113
209749939714,169cyclictest0-21swapper/411:15:034
209759939410,42cyclictest0-21swapper/508:24:515
209749939415,169cyclictest49-21ksoftirqd/408:00:124
209739938850,171cyclictest0-21swapper/310:39:413
20976993844,169cyclictest0-21swapper/608:24:176
209719937981,295cyclictest0-21swapper/108:00:101
2097499370112,130cyclictest49-21ksoftirqd/408:25:144
209769932021,126cyclictest0-21swapper/608:00:106
149752930,0sleep60-21swapper/609:34:456
2023729264,24sleep40-21swapper/407:05:424
2051528943,42sleep70-21swapper/707:09:387
120812850,1sleep10-21swapper/111:50:191
2035128453,27sleep30-21swapper/307:07:163
2023528351,28sleep20-21swapper/207:05:392
1793828350,29sleep60-21swapper/607:05:036
1794128250,28sleep00-21swapper/007:05:060
2043228146,31sleep10-21swapper/107:08:281
2036227948,27sleep50-21swapper/507:07:265
209912760,0sleep40-21swapper/410:41:584
158172730,0sleep10-21swapper/109:35:051
2097799521,48cyclictest20143-21ssh12:35:047
2097699522,16cyclictest0-21swapper/612:35:116
20975994614,4cyclictest21224-21grep12:35:185
2097499440,17cyclictest0-21swapper/412:35:044
2097099392,33cyclictest21442-21gltestperf12:35:200
2097399371,32cyclictest0-21swapper/312:35:083
2097299372,31cyclictest21543-21sed12:35:202
20971993730,4cyclictest0-21swapper/112:35:151
41832350,1sleep40-21swapper/410:00:154
20977993310,22cyclictest0-21swapper/709:27:177
20977993210,22cyclictest0-21swapper/709:44:117
20977993210,21cyclictest0-21swapper/709:17:067
20977993110,4cyclictest0-21swapper/709:36:397
2054323128,1sleep60-21swapper/607:10:016
20977993010,19cyclictest0-21swapper/709:06:027
20977992910,2cyclictest0-21swapper/708:12:447
20977992910,18cyclictest0-21swapper/708:37:437
20975992910,18cyclictest0-21swapper/510:04:015
20977992810,18cyclictest0-21swapper/709:53:307
20977992810,18cyclictest0-21swapper/707:46:497
20977992810,17cyclictest0-21swapper/710:03:137
20977992810,17cyclictest0-21swapper/707:25:027
20977992810,0cyclictest0-21swapper/707:38:547
20976992810,0cyclictest0-21swapper/607:19:166
20975992827,1cyclictest0-21swapper/509:53:335
20975992827,1cyclictest0-21swapper/509:27:065
20973992828,0cyclictest0-21swapper/307:39:053
20973992810,18cyclictest0-21swapper/310:03:493
20973992810,18cyclictest0-21swapper/309:53:183
20973992810,18cyclictest0-21swapper/309:44:113
20973992810,18cyclictest0-21swapper/309:36:223
20973992810,18cyclictest0-21swapper/309:05:373
20973992810,18cyclictest0-21swapper/307:15:013
20973992810,0cyclictest0-21swapper/309:26:513
20973992810,0cyclictest0-21swapper/309:16:333
20972992828,0cyclictest0-21swapper/209:16:512
20972992810,18cyclictest0-21swapper/209:44:562
20972992810,18cyclictest0-21swapper/208:12:442
20972992810,18cyclictest0-21swapper/207:14:432
20972992810,0cyclictest0-21swapper/209:26:462
20972992810,0cyclictest0-21swapper/207:31:542
20971992810,18cyclictest0-21swapper/109:44:221
20970992810,18cyclictest0-21swapper/009:27:130
20970992810,0cyclictest0-21swapper/009:44:500
20977992710,0cyclictest0-21swapper/707:24:347
20977992710,0cyclictest0-21swapper/707:14:497
20976992727,0cyclictest0-21swapper/609:36:226
20976992710,17cyclictest2086-21ssh09:44:016
20976992710,17cyclictest0-21swapper/609:53:206
20976992710,17cyclictest0-21swapper/609:26:426
20976992710,17cyclictest0-21swapper/608:19:566
20976992710,17cyclictest0-21swapper/607:38:596
20976992710,17cyclictest0-21swapper/607:31:246
20976992710,17cyclictest0-21swapper/607:24:516
20976992710,0cyclictest0-21swapper/610:03:206
20976992710,0cyclictest0-21swapper/609:16:416
20976992710,0cyclictest0-21swapper/609:05:446
20976992710,0cyclictest0-21swapper/608:37:196
20976992710,0cyclictest0-21swapper/608:12:336
20976992710,0cyclictest0-21swapper/607:46:436
20975992727,0cyclictest0-21swapper/507:15:025
20975992726,1cyclictest0-21swapper/508:37:205
20975992710,17cyclictest0-21swapper/509:16:355
20975992710,17cyclictest0-21swapper/508:19:575
20975992710,0cyclictest0-21swapper/509:44:055
20975992710,0cyclictest0-21swapper/509:36:235
20975992710,0cyclictest0-21swapper/509:05:385
20975992710,0cyclictest0-21swapper/507:46:435
20975992710,0cyclictest0-21swapper/507:31:235
20975992710,0cyclictest0-21swapper/507:24:275
20975992710,0cyclictest0-21swapper/507:14:475
20974992727,0cyclictest0-21swapper/409:36:364
20974992727,0cyclictest0-21swapper/409:05:494
20974992727,0cyclictest0-21swapper/407:38:524
20974992710,17cyclictest0-21swapper/409:53:264
20974992710,17cyclictest0-21swapper/409:44:084
20974992710,17cyclictest0-21swapper/409:26:404
20974992710,17cyclictest0-21swapper/409:16:434
20974992710,17cyclictest0-21swapper/408:37:454
20974992710,17cyclictest0-21swapper/408:12:364
20974992710,17cyclictest0-21swapper/407:46:404
20974992710,0cyclictest0-21swapper/407:31:314
20974992710,0cyclictest0-21swapper/407:14:484
20973992727,0cyclictest0-21swapper/307:46:443
20973992727,0cyclictest0-21swapper/307:14:433
20973992710,17cyclictest0-21swapper/308:37:173
20973992710,0cyclictest0-21swapper/308:12:283
20973992710,0cyclictest0-21swapper/307:31:243
20973992710,0cyclictest0-21swapper/307:24:463
20972992727,0cyclictest0-21swapper/207:19:082
20972992710,17cyclictest0-21swapper/209:53:332
20972992710,17cyclictest0-21swapper/209:05:362
20972992710,17cyclictest0-21swapper/207:46:482
20972992710,0cyclictest0-21swapper/210:03:202
20972992710,0cyclictest0-21swapper/209:36:272
20972992710,0cyclictest0-21swapper/208:37:232
20972992710,0cyclictest0-21swapper/208:19:592
20972992710,0cyclictest0-21swapper/207:38:572
20972992710,0cyclictest0-21swapper/207:25:002
20972992710,0cyclictest0-21swapper/207:24:282
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional