You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 23:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed Jun 10, 2026 12:54:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
82329964611,126cyclictest121rcu_preempt11:13:524
8233996371,41cyclictest0-21swapper/512:00:585
82329963480,339cyclictest0-21swapper/408:39:154
82339963140,507cyclictest16154-21ssh11:55:495
822899629203,211cyclictest20839-21ssh10:33:490
822899608181,296cyclictest0-21swapper/011:55:450
82349960694,126cyclictest0-21swapper/611:43:336
82339960510,41cyclictest0-21swapper/511:37:065
82339960510,41cyclictest0-21swapper/511:37:065
8233996049,43cyclictest15809-21diskmemload09:59:445
82289960353,126cyclictest0-21swapper/011:29:540
82309960210,383cyclictest0-21swapper/208:15:182
8235995931,2cyclictest0-21swapper/710:02:297
823599593124,296cyclictest0-21swapper/711:43:587
8228995931,3cyclictest0-21swapper/010:02:290
82339959081,127cyclictest0-21swapper/511:13:585
82349958779,126cyclictest121rcu_preempt08:37:586
822899587120,295cyclictest0-21swapper/008:39:520
82289958372,338cyclictest0-21swapper/011:00:130
823199582283,126cyclictest0-21swapper/311:45:143
823099582543,3cyclictest311rcuc/212:16:542
822899578279,126cyclictest0-21swapper/012:16:450
823599577320,126cyclictest0-21swapper/711:55:567
82339957666,296cyclictest0-21swapper/508:13:415
823399573489,4cyclictest551rcuc/511:45:055
823499572105,211cyclictest0-21swapper/610:42:496
82329957118,422cyclictest0-21swapper/411:45:094
82319956860,129cyclictest0-21swapper/311:42:203
823099568142,253cyclictest0-21swapper/210:01:112
82289956213,126cyclictest0-21swapper/011:41:550
82289956096,253cyclictest0-21swapper/012:04:320
82309955789,465cyclictest8226-21cyclictest12:26:392
82349955348,84cyclictest0-21swapper/608:15:216
82309955386,294cyclictest0-21swapper/211:29:542
8232995501,126cyclictest0-21swapper/411:37:064
8232995501,126cyclictest0-21swapper/411:37:064
82319954979,296cyclictest0-21swapper/308:33:533
82339954740,422cyclictest0-21swapper/510:01:175
82309954533,254cyclictest0-21swapper/212:01:252
822999545120,422cyclictest0-21swapper/111:43:081
822999545118,84cyclictest26266-21ssh11:45:011
82329954476,87cyclictest121rcu_preempt10:34:044
822999543116,126cyclictest0-21swapper/110:00:561
82349954235,43cyclictest121rcu_preempt11:56:476
82339954231,339cyclictest0-21swapper/510:42:275
823499541326,84cyclictest0-21swapper/608:13:506
82329954075,90cyclictest0-21swapper/412:27:154
823299540369,168cyclictest471rcuc/411:52:044
823199540245,132cyclictest10762-1kworker/u17:010:34:503
82339953974,85cyclictest0-21swapper/511:41:375
823199538281,126cyclictest0-21swapper/311:52:373
823199538113,296cyclictest0-21swapper/308:14:043
822999537198,84cyclictest8226-21cyclictest12:31:041
82329953627,219cyclictest0-21swapper/412:04:494
82309953225,84cyclictest0-21swapper/212:42:392
82289953165,84cyclictest0-21swapper/011:14:050
823199530103,169cyclictest41-21ksoftirqd/312:15:323
82319952964,84cyclictest0-21swapper/308:40:093
82319952964,84cyclictest0-21swapper/308:40:093
822999529148,211cyclictest8226-21cyclictest12:04:451
823199528359,42cyclictest0-21swapper/310:59:303
82329952561,295cyclictest0-21swapper/409:59:244
823299522267,253cyclictest64450irq/122-eth011:42:514
82329952214,83cyclictest0-21swapper/410:01:114
822999522306,84cyclictest0-21swapper/108:33:471
82329951958,250cyclictest0-21swapper/412:16:564
82309951951,92cyclictest0-21swapper/211:56:422
82309951912,126cyclictest0-21swapper/211:45:152
82299951953,126cyclictest8226-21cyclictest10:42:271
82289951954,84cyclictest0-21swapper/011:45:130
8233995187,339cyclictest0-21swapper/510:23:115
8233995166,41cyclictest0-21swapper/511:52:375
8233995144,41cyclictest0-21swapper/512:16:135
823299514260,84cyclictest481ktimersoftd/412:31:024
823599513340,43cyclictest0-21swapper/710:34:277
8228995111,84cyclictest0-21swapper/011:51:390
8235995081,2cyclictest0-21swapper/712:15:487
8233995081,257cyclictest16618-21hwlatdetect08:15:185
8232995081,340cyclictest0-21swapper/408:15:184
823199507381,42cyclictest391rcuc/312:31:343
82359950641,126cyclictest0-21swapper/712:03:187
823499505165,338cyclictest19011-21sshd12:16:356
82299950239,218cyclictest0-21swapper/111:00:141
823199501286,84cyclictest0-21swapper/312:04:273
82349950078,84cyclictest0-21swapper/608:33:106
8231995003,2cyclictest0-21swapper/310:02:293
8235994991,3cyclictest0-21swapper/709:59:597
82339949934,384cyclictest30007-21taskset08:36:235
82289949975,126cyclictest0-21swapper/008:34:500
82289949935,84cyclictest0-21swapper/008:13:500
82329949830,465cyclictest64450irq/122-eth011:56:174
82309949830,253cyclictest0-21swapper/211:43:122
82339949730,127cyclictest6314-21ssh12:26:515
82309949769,211cyclictest0-21swapper/210:42:002
822999497116,170cyclictest15809-21diskmemload12:13:351
822999497116,170cyclictest15809-21diskmemload12:13:351
82289949732,84cyclictest0-21swapper/008:15:080
82299949632,84cyclictest0-21swapper/112:16:431
823199494283,46cyclictest0-21swapper/308:15:203
82299949329,126cyclictest0-21swapper/110:59:301
82309949226,84cyclictest0-21swapper/210:34:002
82349949169,84cyclictest0-21swapper/610:34:026
82329949127,253cyclictest0-21swapper/412:42:424
82309949025,298cyclictest0-21swapper/212:31:292
822899490361,127cyclictest101ktimersoftd/012:26:390
82359948457,83cyclictest121rcu_preempt08:13:367
823099484142,126cyclictest121rcu_preempt12:14:292
823099484142,126cyclictest121rcu_preempt12:14:292
82299948415,84cyclictest0-21swapper/111:55:561
82329948314,85cyclictest0-21swapper/412:13:254
82329948314,85cyclictest0-21swapper/412:13:254
82299948317,127cyclictest0-21swapper/108:15:201
82329948255,296cyclictest0-21swapper/410:23:084
822899482352,45cyclictest0-21swapper/010:42:280
82299948117,84cyclictest0-21swapper/111:51:551
82349948015,84cyclictest0-21swapper/609:59:256
82339948011,87cyclictest0-21swapper/510:34:165
82319948057,84cyclictest0-21swapper/311:37:063
82319948057,84cyclictest0-21swapper/311:37:063
82319947914,84cyclictest0-21swapper/310:23:103
82299947953,211cyclictest698-21ptp4l08:35:451
82359947712,126cyclictest0-21swapper/707:58:047
82289947612,84cyclictest0-21swapper/012:14:250
82289947612,84cyclictest0-21swapper/012:14:250
8230994736,127cyclictest481-21runrttasks10:23:082
8235994714,84cyclictest0-21swapper/711:30:197
82319947144,296cyclictest0-21swapper/308:36:023
8233994691,126cyclictest0-21swapper/508:34:035
8228994692,211cyclictest9-21ksoftirqd/012:31:010
823399466210,126cyclictest13818-21rm12:13:435
823399466210,126cyclictest13818-21rm12:13:435
823499465124,338cyclictest704-21nscd12:02:486
82329946584,85cyclictest8226-21cyclictest10:35:124
82329946480,253cyclictest0-21swapper/411:00:004
82319946441,83cyclictest0-21swapper/310:41:513
823199464123,338cyclictest0-21swapper/311:13:533
823199462247,84cyclictest0-21swapper/311:56:053
82309946278,338cyclictest0-21swapper/210:35:172
82299946240,2cyclictest0-21swapper/108:14:431
82329946038,212cyclictest121rcu_preempt10:42:014
82299946038,160cyclictest0-21swapper/110:34:431
823299459118,338cyclictest1318-21kernelversion11:30:174
82309945937,338cyclictest0-21swapper/209:59:312
823099459248,42cyclictest16682-21kworker/u16:211:51:252
82309945836,256cyclictest0-21swapper/208:14:432
82299945836,2cyclictest0-21swapper/111:13:401
823499457116,338cyclictest8226-21cyclictest12:31:066
823099457373,3cyclictest311rcuc/210:59:142
823599455200,253cyclictest721ktimersoftd/712:31:237
82349945526,296cyclictest0-21swapper/611:13:526
82339945533,342cyclictest0-21swapper/512:42:515
82329945571,211cyclictest0-21swapper/407:58:044
82309945575,84cyclictest0-21swapper/211:30:192
82309945529,211cyclictest33-21ksoftirqd/208:35:592
82299945529,337cyclictest0-21swapper/112:42:421
822999455114,338cyclictest0-21swapper/111:29:211
82359945472,338cyclictest0-21swapper/711:45:107
823599454112,339cyclictest0-21swapper/711:37:067
823599454112,339cyclictest0-21swapper/711:37:067
82339945428,253cyclictest121rcu_preempt12:31:095
823299454115,126cyclictest49-21ksoftirqd/411:29:464
82309945432,2cyclictest0-21swapper/211:36:592
82309945432,2cyclictest0-21swapper/211:36:592
82289945434,82cyclictest0-21swapper/009:59:240
82349945372,84cyclictest0-21swapper/612:42:466
82329945370,253cyclictest0-21swapper/408:34:494
82319945330,253cyclictest0-21swapper/312:27:293
822999453158,84cyclictest121rcu_preempt10:35:051
823199449238,84cyclictest0-21swapper/312:13:143
823199449238,84cyclictest0-21swapper/312:13:143
82299944821,84cyclictest0-21swapper/110:23:021
822999448106,339cyclictest15809-21diskmemload11:36:591
822999448106,339cyclictest15809-21diskmemload11:36:591
82289944822,126cyclictest22845-21cstates10:35:150
82309944725,256cyclictest0-21swapper/211:00:132
822999447148,126cyclictest121rcu_preempt12:27:421
82289944763,211cyclictest0-21swapper/007:38:040
82289944763,211cyclictest0-21swapper/007:38:040
823599446106,338cyclictest0-21swapper/711:29:197
82349944667,295cyclictest0-21swapper/611:37:066
82349944667,295cyclictest0-21swapper/611:37:066
823499446105,126cyclictest0-21swapper/611:51:246
82339944624,255cyclictest0-21swapper/507:57:585
822899446104,253cyclictest0-21swapper/010:23:100
82309944215,84cyclictest121rcu_preempt08:34:422
82289944219,125cyclictest0-21swapper/010:59:420
82349944158,127cyclictest0-21swapper/610:00:376
82339944115,42cyclictest0-21swapper/511:29:535
82359943917,256cyclictest0-21swapper/708:36:257
82319943959,296cyclictest121rcu_preempt12:42:453
82359943613,2cyclictest0-21swapper/710:41:367
82339943610,423cyclictest0-21swapper/510:59:115
82309943411,257cyclictest0-21swapper/211:14:092
82289943310,126cyclictest0-21swapper/011:30:180
82339943210,260cyclictest8226-21cyclictest10:35:175
8228994318,84cyclictest0-21swapper/008:40:100
8228994318,84cyclictest0-21swapper/008:40:100
8231994274,2cyclictest0-21swapper/309:59:453
8233994261,41cyclictest0-21swapper/508:40:115
8233994261,41cyclictest0-21swapper/508:40:115
82319942683,211cyclictest41-21ksoftirqd/310:35:123
8228994263,84cyclictest0-21swapper/011:37:240
8228994263,84cyclictest0-21swapper/011:37:240
8234994241,169cyclictest0-21swapper/612:14:136
8234994241,169cyclictest0-21swapper/612:14:136
82309942483,338cyclictest0-21swapper/208:40:102
82309942483,338cyclictest0-21swapper/208:40:102
82359942382,338cyclictest0-21swapper/712:13:407
82359942382,338cyclictest0-21swapper/712:13:407
82359942382,338cyclictest0-21swapper/711:00:137
82359942381,339cyclictest0-21swapper/708:15:197
8235994231,3cyclictest0-21swapper/711:14:027
82339942382,338cyclictest0-21swapper/511:00:135
8232994231,211cyclictest0-21swapper/411:00:134
82359942281,338cyclictest0-21swapper/712:27:397
823599422127,84cyclictest0-21swapper/711:52:207
82299942282,338cyclictest0-21swapper/109:59:441
82349942081,84cyclictest0-21swapper/612:27:336
82339942080,338cyclictest0-21swapper/507:38:045
82339942080,338cyclictest0-21swapper/507:38:045
82359941978,338cyclictest0-21swapper/708:33:177
82349941981,84cyclictest0-21swapper/611:29:286
82359941879,126cyclictest121rcu_preempt10:35:127
82329941877,253cyclictest0-21swapper/408:40:104
82329941877,253cyclictest0-21swapper/408:40:104
82359941677,254cyclictest0-21swapper/708:40:097
82359941677,254cyclictest0-21swapper/708:40:097
82359941675,126cyclictest4992-21ssh10:59:317
823599416159,124cyclictest121rcu_preempt10:23:067
82349941677,84cyclictest0-21swapper/610:35:146
82299941676,165cyclictest121rcu_preempt11:30:181
82329941574,338cyclictest0-21swapper/407:38:044
82329941574,338cyclictest0-21swapper/407:38:044
82349941476,84cyclictest0-21swapper/611:00:136
82349941475,84cyclictest0-21swapper/608:40:106
82349941475,84cyclictest0-21swapper/608:40:106
82319941432,126cyclictest0-21swapper/311:29:383
82349941376,171cyclictest5252-21ssh10:59:436
82349941375,84cyclictest0-21swapper/611:30:196
82329941373,338cyclictest0-21swapper/408:13:564
82319941131,86cyclictest0-21swapper/311:00:073
82289940928,41cyclictest0-21swapper/012:42:500
82299940666,338cyclictest8226-21cyclictest08:40:101
82299940666,338cyclictest8226-21cyclictest08:40:101
82339940564,212cyclictest1200-21ssh11:30:145
82349940425,41cyclictest131rcu_sched10:23:116
82319940263,84cyclictest0-21swapper/311:30:193
82349940099,211cyclictest26712-21seq11:45:156
82359938139,127cyclictest0-21swapper/712:42:467
82319937836,339cyclictest0-21swapper/307:38:043
82319937836,339cyclictest0-21swapper/307:38:043
82349937682,82cyclictest0-21swapper/607:37:286
82349937682,82cyclictest0-21swapper/607:37:286
82319937235,2cyclictest0-21swapper/307:57:583
82299936426,169cyclictest0-21swapper/107:37:281
82299936426,169cyclictest0-21swapper/107:37:281
82289935922,171cyclictest0-21swapper/007:57:580
82349935820,171cyclictest0-21swapper/607:57:586
82309935311,211cyclictest26488-21seq07:38:042
82309935311,211cyclictest26488-21seq07:38:042
82299932930,126cyclictest0-21swapper/107:57:581
82309932626,127cyclictest0-21swapper/207:58:042
82359929579,84cyclictest0-21swapper/707:37:547
82359929579,84cyclictest0-21swapper/707:37:547
765329742,18sleep40-21swapper/407:07:574
699129061,24sleep20-21swapper/207:05:222
629528984,2sleep50-21swapper/507:05:175
79272860,1sleep10-21swapper/110:10:191
771128251,28sleep30-21swapper/307:08:443
763628252,27sleep60-21swapper/607:07:436
747928251,28sleep00-21swapper/007:05:280
760128049,28sleep10-21swapper/107:07:131
519727948,28sleep70-21swapper/707:05:037
197162750,0sleep60-21swapper/608:20:156
112052740,0sleep60-21swapper/610:29:166
89262720,0sleep30-21swapper/308:55:193
823299581,43cyclictest0-21swapper/412:05:474
823299541,40cyclictest21349-21ssh12:35:284
37072540,2sleep20-21swapper/211:15:142
823299522,30cyclictest4961-21mailstats11:15:254
823299512,32cyclictest0-21swapper/409:10:254
823299511,28cyclictest7036-21cstates08:00:134
823299491,44cyclictest0-21swapper/409:07:544
8232994823,22cyclictest3165-21rm10:25:094
8232994818,26cyclictest30389-21tr10:05:244
823299462,27cyclictest27155-21grep07:40:124
8232994422,19cyclictest10167-21cat10:45:214
823399372,31cyclictest0-21swapper/511:15:045
823499365,28cyclictest0-21swapper/609:08:026
8234993630,3cyclictest0-21swapper/611:15:066
8231993525,6cyclictest9025-21tr10:45:133
822999352,20cyclictest16572-21ssh09:10:121
8234993426,4cyclictest325912sleep612:06:076
823399342,4cyclictest0-21swapper/509:07:535
8231993429,3cyclictest0-21swapper/311:15:093
8231993428,3cyclictest0-21swapper/309:08:033
8230993425,5cyclictest29530-21grep12:05:152
8229993424,6cyclictest4006-21cut10:25:141
822899341,30cyclictest0-21swapper/009:08:030
823599331,28cyclictest27152-21cut07:40:127
823499335,21cyclictest0-21swapper/607:40:246
823399331,29cyclictest0-21swapper/510:05:245
823099331,29cyclictest0-21swapper/209:07:522
823599321,29cyclictest0-21swapper/709:08:097
8234993227,2cyclictest0-21swapper/610:05:106
8233993224,5cyclictest8911-21tr10:45:135
8233993224,5cyclictest21934-21ssh12:35:425
8230993224,5cyclictest6773-21grep08:00:122
8230993224,5cyclictest31250-21tail10:05:322
8229993228,2cyclictest0-21swapper/109:08:041
8229993224,5cyclictest4487-21ssh11:15:201
8229993224,5cyclictest30312-21cat10:05:231
8229993224,5cyclictest19432-21cut12:35:131
8228993224,5cyclictest32268-21ssh12:05:480
822899321,28cyclictest0-21swapper/011:15:100
8235993124,4cyclictest19311-21cut12:35:137
823499318,17cyclictest0-21swapper/612:35:496
8233993123,5cyclictest3433-21grep10:25:115
8233993122,6cyclictest27250-21tr07:40:125
8231993121,6cyclictest28936-21cut10:05:153
8230993124,4cyclictest8569-21ssh10:45:012
8228993123,5cyclictest5345-21rm10:25:260
8228993122,5cyclictest21601-21taskset12:35:300
8235993024,3cyclictest2881-21ssh11:15:057
8234993022,5cyclictest7100-21expr08:00:136
8232993010,19cyclictest0-21swapper/409:34:284
8231993022,5cyclictest17271-21cut09:10:153
8231993022,4cyclictest31841-21grep12:05:323
8231993022,4cyclictest20033-21tune2fs12:35:173
8231993020,5cyclictest3310-21grep10:25:103
8230993023,4cyclictest3398-21grep10:25:112
8230993022,5cyclictest18969-21ssh09:10:322
8229993023,4cyclictest385-21ssh12:06:231
8229993022,5cyclictest28069-21cut07:40:161
822999301,15cyclictest0-21swapper/110:45:141
822899303,15cyclictest121rcu_preempt10:45:310
8228993024,3cyclictest8633-21expr08:00:300
8228993022,5cyclictest16317-21ssh09:10:080
8228993022,4cyclictest29203-21cat10:05:160
8235992922,5cyclictest29012-21grep10:05:157
8235992922,4cyclictest7148-21expr08:00:137
8235992922,4cyclictest3355-21tr10:25:117
8235992922,4cyclictest16292-21seq09:10:067
8234992922,4cyclictest8749-21ssh10:45:116
8234992922,4cyclictest16804-21expr09:10:116
8233992922,5cyclictest31011-21rm12:05:245
8233992922,4cyclictest8764-21tail08:00:315
8231992922,4cyclictest28804-21which07:40:253
8230992922,4cyclictest27030-21taskset07:40:062
8229992921,5cyclictest8522-21timerandwakeup08:00:291
8228992922,4cyclictest27029-21chrt07:40:050
8235992822,3cyclictest11727-21ssh10:45:527
8235992821,4cyclictest31888-21sed12:05:337
8235992810,0cyclictest0-21swapper/707:27:237
8234992810,17cyclictest0-21swapper/609:22:116
8233992827,0cyclictest0-21swapper/509:21:505
8233992822,4cyclictest19088-21ssh09:10:375
8231992810,18cyclictest0-21swapper/309:34:333
8231992810,18cyclictest0-21swapper/309:21:443
8231992810,0cyclictest0-21swapper/309:47:493
8230992821,4cyclictest19185-21sh12:35:122
8229992810,18cyclictest0-21swapper/109:48:111
8229992810,18cyclictest0-21swapper/109:34:401
8228992810,17cyclictest0-21swapper/009:47:490
8235992727,0cyclictest0-21swapper/709:47:577
8235992727,0cyclictest0-21swapper/707:13:557
8235992710,17cyclictest0-21swapper/709:34:267
8235992710,17cyclictest0-21swapper/709:21:327
8235992710,17cyclictest0-21swapper/707:34:447
8235992710,17cyclictest0-21swapper/707:20:587
8235992710,0cyclictest0-21swapper/708:56:337
8235992710,0cyclictest0-21swapper/707:47:577
8234992727,0cyclictest0-21swapper/607:27:276
8234992710,17cyclictest0-21swapper/609:48:016
8234992710,17cyclictest0-21swapper/609:34:446
8234992710,17cyclictest0-21swapper/608:56:266
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional