You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 16:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot6.osadl.org (updated Thu Nov 20, 2025 12:46:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
713861998816,39cyclictest0-21swapper/211:43:142
216999870,40rtkit-daemon0-21swapper/507:05:335
713861998616,37cyclictest0-21swapper/210:08:142
713861998616,37cyclictest0-21swapper/210:08:142
713869998415,37cyclictest0-21swapper/311:08:143
713869998414,40cyclictest0-21swapper/307:23:133
71351628443,34sleep00-21swapper/007:07:560
713861998015,38cyclictest0-21swapper/210:43:132
71359127641,13sleep70-21swapper/707:08:597
8155812750,0sleep00-21swapper/009:50:140
71384599711,39cyclictest0-21swapper/011:18:130
8075992700,0sleep30-21swapper/309:35:203
71340727044,13sleep40-21swapper/407:06:224
713845996916,36cyclictest0-21swapper/011:53:140
71343326943,13sleep10-21swapper/107:06:431
71339726949,14sleep30-21swapper/307:06:143
713845996835,33cyclictest0-21swapper/008:33:130
713845996715,39cyclictest0-21swapper/009:43:140
71346126747,13sleep20-21swapper/207:07:092
71387599660,35cyclictest0-21swapper/411:28:144
71361726647,13sleep60-21swapper/607:09:216
71385099656,30cyclictest0-21swapper/108:18:141
713883996115,37cyclictest0-21swapper/512:03:145
713850994917,3cyclictest0-21swapper/109:23:141
71389899487,34cyclictest0-21swapper/710:33:147
713898994812,26cyclictest0-21swapper/707:58:147
713850994718,29cyclictest0-21swapper/110:18:131
713850994616,30cyclictest0-21swapper/112:28:131
713850994316,27cyclictest0-21swapper/109:03:141
713845994217,3cyclictest0-21swapper/008:53:140
713875993614,22cyclictest0-21swapper/409:58:144
713890993511,24cyclictest0-21swapper/612:12:586
713845993511,24cyclictest0-21swapper/010:42:580
713890993314,7cyclictest0-21swapper/608:43:146
713890993314,7cyclictest0-21swapper/608:43:146
713890993310,0cyclictest0-21swapper/610:30:596
71385099339,24cyclictest0-21swapper/112:11:581
71384599339,24cyclictest0-21swapper/010:11:590
71387599328,24cyclictest0-21swapper/407:31:584
713875993216,16cyclictest0-21swapper/408:08:144
713861993216,15cyclictest28-21ksoftirqd/207:13:132
713898993131,0cyclictest0-21swapper/710:28:317
71389099317,24cyclictest0-21swapper/609:46:596
71389899306,24cyclictest0-21swapper/709:32:587
71389899306,24cyclictest0-21swapper/708:47:587
713890993014,15cyclictest0-21swapper/609:18:146
713845992913,15cyclictest0-21swapper/007:28:130
71389899284,24cyclictest0-21swapper/710:40:597
713898992812,15cyclictest0-21swapper/711:33:147
71389099284,24cyclictest0-21swapper/611:50:586
71389099284,24cyclictest0-21swapper/610:41:596
71389099284,24cyclictest0-21swapper/607:21:586
71389099284,24cyclictest0-21swapper/607:16:596
713890992812,15cyclictest0-21swapper/610:53:146
71387599284,24cyclictest0-21swapper/407:19:584
713845992812,15cyclictest0-21swapper/007:18:130
71389899273,24cyclictest0-21swapper/707:11:597
71389099273,24cyclictest0-21swapper/608:33:596
713890992711,15cyclictest0-21swapper/608:58:136
713890992711,15cyclictest0-21swapper/608:28:146
713890992711,15cyclictest0-21swapper/607:33:136
713883992711,15cyclictest0-21swapper/511:13:135
713883992711,15cyclictest0-21swapper/510:23:145
713883992711,15cyclictest0-21swapper/507:38:145
71387599273,24cyclictest0-21swapper/412:01:584
713850992711,15cyclictest0-21swapper/110:58:141
7649772260,0sleep50-21swapper/508:30:105
71389899262,24cyclictest0-21swapper/708:42:587
71389899262,24cyclictest0-21swapper/708:42:587
71389099263,0cyclictest0-21swapper/611:23:586
71389099262,24cyclictest0-21swapper/610:06:596
71389099262,24cyclictest0-21swapper/610:06:586
713890992610,15cyclictest0-21swapper/610:03:136
713883992610,15cyclictest0-21swapper/512:23:145
713875992610,15cyclictest0-21swapper/410:28:134
71389099252,0cyclictest0-21swapper/612:37:586
71389099251,24cyclictest0-21swapper/609:02:596
71388399259,15cyclictest0-21swapper/512:13:145
71386199259,15cyclictest0-21swapper/212:33:142
71385099259,15cyclictest0-21swapper/111:58:131
71384599259,15cyclictest0-21swapper/007:53:140
71384599251,24cyclictest0-21swapper/007:49:590
7463672240,0sleep228-21ksoftirqd/208:00:122
71389899244,13cyclictest0-21swapper/707:48:137
713898992423,1cyclictest2107-21gnome-shell12:06:587
71389899240,24cyclictest0-21swapper/711:29:597
71389899240,24cyclictest0-21swapper/710:08:587
71389899240,24cyclictest0-21swapper/710:08:587
71389899240,23cyclictest0-21swapper/708:38:217
71389099248,15cyclictest0-21swapper/609:53:146
71389099241,0cyclictest0-21swapper/611:18:586
71388399248,15cyclictest0-21swapper/511:03:135
8626722230,0sleep2271rcuc/211:05:132
71389899237,15cyclictest0-21swapper/712:18:147
713898992322,1cyclictest2107-21gnome-shell11:00:587
71388399237,15cyclictest0-21swapper/511:48:145
713861992320,0cyclictest0-21swapper/207:17:232
71384599237,15cyclictest0-21swapper/009:13:130
71384599230,23cyclictest0-21swapper/008:36:590
216999230,0rtkit-daemon0-21swapper/508:50:091
9142822220,0sleep60-21swapper/612:30:006
8624122220,4sleep10-21swapper/111:05:131
7601792220,0sleep763-21ksoftirqd/708:20:197
713898992221,1cyclictest2107-21gnome-shell10:53:597
71389099226,15cyclictest0-21swapper/610:13:136
713890992212,9cyclictest0-21swapper/608:13:136
71387599226,15cyclictest0-21swapper/412:38:134
713861992221,1cyclictest2107-21gnome-shell11:48:592
71386199220,22cyclictest0-21swapper/209:22:442
713890992120,1cyclictest2107-21gnome-shell11:28:586
71388399215,16cyclictest49-21ksoftirqd/509:28:135
71388399215,15cyclictest0-21swapper/509:48:135
7996862200,0sleep40-21swapper/409:25:124
7779212200,0sleep60-21swapper/608:50:136
713898992019,1cyclictest2107-21gnome-shell11:20:597
713875992019,1cyclictest2107-21gnome-shell10:13:424
71386199204,15cyclictest0-21swapper/212:08:142
713898991919,0cyclictest0-21swapper/710:20:597
713898991919,0cyclictest0-21swapper/709:44:597
713898991918,1cyclictest2107-21gnome-shell08:27:597
713890991918,1cyclictest2107-21gnome-shell08:46:596
713883991919,0cyclictest0-21swapper/512:07:595
8553722180,0sleep20-21swapper/210:55:132
71389099181,9cyclictest0-21swapper/611:43:326
713890991817,1cyclictest2107-21gnome-shell08:37:596
71385099180,1cyclictest717725-21tune2fs07:15:021
713890991716,1cyclictest0-21swapper/607:43:146
713861991717,0cyclictest0-21swapper/212:14:472
713861991717,0cyclictest0-21swapper/208:54:592
71386199170,8cyclictest0-21swapper/209:08:132
71384599174,13cyclictest0-21swapper/008:23:130
216999170,1rtkit-daemon2168-21rtkit-daemon08:40:215
216999170,1rtkit-daemon2168-21rtkit-daemon08:40:215
71389099163,12cyclictest0-21swapper/607:13:006
71389099160,1cyclictest0-21swapper/608:03:136
71388399165,11cyclictest0-21swapper/510:38:135
71388399164,11cyclictest0-21swapper/510:48:135
713850991615,1cyclictest0-21swapper/111:52:151
713845991615,1cyclictest10-21ksoftirqd/011:45:270
216999160,1rtkit-daemon2168-21rtkit-daemon08:19:125
216999160,0rtkit-daemon0-21swapper/109:55:125
71389899150,15cyclictest0-21swapper/709:56:597
71389099153,11cyclictest0-21swapper/609:38:146
71388399157,5cyclictest829-21irqbalance08:14:075
713883991515,0cyclictest0-21swapper/511:28:195
713883991514,1cyclictest49-21ksoftirqd/510:08:415
713883991514,1cyclictest49-21ksoftirqd/510:08:405
71388399150,15cyclictest0-21swapper/510:13:585
71387599150,15cyclictest0-21swapper/410:56:594
71386999150,14cyclictest752927-21expr08:10:123
713861991513,1cyclictest28-21ksoftirqd/207:35:222
216999150,3rtkit-daemon0-21swapper/508:46:575
216999150,1rtkit-daemon2168-21rtkit-daemon11:02:451
713898991414,0cyclictest2107-21gnome-shell08:31:587
71389099141,12cyclictest820885-21cat10:00:016
713883991413,1cyclictest0-21swapper/508:55:185
713883991412,1cyclictest787804-21fschecks_time09:05:115
713861991413,1cyclictest0-21swapper/210:38:582
71385099143,8cyclictest937-21lldpd10:37:091
713845991414,0cyclictest0-21swapper/011:07:430
713845991411,2cyclictest97850irq/166-enp0s3110:55:220
216999140,0rtkit-daemon0-21swapper/108:23:595
8872442130,0sleep10-21swapper/111:45:171
8515062130,1sleep00-21swapper/010:47:580
713898991313,0cyclictest0-21swapper/712:13:447
713898991312,1cyclictest0-21swapper/710:16:107
713898991312,1cyclictest0-21swapper/709:30:007
71389899130,13cyclictest0-21swapper/712:35:117
71389899130,13cyclictest0-21swapper/711:09:397
71389899130,13cyclictest0-21swapper/708:00:147
713890991312,1cyclictest0-21swapper/611:01:176
713890991310,2cyclictest0-21swapper/608:19:596
713883991312,1cyclictest49-21ksoftirqd/509:20:385
713883991310,1cyclictest730593-21cat07:35:015
71387599130,0cyclictest0-21swapper/410:20:104
71386999130,13cyclictest0-21swapper/307:50:133
71386999130,13cyclictest0-21swapper/307:19:093
713861991313,0cyclictest0-21swapper/209:00:182
713861991311,1cyclictest28-21ksoftirqd/207:45:192
71385099133,8cyclictest2196888-21kworker/1:008:10:141
71384599130,1cyclictest0-21swapper/011:38:140
71384599130,1cyclictest0-21swapper/011:38:130
216999130,1rtkit-daemon901-21NetworkManager09:35:541
216999130,1rtkit-daemon890-21gmain08:28:085
216999130,1rtkit-daemon2168-21rtkit-daemon12:23:471
7240742120,1sleep7724079-21munin-plugin-st07:25:017
713898991212,0cyclictest0-21swapper/708:50:487
713898991212,0cyclictest0-21swapper/707:54:597
713898991211,1cyclictest2107-21gnome-shell07:27:587
71389899120,12cyclictest0-21swapper/711:40:447
71389899120,12cyclictest0-21swapper/711:35:027
71389899120,12cyclictest0-21swapper/711:35:027
71387599123,7cyclictest845-21rngd07:20:204
71386999122,9cyclictest901-21NetworkManager07:55:213
713869991212,0cyclictest0-21swapper/310:31:403
71386999120,0cyclictest0-21swapper/309:19:103
713861991212,0cyclictest0-21swapper/212:20:192
713861991212,0cyclictest0-21swapper/207:40:182
71384599120,12cyclictest0-21swapper/007:40:220
71384599120,11cyclictest836120-21crond10:25:000
216999120,0rtkit-daemon0-21swapper/109:01:175
8693382110,0sleep549-21ksoftirqd/511:15:195
713898991111,0cyclictest0-21swapper/711:56:587
713898991111,0cyclictest0-21swapper/710:03:007
713898991110,1cyclictest63-21ksoftirqd/709:13:227
71389899110,11cyclictest0-21swapper/709:52:367
71389899110,11cyclictest0-21swapper/709:49:507
71389899110,11cyclictest0-21swapper/709:07:237
71389899110,11cyclictest0-21swapper/708:10:587
713890991110,0cyclictest0-21swapper/610:16:046
71388399118,1cyclictest0-21swapper/510:18:095
713883991111,0cyclictest0-21swapper/511:41:005
713883991111,0cyclictest0-21swapper/508:00:595
71388399110,11cyclictest0-21swapper/510:56:065
71387599118,1cyclictest0-21swapper/409:19:024
713875991111,0cyclictest0-21swapper/409:09:064
71387599110,11cyclictest0-21swapper/411:45:414
71387599110,11cyclictest0-21swapper/411:43:344
71386999117,2cyclictest35-21ksoftirqd/307:10:153
71386999115,5cyclictest901-21NetworkManager07:35:123
713869991111,0cyclictest0-21swapper/310:00:373
713869991111,0cyclictest0-21swapper/309:46:473
713869991111,0cyclictest0-21swapper/308:44:413
713869991111,0cyclictest0-21swapper/308:44:413
713869991111,0cyclictest0-21swapper/308:29:143
713869991111,0cyclictest0-21swapper/308:03:133
713869991110,1cyclictest0-21swapper/310:58:493
713869991110,1cyclictest0-21swapper/310:11:023
713869991110,1cyclictest0-21swapper/309:10:333
713869991110,1cyclictest0-21swapper/308:34:563
71386999110,11cyclictest0-21swapper/312:22:543
71386999110,11cyclictest0-21swapper/310:39:483
71386999110,0cyclictest0-21swapper/312:11:503
71386999110,0cyclictest0-21swapper/311:33:573
71386999110,0cyclictest0-21swapper/308:16:323
71386999110,0cyclictest0-21swapper/307:40:573
713861991111,0cyclictest0-21swapper/208:24:032
71386199110,11cyclictest0-21swapper/212:36:442
71386199110,11cyclictest0-21swapper/211:38:312
71386199110,11cyclictest0-21swapper/211:38:312
71386199110,11cyclictest0-21swapper/209:52:292
71386199110,11cyclictest0-21swapper/209:45:402
71385099110,1cyclictest0-21swapper/110:08:121
71385099110,1cyclictest0-21swapper/110:08:111
71385099110,11cyclictest0-21swapper/112:02:011
71385099110,11cyclictest0-21swapper/109:05:361
71385099110,11cyclictest0-21swapper/108:25:261
71385099110,11cyclictest0-21swapper/107:44:171
71384599110,11cyclictest0-21swapper/010:53:050
71384599110,11cyclictest0-21swapper/007:30:290
71384599110,0cyclictest0-21swapper/012:00:540
71384599110,0cyclictest0-21swapper/011:42:020
71384599110,0cyclictest0-21swapper/009:56:100
216999110,3rtkit-daemon0-21swapper/108:08:001
216999110,0rtkit-daemon2168-21rtkit-daemon08:59:191
216999110,0rtkit-daemon0-21swapper/511:24:021
216999110,0rtkit-daemon0-21swapper/511:13:301
216999110,0rtkit-daemon0-21swapper/510:31:241
216999110,0rtkit-daemon0-21swapper/509:30:421
216999110,0rtkit-daemon0-21swapper/508:43:421
216999110,0rtkit-daemon0-21swapper/508:43:421
216999110,0rtkit-daemon0-21swapper/112:25:285
216999110,0rtkit-daemon0-21swapper/112:18:505
216999110,0rtkit-daemon0-21swapper/111:20:505
216999110,0rtkit-daemon0-21swapper/109:36:195
216999110,0rtkit-daemon0-21swapper/109:31:375
216999110,0rtkit-daemon0-21swapper/109:15:435
216999110,0rtkit-daemon0-21swapper/107:50:295
216999110,0rtkit-daemon0-21swapper/107:46:265
216999110,0rtkit-daemon0-21swapper/107:40:395
71389899103,6cyclictest855-21in:imjournal08:05:137
71389899101,6cyclictest829795-21kworker/7:110:55:157
713898991010,0cyclictest0-21swapper/712:24:477
713898991010,0cyclictest0-21swapper/709:20:437
713898991010,0cyclictest0-21swapper/708:17:187
71389899100,0cyclictest0-21swapper/711:19:267
71389099109,1cyclictest2107-21gnome-shell09:26:596
71389099103,4cyclictest810417-21sh09:40:246
713890991010,0cyclictest0-21swapper/611:09:356
713890991010,0cyclictest0-21swapper/610:23:236
713890991010,0cyclictest0-21swapper/607:50:436
713890991010,0cyclictest0-21swapper/607:39:396
71389099100,10cyclictest0-21swapper/612:32:496
71389099100,10cyclictest0-21swapper/612:01:566
71389099100,0cyclictest0-21swapper/611:49:246
71389099100,0cyclictest0-21swapper/608:21:176
71389099100,0cyclictest0-21swapper/607:45:116
713883991010,0cyclictest0-21swapper/512:38:335
713883991010,0cyclictest0-21swapper/510:31:135
713883991010,0cyclictest0-21swapper/508:09:465
713883991010,0cyclictest0-21swapper/507:57:545
71388399100,10cyclictest0-21swapper/511:32:325
71388399100,10cyclictest0-21swapper/510:43:255
71388399100,10cyclictest0-21swapper/508:36:555
71388399100,0cyclictest0-21swapper/509:43:545
71387599101,5cyclictest797796-21ntp_states09:20:184
713875991010,0cyclictest0-21swapper/412:34:474
713875991010,0cyclictest0-21swapper/412:25:124
713875991010,0cyclictest0-21swapper/412:21:474
713875991010,0cyclictest0-21swapper/411:05:034
713875991010,0cyclictest0-21swapper/410:33:494
713875991010,0cyclictest0-21swapper/409:39:014
713875991010,0cyclictest0-21swapper/408:55:174
713875991010,0cyclictest0-21swapper/408:41:174
713875991010,0cyclictest0-21swapper/408:41:174
713875991010,0cyclictest0-21swapper/408:38:414
713875991010,0cyclictest0-21swapper/408:33:394
713875991010,0cyclictest0-21swapper/407:57:134
713875991010,0cyclictest0-21swapper/407:48:364
713875991010,0cyclictest0-21swapper/407:13:584
71387599100,10cyclictest0-21swapper/411:39:214
71387599100,10cyclictest0-21swapper/411:39:204
71387599100,10cyclictest0-21swapper/409:46:304
71387599100,10cyclictest0-21swapper/407:54:084
71387599100,0cyclictest0-21swapper/411:13:204
71387599100,0cyclictest0-21swapper/410:53:104
71387599100,0cyclictest0-21swapper/410:01:384
71386999109,1cyclictest0-21swapper/312:33:583
71386999109,1cyclictest0-21swapper/312:04:123
71386999109,1cyclictest0-21swapper/311:52:193
71386999109,1cyclictest0-21swapper/311:13:283
71386999109,1cyclictest0-21swapper/310:54:363
71386999109,1cyclictest0-21swapper/310:28:553
71386999109,1cyclictest0-21swapper/309:43:233
71386999109,1cyclictest0-21swapper/308:52:003
71386999109,1cyclictest0-21swapper/307:34:073
713869991010,0cyclictest0-21swapper/311:41:453
713869991010,0cyclictest0-21swapper/311:29:433
713869991010,0cyclictest0-21swapper/311:00:573
713869991010,0cyclictest0-21swapper/309:34:273
713869991010,0cyclictest0-21swapper/309:01:153
71386199109,1cyclictest0-21swapper/211:14:362
71386199101,8cyclictest864146-21kworker/2:111:25:252
713861991010,0cyclictest0-21swapper/210:13:082
713861991010,0cyclictest0-21swapper/209:10:122
713861991010,0cyclictest0-21swapper/208:47:472
713861991010,0cyclictest0-21swapper/208:17:422
713861991010,0cyclictest0-21swapper/207:50:132
713861991010,0cyclictest0-21swapper/207:21:072
71386199100,8cyclictest901-21NetworkManager08:38:582
71386199100,10cyclictest0-21swapper/209:36:042
71386199100,0cyclictest0-21swapper/212:01:372
71386199100,0cyclictest0-21swapper/211:34:182
71386199100,0cyclictest0-21swapper/210:28:562
71386199100,0cyclictest0-21swapper/207:56:242
71386199100,0cyclictest0-21swapper/207:33:272
71385099109,1cyclictest0-21swapper/112:32:161
71385099109,1cyclictest0-21swapper/112:07:331
71385099109,1cyclictest0-21swapper/107:20:131
71385099108,1cyclictest21-21ksoftirqd/108:02:001
71385099104,3cyclictest21-21ksoftirqd/108:38:221
713850991010,0cyclictest0-21swapper/112:35:401
713850991010,0cyclictest0-21swapper/112:15:501
713850991010,0cyclictest0-21swapper/110:10:581
713850991010,0cyclictest0-21swapper/110:02:021
713850991010,0cyclictest0-21swapper/108:34:521
713850991010,0cyclictest0-21swapper/107:47:221
713850991010,0cyclictest0-21swapper/107:29:291
71385099100,0cyclictest0-21swapper/110:20:341
71385099100,0cyclictest0-21swapper/109:28:421
71384599106,2cyclictest919931-21runrttasks12:37:100
713845991010,0cyclictest0-21swapper/012:15:230
713845991010,0cyclictest0-21swapper/012:06:260
713845991010,0cyclictest0-21swapper/008:11:560
713845991010,0cyclictest0-21swapper/007:56:590
71384599100,10cyclictest0-21swapper/010:05:460
71384599100,10cyclictest0-21swapper/010:05:460
71384599100,10cyclictest0-21swapper/009:36:210
71384599100,0cyclictest0-21swapper/010:37:480
71384599100,0cyclictest0-21swapper/008:48:520
216999100,0rtkit-daemon0-21swapper/511:39:461
216999100,0rtkit-daemon0-21swapper/511:39:451
216999100,0rtkit-daemon0-21swapper/511:26:081
216999100,0rtkit-daemon0-21swapper/510:27:041
216999100,0rtkit-daemon0-21swapper/509:57:571
216999100,0rtkit-daemon0-21swapper/509:52:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional