You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 11:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot6.osadl.org (updated Fri Dec 05, 2025 00:46:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
159017221050,7sleep40-21swapper/419:05:124
15929049910133,35cyclictest0-21swapper/623:33:156
1592891999412,49cyclictest1698899-21ssh21:33:154
18751792920,0sleep3341rcuc/323:51:243
18751792920,0sleep3341rcuc/323:51:243
18124432910,1sleep010-21ksoftirqd/023:02:110
1592899998918,41cyclictest0-21swapper/520:48:155
1592911998817,38cyclictest0-21swapper/700:18:157
1592911998516,36cyclictest0-21swapper/721:43:147
1592899998516,38cyclictest0-21swapper/521:58:155
159252228543,13sleep10-21swapper/119:07:431
1592911998415,37cyclictest0-21swapper/700:08:157
1592904998416,36cyclictest0-21swapper/619:58:156
1592899998414,38cyclictest0-21swapper/522:18:145
1592911998316,35cyclictest0-21swapper/720:23:157
1592899998317,36cyclictest0-21swapper/523:43:155
17386942820,0sleep10-21swapper/122:05:011
1592904998216,35cyclictest0-21swapper/623:18:156
159247528141,13sleep30-21swapper/319:07:043
159239428143,32sleep00-21swapper/019:05:570
16574412780,2sleep010-21ksoftirqd/020:50:180
1592904997816,33cyclictest0-21swapper/623:53:156
1592904997816,33cyclictest0-21swapper/623:53:156
1592899997715,33cyclictest0-21swapper/521:23:155
16316152760,0sleep10-21swapper/120:10:131
16662372740,1sleep010-21ksoftirqd/021:05:160
16097832730,0sleep763-21ksoftirqd/719:35:127
17953432720,0sleep70-21swapper/722:49:527
18154892710,0sleep00-21swapper/023:05:140
16462032710,0sleep70-21swapper/720:30:317
18132672700,0sleep40-21swapper/423:03:194
159256827044,13sleep20-21swapper/219:08:232
159246927043,13sleep60-21swapper/619:06:596
159289999690,36cyclictest0-21swapper/519:48:155
159254426943,13sleep50-21swapper/519:08:035
159245226943,13sleep70-21swapper/719:06:447
1592911996416,34cyclictest0-21swapper/719:13:157
17161502630,0sleep60-21swapper/621:45:436
1592904995316,33cyclictest0-21swapper/622:08:156
1592904995015,32cyclictest0-21swapper/622:58:156
1592911993511,24cyclictest0-21swapper/700:22:597
1592904993511,24cyclictest0-21swapper/620:17:596
1592866993410,24cyclictest0-21swapper/122:26:591
159291199328,24cyclictest0-21swapper/722:15:597
1592911993116,15cyclictest0-21swapper/700:38:157
159288399318,0cyclictest0-21swapper/323:08:583
159285899317,24cyclictest0-21swapper/019:45:590
18755542300,0sleep20-21swapper/223:51:552
18755542300,0sleep20-21swapper/223:51:542
1592904993014,15cyclictest0-21swapper/620:53:156
1592899993014,15cyclictest0-21swapper/523:23:155
1592875993014,15cyclictest0-21swapper/223:58:142
159285899306,24cyclictest0-21swapper/021:41:590
1592866992913,15cyclictest0-21swapper/122:38:151
17906062280,1sleep442-21ksoftirqd/422:45:164
1592911992813,5cyclictest0-21swapper/723:28:157
1592866992812,15cyclictest0-21swapper/123:48:141
18896572270,2sleep3159288399cyclictest00:03:583
159290499273,0cyclictest0-21swapper/621:05:596
1592904992711,15cyclictest0-21swapper/621:13:156
1592875992711,15cyclictest0-21swapper/220:58:152
1592875992711,15cyclictest0-21swapper/220:58:142
1592866992711,15cyclictest0-21swapper/119:53:141
159285899273,24cyclictest0-21swapper/020:49:590
16621832260,0sleep50-21swapper/520:59:595
16621832260,0sleep50-21swapper/520:59:595
1592899992611,14cyclictest0-21swapper/519:28:155
1592891992610,13cyclictest0-21swapper/400:23:154
159286699269,16cyclictest0-21swapper/121:38:141
1592866992611,15cyclictest0-21swapper/100:13:151
1592866992610,15cyclictest0-21swapper/121:18:151
159291199259,15cyclictest0-21swapper/722:13:157
159290499259,16cyclictest0-21swapper/621:53:156
1592904992523,1cyclictest2107-21gnome-shell20:01:596
159289999259,15cyclictest0-21swapper/520:18:155
159286699259,15cyclictest0-21swapper/119:18:151
159285899251,24cyclictest0-21swapper/000:15:580
18864732240,0sleep40-21swapper/400:00:224
159290499241,0cyclictest0-21swapper/621:57:596
159290499240,24cyclictest0-21swapper/621:29:596
1592883992423,1cyclictest2107-21gnome-shell00:05:593
159287599248,15cyclictest0-21swapper/221:08:152
1592875992415,3cyclictest0-21swapper/222:23:152
1592875992415,3cyclictest0-21swapper/222:23:152
159286699248,15cyclictest0-21swapper/121:48:151
159285899240,24cyclictest0-21swapper/021:49:590
1592883992322,1cyclictest2107-21gnome-shell22:21:593
1592883992322,1cyclictest2107-21gnome-shell22:21:583
159291199226,15cyclictest0-21swapper/722:03:147
159289999226,15cyclictest0-21swapper/523:13:155
159286699226,15cyclictest0-21swapper/123:38:151
1592866992221,1cyclictest0-21swapper/119:13:521
18463082210,0sleep228-21ksoftirqd/223:29:592
17082102210,0sleep60-21swapper/621:40:146
16859722210,0sleep20-21swapper/221:22:562
159290499215,15cyclictest0-21swapper/600:33:156
1592904992120,1cyclictest2107-21gnome-shell00:27:596
159289999216,12cyclictest0-21swapper/520:08:155
1592891992120,1cyclictest0-21swapper/421:41:384
1592883992120,1cyclictest1624866-21kworker/3:122:46:433
1592883992120,1cyclictest0-21swapper/322:40:583
159286699215,15cyclictest0-21swapper/121:03:151
1592858992120,1cyclictest0-21swapper/023:18:590
1592858992111,10cyclictest0-21swapper/022:43:150
17596122200,0sleep60-21swapper/622:20:196
17596122200,0sleep60-21swapper/622:20:196
17367382200,0sleep60-21swapper/622:02:496
16554302200,0sleep4411rcuc/420:45:264
1592883992019,1cyclictest2107-21gnome-shell22:01:593
159287599204,15cyclictest0-21swapper/220:13:152
1592875992019,1cyclictest2107-21gnome-shell20:38:592
1592858992014,6cyclictest0-21swapper/019:23:150
19247402190,0sleep20-21swapper/200:30:242
159290499193,15cyclictest0-21swapper/619:43:156
1592904991919,0cyclictest0-21swapper/619:24:596
1592904991918,1cyclictest2107-21gnome-shell23:59:596
159289999196,12cyclictest0-21swapper/522:53:155
159289999194,13cyclictest0-21swapper/520:38:155
159289999193,15cyclictest0-21swapper/522:28:145
159288399196,13cyclictest0-21swapper/322:33:143
1592883991918,1cyclictest2107-21gnome-shell20:52:593
159286699195,13cyclictest0-21swapper/119:33:151
159286699195,13cyclictest0-21swapper/119:33:151
1592866991918,1cyclictest0-21swapper/121:33:231
216999180,0rtkit-daemon2168-21rtkit-daemon22:56:403
159291199182,15cyclictest0-21swapper/720:03:157
1592904991816,1cyclictest56-21ksoftirqd/623:40:466
1592883991812,6cyclictest0-21swapper/300:28:153
1592866991817,1cyclictest2107-21gnome-shell21:53:591
1592858991818,0cyclictest0-21swapper/019:56:590
19087172170,0sleep5481rcuc/500:19:065
1592904991716,1cyclictest2107-21gnome-shell23:06:596
159290499171,15cyclictest0-21swapper/600:03:156
159290499170,16cyclictest0-21swapper/620:43:156
1592875991716,1cyclictest0-21swapper/223:08:152
1592866991716,1cyclictest2107-21gnome-shell20:57:591
1592866991716,1cyclictest2107-21gnome-shell20:57:591
1592858991712,4cyclictest97850irq/166-enp0s3123:30:230
216999160,1rtkit-daemon0-21swapper/320:50:007
19163822160,0sleep71916385-21aten_rcpower_po00:25:157
159290499161,11cyclictest17024732sleep621:35:196
1592883991616,0cyclictest0-21swapper/323:36:583
1592883991615,1cyclictest2107-21gnome-shell19:42:593
1592883991614,1cyclictest844-21nscd21:50:143
159287599169,7cyclictest855-21in:imjournal22:10:342
1592866991615,1cyclictest2107-21gnome-shell20:08:591
159286699161,10cyclictest0-21swapper/120:33:151
159285899169,5cyclictest855-21in:imjournal21:52:050
159285899162,8cyclictest0-21swapper/023:43:490
216999150,1rtkit-daemon823-21earlyoom19:56:323
216999150,1rtkit-daemon2168-21rtkit-daemon21:04:397
216999150,1rtkit-daemon2168-21rtkit-daemon20:54:207
216999150,1rtkit-daemon2168-21rtkit-daemon20:38:037
216999150,1rtkit-daemon2168-21rtkit-daemon20:34:573
216999150,0rtkit-daemon0-21swapper/323:04:077
1592911991514,1cyclictest2107-21gnome-shell23:08:597
1592899991514,1cyclictest0-21swapper/500:36:235
1592883991514,1cyclictest2107-21gnome-shell00:33:593
1592883991514,1cyclictest1833094-21kworker/3:023:48:393
159288399151,14cyclictest1624866-21kworker/3:120:46:033
159287599152,7cyclictest901-21NetworkManager20:09:092
159286699152,12cyclictest0-21swapper/122:48:141
1592866991515,0cyclictest0-21swapper/120:41:581
1592858991514,1cyclictest10-21ksoftirqd/023:22:060
1592858991510,4cyclictest2168-21rtkit-daemon23:45:080
216999140,8rtkit-daemon2297-21pool-gsd-smartc21:47:017
216999140,0rtkit-daemon823-21earlyoom22:32:417
216999140,0rtkit-daemon0-21swapper/721:32:213
216999140,0rtkit-daemon0-21swapper/321:23:557
19146802140,1sleep20-21swapper/200:23:362
16061532140,1sleep70-21swapper/719:30:007
1592911991412,1cyclictest0-21swapper/723:52:317
1592911991412,1cyclictest0-21swapper/723:52:307
159291199140,1cyclictest0-21swapper/700:01:287
159291199140,14cyclictest0-21swapper/721:10:527
1592904991413,1cyclictest0-21swapper/621:16:406
1592899991414,0cyclictest0-21swapper/523:50:235
1592899991414,0cyclictest0-21swapper/523:50:235
1592899991413,1cyclictest2107-21gnome-shell22:30:595
159289999140,14cyclictest0-21swapper/500:24:035
1592891991414,0cyclictest0-21swapper/422:04:234
1592891991413,1cyclictest0-21swapper/423:05:514
1592891991413,1cyclictest0-21swapper/421:15:074
1592891991411,2cyclictest1892982-21swap00:05:234
159288399149,5cyclictest855-21in:imjournal21:10:043
1592883991414,0cyclictest0-21swapper/323:57:593
1592883991413,1cyclictest0-21swapper/319:10:033
159288399141,1cyclictest121rcu_preempt23:28:323
159288399140,14cyclictest0-21swapper/323:30:133
159288399140,14cyclictest0-21swapper/300:13:273
159287599140,13cyclictest1934319-21taskset00:39:302
159286699143,10cyclictest845-21rngd21:58:551
159286699140,13cyclictest0-21swapper/123:14:321
1592858991413,1cyclictest97850irq/166-enp0s3122:25:150
1592858991413,1cyclictest2107-21gnome-shell22:03:590
159285899140,1cyclictest1605029-21missed_timers19:25:170
216999130,1rtkit-daemon2168-21rtkit-daemon00:13:427
216999130,1rtkit-daemon1882787-21ssh23:58:117
216999130,0rtkit-daemon0-21swapper/322:55:447
216999130,0rtkit-daemon0-21swapper/321:57:017
18839282130,0sleep00-21swapper/023:59:470
17799522130,1sleep70-21swapper/722:36:077
1592911991313,0cyclictest0-21swapper/723:19:017
1592911991313,0cyclictest0-21swapper/700:30:147
1592911991311,1cyclictest844-21nscd22:05:197
159291199130,13cyclictest0-21swapper/723:38:527
159291199130,13cyclictest0-21swapper/722:25:417
159291199130,13cyclictest0-21swapper/721:52:417
159291199130,13cyclictest0-21swapper/721:31:037
159291199130,0cyclictest0-21swapper/723:22:257
1592904991313,0cyclictest0-21swapper/623:37:386
1592904991313,0cyclictest0-21swapper/619:29:596
1592904991313,0cyclictest0-21swapper/600:37:106
1592904991312,1cyclictest0-21swapper/623:21:146
1592904991312,1cyclictest0-21swapper/622:44:196
1592904991312,1cyclictest0-21swapper/622:17:396
159290499130,13cyclictest0-21swapper/623:02:036
159290499130,13cyclictest0-21swapper/622:37:296
159290499130,13cyclictest0-21swapper/600:22:516
1592899991310,1cyclictest1668393-21diskmemload22:37:585
159289999130,13cyclictest0-21swapper/521:19:095
159289999130,13cyclictest0-21swapper/500:27:285
159289999130,0cyclictest0-21swapper/523:04:315
159289999130,0cyclictest0-21swapper/522:41:175
159289999130,0cyclictest0-21swapper/522:11:505
159289999130,0cyclictest0-21swapper/521:45:395
1592891991312,0cyclictest0-21swapper/421:36:444
159289199130,13cyclictest0-21swapper/423:44:434
159288399134,3cyclictest986-21runrttasks23:23:553
1592883991313,0cyclictest0-21swapper/323:03:233
1592883991312,1cyclictest2107-21gnome-shell21:39:593
1592883991312,1cyclictest0-21swapper/321:45:493
159288399130,13cyclictest0-21swapper/321:05:303
159288399130,0cyclictest0-21swapper/320:40:173
1592866991313,0cyclictest0-21swapper/123:17:561
1592866991313,0cyclictest0-21swapper/123:08:211
1592866991312,1cyclictest2107-21gnome-shell21:25:591
1592866991312,1cyclictest0-21swapper/123:32:251
159286699130,13cyclictest0-21swapper/122:55:201
159286699130,13cyclictest0-21swapper/122:24:361
159286699130,13cyclictest0-21swapper/122:24:361
159286699130,13cyclictest0-21swapper/100:26:331
159286699130,13cyclictest0-21swapper/100:23:081
159286699130,13cyclictest0-21swapper/100:19:441
159285899139,3cyclictest844-21nscd22:24:460
159285899139,3cyclictest844-21nscd22:24:460
1592858991311,1cyclictest97850irq/166-enp0s3123:53:390
1592858991311,1cyclictest97850irq/166-enp0s3123:53:390
159285899130,13cyclictest0-21swapper/019:40:140
159285899130,11cyclictest0-21swapper/000:27:570
216999120,0rtkit-daemon0-21swapper/721:56:423
216999120,0rtkit-daemon0-21swapper/321:40:493
159291199122,7cyclictest823-21earlyoom23:32:227
1592904991212,0cyclictest0-21swapper/621:24:196
1592904991211,1cyclictest0-21swapper/622:47:446
1592904991211,1cyclictest0-21swapper/619:17:086
159290499120,12cyclictest0-21swapper/623:27:256
159290499120,12cyclictest0-21swapper/620:57:296
159290499120,12cyclictest0-21swapper/620:57:296
159290499120,0cyclictest0-21swapper/623:47:546
159290499120,0cyclictest0-21swapper/622:12:076
159289999122,6cyclictest859-21systemd-machine00:10:015
1592899991212,0cyclictest0-21swapper/523:57:125
1592899991212,0cyclictest0-21swapper/522:57:035
1592899991212,0cyclictest0-21swapper/522:47:285
159289999120,12cyclictest0-21swapper/521:40:475
1592891991212,0cyclictest0-21swapper/422:54:574
1592891991212,0cyclictest0-21swapper/422:44:044
1592891991212,0cyclictest0-21swapper/422:33:104
1592891991212,0cyclictest0-21swapper/400:35:084
1592891991211,1cyclictest0-21swapper/422:22:174
1592891991211,1cyclictest0-21swapper/422:22:164
1592891991210,2cyclictest957-21ntpd23:23:344
159289199120,12cyclictest0-21swapper/423:37:534
159289199120,0cyclictest0-21swapper/421:12:204
159288399122,2cyclictest121rcu_preempt23:17:203
1592883991212,0cyclictest0-21swapper/322:35:253
1592883991212,0cyclictest0-21swapper/321:24:513
1592883991212,0cyclictest0-21swapper/321:16:593
1592883991211,1cyclictest1794567-21kworker/3:223:11:103
159288399120,0cyclictest0-21swapper/321:29:433
159287599121,11cyclictest0-21swapper/220:28:152
159287599120,12cyclictest0-21swapper/223:49:362
159287599120,12cyclictest0-21swapper/222:34:482
1592866991212,0cyclictest0-21swapper/123:44:461
1592866991212,0cyclictest0-21swapper/123:02:101
1592866991212,0cyclictest0-21swapper/122:15:391
1592866991212,0cyclictest0-21swapper/121:22:101
1592866991212,0cyclictest0-21swapper/120:29:291
1592866991212,0cyclictest0-21swapper/120:22:001
1592866991212,0cyclictest0-21swapper/100:33:241
1592866991211,1cyclictest0-21swapper/122:01:121
159286699120,1cyclictest0-21swapper/119:23:381
1592858991212,0cyclictest0-21swapper/021:26:050
1592858991211,1cyclictest0-21swapper/023:12:560
1592858991210,1cyclictest97850irq/166-enp0s3122:48:420
1592858991210,1cyclictest97850irq/166-enp0s3122:06:400
159285899120,12cyclictest0-21swapper/022:58:080
159285899120,11cyclictest1842471-21expr23:25:230
159285899120,0cyclictest0-21swapper/023:36:300
216999110,1rtkit-daemon1134-21snmpd19:21:213
216999110,0rtkit-daemon0-21swapper/723:42:193
216999110,0rtkit-daemon0-21swapper/720:57:373
216999110,0rtkit-daemon0-21swapper/720:57:373
216999110,0rtkit-daemon0-21swapper/720:36:293
216999110,0rtkit-daemon0-21swapper/720:01:233
216999110,0rtkit-daemon0-21swapper/322:50:157
216999110,0rtkit-daemon0-21swapper/320:11:317
216999110,0rtkit-daemon0-21swapper/319:56:377
19000372110,1sleep60-21swapper/600:10:516
17996812110,1sleep30-21swapper/322:52:063
159291199113,5cyclictest1-21systemd19:50:257
1592911991111,0cyclictest0-21swapper/723:45:027
1592911991111,0cyclictest0-21swapper/722:22:167
1592911991111,0cyclictest0-21swapper/722:22:167
1592911991111,0cyclictest0-21swapper/721:38:027
1592911991111,0cyclictest0-21swapper/719:21:577
159291199110,11cyclictest0-21swapper/721:07:287
159291199110,11cyclictest0-21swapper/720:15:557
159291199110,11cyclictest0-21swapper/719:43:447
159291199110,11cyclictest0-21swapper/719:31:327
159291199110,11cyclictest0-21swapper/719:31:327
159291199110,0cyclictest0-21swapper/720:09:067
1592904991111,0cyclictest0-21swapper/622:51:096
1592904991111,0cyclictest0-21swapper/622:33:246
1592904991111,0cyclictest0-21swapper/622:26:366
1592904991111,0cyclictest0-21swapper/621:31:176
1592904991110,1cyclictest0-21swapper/620:33:066
1592904991110,1cyclictest0-21swapper/620:13:596
1592904991110,1cyclictest0-21swapper/620:05:086
159289999111,6cyclictest1819571-21taskset23:08:175
1592899991111,0cyclictest0-21swapper/523:36:445
1592899991111,0cyclictest0-21swapper/522:20:085
1592899991111,0cyclictest0-21swapper/522:20:085
1592899991111,0cyclictest0-21swapper/520:26:095
1592899991111,0cyclictest0-21swapper/519:31:315
1592899991111,0cyclictest0-21swapper/519:31:305
1592899991110,1cyclictest2107-21gnome-shell20:42:595
159289999110,11cyclictest0-21swapper/521:00:385
159289999110,11cyclictest0-21swapper/520:30:525
159289999110,11cyclictest0-21swapper/500:02:445
159289999110,0cyclictest0-21swapper/523:46:585
159289199112,6cyclictest823-21earlyoom22:14:404
1592891991111,0cyclictest0-21swapper/421:22:464
1592891991111,0cyclictest0-21swapper/419:13:594
1592891991111,0cyclictest0-21swapper/400:15:274
1592891991110,1cyclictest2107-21gnome-shell19:45:594
159288399118,3cyclictest1624866-21kworker/3:122:05:393
159288399118,2cyclictest1896042-21kworker/u16:200:22:033
159288399118,2cyclictest1624866-21kworker/3:122:17:153
1592883991111,0cyclictest0-21swapper/322:25:103
1592883991111,0cyclictest0-21swapper/320:07:593
1592883991110,1cyclictest1833094-21kworker/3:000:35:033
1592883991110,1cyclictest1580289-21kworker/3:219:26:033
159288399110,11cyclictest0-21swapper/319:33:283
159288399110,11cyclictest0-21swapper/319:33:283
159287599112,5cyclictest1670830-21awk21:10:202
1592875991111,0cyclictest0-21swapper/223:30:442
1592875991111,0cyclictest0-21swapper/222:48:572
1592875991111,0cyclictest0-21swapper/221:49:252
1592875991111,0cyclictest0-21swapper/220:49:552
1592875991111,0cyclictest0-21swapper/220:30:242
159287599110,11cyclictest0-21swapper/223:44:142
159287599110,11cyclictest0-21swapper/222:44:142
159287599110,11cyclictest0-21swapper/222:01:382
159287599110,11cyclictest0-21swapper/221:40:292
159287599110,11cyclictest0-21swapper/221:34:582
159287599110,0cyclictest0-21swapper/221:38:232
159287599110,0cyclictest0-21swapper/219:24:232
159286699115,6cyclictest855-21in:imjournal22:41:231
159286699112,7cyclictest873-21nscd20:00:241
159286699111,5cyclictest859-21systemd-machine00:00:011
1592866991111,0cyclictest0-21swapper/123:22:101
1592866991111,0cyclictest0-21swapper/122:34:121
1592866991111,0cyclictest0-21swapper/121:14:301
1592866991111,0cyclictest0-21swapper/119:35:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional