You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-21 - 22:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Thu Aug 21, 2025 12:45:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
230921350,1sleep3673499cyclictest09:38:593
230921350,1sleep3673499cyclictest09:38:593
356321280,5sleep4674399cyclictest11:15:174
3258821170,0sleep60-21swapper/610:50:346
631521050,0sleep10-21swapper/109:39:371
631521050,0sleep10-21swapper/109:39:371
72682870,1sleep10-21swapper/110:08:301
123762850,0sleep50-21swapper/511:30:565
63102800,0sleep00-21swapper/011:35:000
156512780,0sleep3411ktimersoftd/310:38:373
8612770,0sleep10-21swapper/109:19:331
56072770,0sleep10-21swapper/111:15:301
122032760,1sleep70-21swapper/709:59:387
54742750,1sleep50-21swapper/512:21:535
320732740,0sleep00-21swapper/009:33:510
320732740,0sleep00-21swapper/009:33:510
321432730,0sleep00-21swapper/012:40:010
307692710,0sleep70-21swapper/709:52:417
250182710,1sleep40-21swapper/409:18:164
15952710,0sleep10-21swapper/109:24:301
318932700,1sleep5581rcuc/512:25:385
263072700,0sleep3411ktimersoftd/311:56:433
3322690,0sleep50-21swapper/509:48:145
3322690,0sleep50-21swapper/509:48:145
231182690,1sleep5591ktimersoftd/511:18:145
161062690,0sleep50-21swapper/512:32:515
79402670,0sleep27941-21bash11:35:102
225582670,0sleep50-21swapper/509:17:535
219192670,1sleep2311rcuc/211:56:022
194842660,0sleep00-21swapper/009:17:240
643925949,6sleep30-21swapper/307:09:253
630225848,6sleep70-21swapper/707:07:447
614825229,7sleep10-21swapper/107:05:461
630025140,7sleep50-21swapper/507:07:435
626124838,6sleep40-21swapper/407:07:094
633124535,6sleep00-21swapper/007:08:020
616224425,14sleep60-21swapper/607:05:516
145302410,0sleep70-21swapper/712:13:557
621424029,7sleep20-21swapper/207:06:352
56852280,0sleep00-21swapper/011:01:110
56852280,0sleep00-21swapper/011:01:100
327612240,0sleep7761rcuc/712:02:247
184422230,0sleep60-21swapper/611:46:046
85362220,0sleep4501ktimersoftd/411:35:124
32572220,0sleep70-21swapper/710:31:527
250772220,0sleep60-21swapper/612:20:106
173772220,4sleep1672299cyclictest10:24:331
6722992119,1cyclictest465-21systemd-journal10:58:221
312892210,1sleep4501ktimersoftd/409:38:284
312892210,1sleep4501ktimersoftd/409:38:284
188432210,1sleep60-21swapper/612:33:166
263592200,0sleep626361-21grepconf.sh09:52:006
227552200,0sleep70-21swapper/709:17:557
125902200,4sleep6675599cyclictest12:08:576
81822190,1sleep6671rcuc/609:15:376
72232190,0sleep20-21swapper/209:10:452
6755991914,1cyclictest660-21dbus-daemon10:06:466
45532190,0sleep50-21swapper/511:20:155
143352190,0sleep30-21swapper/310:57:463
672899180,16cyclictest0-21swapper/209:20:162
63622180,0sleep40-21swapper/410:32:214
62492180,0sleep40-21swapper/412:22:004
321272180,0sleep70-21swapper/712:25:417
268802180,1sleep316759-1kworker/3:2H09:52:053
256282180,4sleep3673499cyclictest09:32:503
256282180,4sleep3673499cyclictest09:32:503
22392180,1sleep60-21swapper/611:53:176
14312180,0sleep50-21swapper/510:36:235
6832170,1sleep70-21swapper/710:36:177
6748991714,2cyclictest662-21gdbus09:23:365
673499173,12cyclictest660-21dbus-daemon11:20:153
672299170,1cyclictest1-21systemd11:30:231
267612170,0sleep6681ktimersoftd/610:25:426
163252170,0sleep30-21swapper/310:05:033
88242160,1sleep4501ktimersoftd/409:49:344
88242160,1sleep4501ktimersoftd/409:49:344
675599160,15cyclictest19307-21bash10:10:166
674399160,14cyclictest0-21swapper/409:33:324
674399160,14cyclictest0-21swapper/409:33:324
6728991611,3cyclictest0-21swapper/211:08:312
6722991613,2cyclictest662-21gdbus12:17:331
295942160,0sleep00-21swapper/011:09:440
229212160,0sleep40-21swapper/410:59:064
21452160,4sleep3673499cyclictest10:46:073
208712160,0sleep50-21swapper/510:20:135
158842160,0sleep50-21swapper/512:04:465
134922160,0sleep5581rcuc/512:37:085
113462160,0sleep00-21swapper/012:18:040
95942150,0sleep30-21swapper/311:44:573
6760991511,2cyclictest662-21gdbus10:05:597
6760991511,2cyclictest0-21swapper/711:02:537
6760991511,2cyclictest0-21swapper/711:02:537
675599153,1cyclictest660-21dbus-daemon09:48:276
675599153,1cyclictest660-21dbus-daemon09:48:276
6755991510,3cyclictest0-21swapper/612:10:156
674899155,8cyclictest22253-21gdbus10:19:405
674899150,14cyclictest0-21swapper/511:51:245
674899150,13cyclictest0-21swapper/510:40:095
674899150,13cyclictest0-21swapper/507:35:195
674399150,13cyclictest0-21swapper/411:06:324
673499153,7cyclictest4289-21bash12:17:003
673499152,6cyclictest758-21nscd12:21:093
6734991511,2cyclictest0-21swapper/308:20:153
6734991511,2cyclictest0-21swapper/308:20:153
673499150,13cyclictest0-21swapper/310:16:473
6728991511,1cyclictest0-21swapper/209:45:202
6728991511,1cyclictest0-21swapper/209:45:192
672899150,14cyclictest0-21swapper/209:41:292
6722991513,0cyclictest11712-21systemd-cgroups11:35:321
6722991512,2cyclictest17772-21sshd11:12:391
6722991512,2cyclictest17772-21sshd11:12:381
6722991510,4cyclictest5527-21sshd09:49:021
6722991510,4cyclictest5527-21sshd09:49:021
237072150,1sleep40-21swapper/409:13:194
83992140,2sleep40-21swapper/410:42:154
676099140,12cyclictest1044-21sshd09:10:477
6755991411,2cyclictest662-21gdbus10:47:036
6755991411,2cyclictest0-21swapper/611:25:056
675599140,1cyclictest683-21bash12:02:286
675599140,12cyclictest10722-21sshd10:42:386
674899145,7cyclictest738-21gdbus10:52:485
674899145,7cyclictest662-21gdbus09:32:065
674899145,7cyclictest662-21gdbus09:32:065
674899145,7cyclictest27150-21sshd10:25:465
674899145,7cyclictest1060-21in:imjournal09:39:345
674899145,7cyclictest1060-21in:imjournal09:39:345
674899144,2cyclictest738-21gdbus12:05:345
674899142,10cyclictest0-21swapper/511:42:015
674899140,2cyclictest660-21dbus-daemon10:49:295
673499145,6cyclictest5351-21sshd11:53:473
673499144,6cyclictest660-21dbus-daemon11:03:573
673499144,6cyclictest660-21dbus-daemon11:03:573
673499143,8cyclictest0-21swapper/310:04:203
673499143,7cyclictest27452-21/usr/sbin/munin10:55:013
673499143,7cyclictest16918-21sshd10:24:293
673499143,6cyclictest17366-21sshd10:10:013
673499143,2cyclictest660-21dbus-daemon12:06:063
6734991412,1cyclictest0-21swapper/312:12:483
673499141,12cyclictest0-21swapper/309:25:033
673499140,2cyclictest0-21swapper/311:06:233
673499140,12cyclictest1117-21nfsd09:44:503
6728991411,2cyclictest0-21swapper/210:40:172
6728991411,1cyclictest28079-21sshd12:39:232
672899140,12cyclictest0-21swapper/209:52:102
672299140,12cyclictest0-21swapper/112:13:441
6717991412,1cyclictest0-21swapper/010:05:320
56142140,0sleep50-21swapper/510:32:145
320602140,0sleep00-21swapper/012:06:580
172352140,1sleep0121rcuc/009:12:190
6760991311,1cyclictest0-21swapper/711:20:057
6760991310,2cyclictest0-21swapper/711:45:467
676099130,1cyclictest6638-21sshd11:15:397
676099130,1cyclictest0-21swapper/711:58:087
676099130,1cyclictest0-21swapper/708:15:007
676099130,12cyclictest0-21swapper/711:31:077
676099130,12cyclictest0-21swapper/709:29:207
675599139,2cyclictest15478-21id09:12:016
675599130,1cyclictest0-21swapper/611:13:326
675599130,1cyclictest0-21swapper/611:13:326
675599130,12cyclictest0-21swapper/609:35:556
675599130,12cyclictest0-21swapper/609:35:556
675599130,11cyclictest0-21swapper/610:22:186
674899139,3cyclictest0-21swapper/509:25:585
674899135,7cyclictest738-21gdbus12:15:265
674899135,7cyclictest660-21dbus-daemon11:27:535
674899135,7cyclictest22253-21gdbus11:07:415
674899135,7cyclictest22253-21gdbus09:59:185
674899135,6cyclictest22253-21gdbus09:10:495
674899134,7cyclictest738-21gdbus10:10:325
674899134,2cyclictest765-21nscd10:00:245
674899133,2cyclictest5672-21rm10:08:125
674899133,2cyclictest22253-21gdbus11:55:205
674899133,2cyclictest1060-21in:imjournal11:35:155
674899131,2cyclictest0-21swapper/510:57:155
6748991310,2cyclictest662-21gdbus12:10:295
674899130,4cyclictest14913-21systemd-cgroups09:50:205
674899130,1cyclictest0-21swapper/508:52:545
6743991311,1cyclictest21462-21sshd10:39:314
6743991311,1cyclictest1746-21sshd09:24:314
6743991311,1cyclictest0-21swapper/412:00:024
6743991311,1cyclictest0-21swapper/409:56:474
674399130,1cyclictest30213-21bash09:43:044
674399130,1cyclictest0-21swapper/409:50:284
674399130,12cyclictest0-21swapper/412:29:284
674399130,12cyclictest0-21swapper/412:11:444
674399130,11cyclictest0-21swapper/411:50:304
673499133,6cyclictest2905-21grepconf.sh09:58:113
673499133,6cyclictest23999-21sshd10:44:423
673499133,6cyclictest14191-21bash11:31:143
673499133,6cyclictest1044-21sshd12:33:233
673499133,4cyclictest13695-21grepconf.sh12:37:103
673499133,3cyclictest25208-21sshd09:47:033
673499133,3cyclictest25208-21sshd09:47:033
673499133,3cyclictest1-21systemd11:35:093
6734991311,1cyclictest0-21swapper/312:25:343
673499130,12cyclictest2188-21sshd11:10:173
673499130,12cyclictest2188-21sshd11:10:173
6728991311,1cyclictest30523-21sshd11:19:252
672899130,1cyclictest0-21swapper/210:35:592
672899130,1cyclictest0-21swapper/209:33:372
672899130,1cyclictest0-21swapper/209:33:372
672899130,12cyclictest0-21swapper/211:28:252
672899130,12cyclictest0-21swapper/210:31:092
672899130,12cyclictest0-21swapper/210:05:532
6722991310,2cyclictest0-21swapper/111:41:121
672299130,1cyclictest0-21swapper/112:22:041
672299130,1cyclictest0-21swapper/109:25:271
672299130,12cyclictest0-21swapper/111:56:251
672299130,12cyclictest0-21swapper/111:50:311
672299130,12cyclictest0-21swapper/109:12:091
672299130,12cyclictest0-21swapper/108:22:251
672299130,12cyclictest0-21swapper/108:22:251
6717991310,2cyclictest0-21swapper/011:47:330
6717991310,2cyclictest0-21swapper/011:35:430
671799130,12cyclictest0-21swapper/012:33:160
671799130,12cyclictest0-21swapper/012:11:370
127102130,0sleep40-21swapper/410:09:214
6760991210,1cyclictest0-21swapper/711:25:047
676099120,1cyclictest0-21swapper/712:16:017
676099120,1cyclictest0-21swapper/710:03:127
676099120,1cyclictest0-21swapper/709:42:387
676099120,11cyclictest0-21swapper/711:06:477
676099120,11cyclictest0-21swapper/710:51:297
676099120,11cyclictest0-21swapper/709:20:207
6755991210,1cyclictest0-21swapper/612:25:106
6755991210,1cyclictest0-21swapper/611:19:036
675599120,1cyclictest18819-21bash11:08:016
675599120,1cyclictest0-21swapper/609:42:406
675599120,11cyclictest0-21swapper/611:38:246
674899122,2cyclictest999-21sleep08:05:005
674899122,2cyclictest654-21polkitd11:45:025
674899122,2cyclictest653-21avahi-daemon08:25:005
674899122,2cyclictest653-21avahi-daemon08:25:005
674899121,5cyclictest0-21swapper/509:08:355
674899121,3cyclictest0-21swapper/507:15:015
674899121,2cyclictest22253-21gdbus11:01:045
674899121,2cyclictest22253-21gdbus11:01:045
674899121,2cyclictest0-21swapper/508:20:005
674899121,1cyclictest465-21systemd-journal09:40:155
674899120,2cyclictest27846-21grepconf.sh11:14:145
674899120,2cyclictest27846-21grepconf.sh11:14:135
674899120,2cyclictest0-21swapper/508:40:005
674899120,11cyclictest0-21swapper/507:15:195
6743991210,1cyclictest0-21swapper/411:32:294
6743991210,1cyclictest0-21swapper/411:20:234
6743991210,1cyclictest0-21swapper/410:02:344
674399120,1cyclictest0-21swapper/412:38:224
674399120,1cyclictest0-21swapper/411:44:204
674399120,1cyclictest0-21swapper/411:26:264
674399120,1cyclictest0-21swapper/410:22:194
674399120,11cyclictest0-21swapper/412:33:554
674399120,11cyclictest0-21swapper/410:54:594
673499129,2cyclictest12931-21id11:45:163
673499129,2cyclictest0-21swapper/311:16:113
673499123,6cyclictest24350-21sshd10:30:153
673499123,5cyclictest28904-21sshd12:01:483
673499123,3cyclictest12394-21sshd09:11:333
673499122,6cyclictest660-21dbus-daemon10:25:423
673499122,6cyclictest23268-21grep09:22:493
673499120,11cyclictest0-21swapper/311:25:123
673499120,11cyclictest0-21swapper/309:15:143
6728991210,1cyclictest9501-21df_inode09:35:142
6728991210,1cyclictest9501-21df_inode09:35:142
6728991210,1cyclictest0-21swapper/212:31:032
6728991210,1cyclictest0-21swapper/212:18:172
6728991210,1cyclictest0-21swapper/212:09:582
6728991210,1cyclictest0-21swapper/211:32:512
6728991210,1cyclictest0-21swapper/210:28:282
6728991210,1cyclictest0-21swapper/210:15:012
672899120,1cyclictest0-21swapper/212:23:152
672899120,1cyclictest0-21swapper/212:14:242
672899120,11cyclictest0-21swapper/211:47:302
672899120,11cyclictest0-21swapper/211:41:192
672899120,11cyclictest0-21swapper/211:22:542
672899120,11cyclictest0-21swapper/210:10:112
672299128,3cyclictest1117-21nfsd10:18:401
672299123,0cyclictest0-21swapper/109:33:261
672299123,0cyclictest0-21swapper/109:33:261
6722991210,1cyclictest15042-21systemd-cgroups10:48:081
6722991210,1cyclictest0-21swapper/112:09:181
672299120,1cyclictest0-21swapper/112:25:581
672299120,1cyclictest0-21swapper/111:05:041
672299120,1cyclictest0-21swapper/111:01:421
672299120,1cyclictest0-21swapper/111:01:421
672299120,1cyclictest0-21swapper/109:55:421
672299120,11cyclictest654-21polkitd10:02:331
672299120,11cyclictest0-21swapper/112:37:401
672299120,11cyclictest0-21swapper/112:02:361
672299120,11cyclictest0-21swapper/111:28:181
6717991210,1cyclictest0-21swapper/012:24:550
6717991210,1cyclictest0-21swapper/012:00:270
6717991210,1cyclictest0-21swapper/011:57:060
6717991210,1cyclictest0-21swapper/011:27:570
6717991210,1cyclictest0-21swapper/010:10:220
671799120,1cyclictest20108-21sshd11:13:000
671799120,1cyclictest20108-21sshd11:13:000
671799120,1cyclictest18673-21sshd09:36:300
671799120,1cyclictest18673-21sshd09:36:300
671799120,1cyclictest16821-21sshd10:48:250
671799120,1cyclictest0-21swapper/012:29:210
671799120,1cyclictest0-21swapper/011:50:550
671799120,1cyclictest0-21swapper/011:44:440
671799120,1cyclictest0-21swapper/010:04:270
671799120,11cyclictest0-21swapper/009:59:130
671799120,11cyclictest0-21swapper/009:52:540
671799120,11cyclictest0-21swapper/009:26:250
255012120,0sleep00-21swapper/010:35:140
676099119,1cyclictest0-21swapper/712:24:217
676099119,1cyclictest0-21swapper/712:07:407
676099119,1cyclictest0-21swapper/711:51:577
676099119,1cyclictest0-21swapper/711:39:357
676099119,1cyclictest0-21swapper/707:50:007
676099110,10cyclictest0-21swapper/711:10:417
676099110,10cyclictest0-21swapper/711:10:417
675599119,1cyclictest0-21swapper/611:44:356
675599119,1cyclictest0-21swapper/610:55:236
675599119,1cyclictest0-21swapper/610:04:116
675599119,1cyclictest0-21swapper/609:21:026
675599118,2cyclictest662-21gdbus09:57:116
675599110,10cyclictest0-21swapper/611:03:036
675599110,10cyclictest0-21swapper/611:03:036
675599110,10cyclictest0-21swapper/609:27:216
674899113,2cyclictest0-21swapper/507:20:185
674899112,3cyclictest0-21swapper/507:45:175
674899111,3cyclictest0-21swapper/509:00:165
674899111,3cyclictest0-21swapper/508:55:145
674899111,3cyclictest0-21swapper/508:45:145
674899111,3cyclictest0-21swapper/508:40:135
674899111,3cyclictest0-21swapper/508:25:205
674899111,3cyclictest0-21swapper/508:10:155
674899111,3cyclictest0-21swapper/507:55:185
674899111,3cyclictest0-21swapper/507:50:135
674899111,3cyclictest0-21swapper/507:40:155
674899111,3cyclictest0-21swapper/507:30:185
674899111,3cyclictest0-21swapper/507:25:175
674399119,1cyclictest1-21systemd12:15:384
674399119,1cyclictest0-21swapper/411:56:414
674399119,1cyclictest0-21swapper/407:25:174
674399118,2cyclictest0-21swapper/411:10:264
674399118,2cyclictest0-21swapper/411:10:264
673499114,2cyclictest19323-21cat08:40:173
673499113,5cyclictest31193-21gltestperf09:05:143
673499113,5cyclictest28286-21cat09:00:123
673499113,2cyclictest7924-21users08:15:223
672899119,1cyclictest1-21systemd11:00:432
672899119,1cyclictest1-21systemd11:00:432
672899119,1cyclictest0-21swapper/212:27:092
672899119,1cyclictest0-21swapper/212:02:422
672899110,6cyclictest0-21swapper/208:35:142
672899110,1cyclictest0-21swapper/211:53:412
672299119,1cyclictest0-21swapper/107:50:181
672299118,2cyclictest0-21swapper/112:33:131
672299113,4cyclictest0-21swapper/108:33:461
672299110,3cyclictest0-21swapper/110:31:431
672299110,10cyclictest0-21swapper/110:28:461
671799119,1cyclictest0-21swapper/010:50:340
671799110,10cyclictest0-21swapper/011:22:250
231642110,0sleep1231ktimersoftd/107:40:221
676099108,1cyclictest662-21gdbus10:10:127
676099108,1cyclictest0-21swapper/712:32:087
676099108,1cyclictest0-21swapper/709:30:257
676099108,1cyclictest0-21swapper/709:30:257
676099100,9cyclictest8150-21sshd09:49:277
676099100,9cyclictest8150-21sshd09:49:277
675599103,6cyclictest0-21swapper/608:18:346
675599100,3cyclictest0-21swapper/607:50:136
674899101,2cyclictest0-21swapper/508:05:145
674899100,2cyclictest0-21swapper/508:30:175
674399108,1cyclictest0-21swapper/411:47:084
673499105,3cyclictest574-21crond08:01:003
673499105,3cyclictest1-21systemd07:20:003
673499104,4cyclictest26446-21grep07:50:123
672899108,1cyclictest704-21systemd-logind09:59:342
672899108,1cyclictest0-21swapper/208:55:192
672899104,4cyclictest738-21gdbus10:49:452
672899100,2cyclictest9814-21sshd10:52:052
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional