You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 04:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri May 01, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29273998969,1cyclictest9-21ksoftirqd/022:54:540
226042740,0sleep30-21swapper/321:45:123
29299997370,2cyclictest19189-21bash22:54:556
146162690,0sleep3391rcuc/321:33:353
29294996140,1cyclictest0-21swapper/322:54:543
234292590,0sleep30-21swapper/323:38:303
180592580,1sleep418060-21grep21:28:074
29300995331,22cyclictest0-21swapper/722:54:547
114842520,0sleep20-21swapper/222:16:352
2903125027,8sleep10-21swapper/119:08:241
25772500,2sleep02927399cyclictest22:14:170
323492490,1sleep432347-21grep23:54:164
21562490,0sleep60-21swapper/621:21:376
2887624825,8sleep60-21swapper/619:06:216
121882480,2sleep02927399cyclictest22:14:490
120972480,0sleep40-21swapper/422:54:344
99842470,1sleep6758-21runrttasks00:08:206
85552470,0sleep40-21swapper/423:07:234
54942470,0sleep00-21swapper/021:27:230
32602470,0sleep20-21swapper/223:56:232
32602470,0sleep20-21swapper/223:56:232
308892470,1sleep7721ktimersoftd/722:40:277
99712460,0sleep10-21swapper/121:53:591
86732460,0sleep10-21swapper/100:25:131
10812460,0sleep00-21swapper/023:52:120
66202440,0sleep00-21swapper/000:19:350
241422440,1sleep233-21ksoftirqd/223:29:082
218472440,0sleep00-21swapper/022:45:320
259442430,2sleep72930099cyclictest00:05:257
232932430,0sleep60-21swapper/623:06:216
144882430,1sleep414485-21sshd21:46:424
5132420,0sleep3487-21sshd22:31:103
2929899422,40cyclictest0-21swapper/522:54:535
2890924230,8sleep40-21swapper/419:06:434
266912420,1sleep326690-21grepconf.sh23:02:493
208372420,0sleep30-21swapper/322:17:083
197902420,0sleep00-21swapper/019:49:380
14912420,0sleep70-21swapper/721:51:337
136272420,0sleep60-21swapper/600:27:266
57352410,0sleep70-21swapper/723:58:287
57352410,0sleep70-21swapper/723:58:287
324192410,0sleep30-21swapper/323:44:383
2908224128,9sleep30-21swapper/319:09:063
2878524129,9sleep00-21swapper/019:05:030
281802410,0sleep30-21swapper/300:01:363
281802410,0sleep30-21swapper/300:01:363
317602400,0sleep30-21swapper/322:29:183
275052400,0sleep5721-21dbus-daemon21:36:095
215782400,0sleep70-21swapper/700:20:227
291922390,1sleep029193-21sshd23:31:140
2893223928,8sleep50-21swapper/519:07:005
2885923927,8sleep70-21swapper/719:06:067
2927699380,37cyclictest18866-21sshd22:54:531
2881623826,8sleep20-21swapper/219:05:292
58402370,0sleep30-21swapper/323:26:043
324472370,0sleep50-21swapper/522:23:275
29297993535,0cyclictest10436-21kworker/4:322:54:544
2928799352,10cyclictest0-21swapper/222:54:542
171882350,0sleep00-21swapper/023:28:410
144882350,1sleep014491-21kworker/u16:100:21:520
96892210,0sleep10-21swapper/100:14:081
29294992115,4cyclictest41-21ksoftirqd/321:34:513
29294992115,3cyclictest41-21ksoftirqd/323:14:303
29294992110,1cyclictest41-21ksoftirqd/322:21:503
2929499208,1cyclictest41-21ksoftirqd/323:08:383
2929499204,1cyclictest41-21ksoftirqd/322:04:243
2929499203,1cyclictest41-21ksoftirqd/323:16:103
2929899191,0cyclictest0-21swapper/522:27:115
2929499195,3cyclictest41-21ksoftirqd/322:48:453
29294991915,1cyclictest41-21ksoftirqd/321:21:013
29294991913,3cyclictest41-21ksoftirqd/322:40:593
290102190,0sleep50-21swapper/522:30:565
327482180,0sleep70-21swapper/723:40:507
2929499186,1cyclictest41-21ksoftirqd/323:57:523
2929499186,1cyclictest41-21ksoftirqd/323:57:523
2929499185,1cyclictest41-21ksoftirqd/323:22:233
2929499185,1cyclictest41-21ksoftirqd/300:23:133
2929499184,1cyclictest41-21ksoftirqd/321:10:193
29294991817,1cyclictest41-21ksoftirqd/300:29:013
29294991816,1cyclictest41-21ksoftirqd/322:52:053
29294991815,2cyclictest41-21ksoftirqd/322:07:043
29294991815,2cyclictest41-21ksoftirqd/322:07:043
29294991814,3cyclictest41-21ksoftirqd/300:15:303
29294991814,1cyclictest41-21ksoftirqd/322:38:543
29294991811,1cyclictest41-21ksoftirqd/321:28:523
2929499181,3cyclictest41-21ksoftirqd/300:34:503
2927399187,5cyclictest0-21swapper/023:08:470
2927399187,5cyclictest0-21swapper/019:15:000
105132180,0sleep70-21swapper/723:47:077
43922170,1sleep54391-21grepconf.sh23:41:045
295542170,2sleep22928799cyclictest23:10:252
29299991714,2cyclictest65-21ksoftirqd/622:14:566
2929899178,8cyclictest24746-21bash23:25:155
2929899170,5cyclictest0-21swapper/522:15:395
2929499175,1cyclictest41-21ksoftirqd/323:50:253
29294991716,1cyclictest41-21ksoftirqd/323:29:563
29294991716,1cyclictest41-21ksoftirqd/300:09:503
29294991715,1cyclictest41-21ksoftirqd/321:53:533
29294991715,1cyclictest41-21ksoftirqd/321:39:573
29294991713,3cyclictest41-21ksoftirqd/321:57:133
29294991712,3cyclictest41-21ksoftirqd/321:15:373
29294991710,4cyclictest41-21ksoftirqd/300:29:573
2927399177,0cyclictest0-21swapper/000:08:010
29299991614,1cyclictest65-21ksoftirqd/623:47:086
29299991614,1cyclictest65-21ksoftirqd/621:39:386
29299991613,2cyclictest65-21ksoftirqd/623:09:476
2929899168,2cyclictest24305-21cp23:17:455
29294991615,1cyclictest41-21ksoftirqd/322:12:103
29294991614,1cyclictest41-21ksoftirqd/323:39:533
29294991614,1cyclictest41-21ksoftirqd/300:07:143
2928799169,6cyclictest33-21ksoftirqd/221:19:272
29273991611,5cyclictest0-21swapper/000:35:030
29300991511,3cyclictest73-21ksoftirqd/723:05:327
2929999159,5cyclictest65-21ksoftirqd/623:35:076
29299991513,1cyclictest65-21ksoftirqd/623:33:196
29299991513,1cyclictest65-21ksoftirqd/622:44:576
29299991513,1cyclictest65-21ksoftirqd/622:25:596
29299991513,1cyclictest65-21ksoftirqd/621:17:006
29299991512,3cyclictest65-21ksoftirqd/623:56:166
29299991512,3cyclictest65-21ksoftirqd/623:56:166
2929999150,14cyclictest26118-21kworker/6:022:34:386
2929899156,2cyclictest7622-21grepconf.sh22:06:575
2929899156,2cyclictest7622-21grepconf.sh22:06:575
2927399158,6cyclictest9395-21sshd21:35:040
2927399154,6cyclictest0-21swapper/023:22:430
2927399154,5cyclictest0-21swapper/019:30:000
2927399153,9cyclictest1-21systemd22:00:570
2927399150,9cyclictest0-21swapper/023:18:150
2927399150,9cyclictest0-21swapper/021:09:080
280242150,0sleep7711rcuc/700:32:087
143002150,0sleep50-21swapper/500:29:265
108622150,1sleep110863-21kworker/u16:523:58:461
108622150,1sleep110863-21kworker/u16:523:58:461
81542140,0sleep40-21swapper/421:42:334
2929999147,5cyclictest65-21ksoftirqd/622:37:576
29299991413,1cyclictest65-21ksoftirqd/622:24:196
29299991412,1cyclictest65-21ksoftirqd/622:09:596
29299991412,1cyclictest65-21ksoftirqd/621:59:486
29299991412,1cyclictest65-21ksoftirqd/621:32:596
29299991412,1cyclictest65-21ksoftirqd/600:01:436
29299991412,1cyclictest65-21ksoftirqd/600:01:436
2929899144,6cyclictest464-21systemd-journal23:36:195
2929899143,2cyclictest464-21systemd-journal22:35:275
2929899141,5cyclictest0-21swapper/500:16:035
2929899140,5cyclictest20577-21sshd22:00:065
2929899140,1cyclictest13032-21sshd23:32:135
29287991412,2cyclictest33-21ksoftirqd/221:21:102
2927399149,5cyclictest0-21swapper/022:50:030
2927399149,0cyclictest0-21swapper/019:26:340
2927399148,6cyclictest0-21swapper/021:11:120
2927399148,5cyclictest0-21swapper/023:35:190
2927399144,3cyclictest17076-21kworker/u16:321:54:110
2927399143,1cyclictest15245-21kworker/u16:200:33:150
2927399142,6cyclictest0-21swapper/021:49:220
2927399142,0cyclictest0-21swapper/019:59:060
29273991411,2cyclictest9-21ksoftirqd/000:26:020
2927399141,7cyclictest0-21swapper/023:03:210
2927399140,8cyclictest0-21swapper/020:11:480
269032140,0sleep40-21swapper/423:21:414
261572140,1sleep773-21ksoftirqd/722:23:057
241632140,1sleep124165-21bash23:06:241
240942140,0sleep524085-21sshd21:32:095
53592130,0sleep20-21swapper/221:42:232
43132130,0sleep50-21swapper/521:29:135
32422130,0sleep70-21swapper/723:27:527
29299991312,1cyclictest65-21ksoftirqd/622:07:426
29299991312,1cyclictest65-21ksoftirqd/622:07:426
29299991312,1cyclictest65-21ksoftirqd/600:38:586
29299991311,1cyclictest65-21ksoftirqd/623:51:506
29299991311,1cyclictest65-21ksoftirqd/622:53:246
29299991311,1cyclictest65-21ksoftirqd/622:40:576
29299991311,1cyclictest65-21ksoftirqd/621:48:256
29299991311,1cyclictest65-21ksoftirqd/600:12:076
29299991310,2cyclictest8103-21sshd21:55:386
29299991310,2cyclictest65-21ksoftirqd/623:15:496
29299991310,2cyclictest65-21ksoftirqd/621:51:046
2929999130,13cyclictest7613-21kworker/6:100:33:206
2929999130,12cyclictest10588-21kworker/6:200:22:116
2929899139,3cyclictest17174-21sshd23:04:115
2929899138,1cyclictest21704-21sshd00:01:135
2929899138,1cyclictest21704-21sshd00:01:135
2929899136,1cyclictest721-21dbus-daemon23:21:555
2929899135,1cyclictest25054-21expr20:54:505
2929899132,0cyclictest0-21swapper/521:43:185
2929899131,5cyclictest721-21dbus-daemon23:07:015
2929899130,2cyclictest0-21swapper/523:54:395
2929899130,2cyclictest0-21swapper/523:54:395
2929899130,12cyclictest1-21systemd23:10:305
29297991311,1cyclictest49-21ksoftirqd/400:19:434
29297991311,1cyclictest49-21ksoftirqd/400:03:574
29297991311,1cyclictest49-21ksoftirqd/400:03:574
2929799130,12cyclictest20189-21kworker/4:200:15:194
2928799136,4cyclictest33-21ksoftirqd/222:09:492
29287991312,0cyclictest13550irq/24-ahci[00022:49:362
29287991311,2cyclictest33-21ksoftirqd/222:37:172
29287991311,1cyclictest33-21ksoftirqd/222:41:472
2927699138,1cyclictest30684-21kworker/1:121:21:561
2927699132,5cyclictest27840-21systemd21:56:491
29276991311,1cyclictest0-21swapper/100:37:071
2927699130,12cyclictest0-21swapper/123:59:411
2927699130,12cyclictest0-21swapper/123:59:411
2927399138,5cyclictest672-21sshd21:21:320
2927399138,5cyclictest0-21swapper/023:11:070
2927399138,5cyclictest0-21swapper/021:54:590
2927399138,5cyclictest0-21swapper/020:08:100
2927399138,5cyclictest0-21swapper/020:00:080
2927399138,5cyclictest0-21swapper/019:50:260
2927399138,5cyclictest0-21swapper/019:41:200
2927399138,5cyclictest0-21swapper/019:24:180
2927399138,5cyclictest0-21swapper/019:11:120
2927399138,5cyclictest0-21swapper/000:01:230
2927399138,5cyclictest0-21swapper/000:01:230
2927399138,0cyclictest0-21swapper/020:50:100
2927399137,5cyclictest14707-21sshd22:24:190
2927399137,1cyclictest0-21swapper/023:58:070
2927399137,1cyclictest0-21swapper/023:58:070
2927399132,6cyclictest0-21swapper/021:40:400
2927399132,5cyclictest0-21swapper/023:45:390
2927399132,5cyclictest0-21swapper/020:59:400
2927399132,5cyclictest0-21swapper/020:47:040
2927399132,0cyclictest0-21swapper/022:30:010
2927399130,8cyclictest0-21swapper/022:42:350
2759821310,1sleep665-21ksoftirqd/621:41:486
121052130,0sleep00-21swapper/023:41:310
2930099129,2cyclictest17838-21bash22:34:067
2930099122,4cyclictest857-21polkitd22:26:217
2930099122,4cyclictest31319-21sshd22:15:507
2930099122,4cyclictest20934-21sshd23:53:337
2930099121,5cyclictest709-21systemd-logind21:25:267
2930099120,12cyclictest14288-21kworker/7:521:13:577
2930099120,11cyclictest17875-21kworker/7:500:02:567
2930099120,11cyclictest17875-21kworker/7:500:02:567
29299991210,2cyclictest65-21ksoftirqd/623:21:596
29299991210,1cyclictest65-21ksoftirqd/623:40:316
29299991210,1cyclictest65-21ksoftirqd/623:25:116
29299991210,1cyclictest65-21ksoftirqd/623:00:286
29299991210,1cyclictest65-21ksoftirqd/621:10:366
2929899128,1cyclictest13053-21sshd00:37:035
2929899127,1cyclictest30423-21sshd21:45:445
2929899126,0cyclictest0-21swapper/519:49:245
2929899124,8cyclictest0-21swapper/520:05:485
2929899124,6cyclictest23310-21sshd23:49:455
2929899124,0cyclictest85250irq/26-em1-tx-021:10:265
2929899122,1cyclictest3540-21sshd00:07:575
29298991211,1cyclictest57-21ksoftirqd/521:19:325
29298991210,1cyclictest57-21ksoftirqd/522:43:085
2929899121,2cyclictest1803-21grepconf.sh00:21:075
2929899121,0cyclictest0-21swapper/522:48:135
2929899120,3cyclictest0-21swapper/521:23:345
2929899120,3cyclictest0-21swapper/500:09:575
2929799129,2cyclictest3975-21systemd23:25:564
2929799129,1cyclictest5515-21kworker/4:422:32:094
2929799128,1cyclictest49-21ksoftirqd/422:38:424
29297991210,1cyclictest49-21ksoftirqd/400:33:314
2929799120,11cyclictest721-21dbus-daemon21:58:274
2928799129,2cyclictest29214-21sshd00:13:202
2928799122,3cyclictest7635-21sshd22:50:192
2928799120,2cyclictest20393-21sshd21:30:012
2928799120,12cyclictest22186-21kworker/2:500:17:292
2928799120,11cyclictest13771-21kworker/2:000:03:382
2928799120,11cyclictest13771-21kworker/2:000:03:382
2927699127,1cyclictest25-21ksoftirqd/100:30:121
2927699122,4cyclictest28024-21grep21:36:111
2927699122,4cyclictest15008-21sshd23:26:391
29276991210,1cyclictest25-21ksoftirqd/121:18:141
2927399128,0cyclictest0-21swapper/020:58:500
2927399128,0cyclictest0-21swapper/019:36:240
2927399127,5cyclictest22795-21sshd22:26:390
2927399127,5cyclictest0-21swapper/022:38:170
2927399127,5cyclictest0-21swapper/020:29:480
2927399127,5cyclictest0-21swapper/020:17:000
2927399127,5cyclictest0-21swapper/020:17:000
2927399127,5cyclictest0-21swapper/000:13:130
29273991210,1cyclictest9-21ksoftirqd/022:06:530
29273991210,1cyclictest9-21ksoftirqd/022:06:530
29273991210,1cyclictest9-21ksoftirqd/021:15:450
29273991210,1cyclictest25828-21bash21:30:200
2927399120,6cyclictest0-21swapper/020:20:040
2927399120,0cyclictest0-21swapper/020:40:040
2927399120,0cyclictest0-21swapper/020:35:480
257892120,0sleep10-21swapper/122:42:051
252432120,0sleep10-21swapper/121:32:131
175112120,0sleep2321ktimersoftd/223:49:262
12322120,0sleep40-21swapper/400:38:224
301862110,0sleep40-21swapper/423:10:274
2930099119,1cyclictest73-21ksoftirqd/721:56:197
2930099119,1cyclictest73-21ksoftirqd/721:49:117
2930099119,1cyclictest0-21swapper/721:30:437
2930099118,2cyclictest770-21systemd00:09:457
2930099118,2cyclictest2845-21sshd00:38:277
2930099114,4cyclictest3601-21sshd23:10:487
2930099111,5cyclictest25240-21sd-pam21:22:577
2930099111,4cyclictest709-21systemd-logind23:15:567
2930099111,4cyclictest22388-21sshd23:32:467
2930099111,4cyclictest0-21swapper/723:01:027
2930099111,4cyclictest0-21swapper/721:38:507
2930099110,5cyclictest29601-21grepconf.sh22:12:027
2930099110,5cyclictest1951-21systemd23:22:087
2930099110,11cyclictest17699-21kworker/7:100:25:047
2930099110,11cyclictest16544-21kworker/7:222:49:537
2930099110,11cyclictest16544-21kworker/7:222:48:377
2930099110,10cyclictest14288-21kworker/7:521:14:567
2930099110,10cyclictest0-21swapper/720:44:527
2929999119,1cyclictest65-21ksoftirqd/600:15:096
2929999118,2cyclictest65-21ksoftirqd/621:24:566
2929899118,2cyclictest1-21systemd22:13:075
2929899115,6cyclictest0-21swapper/521:54:035
2929899114,0cyclictest0-21swapper/520:24:485
2929899112,5cyclictest1-21systemd23:47:005
2929899110,9cyclictest0-21swapper/519:12:345
2929899110,9cyclictest0-21swapper/500:33:555
2929899110,10cyclictest18246-21kworker/5:522:49:465
2929799119,1cyclictest721-21dbus-daemon21:52:374
2929799119,1cyclictest49-21ksoftirqd/422:27:354
2929799119,1cyclictest49-21ksoftirqd/422:21:124
2929799118,2cyclictest25603-21sshd23:15:554
2929799114,4cyclictest25154-21grepconf.sh21:19:114
29297991110,1cyclictest49-21ksoftirqd/422:44:434
29297991110,1cyclictest0-21swapper/422:42:544
2929799110,10cyclictest3264-21bash00:05:594
2929799110,1cyclictest721-21dbus-daemon22:09:004
2929799110,1cyclictest721-21dbus-daemon22:09:004
2929799110,1cyclictest4387-21sshd23:46:454
2929499119,1cyclictest41-21ksoftirqd/320:19:533
2928799119,2cyclictest33-21ksoftirqd/221:37:102
2928799119,1cyclictest33-21ksoftirqd/223:40:262
2928799119,1cyclictest33-21ksoftirqd/222:04:562
2928799119,1cyclictest33-21ksoftirqd/222:04:562
2928799119,1cyclictest33-21ksoftirqd/222:00:302
2928799119,1cyclictest33-21ksoftirqd/221:56:352
2928799119,1cyclictest33-21ksoftirqd/221:24:522
2928799117,3cyclictest3593-21sshd23:24:092
2928799110,11cyclictest8806-21kworker/2:300:36:502
2928799110,11cyclictest0-21swapper/200:05:182
2928799110,10cyclictest16183-21kworker/2:022:29:592
2928799110,10cyclictest10381-21kworker/2:421:50:432
2927699119,1cyclictest25-21ksoftirqd/123:53:221
2927699119,1cyclictest16705-21sshd23:41:471
2927699115,3cyclictest25330-21sshd22:00:231
2927699113,2cyclictest14664-21bash00:06:421
2927699112,4cyclictest721-21dbus-daemon22:15:551
2927699112,4cyclictest31339-21sshd22:25:141
2927699112,4cyclictest30096-21sshd23:35:001
2927699112,4cyclictest28158-21sshd22:51:361
2927699112,4cyclictest25611-21sshd23:46:061
2927699112,4cyclictest22677-21systemd21:24:401
2927699112,4cyclictest20132-21sshd23:19:281
2927699111,5cyclictest18806-21systemd22:07:371
2927699111,5cyclictest18806-21systemd22:07:371
2927699111,4cyclictest22233-21bash22:22:511
2927699110,5cyclictest18228-21bash23:02:201
2927699110,11cyclictest30386-21kworker/1:200:23:101
2927399110,0cyclictest0-21swapper/020:27:400
167222110,1sleep716724-21grepconf.sh21:41:087
2930099102,4cyclictest1-21systemd22:04:117
2930099100,4cyclictest4409-21sshd23:35:257
2930099100,10cyclictest5096-21kworker/7:122:05:087
2930099100,10cyclictest5096-21kworker/7:122:05:087
2930099100,10cyclictest0-21swapper/722:35:477
2930099100,10cyclictest0-21swapper/700:16:067
2929899108,2cyclictest0-21swapper/521:00:265
2929899108,2cyclictest0-21swapper/520:33:145
2929899105,5cyclictest0-21swapper/520:21:305
2929899105,5cyclictest0-21swapper/519:15:325
2929899104,5cyclictest22389-21grepconf.sh21:54:425
2929899104,3cyclictest0-21swapper/519:22:565
2929899104,0cyclictest0-21swapper/520:10:225
2929899104,0cyclictest0-21swapper/519:50:505
2929899100,9cyclictest0-21swapper/520:44:185
2929899100,4cyclictest0-21swapper/519:58:405
2929799109,1cyclictest49-21ksoftirqd/422:15:094
2929799108,1cyclictest49-21ksoftirqd/423:55:354
2929799108,1cyclictest49-21ksoftirqd/423:55:354
2929799108,1cyclictest49-21ksoftirqd/422:01:354
2929799108,1cyclictest49-21ksoftirqd/421:39:134
2929799108,1cyclictest0-21swapper/423:40:554
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional