You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 05:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Dec 19, 2025 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
269612940,0sleep62950299cyclictest00:12:466
109222710,2sleep12945999cyclictest22:22:301
2911724925,9sleep60-21swapper/619:08:016
2917224825,8sleep70-21swapper/719:08:507
285702480,1sleep128547-21bash23:44:471
138912450,0sleep60-21swapper/622:58:476
171992430,1sleep217196-21systemd22:30:482
2923924130,8sleep50-21swapper/519:09:445
2889424128,9sleep40-21swapper/419:05:434
303932400,0sleep30-21swapper/322:34:013
2889924016,8sleep00-21swapper/019:05:470
170692400,0sleep50-21swapper/500:03:335
7722390,0sleep10-21swapper/122:41:281
2889123928,8sleep10-21swapper/119:05:401
2886623926,9sleep30-21swapper/319:05:183
201082390,0sleep40-21swapper/421:20:344
128522390,0sleep20-21swapper/222:01:332
2903823826,8sleep20-21swapper/219:07:012
29486991813,3cyclictest49-21ksoftirqd/422:09:174
29459991812,2cyclictest29267-21systemd00:05:561
2948699173,4cyclictest49-21ksoftirqd/400:35:554
29486991712,3cyclictest49-21ksoftirqd/421:43:484
29486991710,4cyclictest49-21ksoftirqd/421:58:574
2948699168,3cyclictest49-21ksoftirqd/421:37:454
29486991615,1cyclictest49-21ksoftirqd/422:38:014
29486991614,1cyclictest49-21ksoftirqd/423:40:064
29486991614,1cyclictest49-21ksoftirqd/421:59:524
29486991613,1cyclictest49-21ksoftirqd/422:46:514
29486991611,3cyclictest49-21ksoftirqd/400:01:094
92902150,0sleep30-21swapper/321:25:143
29486991514,1cyclictest49-21ksoftirqd/423:47:484
29486991514,1cyclictest49-21ksoftirqd/423:31:094
29486991514,1cyclictest49-21ksoftirqd/400:29:474
29486991513,1cyclictest49-21ksoftirqd/423:35:244
29486991513,1cyclictest49-21ksoftirqd/422:32:514
29486991513,1cyclictest49-21ksoftirqd/400:18:414
29486991511,3cyclictest49-21ksoftirqd/422:09:484
29486991511,3cyclictest49-21ksoftirqd/421:16:114
29486991511,1cyclictest49-21ksoftirqd/422:26:394
29486991510,3cyclictest49-21ksoftirqd/423:13:124
29486991510,3cyclictest49-21ksoftirqd/422:59:434
29486991413,1cyclictest49-21ksoftirqd/422:50:314
29486991413,1cyclictest49-21ksoftirqd/422:18:534
29486991413,1cyclictest49-21ksoftirqd/421:10:274
29486991413,1cyclictest49-21ksoftirqd/400:20:004
29486991413,1cyclictest49-21ksoftirqd/400:20:004
29486991413,1cyclictest10574-21kworker/4:400:31:374
29486991412,1cyclictest49-21ksoftirqd/423:56:554
29486991412,1cyclictest49-21ksoftirqd/423:25:134
29486991412,1cyclictest49-21ksoftirqd/423:20:044
29486991412,1cyclictest49-21ksoftirqd/423:00:134
29486991412,1cyclictest49-21ksoftirqd/421:45:194
29486991411,2cyclictest49-21ksoftirqd/421:50:424
29486991410,1cyclictest49-21ksoftirqd/400:07:234
2948699140,1cyclictest131rcu_sched22:42:354
2948699140,1cyclictest131rcu_sched21:26:494
29470991412,2cyclictest13550irq/24-ahci[00023:14:552
29452991412,1cyclictest7600-21sshd21:39:290
256092140,1sleep125608-21systemd-cgroups23:58:161
319302130,0sleep00-21swapper/019:11:470
29502991312,1cyclictest65-21ksoftirqd/600:17:206
2949499139,1cyclictest57-21ksoftirqd/520:14:475
2949499137,5cyclictest31359-21systemd00:20:395
2949499137,5cyclictest31359-21systemd00:20:395
29486991312,1cyclictest49-21ksoftirqd/400:10:154
29486991311,1cyclictest49-21ksoftirqd/423:49:544
29486991311,1cyclictest49-21ksoftirqd/423:06:404
29486991311,1cyclictest49-21ksoftirqd/422:21:314
29486991311,1cyclictest49-21ksoftirqd/421:30:004
29486991311,1cyclictest49-21ksoftirqd/419:35:044
29486991311,1cyclictest49-21ksoftirqd/419:35:044
2947999132,5cyclictest691-21systemd-logind22:24:533
29470991310,1cyclictest3922-1kworker/2:1H00:17:362
244752130,0sleep10-21swapper/100:12:091
181732130,0sleep00-21swapper/022:31:020
108812130,0sleep70-21swapper/723:26:197
2951099127,3cyclictest73-21ksoftirqd/721:45:247
2951099120,11cyclictest0-21swapper/722:28:297
29502991211,1cyclictest65-21ksoftirqd/621:15:026
29502991210,1cyclictest65-21ksoftirqd/622:24:366
29486991211,1cyclictest49-21ksoftirqd/423:15:024
29486991210,1cyclictest49-21ksoftirqd/421:05:024
29486991210,1cyclictest49-21ksoftirqd/419:25:084
2947999122,4cyclictest15909-21kworker/u16:022:02:183
2947999121,10cyclictest691-21systemd-logind22:20:363
29470991210,1cyclictest33-21ksoftirqd/200:08:432
29459991210,1cyclictest1-21systemd23:15:401
2945999120,1cyclictest0-21swapper/122:10:591
29452991210,2cyclictest6180-21kworker/0:023:50:010
2945299120,11cyclictest1-21systemd00:39:150
168102120,0sleep70-21swapper/723:41:567
2951099113,4cyclictest691-21systemd-logind22:48:077
2951099110,10cyclictest0-21swapper/723:59:467
2951099110,1cyclictest7647-21systemd-cgroups00:22:477
2951099110,1cyclictest7647-21systemd-cgroups00:22:477
2950299119,1cyclictest65-21ksoftirqd/621:20:216
29502991110,1cyclictest65-21ksoftirqd/600:36:586
29502991110,1cyclictest65-21ksoftirqd/600:21:326
29502991110,1cyclictest65-21ksoftirqd/600:21:326
2950299110,1cyclictest12236-21systemd-cgroups23:40:486
2949499116,5cyclictest0-21swapper/519:38:405
2949499116,5cyclictest0-21swapper/519:38:405
2949499113,7cyclictest885-21polkitd21:36:045
2949499111,4cyclictest885-21polkitd00:30:475
2949499111,4cyclictest691-21systemd-logind22:47:245
2949499110,11cyclictest4114-21kworker/5:023:06:435
2949499110,11cyclictest4114-21kworker/5:023:00:065
2949499110,1cyclictest30922-21sshd23:38:025
2948699119,1cyclictest49-21ksoftirqd/419:15:004
29486991110,1cyclictest29068-21kworker/4:219:10:574
2947999115,2cyclictest28180-21systemd21:57:593
2947999112,4cyclictest15695-21systemd-cgroups23:41:393
2947999110,10cyclictest0-21swapper/320:55:003
2947099119,1cyclictest33-21ksoftirqd/223:28:512
2947099119,1cyclictest33-21ksoftirqd/200:32:052
29470991110,1cyclictest33-21ksoftirqd/221:26:442
2945999119,1cyclictest25-21ksoftirqd/100:25:321
29459991110,1cyclictest25-21ksoftirqd/122:25:591
2945999110,11cyclictest0-21swapper/121:12:091
2945299119,1cyclictest9-21ksoftirqd/022:01:340
2945299119,1cyclictest18003-21systemd00:10:330
2945299115,1cyclictest25061-21kworker/u16:423:05:350
2945299113,4cyclictest763-21NetworkManager23:16:020
2945299113,4cyclictest686-21dbus-daemon00:16:170
2945299113,4cyclictest10496-21systemd-cgroups00:30:170
2945299112,3cyclictest0-21swapper/022:45:370
2945299110,5cyclictest0-21swapper/022:43:050
2945299110,1cyclictest492-21systemd-journal00:19:520
2945299110,1cyclictest492-21systemd-journal00:19:520
227072110,0sleep70-21swapper/700:11:437
39252100,0sleep60-21swapper/622:14:026
2951099108,1cyclictest73-21ksoftirqd/722:52:557
2951099101,5cyclictest6538-21sshd00:29:497
2951099100,10cyclictest8230-21kworker/7:623:03:217
2950299109,1cyclictest65-21ksoftirqd/623:21:496
2950299108,2cyclictest0-21swapper/619:38:406
2950299108,2cyclictest0-21swapper/619:38:406
2950299108,1cyclictest65-21ksoftirqd/622:47:406
2950299108,1cyclictest65-21ksoftirqd/622:35:006
2950299108,1cyclictest65-21ksoftirqd/621:42:466
2950299107,2cyclictest12598-21grepconf.sh22:44:226
2950299107,2cyclictest12423-21systemd21:11:596
2950299107,2cyclictest0-21swapper/623:55:296
2950299100,1cyclictest0-21swapper/600:04:276
2949499109,1cyclictest0-21swapper/523:59:285
2949499108,1cyclictest57-21ksoftirqd/521:30:295
2949499103,6cyclictest21237-21sshd22:17:415
2949499101,5cyclictest686-21dbus-daemon00:38:005
2949499101,3cyclictest19686-21systemd-cgroups21:49:105
2949499100,4cyclictest691-21systemd-logind23:54:115
2949499100,4cyclictest31225-21sshd21:23:175
2949499100,4cyclictest15961-21systemd22:51:565
2949499100,4cyclictest0-21swapper/521:54:315
2949499100,10cyclictest4771-21kworker/5:121:24:535
2949499100,10cyclictest32756-21kworker/5:423:46:395
2949499100,10cyclictest0-21swapper/521:41:505
2949499100,1cyclictest0-21swapper/523:14:325
2948699109,1cyclictest29068-21kworker/4:220:30:214
2948699109,1cyclictest29068-21kworker/4:220:10:034
29486991010,0cyclictest29068-21kworker/4:220:29:074
29486991010,0cyclictest29068-21kworker/4:220:29:074
2947999109,1cyclictest7558-21sshd00:15:223
2947999109,1cyclictest1-21systemd21:52:323
2947999101,4cyclictest17018-21sshd21:13:063
2947999100,4cyclictest885-21polkitd21:38:333
2947999100,10cyclictest0-21swapper/322:16:393
2947999100,10cyclictest0-21swapper/321:22:253
2947099109,1cyclictest33-21ksoftirqd/223:57:202
2947099109,1cyclictest33-21ksoftirqd/200:14:192
2947099109,1cyclictest0-21swapper/221:12:552
2947099108,1cyclictest33-21ksoftirqd/222:55:252
2947099103,1cyclictest4755-21systemd-cgroups00:00:292
2947099102,4cyclictest686-21dbus-daemon21:47:052
2947099100,10cyclictest0-21swapper/221:42:052
2945999109,1cyclictest25-21ksoftirqd/123:32:131
2945999109,1cyclictest25-21ksoftirqd/122:15:541
2945999109,1cyclictest11979-21sshd00:38:031
2945999106,1cyclictest686-21dbus-daemon21:29:421
2945999104,3cyclictest691-21systemd-logind22:36:031
2945999100,10cyclictest0-21swapper/100:20:031
2945999100,10cyclictest0-21swapper/100:20:031
2945299109,1cyclictest9-21ksoftirqd/023:13:340
2945299109,1cyclictest9-21ksoftirqd/022:05:230
2945299108,1cyclictest17600-21kworker/u16:122:36:330
2945299108,1cyclictest13991-21bash23:41:140
2945299107,1cyclictest1-21systemd21:16:470
2945299104,3cyclictest10325-21systemd-cgroups21:46:520
2945299104,3cyclictest1-21systemd22:16:440
2945299102,4cyclictest0-21swapper/020:34:470
2945299100,10cyclictest0-21swapper/021:25:390
295109997,1cyclictest73-21ksoftirqd/700:07:577
295109993,5cyclictest8302-21sshd21:10:587
295109993,1cyclictest0-21swapper/721:55:387
295109993,1cyclictest0-21swapper/721:40:497
295109992,3cyclictest12074-21systemd-cgroups22:15:257
295109990,9cyclictest8377-21kworker/7:223:12:417
295109990,9cyclictest32711-21kworker/7:422:23:087
295109990,9cyclictest0-21swapper/723:50:287
295109990,9cyclictest0-21swapper/723:45:357
295109990,9cyclictest0-21swapper/723:20:037
295109990,9cyclictest0-21swapper/722:11:477
295109990,9cyclictest0-21swapper/722:06:537
295109990,9cyclictest0-21swapper/721:17:237
295109990,9cyclictest0-21swapper/700:18:227
295109990,9cyclictest0-21swapper/700:04:407
295109990,8cyclictest14947-21kworker/7:221:31:157
295109990,6cyclictest8296-21sshd21:53:427
295109990,5cyclictest32088-21systemd-cgroups00:35:077
295109990,0cyclictest0-21swapper/721:19:557
295109990,0cyclictest0-21swapper/720:55:007
295029999,0cyclictest0-21swapper/622:01:106
295029998,1cyclictest65-21ksoftirqd/622:26:486
295029997,1cyclictest65-21ksoftirqd/622:15:226
295029997,1cyclictest65-21ksoftirqd/622:07:216
295029997,1cyclictest65-21ksoftirqd/621:55:076
295029997,1cyclictest65-21ksoftirqd/621:50:526
295029996,1cyclictest65-21ksoftirqd/621:45:366
295029996,1cyclictest65-21ksoftirqd/600:25:186
295029994,3cyclictest0-21swapper/600:05:096
295029990,5cyclictest691-21systemd-logind21:26:016
294949993,3cyclictest27793-21sshd23:30:045
294949992,6cyclictest11933-21sshd22:01:195
294949992,4cyclictest887-21gdbus22:21:065
294949991,7cyclictest23975-21systemd00:05:035
294949990,9cyclictest0-21swapper/523:15:015
294869998,1cyclictest49-21ksoftirqd/420:35:024
294869998,1cyclictest49-21ksoftirqd/419:45:084
294869998,1cyclictest49-21ksoftirqd/419:44:484
294869998,1cyclictest49-21ksoftirqd/419:29:584
294869998,1cyclictest29068-21kworker/4:220:47:514
294869998,1cyclictest29068-21kworker/4:219:59:194
294869997,1cyclictest49-21ksoftirqd/421:00:044
294869997,1cyclictest49-21ksoftirqd/419:24:474
294799999,0cyclictest0-21swapper/323:31:043
294799993,6cyclictest0-21swapper/323:56:293
294799993,1cyclictest24432-21kworker/3:123:23:123
294799993,1cyclictest0-21swapper/300:14:223
294799992,6cyclictest885-21polkitd23:26:163
294799992,6cyclictest691-21systemd-logind00:30:223
294799992,1cyclictest691-21systemd-logind22:40:233
294799990,9cyclictest0-21swapper/322:06:533
294799990,9cyclictest0-21swapper/321:45:273
294709998,1cyclictest686-21dbus-daemon21:35:082
294709997,1cyclictest1-21systemd22:49:062
294709996,2cyclictest33-21ksoftirqd/223:13:512
294709996,2cyclictest33-21ksoftirqd/222:43:332
294709995,1cyclictest691-21systemd-logind22:15:122
294709994,4cyclictest691-21systemd-logind23:21:292
294709994,2cyclictest1-21systemd23:02:232
294709994,1cyclictest17338-21sshd23:06:242
294709993,4cyclictest885-21polkitd22:21:022
294709993,3cyclictest691-21systemd-logind22:11:042
294709992,6cyclictest13103-21systemd-cgroups23:34:142
294709990,9cyclictest4451-21kworker/2:500:37:052
294709990,9cyclictest0-21swapper/223:38:162
294709990,9cyclictest0-21swapper/221:52:192
294709990,6cyclictest4713-21systemd-cgroups00:22:032
294709990,6cyclictest4713-21systemd-cgroups00:22:032
294599999,0cyclictest0-21swapper/122:01:491
294599999,0cyclictest0-21swapper/121:22:431
294599998,1cyclictest25-21ksoftirqd/121:16:401
294599998,1cyclictest0-21swapper/123:20:201
294599997,1cyclictest25-21ksoftirqd/122:47:441
294599997,1cyclictest25-21ksoftirqd/121:56:281
294599997,1cyclictest25-21ksoftirqd/121:35:381
294599997,1cyclictest25-21ksoftirqd/120:44:471
294599996,2cyclictest25-21ksoftirqd/100:17:251
294599994,3cyclictest361-21kworker/1:422:51:401
294599992,3cyclictest3786-21sshd23:53:281
294599990,9cyclictest0-21swapper/123:29:001
294599990,9cyclictest0-21swapper/122:07:101
294599990,0cyclictest0-21swapper/123:45:241
294529999,0cyclictest0-21swapper/022:50:560
294529999,0cyclictest0-21swapper/022:09:570
294529994,1cyclictest25829-21systemd-cgroups23:36:460
294529993,5cyclictest1-21systemd21:52:180
294529993,3cyclictest686-21dbus-daemon22:59:380
294529993,3cyclictest686-21dbus-daemon21:14:190
294529993,3cyclictest686-21dbus-daemon00:09:160
294529993,3cyclictest17761-21systemd-cgroups00:25:000
294529992,5cyclictest0-21swapper/023:32:470
294529990,9cyclictest0-21swapper/021:42:120
294529990,8cyclictest6180-21kworker/0:000:00:570
294529990,8cyclictest10768-21kworker/0:421:55:150
294529990,3cyclictest0-21swapper/019:40:490
2853290,0sleep00-21swapper/019:19:470
295109988,0cyclictest0-21swapper/722:41:537
295109986,1cyclictest73-21ksoftirqd/721:35:267
295109985,2cyclictest686-21dbus-daemon23:17:277
295109983,1cyclictest20464-21systemd-cgroups21:27:587
295109982,3cyclictest28250-21systemd23:30:077
295109982,3cyclictest0-21swapper/722:38:457
295109982,2cyclictest6615-21systemd22:00:087
295109982,2cyclictest0-21swapper/722:30:017
295109981,4cyclictest12645-21systemd-cgroups23:05:147
295109980,7cyclictest14722-21kworker/7:223:36:437
295029988,0cyclictest0-21swapper/623:46:106
295029987,1cyclictest65-21ksoftirqd/600:33:346
295029986,1cyclictest65-21ksoftirqd/623:35:466
295029986,1cyclictest65-21ksoftirqd/623:30:246
295029986,1cyclictest65-21ksoftirqd/623:10:196
295029986,1cyclictest65-21ksoftirqd/622:30:056
295029984,3cyclictest21180-21sshd21:35:056
295029983,2cyclictest14241-21systemd21:33:476
295029980,8cyclictest26215-21kworker/6:423:16:206
295029980,8cyclictest0-21swapper/623:51:036
295029980,7cyclictest26215-21kworker/6:423:25:426
294949988,0cyclictest0-21swapper/522:30:145
294949987,1cyclictest0-21swapper/500:13:405
294949983,5cyclictest0-21swapper/521:56:405
294949983,4cyclictest23126-21sshd21:14:375
294949983,1cyclictest0-21swapper/520:47:245
294949983,0cyclictest0-21swapper/522:35:415
294949982,3cyclictest23959-21systemd-cgroups00:19:265
294949980,8cyclictest32756-21kworker/5:423:40:075
294949980,7cyclictest691-21systemd-logind23:20:305
294949980,7cyclictest32064-21sshd22:41:115
294949980,7cyclictest27966-21kworker/5:422:09:545
294949980,7cyclictest1-21systemd23:28:565
294949980,2cyclictest885-21polkitd22:58:175
294949980,2cyclictest32033-21sshd22:05:395
294949980,1cyclictest0-21swapper/522:25:545
294869988,0cyclictest29068-21kworker/4:219:53:574
294869986,1cyclictest49-21ksoftirqd/420:00:094
294869983,2cyclictest0-21swapper/420:49:484
294799988,0cyclictest0-21swapper/322:56:523
294799988,0cyclictest0-21swapper/321:40:053
294799988,0cyclictest0-21swapper/321:32:023
294799988,0cyclictest0-21swapper/319:45:003
294799987,1cyclictest41-21ksoftirqd/323:49:563
294799986,1cyclictest41-21ksoftirqd/323:05:343
294799986,1cyclictest41-21ksoftirqd/322:45:393
294799986,1cyclictest41-21ksoftirqd/321:15:163
294799986,1cyclictest41-21ksoftirqd/319:19:473
294799985,2cyclictest885-21polkitd23:16:113
294799985,2cyclictest885-21polkitd00:09:333
294799985,2cyclictest708-21nscd23:39:273
294799983,1cyclictest0-21swapper/320:36:333
294799982,1cyclictest0-21swapper/323:14:253
294799980,8cyclictest9109-21kworker/3:522:36:533
294799980,8cyclictest28868-21kworker/3:000:21:343
294799980,8cyclictest28868-21kworker/3:000:21:343
294799980,7cyclictest17059-21systemd-cgroups22:52:123
294799980,5cyclictest691-21systemd-logind22:10:283
294799980,0cyclictest0-21swapper/300:27:123
294709986,1cyclictest33-21ksoftirqd/220:24:472
294709986,1cyclictest33-21ksoftirqd/219:24:542
294709986,1cyclictest13550irq/24-ahci[00023:45:032
294709985,2cyclictest686-21dbus-daemon21:22:172
294709984,1cyclictest686-21dbus-daemon21:14:552
294709984,1cyclictest14003-21systemd-cgroups23:41:142
294709983,3cyclictest5407-21sshd22:35:152
294709983,2cyclictest13996-21systemd21:33:432
294709983,2cyclictest0-21swapper/220:03:532
294709982,3cyclictest763-21NetworkManager23:49:592
294709982,3cyclictest16127-21sshd21:55:072
294709980,5cyclictest0-21swapper/222:25:042
294599988,0cyclictest0-21swapper/119:50:011
294599987,1cyclictest25-21ksoftirqd/100:00:461
294599986,1cyclictest25-21ksoftirqd/123:11:201
294599986,1cyclictest25-21ksoftirqd/123:05:591
294599986,1cyclictest25-21ksoftirqd/122:57:281
294599986,1cyclictest25-21ksoftirqd/121:40:581
294599986,1cyclictest25-21ksoftirqd/121:30:591
294599985,1cyclictest686-21dbus-daemon22:59:471
294599982,3cyclictest22787-21systemd22:32:101
294599982,3cyclictest0-21swapper/121:50:231
294599981,3cyclictest443-21kworker/1:221:44:521
294599980,5cyclictest25613-21sshd23:36:441
294599980,5cyclictest11228-21awk19:34:471
294529988,0cyclictest0-21swapper/020:15:110
294529986,1cyclictest9-21ksoftirqd/023:55:180
294529986,1cyclictest9-21ksoftirqd/021:20:300
294529985,2cyclictest9828-21grepconf.sh23:26:030
294529983,2cyclictest0-21swapper/022:29:270
294529983,2cyclictest0-21swapper/020:00:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional