You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-22 - 12:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sun Mar 22, 2026 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
312521090,0sleep4471rcuc/400:26:094
276112850,2sleep41144099cyclictest23:18:094
15052810,0sleep60-21swapper/621:15:416
130332730,2sleep71145799cyclictest21:38:337
286212700,2sleep51144799cyclictest00:06:565
317222550,1sleep01142499cyclictest00:16:360
84392540,0sleep00-21swapper/000:17:000
209632530,0sleep10-21swapper/121:06:551
273572510,1sleep127353-21bash22:16:391
266252500,1sleep7686-21dbus-daemon22:42:407
266252500,1sleep7686-21dbus-daemon22:42:407
196022480,1sleep319601-21bash00:34:333
12742480,0sleep50-21swapper/523:20:275
1117624824,9sleep10-21swapper/119:04:371
1101724826,18sleep70-21swapper/719:02:357
280922470,1sleep728079-21sshd23:38:477
280922470,1sleep728079-21sshd23:38:477
253472460,0sleep00-21swapper/022:09:010
160362460,0sleep00-21swapper/022:19:430
183642450,0sleep50-21swapper/500:13:535
137332440,0sleep10-21swapper/122:47:311
130242440,1sleep713018-21bash22:58:427
124262440,0sleep10-21swapper/121:12:321
221952430,0sleep6631rcuc/622:05:076
193552430,0sleep00-21swapper/023:06:360
182192430,0sleep218217-21systemd-cgroups22:10:322
12402430,0sleep70-21swapper/723:59:457
62642420,0sleep10-21swapper/122:06:061
23752420,0sleep00-21swapper/022:13:180
313082410,0sleep40-21swapper/400:07:034
282602410,1sleep128261-21grepconf.sh21:43:081
196982410,0sleep4481ktimersoftd/423:25:144
1104124129,8sleep00-21swapper/019:02:520
1130824027,9sleep30-21swapper/319:06:313
1129324029,8sleep60-21swapper/619:06:186
1125324022,15sleep20-21swapper/219:05:422
1121624028,9sleep50-21swapper/519:05:135
4752390,0sleep70-21swapper/723:01:477
211312390,0sleep60-21swapper/622:49:526
204202390,0sleep70-21swapper/723:30:547
204202390,0sleep70-21swapper/723:30:547
1101423928,8sleep40-21swapper/419:02:324
290462380,0sleep20-21swapper/221:54:222
224922370,0sleep70-21swapper/722:05:087
162272310,1sleep01142499cyclictest23:30:390
162272310,1sleep01142499cyclictest23:30:390
1144099269,1cyclictest49-21ksoftirqd/421:38:084
11457992117,3cyclictest73-21ksoftirqd/721:23:567
11457992117,1cyclictest73-21ksoftirqd/723:32:317
11457992117,1cyclictest73-21ksoftirqd/723:32:317
1144099214,3cyclictest49-21ksoftirqd/421:28:484
1144099213,4cyclictest49-21ksoftirqd/423:49:594
11440992117,1cyclictest49-21ksoftirqd/422:03:044
70212200,0sleep00-21swapper/021:49:230
45232200,0sleep40-21swapper/422:17:064
231782200,0sleep30-21swapper/322:42:283
231782200,0sleep30-21swapper/322:42:283
1145799207,3cyclictest73-21ksoftirqd/723:17:067
11457992018,1cyclictest73-21ksoftirqd/722:20:007
11457992017,1cyclictest73-21ksoftirqd/700:21:437
1145799201,1cyclictest73-21ksoftirqd/700:14:497
1144099205,2cyclictest49-21ksoftirqd/400:26:554
11440992018,1cyclictest492-21systemd-journal23:55:334
11440992018,1cyclictest49-21ksoftirqd/422:26:504
11440992017,1cyclictest49-21ksoftirqd/400:04:324
11440992016,3cyclictest49-21ksoftirqd/400:01:284
11427992016,3cyclictest33-21ksoftirqd/223:17:012
1145799198,1cyclictest73-21ksoftirqd/722:30:007
1145799195,1cyclictest73-21ksoftirqd/721:26:577
1145799195,1cyclictest73-21ksoftirqd/700:36:157
1145799194,1cyclictest73-21ksoftirqd/721:52:427
11457991917,1cyclictest73-21ksoftirqd/700:04:557
11457991913,3cyclictest73-21ksoftirqd/700:07:117
11457991912,4cyclictest73-21ksoftirqd/721:16:547
1144099199,3cyclictest49-21ksoftirqd/423:26:554
1144099199,3cyclictest49-21ksoftirqd/423:26:554
1144099194,3cyclictest49-21ksoftirqd/422:39:574
1144099194,1cyclictest49-21ksoftirqd/422:24:254
1144099192,2cyclictest49-21ksoftirqd/421:12:514
1144099192,1cyclictest49-21ksoftirqd/423:10:324
11440991918,1cyclictest49-21ksoftirqd/423:32:104
11440991918,1cyclictest49-21ksoftirqd/423:32:104
11440991915,3cyclictest49-21ksoftirqd/422:56:504
1144099191,1cyclictest49-21ksoftirqd/400:34:174
231362180,2sleep01142499cyclictest22:46:180
231362180,2sleep01142499cyclictest22:46:180
1145799184,2cyclictest73-21ksoftirqd/700:20:177
11457991817,1cyclictest73-21ksoftirqd/722:51:487
11457991816,1cyclictest73-21ksoftirqd/723:14:067
11457991816,1cyclictest73-21ksoftirqd/721:36:037
11457991816,1cyclictest73-21ksoftirqd/721:08:257
11457991815,1cyclictest73-21ksoftirqd/723:49:387
11457991815,1cyclictest73-21ksoftirqd/721:11:517
11457991814,3cyclictest73-21ksoftirqd/722:09:247
11457991814,3cyclictest73-21ksoftirqd/700:30:267
11457991811,4cyclictest73-21ksoftirqd/722:11:417
1145799181,2cyclictest73-21ksoftirqd/722:23:237
1145799181,1cyclictest73-21ksoftirqd/722:51:307
1145799180,17cyclictest20714-21kworker/7:521:48:027
1144099187,1cyclictest49-21ksoftirqd/421:34:504
1144099186,1cyclictest49-21ksoftirqd/400:21:054
1144099185,3cyclictest49-21ksoftirqd/422:41:404
1144099185,3cyclictest49-21ksoftirqd/422:41:404
1144099184,3cyclictest49-21ksoftirqd/422:50:094
1144099184,2cyclictest49-21ksoftirqd/421:56:454
1144099183,2cyclictest49-21ksoftirqd/423:01:594
1144099182,1cyclictest49-21ksoftirqd/421:54:164
11440991817,1cyclictest49-21ksoftirqd/422:35:124
11440991816,1cyclictest49-21ksoftirqd/422:10:184
11440991814,1cyclictest49-21ksoftirqd/421:51:364
11440991811,3cyclictest49-21ksoftirqd/400:16:234
1144099181,1cyclictest131rcu_sched21:10:584
11427991816,1cyclictest33-21ksoftirqd/223:30:462
11427991816,1cyclictest33-21ksoftirqd/223:30:462
11427991816,1cyclictest33-21ksoftirqd/222:27:062
11427991815,3cyclictest33-21ksoftirqd/223:03:072
11424991815,2cyclictest9-21ksoftirqd/023:36:440
11424991815,2cyclictest9-21ksoftirqd/023:36:440
1142499180,17cyclictest2880-21kworker/0:423:08:470
1142499180,1cyclictest131rcu_sched21:54:090
11457991716,1cyclictest73-21ksoftirqd/722:31:537
11457991715,1cyclictest73-21ksoftirqd/723:53:247
11457991715,1cyclictest73-21ksoftirqd/723:22:327
11457991715,1cyclictest73-21ksoftirqd/722:38:337
1144099174,3cyclictest49-21ksoftirqd/422:13:134
11440991716,1cyclictest49-21ksoftirqd/423:41:384
11440991716,1cyclictest49-21ksoftirqd/423:41:384
11440991716,1cyclictest49-21ksoftirqd/422:52:394
11440991715,1cyclictest49-21ksoftirqd/423:42:024
11440991715,1cyclictest49-21ksoftirqd/421:46:134
11440991715,1cyclictest49-21ksoftirqd/421:22:194
11427991715,1cyclictest33-21ksoftirqd/223:01:192
11427991715,1cyclictest33-21ksoftirqd/221:36:562
11427991713,1cyclictest33-21ksoftirqd/221:12:242
11427991712,3cyclictest33-21ksoftirqd/200:26:202
11424991715,2cyclictest6497-21kworker/u16:421:13:490
11424991715,1cyclictest9-21ksoftirqd/023:34:300
11424991715,1cyclictest9-21ksoftirqd/023:34:300
11424991715,1cyclictest9-21ksoftirqd/000:35:350
11424991715,1cyclictest492-21systemd-journal23:00:120
11424991715,1cyclictest1181-21kworker/0:222:51:270
290302160,1sleep029017-21sshd00:21:570
148292160,0sleep20-21swapper/200:34:162
11457991615,1cyclictest73-21ksoftirqd/723:42:427
11457991615,1cyclictest73-21ksoftirqd/723:08:027
11457991614,1cyclictest73-21ksoftirqd/721:57:057
11457991614,1cyclictest73-21ksoftirqd/721:41:527
11440991615,1cyclictest49-21ksoftirqd/421:16:584
11440991614,1cyclictest49-21ksoftirqd/423:12:374
11427991615,1cyclictest33-21ksoftirqd/223:31:552
11427991615,1cyclictest33-21ksoftirqd/223:31:552
11427991614,2cyclictest33-21ksoftirqd/221:34:012
11427991614,1cyclictest492-21systemd-journal22:31:412
11427991614,1cyclictest33-21ksoftirqd/223:47:102
11427991614,1cyclictest33-21ksoftirqd/221:26:512
11427991614,1cyclictest33-21ksoftirqd/221:21:552
11427991613,3cyclictest33-21ksoftirqd/200:20:132
11427991613,2cyclictest33-21ksoftirqd/222:18:092
11427991613,2cyclictest33-21ksoftirqd/200:11:162
11427991612,3cyclictest33-21ksoftirqd/221:17:082
11424991615,1cyclictest9-21ksoftirqd/023:11:500
11424991615,1cyclictest9-21ksoftirqd/022:04:050
11424991614,1cyclictest9-21ksoftirqd/022:31:590
11424991614,1cyclictest9-21ksoftirqd/021:36:570
11424991614,1cyclictest9-21ksoftirqd/000:01:480
11424991614,1cyclictest9-21ksoftirqd/000:00:390
11424991613,3cyclictest9-21ksoftirqd/022:54:090
11424991612,3cyclictest9-21ksoftirqd/022:28:170
1142499161,2cyclictest131rcu_sched23:41:400
1142499160,16cyclictest3861-21kworker/0:321:34:590
1142499160,15cyclictest3861-21kworker/0:321:56:580
1142499160,15cyclictest20623-21kworker/0:221:43:250
1142499160,1cyclictest131rcu_sched23:55:010
1142499160,1cyclictest0-21swapper/021:10:500
277342150,0sleep50-21swapper/522:55:525
127732150,0sleep30-21swapper/323:02:233
1143499159,1cyclictest41-21ksoftirqd/300:26:153
11434991513,1cyclictest22942-21sshd00:19:473
11427991513,1cyclictest33-21ksoftirqd/223:51:562
11427991513,1cyclictest33-21ksoftirqd/223:45:122
11427991513,1cyclictest33-21ksoftirqd/223:39:482
11427991513,1cyclictest33-21ksoftirqd/223:39:482
11427991513,1cyclictest33-21ksoftirqd/223:13:172
11427991513,1cyclictest33-21ksoftirqd/223:10:492
11427991513,1cyclictest33-21ksoftirqd/222:46:432
11427991513,1cyclictest33-21ksoftirqd/222:38:312
11427991513,1cyclictest33-21ksoftirqd/221:59:122
11427991513,1cyclictest33-21ksoftirqd/221:44:192
11427991511,1cyclictest33-21ksoftirqd/222:14:392
11427991510,3cyclictest33-21ksoftirqd/222:55:432
11427991510,3cyclictest33-21ksoftirqd/222:02:372
11424991513,1cyclictest9-21ksoftirqd/023:23:460
11424991513,1cyclictest9-21ksoftirqd/022:23:030
11424991513,1cyclictest9-21ksoftirqd/000:08:200
11424991512,3cyclictest13143-21kworker/0:122:38:510
11424991510,3cyclictest9-21ksoftirqd/023:50:410
1142499150,14cyclictest21407-21kworker/0:421:26:480
1142499150,1cyclictest131rcu_sched00:29:020
31262140,0sleep30-21swapper/321:28:443
293772140,0sleep10-21swapper/122:42:501
293772140,0sleep10-21swapper/122:42:501
120022140,0sleep6641ktimersoftd/621:53:226
11457991412,1cyclictest73-21ksoftirqd/721:06:397
11447991412,1cyclictest686-21dbus-daemon22:34:105
11434991413,1cyclictest0-21swapper/322:11:153
11434991412,1cyclictest41-21ksoftirqd/321:26:123
11427991413,1cyclictest33-21ksoftirqd/223:26:082
11427991413,1cyclictest33-21ksoftirqd/221:09:542
11427991412,2cyclictest33-21ksoftirqd/223:57:522
11427991412,2cyclictest33-21ksoftirqd/222:22:092
11427991412,1cyclictest33-21ksoftirqd/222:41:552
11427991412,1cyclictest33-21ksoftirqd/222:41:552
11427991412,1cyclictest33-21ksoftirqd/200:29:002
11427991412,1cyclictest33-21ksoftirqd/200:12:312
11427991412,1cyclictest33-21ksoftirqd/200:02:132
11427991410,3cyclictest33-21ksoftirqd/221:48:332
1142499149,1cyclictest9-21ksoftirqd/021:18:490
11424991413,1cyclictest9-21ksoftirqd/021:22:120
11424991410,1cyclictest9-21ksoftirqd/023:16:520
212452130,0sleep30-21swapper/322:25:383
174302130,1sleep117416-21strings00:26:541
11457991312,1cyclictest73-21ksoftirqd/720:36:387
1145199136,7cyclictest65-21ksoftirqd/622:23:026
1145199134,8cyclictest763-21NetworkManager21:30:076
1145199133,4cyclictest20398-21sshd00:21:326
11451991311,1cyclictest65-21ksoftirqd/622:13:296
1145199130,12cyclictest17225-21kworker/6:323:12:036
1144799133,4cyclictest16055-21sshd23:49:235
1143499132,5cyclictest885-21polkitd21:33:333
1143499132,5cyclictest29102-21bash21:56:163
1143499132,5cyclictest19811-21sshd23:53:183
11424991311,2cyclictest24119-21kworker/0:119:19:330
225992120,0sleep60-21swapper/622:40:396
11457991210,1cyclictest73-21ksoftirqd/720:11:397
1145199129,2cyclictest15845-21bash23:02:346
1145199122,4cyclictest8644-21sshd22:26:476
1145199122,4cyclictest23016-21kworker/6:100:36:176
1145199122,4cyclictest16123-21sshd23:53:056
1145199122,4cyclictest0-21swapper/621:37:426
1145199120,6cyclictest10661-21systemd23:21:006
1145199120,11cyclictest21491-21kworker/6:300:10:296
1144799129,2cyclictest24068-21sshd22:10:545
1144799122,4cyclictest3131-21bash21:37:585
1144799122,4cyclictest26358-21sshd23:36:515
1144799122,4cyclictest26358-21sshd23:36:515
1144799122,4cyclictest1754-21sshd22:41:205
1144799122,4cyclictest14661-21sshd23:32:205
1144799122,4cyclictest14661-21sshd23:32:205
11447991210,1cyclictest57-21ksoftirqd/523:23:055
1144799121,5cyclictest22162-21bash21:16:515
1144799121,5cyclictest12648-21sshd23:04:175
1144799121,10cyclictest32135-21sshd00:35:175
1144799120,11cyclictest10846-21grep21:49:375
11440991212,0cyclictest5270-21kworker/4:119:12:094
11440991212,0cyclictest5270-21kworker/4:119:12:094
11440991211,1cyclictest5270-21kworker/4:120:36:454
1143499125,1cyclictest0-21swapper/323:23:073
1143499122,4cyclictest887-21gdbus23:27:153
1143499122,4cyclictest887-21gdbus23:27:153
1143499122,4cyclictest30769-21sshd23:37:013
1143499122,4cyclictest30769-21sshd23:37:013
1143499122,4cyclictest28224-21sshd21:37:323
1143499122,4cyclictest19927-21sshd23:15:553
1143499122,4cyclictest0-21swapper/321:13:083
1143499122,4cyclictest0-21swapper/300:14:083
1143499122,4cyclictest0-21swapper/300:02:573
11434991211,1cyclictest41-21ksoftirqd/323:47:433
11434991211,1cyclictest41-21ksoftirqd/322:19:233
11434991210,1cyclictest1-21systemd23:17:113
11434991210,1cyclictest0-21swapper/322:15:513
1143499120,11cyclictest8282-21systemd-cgroups22:49:073
1143499120,11cyclictest0-21swapper/323:07:273
11427991210,1cyclictest33-21ksoftirqd/221:06:392
1142599122,4cyclictest23543-21sshd22:27:331
1142599122,4cyclictest19504-21bash22:21:481
1142599122,4cyclictest1534-21bash21:39:471
1142599122,4cyclictest1271-21sshd22:54:181
1142599122,4cyclictest0-21swapper/123:57:131
11425991210,1cyclictest686-21dbus-daemon23:17:221
11425991210,1cyclictest25-21ksoftirqd/123:55:311
11425991210,1cyclictest10616-21sshd22:13:471
1142599120,11cyclictest1646-21grepconf.sh22:00:141
132372110,0sleep10-21swapper/121:21:531
1145799119,1cyclictest73-21ksoftirqd/720:41:537
1145199119,1cyclictest65-21ksoftirqd/622:43:426
1145199119,1cyclictest65-21ksoftirqd/622:43:426
1145199119,1cyclictest65-21ksoftirqd/622:34:436
1145199119,1cyclictest65-21ksoftirqd/621:25:376
1145199119,1cyclictest65-21ksoftirqd/600:05:126
1145199118,2cyclictest3175-21sshd22:07:426
1145199112,4cyclictest32306-21sshd21:43:226
1145199111,4cyclictest1479-21systemd-cgroups22:20:466
1145199110,5cyclictest691-21systemd-logind21:59:436
1145199110,5cyclictest686-21dbus-daemon22:58:396
1145199110,5cyclictest686-21dbus-daemon00:01:166
1145199110,5cyclictest0-21swapper/623:29:126
1145199110,5cyclictest0-21swapper/623:29:126
1145199110,11cyclictest30651-21kworker/6:321:33:066
1145199110,1cyclictest0-21swapper/623:32:226
1145199110,1cyclictest0-21swapper/623:32:226
1145199110,1cyclictest0-21swapper/600:30:136
1144799119,1cyclictest57-21ksoftirqd/521:10:595
1144799114,6cyclictest29787-21sshd00:05:115
1144799113,7cyclictest1225-21sshd23:29:465
1144799113,7cyclictest1225-21sshd23:29:465
1144799112,3cyclictest0-21swapper/522:14:325
1144799112,3cyclictest0-21swapper/521:43:495
11447991110,1cyclictest57-21ksoftirqd/500:17:225
11447991110,1cyclictest0-21swapper/523:54:195
1144799111,4cyclictest31669-21systemd-cgroups21:35:595
1144799111,4cyclictest1-21systemd21:54:415
1144799110,11cyclictest9600-21kworker/5:023:12:195
1144799110,11cyclictest6462-21kworker/5:021:27:235
1144799110,11cyclictest4415-21kworker/5:521:56:535
1144799110,11cyclictest14963-21kworker/5:221:12:575
11440991111,0cyclictest5270-21kworker/4:120:41:574
11440991111,0cyclictest5270-21kworker/4:120:21:394
11440991110,1cyclictest5270-21kworker/4:119:36:354
11440991110,1cyclictest5270-21kworker/4:119:20:394
1143499119,1cyclictest41-21ksoftirqd/323:57:583
1143499119,1cyclictest41-21ksoftirqd/323:31:573
1143499119,1cyclictest41-21ksoftirqd/323:31:573
1143499116,2cyclictest29414-21systemd22:03:383
1143499112,4cyclictest13427-21sshd23:41:433
11434991110,1cyclictest41-21ksoftirqd/321:19:163
1143499111,4cyclictest0-21swapper/321:58:163
1143499110,5cyclictest16370-21sshd22:27:083
1143499110,11cyclictest32199-21kworker/3:222:55:573
1143499110,11cyclictest0-21swapper/321:07:073
1143499110,10cyclictest28342-21grepconf.sh21:48:443
1142599119,1cyclictest25-21ksoftirqd/123:24:451
1142599119,1cyclictest25-21ksoftirqd/121:19:241
1142599117,3cyclictest25-21ksoftirqd/122:11:351
1142599114,4cyclictest492-21systemd-journal00:13:491
1142599112,7cyclictest13793-21systemd00:19:141
1142599112,5cyclictest21140-21systemd22:40:341
1142599112,4cyclictest24667-21systemd-cgroups23:03:051
11425991110,1cyclictest25-21ksoftirqd/121:33:281
1142599111,4cyclictest2232-21sshd23:44:491
1142599111,4cyclictest14985-21bash00:02:211
1142599111,4cyclictest0-21swapper/123:50:551
1142599110,5cyclictest885-21polkitd21:48:231
1142599110,2cyclictest29929-21sshd23:40:491
1142599110,2cyclictest29929-21sshd23:40:491
1142499119,1cyclictest9-21ksoftirqd/019:41:380
1142499110,2cyclictest0-21swapper/019:49:430
1145799109,1cyclictest73-21ksoftirqd/720:01:577
1145799109,1cyclictest73-21ksoftirqd/719:56:397
1145799109,1cyclictest73-21ksoftirqd/719:56:397
1145799108,1cyclictest73-21ksoftirqd/720:56:587
1145799108,1cyclictest73-21ksoftirqd/720:46:557
1145199103,6cyclictest7005-21sshd00:26:236
1145199101,4cyclictest6458-21systemd-cgroups21:17:456
1145199101,4cyclictest0-21swapper/623:38:456
1145199101,4cyclictest0-21swapper/623:38:456
1145199100,4cyclictest885-21polkitd00:11:506
1145199100,4cyclictest0-21swapper/623:42:126
1145199100,4cyclictest0-21swapper/623:22:016
1145199100,4cyclictest0-21swapper/622:54:036
1145199100,10cyclictest20965-21kworker/6:023:48:446
1145199100,10cyclictest19327-21kworker/6:223:06:556
1145199100,10cyclictest0-21swapper/621:10:476
1144799108,1cyclictest57-21ksoftirqd/523:43:365
1144799108,1cyclictest1-21systemd00:27:445
1144799103,6cyclictest885-21polkitd23:58:335
1144799103,6cyclictest25771-21sshd22:48:145
1144799103,6cyclictest1332-21sshd00:22:125
1144799102,4cyclictest1-21systemd23:08:395
1144799100,4cyclictest30336-21sshd22:22:205
1144799100,4cyclictest28582-21sshd22:16:445
1144799100,10cyclictest0-21swapper/522:57:475
1144799100,1cyclictest1872-21perf19:46:385
1144799100,1cyclictest0-21swapper/522:26:585
1144799100,1cyclictest0-21swapper/521:24:285
1144099109,1cyclictest5270-21kworker/4:120:52:394
1144099109,1cyclictest5270-21kworker/4:120:30:194
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional