You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 07:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu Mar 12, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8592750,0sleep70-21swapper/721:23:087
289182740,0sleep00-21swapper/021:21:080
64682530,0sleep40-21swapper/423:20:304
209722510,0sleep20-21swapper/222:52:012
122762510,1sleep125-21ksoftirqd/123:57:271
90722500,0sleep60-21swapper/622:27:306
40002500,1sleep4686-21dbus-daemon22:25:284
179292500,0sleep40-21swapper/422:57:164
1007224925,8sleep00-21swapper/019:02:560
98292480,1sleep09834-21grepconf.sh21:32:460
1006824825,8sleep50-21swapper/519:02:535
137572470,0sleep213746-21sshd21:14:462
1027024725,18sleep60-21swapper/619:05:436
90542460,1sleep79051-21grepconf.sh23:59:107
87512460,1sleep68752-21grep22:01:596
159822460,1sleep449-21ksoftirqd/400:12:204
157712450,2sleep11049899cyclictest22:07:471
6362440,0sleep30-21swapper/322:36:163
322082440,0sleep40-21swapper/421:26:494
255132440,0sleep40-21swapper/423:50:584
226762440,0sleep10-21swapper/122:46:391
215192440,0sleep70-21swapper/700:25:377
176902440,0sleep60-21swapper/600:03:176
68272430,0sleep10-21swapper/122:38:221
299102430,0sleep30-21swapper/321:32:093
119512430,0sleep50-21swapper/522:55:085
137232420,0sleep013722-21sshd21:08:590
76632410,0sleep40-21swapper/400:04:354
299572410,0sleep30-21swapper/322:54:183
29152410,0sleep10-21swapper/123:23:561
96452400,1sleep449-21ksoftirqd/422:45:544
59632400,0sleep30-21swapper/323:38:473
326042400,0sleep70-21swapper/700:29:537
322552400,0sleep10-21swapper/122:06:591
260492400,0sleep30-21swapper/321:50:113
187602400,0sleep00-21swapper/021:46:070
155542400,0sleep40-21swapper/423:22:464
11842400,0sleep20-21swapper/221:34:082
117102400,2sleep11049899cyclictest23:29:561
101902400,0sleep30-21swapper/323:59:143
1010124029,8sleep70-21swapper/719:03:197
1004924028,9sleep40-21swapper/419:02:364
154932390,0sleep30-21swapper/300:14:113
1027523928,8sleep20-21swapper/219:05:472
1007523926,9sleep30-21swapper/319:02:593
1006423926,9sleep10-21swapper/119:02:491
56262380,0sleep40-21swapper/423:16:464
13892370,2sleep01049199cyclictest23:49:340
204322360,0sleep70-21swapper/723:08:247
39232350,0sleep50-21swapper/522:29:055
296552310,0sleep429656-21grepconf.sh22:21:274
74852290,0sleep60-21swapper/622:14:416
1049899274,5cyclictest10755-21bash22:22:111
1049899253,6cyclictest1-21systemd23:08:331
1049899253,5cyclictest0-21swapper/123:43:141
1049899243,6cyclictest0-21swapper/100:07:241
1049899243,5cyclictest10100-21sshd23:37:121
1049899234,7cyclictest15447-21systemd23:48:301
1049899234,3cyclictest17174-21bash23:33:531
1049899233,7cyclictest686-21dbus-daemon22:56:071
1049899233,6cyclictest492-21systemd-journal21:48:291
1049899233,5cyclictest16688-21rm00:23:261
1049899233,3cyclictest32663-21bash23:53:081
1049899233,2cyclictest18060-21bash22:57:161
1049899232,5cyclictest30440-21systemd-cgroups21:54:021
10508992218,1cyclictest121rcu_preempt23:33:223
10508992216,3cyclictest41-21ksoftirqd/323:05:243
1050899220,21cyclictest2409-21kworker/3:421:19:253
1049899224,7cyclictest1-21systemd23:14:131
1049899224,4cyclictest6010-21sshd21:25:181
1049899224,2cyclictest15822-21sshd22:13:171
1049899223,7cyclictest32583-21systemd22:34:221
1049899223,5cyclictest686-21dbus-daemon00:12:491
1049899223,5cyclictest3920-21grepconf.sh00:35:371
1049899223,5cyclictest0-21swapper/121:33:031
1049899223,3cyclictest0-21swapper/123:18:041
1049899223,2cyclictest1-21systemd23:02:511
1049899222,4cyclictest29142-21systemd22:17:401
10517992116,3cyclictest57-21ksoftirqd/523:57:135
1049899214,5cyclictest31405-21sshd22:28:481
1049899213,6cyclictest1-21systemd00:03:481
1049899213,5cyclictest8488-21grep21:21:501
1049899213,4cyclictest19124-21grep22:00:451
1049899212,3cyclictest691-21systemd-logind21:15:511
10508992017,2cyclictest41-21ksoftirqd/300:03:303
10508992016,1cyclictest41-21ksoftirqd/322:29:373
10508992016,1cyclictest41-21ksoftirqd/321:59:003
1049899203,5cyclictest16755-21grep21:07:071
1049899203,5cyclictest0-21swapper/100:17:041
1049899203,3cyclictest0-21swapper/121:42:201
1049899202,5cyclictest686-21dbus-daemon00:28:261
1049899202,5cyclictest3237-21grep21:37:521
1049899202,5cyclictest29352-21grep21:28:241
260602190,0sleep30-21swapper/323:30:463
10517991917,1cyclictest57-21ksoftirqd/521:38:595
10517991915,3cyclictest57-21ksoftirqd/521:53:065
10517991914,1cyclictest57-21ksoftirqd/500:13:215
1050899198,3cyclictest41-21ksoftirqd/322:07:253
10508991918,1cyclictest41-21ksoftirqd/322:17:113
10508991917,1cyclictest41-21ksoftirqd/323:52:183
10508991917,1cyclictest41-21ksoftirqd/323:17:103
10508991916,2cyclictest41-21ksoftirqd/322:24:413
10508991915,3cyclictest41-21ksoftirqd/322:40:043
10508991915,1cyclictest41-21ksoftirqd/322:57:463
1049899194,5cyclictest30970-21sshd22:47:071
54162180,0sleep00-21swapper/022:20:030
190102180,0sleep00-21swapper/000:16:170
10517991816,1cyclictest57-21ksoftirqd/523:47:365
10517991816,1cyclictest57-21ksoftirqd/523:27:175
10517991816,1cyclictest57-21ksoftirqd/523:15:445
10517991816,1cyclictest57-21ksoftirqd/522:15:405
10517991816,1cyclictest57-21ksoftirqd/522:01:015
10517991816,1cyclictest57-21ksoftirqd/500:28:055
1050899187,1cyclictest41-21ksoftirqd/321:52:193
10508991817,1cyclictest41-21ksoftirqd/322:05:553
10508991816,1cyclictest41-21ksoftirqd/323:42:223
10508991816,1cyclictest41-21ksoftirqd/323:07:093
10508991816,1cyclictest41-21ksoftirqd/300:22:513
10508991816,1cyclictest41-21ksoftirqd/300:09:473
10508991815,2cyclictest41-21ksoftirqd/323:50:533
10508991815,1cyclictest41-21ksoftirqd/300:19:553
10508991813,4cyclictest41-21ksoftirqd/322:43:253
1050899181,2cyclictest41-21ksoftirqd/322:12:013
10491991816,1cyclictest9-21ksoftirqd/021:58:510
10491991813,3cyclictest18226-21kworker/0:323:42:410
10517991716,1cyclictest57-21ksoftirqd/521:48:445
10517991715,1cyclictest57-21ksoftirqd/523:37:425
10517991715,1cyclictest57-21ksoftirqd/522:49:075
10517991715,1cyclictest57-21ksoftirqd/521:30:375
10517991715,1cyclictest57-21ksoftirqd/521:24:095
10517991714,2cyclictest57-21ksoftirqd/521:36:015
10517991714,1cyclictest57-21ksoftirqd/523:18:465
10517991713,3cyclictest57-21ksoftirqd/500:26:055
10517991710,4cyclictest57-21ksoftirqd/523:22:205
1051799170,2cyclictest121rcu_preempt23:08:245
1050999170,17cyclictest28256-21kworker/4:022:33:454
10508991715,1cyclictest41-21ksoftirqd/322:47:223
10508991715,1cyclictest41-21ksoftirqd/321:27:513
10508991715,1cyclictest41-21ksoftirqd/321:10:243
1049899173,4cyclictest14603-21bash21:07:001
10491991715,1cyclictest9-21ksoftirqd/023:40:490
10491991715,1cyclictest9-21ksoftirqd/000:01:590
10491991714,2cyclictest15027-21kworker/u16:100:10:030
50552160,0sleep40-21swapper/422:51:074
29902160,0sleep50-21swapper/522:45:315
262092160,1sleep233-21ksoftirqd/221:44:412
10517991614,2cyclictest57-21ksoftirqd/522:23:515
10517991614,1cyclictest57-21ksoftirqd/523:46:105
10517991614,1cyclictest57-21ksoftirqd/523:04:025
10517991614,1cyclictest57-21ksoftirqd/522:59:575
10517991614,1cyclictest57-21ksoftirqd/522:40:355
10517991614,1cyclictest57-21ksoftirqd/522:20:125
10517991614,1cyclictest57-21ksoftirqd/522:10:405
10517991614,1cyclictest57-21ksoftirqd/500:20:145
10517991614,1cyclictest57-21ksoftirqd/500:05:505
10517991613,1cyclictest57-21ksoftirqd/522:36:335
10517991612,3cyclictest57-21ksoftirqd/522:03:215
10517991610,4cyclictest57-21ksoftirqd/500:34:245
1051799161,3cyclictest121rcu_preempt21:46:395
10508991615,1cyclictest41-21ksoftirqd/321:13:433
10508991614,1cyclictest41-21ksoftirqd/323:25:163
10508991614,1cyclictest41-21ksoftirqd/323:15:083
10508991614,1cyclictest41-21ksoftirqd/321:22:113
10508991614,1cyclictest41-21ksoftirqd/300:28:213
10508991613,1cyclictest41-21ksoftirqd/300:31:583
10491991614,1cyclictest9-21ksoftirqd/023:07:150
10491991614,1cyclictest9-21ksoftirqd/022:43:180
73712150,0sleep60-21swapper/622:18:176
25302150,0sleep00-21swapper/023:25:470
197712150,1sleep419770-21sshd21:46:114
10517991514,1cyclictest57-21ksoftirqd/500:07:235
10517991513,2cyclictest15-21kswork21:11:375
10517991513,1cyclictest57-21ksoftirqd/523:54:135
10517991513,1cyclictest57-21ksoftirqd/523:32:435
10517991511,4cyclictest15-21kswork21:14:295
1051799150,2cyclictest121rcu_preempt21:20:495
10508991513,1cyclictest41-21ksoftirqd/321:42:033
10508991513,1cyclictest41-21ksoftirqd/321:37:133
10502991513,1cyclictest33-21ksoftirqd/223:15:032
1049899152,4cyclictest2690-21grep19:47:161
10491991514,1cyclictest9-21ksoftirqd/022:50:300
10491991514,1cyclictest9-21ksoftirqd/022:37:510
10491991513,1cyclictest9-21ksoftirqd/023:05:180
10491991513,1cyclictest9-21ksoftirqd/022:03:230
10491991513,1cyclictest9-21ksoftirqd/021:26:270
10491991513,1cyclictest9-21ksoftirqd/000:36:570
10491991513,1cyclictest9-21ksoftirqd/000:28:290
10491991512,2cyclictest9-21ksoftirqd/022:54:310
10491991512,2cyclictest18823-21kworker/dying00:04:290
10491991511,3cyclictest14857-21kworker/0:321:31:090
10491991511,1cyclictest9-21ksoftirqd/023:28:540
10491991511,1cyclictest9-21ksoftirqd/021:41:590
269922140,0sleep20-21swapper/200:25:562
10529991412,1cyclictest73-21ksoftirqd/722:32:457
10529991411,2cyclictest492-21systemd-journal22:20:557
10520991412,1cyclictest65-21ksoftirqd/623:30:516
10520991412,1cyclictest6169-21systemd00:19:116
10502991413,1cyclictest33-21ksoftirqd/200:16:332
10502991412,1cyclictest33-21ksoftirqd/223:36:132
10502991412,1cyclictest33-21ksoftirqd/222:40:222
1049899142,4cyclictest30803-21sshd19:42:101
1049899142,4cyclictest28418-21df_inode19:37:091
1049899142,4cyclictest19689-21grep20:17:151
1049899142,4cyclictest11412-21ntp_states20:02:161
10491991413,1cyclictest9-21ksoftirqd/000:23:410
10491991412,1cyclictest9-21ksoftirqd/023:14:210
10491991412,1cyclictest9-21ksoftirqd/022:59:100
10491991412,1cyclictest9-21ksoftirqd/021:51:590
10491991412,1cyclictest12197-21kworker/u16:123:17:150
10491991411,2cyclictest29513-21bash22:15:570
10491991411,1cyclictest25240-21kworker/0:423:55:330
287402130,1sleep6641ktimersoftd/622:45:086
232972130,0sleep60-21swapper/623:37:546
178562130,0sleep60-21swapper/621:53:186
154422130,0sleep70-21swapper/722:40:457
10529991310,2cyclictest691-21systemd-logind21:48:057
1052099136,4cyclictest786-21snmpd21:16:546
1052099133,4cyclictest763-21NetworkManager22:35:576
1052099130,2cyclictest1-21systemd00:01:346
10508991311,1cyclictest41-21ksoftirqd/321:07:003
1050299130,12cyclictest16956-21grepconf.sh23:43:042
1049899132,5cyclictest9484-21diskstats20:57:101
1049899132,5cyclictest7803-21expr19:57:141
1049899132,5cyclictest3869-21perl20:47:111
1049899132,5cyclictest17127-21grep19:17:101
1049899132,4cyclictest5081-21iostat_ios19:52:131
1049899132,4cyclictest27541-21diskstats20:32:101
1049899132,4cyclictest21825-21diskstats20:22:111
1049899132,3cyclictest13931-21ls19:12:101
1049899132,3cyclictest13029-21cstates20:07:111
1049899132,2cyclictest6535-21cstates20:52:081
1049899132,2cyclictest497-21grep20:42:101
1049899132,2cyclictest30252-21cstates20:37:091
1049899132,2cyclictest23920-21smartctl19:27:181
10491991312,1cyclictest9-21ksoftirqd/022:07:130
10491991311,1cyclictest9-21ksoftirqd/022:35:110
10491991311,1cyclictest9-21ksoftirqd/022:29:320
10491991311,1cyclictest9-21ksoftirqd/022:22:280
10491991311,1cyclictest9-21ksoftirqd/000:18:420
77062120,0sleep40-21swapper/423:33:204
1052999122,4cyclictest0-21swapper/722:30:367
10529991210,1cyclictest9531-21sshd21:27:177
10529991210,1cyclictest8399-21sshd22:14:447
10529991210,1cyclictest73-21ksoftirqd/721:41:107
1052999120,11cyclictest1-21systemd22:54:477
1052999120,11cyclictest0-21swapper/721:18:467
1052099128,1cyclictest65-21ksoftirqd/622:47:406
1052099124,4cyclictest9481-21sshd22:22:086
1052099122,4cyclictest7591-21systemd22:56:466
1052099122,4cyclictest3743-21grepconf.sh00:11:456
1052099122,4cyclictest29532-21sshd00:35:146
1052099122,4cyclictest28466-21sshd23:14:206
1052099122,4cyclictest19351-21cp22:40:586
10520991211,1cyclictest65-21ksoftirqd/623:48:026
10520991211,1cyclictest65-21ksoftirqd/621:58:216
10520991210,2cyclictest2995-21systemd21:41:356
10520991210,1cyclictest65-21ksoftirqd/623:36:006
10520991210,1cyclictest0-21swapper/623:01:116
1050999122,4cyclictest8813-21bash22:53:054
1050999122,4cyclictest7988-21sshd00:17:244
1050999122,4cyclictest30777-21bash23:45:454
1050999122,4cyclictest30003-21sshd00:27:514
1050999122,4cyclictest26556-21systemd-cgroups21:13:384
1050999122,4cyclictest22092-21sshd22:08:094
1050999122,4cyclictest21957-21sshd22:04:314
1050999122,4cyclictest13816-21sshd00:34:194
1050999122,4cyclictest1-21systemd21:57:344
1050999122,4cyclictest0-21swapper/422:27:514
10509991211,1cyclictest49-21ksoftirqd/422:12:494
1050999121,5cyclictest12406-21grepconf.sh21:51:154
1050999120,11cyclictest12450-21sshd21:11:064
1050299125,6cyclictest33-21ksoftirqd/221:19:592
1050299122,8cyclictest0-21swapper/223:26:382
1050299122,4cyclictest24355-21sshd22:32:072
1050299122,4cyclictest22447-21sshd21:49:582
10502991210,2cyclictest33-21ksoftirqd/221:25:442
10502991210,1cyclictest33-21ksoftirqd/221:10:462
10502991210,1cyclictest33-21ksoftirqd/200:03:202
1050299121,5cyclictest723-21in:imjournal00:31:492
1049899122,5cyclictest26186-21sed19:32:131
10491991210,1cyclictest9-21ksoftirqd/023:32:100
10491991210,1cyclictest9-21ksoftirqd/021:54:290
10491991210,1cyclictest9-21ksoftirqd/021:15:410
24332110,0sleep20-21swapper/200:20:512
226582110,0sleep20-21swapper/221:37:122
1052999119,1cyclictest73-21ksoftirqd/723:47:327
1052999119,1cyclictest73-21ksoftirqd/723:23:347
1052999119,1cyclictest73-21ksoftirqd/721:10:527
1052999119,1cyclictest73-21ksoftirqd/700:17:157
1052999118,1cyclictest15-21kswork22:03:077
1052999117,3cyclictest73-21ksoftirqd/723:20:117
1052999116,4cyclictest73-21ksoftirqd/722:22:107
1052999114,4cyclictest988-21sshd21:32:177
1052999113,5cyclictest22353-21sshd00:10:577
1052999113,3cyclictest10285-21bash00:32:167
1052999110,10cyclictest1866-21kworker/7:022:51:567
1052099119,1cyclictest65-21ksoftirqd/600:23:366
1052099118,2cyclictest28849-21grepconf.sh23:54:476
1052099115,1cyclictest65-21ksoftirqd/621:48:326
1052099113,4cyclictest26808-21bash21:46:366
1052099112,3cyclictest1569-21sshd00:15:166
10520991110,1cyclictest0-21swapper/621:35:356
1052099111,4cyclictest8177-21sshd21:18:036
1052099111,4cyclictest32087-21sshd23:42:106
1052099110,11cyclictest3875-21kworker/6:223:19:026
1052099110,1cyclictest1-21systemd22:08:506
1052099110,1cyclictest0-21swapper/621:09:056
1050999119,1cyclictest49-21ksoftirqd/421:20:164
1050999112,4cyclictest31980-21sshd21:28:334
1050999111,8cyclictest26486-21sshd23:38:054
1050999111,5cyclictest25301-21grepconf.sh23:52:424
1050999111,4cyclictest26015-21sshd23:28:544
1050999111,4cyclictest1-21systemd00:23:594
1050999111,4cyclictest0-21swapper/423:06:584
1050999111,4cyclictest0-21swapper/421:38:034
1050999110,5cyclictest31950-21grepconf.sh23:10:574
1050999110,1cyclictest14436-21sshd00:08:374
1050899119,1cyclictest41-21ksoftirqd/320:46:593
10508991110,1cyclictest41-21ksoftirqd/319:21:593
1050299119,1cyclictest33-21ksoftirqd/223:18:422
1050299117,2cyclictest33-21ksoftirqd/223:09:562
1050299112,4cyclictest686-21dbus-daemon22:30:532
1050299112,4cyclictest25473-21sshd23:38:022
1050299112,4cyclictest0-21swapper/222:57:272
1050299112,4cyclictest0-21swapper/222:44:212
10502991110,1cyclictest33-21ksoftirqd/222:09:112
1050299110,11cyclictest10389-21kworker/2:322:13:532
1049199119,1cyclictest11880-21sed19:07:140
1052999108,1cyclictest73-21ksoftirqd/723:12:287
1052999108,1cyclictest73-21ksoftirqd/700:13:417
1052999108,1cyclictest73-21ksoftirqd/700:05:107
1052999107,2cyclictest26068-21bash22:57:437
1052999103,4cyclictest691-21systemd-logind21:52:427
1052999103,4cyclictest31004-21sshd23:05:237
1052999103,4cyclictest13582-21sshd23:28:107
1052999102,5cyclictest686-21dbus-daemon23:53:257
1052999102,3cyclictest29244-21sshd21:59:277
1052999101,4cyclictest0-21swapper/721:13:397
1052999100,4cyclictest6874-21sshd23:42:277
1052099105,2cyclictest9236-21grepconf.sh23:26:106
1052099102,5cyclictest31401-21sshd21:30:246
1052099101,5cyclictest13897-21systemd00:30:416
1052099101,4cyclictest0-21swapper/623:03:276
1050999103,1cyclictest26032-21systemd21:33:424
1050999100,5cyclictest9867-21sd-pam21:52:514
1050999100,4cyclictest26803-21sshd23:58:194
1050999100,4cyclictest18654-21bash22:39:044
1050899109,1cyclictest41-21ksoftirqd/319:52:193
1050299109,1cyclictest33-21ksoftirqd/222:03:582
1050299109,1cyclictest0-21swapper/200:33:592
1050299108,2cyclictest33-21ksoftirqd/223:02:372
1050299108,1cyclictest33-21ksoftirqd/223:49:552
1050299103,6cyclictest887-21gdbus21:53:062
1050299103,4cyclictest30181-21bash23:52:592
1050299103,1cyclictest0-21swapper/223:57:082
1050299101,4cyclictest16143-21sshd23:28:192
1050299101,3cyclictest0-21swapper/221:57:222
1050299100,4cyclictest30736-21sshd22:47:062
1050299100,4cyclictest0-21swapper/222:21:432
1049899100,4cyclictest0-21swapper/119:08:351
105299997,1cyclictest73-21ksoftirqd/722:45:287
105299997,1cyclictest73-21ksoftirqd/722:07:307
105299993,3cyclictest7441-21sshd23:37:047
105299992,4cyclictest759-21rs:main7
105299990,5cyclictest6964-21grep23:33:177
105209997,1cyclictest65-21ksoftirqd/623:07:046
105209990,9cyclictest0-21swapper/619:32:086
105209990,5cyclictest18837-21grepconf.sh21:22:186
105179998,1cyclictest57-21ksoftirqd/520:51:595
105179995,4cyclictest57-21ksoftirqd/521:00:225
105099997,1cyclictest49-21ksoftirqd/421:01:594
105089997,1cyclictest41-21ksoftirqd/320:47:093
105089997,1cyclictest41-21ksoftirqd/319:27:093
105029997,1cyclictest33-21ksoftirqd/200:08:352
105029994,1cyclictest0-21swapper/219:13:252
105029992,7cyclictest0-21swapper/222:23:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional