You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-19 - 21:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sun Apr 19, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
248682990,1sleep424862-21sshd11:36:504
62042810,2sleep73142599cyclictest09:26:467
237932750,0sleep00-21swapper/011:08:430
274092730,2sleep03139699cyclictest11:48:150
143292680,1sleep014331-21pmu-power08:26:010
147822530,0sleep20-21swapper/211:04:282
278472500,0sleep10-21swapper/110:44:411
51552490,0sleep20-21swapper/212:11:162
3121424937,8sleep30-21swapper/307:05:013
3121424937,8sleep30-21swapper/307:05:013
210812490,1sleep221062-21bash11:34:482
210812490,1sleep221062-21bash11:34:482
9732470,0sleep60-21swapper/611:35:326
9732470,0sleep60-21swapper/611:35:326
3113524725,8sleep60-21swapper/607:04:006
3113524725,8sleep60-21swapper/607:04:006
3099624724,8sleep10-21swapper/107:02:031
3099624724,8sleep10-21swapper/107:02:031
225172470,0sleep10-21swapper/110:40:401
50762460,0sleep70-21swapper/710:58:167
3115424634,9sleep70-21swapper/707:04:177
3115424634,9sleep70-21swapper/707:04:177
278642460,0sleep60-21swapper/611:03:206
100182460,0sleep20-21swapper/209:25:132
141742450,0sleep20-21swapper/211:21:102
321702440,1sleep432171-21sshd11:50:274
3104024432,9sleep50-21swapper/507:02:395
3104024432,9sleep50-21swapper/507:02:395
232562440,0sleep30-21swapper/312:27:193
203452440,0sleep4481ktimersoftd/410:42:204
326232430,0sleep60-21swapper/609:22:446
261002430,1sleep3686-21dbus-daemon10:33:223
90472420,0sleep20-21swapper/209:15:522
68892420,0sleep60-21swapper/609:10:116
49342420,0sleep40-21swapper/411:01:584
286832420,1sleep228674-21bash09:54:122
185592420,0sleep60-21swapper/611:51:266
175382420,0sleep20-21swapper/209:42:192
65212410,0sleep50-21swapper/512:33:545
55042410,0sleep20-21swapper/211:05:482
3121124129,8sleep20-21swapper/207:05:002
3121124129,8sleep20-21swapper/207:05:002
263252410,0sleep40-21swapper/410:38:594
71542400,0sleep50-21swapper/510:04:085
59452400,0sleep60-21swapper/610:13:306
156692400,0sleep40-21swapper/411:28:494
156692400,0sleep40-21swapper/411:28:494
128902400,0sleep50-21swapper/507:26:005
3115123927,8sleep40-21swapper/407:04:144
3115123927,8sleep40-21swapper/407:04:144
3093723926,9sleep00-21swapper/007:01:140
3093723926,9sleep00-21swapper/007:01:140
249752390,0sleep50-21swapper/509:31:325
232252390,0sleep70-21swapper/710:48:077
202192390,0sleep20-21swapper/210:57:152
16042390,0sleep6631rcuc/611:43:016
135572390,0sleep10-21swapper/109:34:411
28932380,0sleep10-21swapper/112:14:591
253572380,0sleep10-21swapper/110:23:581
17052380,0sleep30-21swapper/309:22:493
46142370,0sleep10-21swapper/111:30:061
46142370,0sleep10-21swapper/111:30:061
178652370,0sleep70-21swapper/711:53:197
143762370,0sleep30-21swapper/309:49:413
135772350,0sleep30-21swapper/311:45:383
118462290,0sleep6631rcuc/610:36:136
31405992015,4cyclictest25-21ksoftirqd/109:28:451
304522190,7sleep63142499cyclictest10:52:156
300422190,0sleep50-21swapper/512:10:555
193712190,0sleep70-21swapper/712:04:407
144212180,1sleep114416-21sshd12:25:011
12082180,0sleep00-21swapper/009:41:210
61802170,0sleep30-21swapper/311:13:183
38842170,0sleep00-21swapper/012:16:510
31411991712,4cyclictest691-21systemd-logind10:39:482
309982170,10sleep687950irq/25-em1-rx-011:07:126
112072170,1sleep25757-21kworker/2:010:30:402
31405991614,1cyclictest25-21ksoftirqd/109:44:071
292572160,0sleep40-21swapper/409:24:274
217402160,1sleep665-21ksoftirqd/609:57:286
213942160,1sleep421395-21systemd-cgroups11:44:114
178142160,0sleep70-21swapper/709:46:007
164632160,0sleep40-21swapper/409:40:284
102172160,0sleep60-21swapper/611:49:096
3142499159,6cyclictest65-21ksoftirqd/609:15:516
31423991513,2cyclictest1-21systemd12:02:415
31418991513,1cyclictest41-21ksoftirqd/310:42:143
31405991513,1cyclictest25-21ksoftirqd/112:03:011
23412150,0sleep20-21swapper/210:24:312
115572150,1sleep125-21ksoftirqd/109:49:301
45372140,0sleep5551rcuc/510:52:385
31425991412,1cyclictest73-21ksoftirqd/711:03:257
3142499144,9cyclictest686-21dbus-daemon12:27:556
3142499144,4cyclictest691-21systemd-logind11:19:386
3142499144,2cyclictest5728-21systemd09:26:446
31424991412,1cyclictest65-21ksoftirqd/609:37:176
3142399145,6cyclictest57-21ksoftirqd/509:41:405
31423991412,1cyclictest57-21ksoftirqd/511:22:125
31423991412,1cyclictest57-21ksoftirqd/509:58:525
3142299149,3cyclictest49-21ksoftirqd/409:29:174
31418991413,1cyclictest41-21ksoftirqd/311:55:183
3141199143,1cyclictest686-21dbus-daemon10:30:562
31405991412,1cyclictest25-21ksoftirqd/111:56:571
31405991410,4cyclictest25-21ksoftirqd/111:07:591
31405991410,3cyclictest25-21ksoftirqd/110:31:001
31405991410,1cyclictest25-21ksoftirqd/111:41:561
307832140,0sleep60-21swapper/611:27:476
307832140,0sleep60-21swapper/611:27:476
298652140,1sleep429857-21bash11:12:474
31425991311,1cyclictest73-21ksoftirqd/711:45:527
31425991311,1cyclictest73-21ksoftirqd/709:34:357
3142499135,7cyclictest19928-21grepconf.sh12:17:486
3142499134,8cyclictest8069-21grep12:20:536
3142499133,4cyclictest16771-21systemd-cgroups09:51:356
3142499130,11cyclictest6079-21kworker/6:010:32:366
31423991312,1cyclictest57-21ksoftirqd/512:27:065
31423991312,1cyclictest57-21ksoftirqd/512:18:155
31423991311,2cyclictest2367-21systemd09:21:005
31423991311,1cyclictest0-21swapper/510:40:065
31423991310,1cyclictest57-21ksoftirqd/511:59:075
31422991312,1cyclictest49-21ksoftirqd/412:26:544
31422991311,1cyclictest49-21ksoftirqd/412:23:274
3142299130,2cyclictest28565-21sshd12:12:414
3141899130,4cyclictest16453-21sshd10:00:553
3141199132,5cyclictest28025-21sshd12:31:192
3141199132,10cyclictest0-21swapper/211:50:552
31411991311,1cyclictest1-21systemd12:23:032
3140599139,3cyclictest25-21ksoftirqd/109:55:111
3140599138,4cyclictest25-21ksoftirqd/110:57:431
31405991312,1cyclictest25-21ksoftirqd/110:50:411
31405991312,1cyclictest25-21ksoftirqd/109:12:531
31405991311,1cyclictest25-21ksoftirqd/111:23:241
31405991311,1cyclictest25-21ksoftirqd/110:27:571
31405991311,1cyclictest25-21ksoftirqd/110:14:391
31405991311,1cyclictest25-21ksoftirqd/110:10:141
31405991311,1cyclictest25-21ksoftirqd/109:57:131
31405991311,1cyclictest25-21ksoftirqd/109:21:051
3139699138,2cyclictest9-21ksoftirqd/011:12:070
3139699137,3cyclictest9-21ksoftirqd/012:02:400
31396991311,1cyclictest9-21ksoftirqd/012:23:430
31396991311,1cyclictest9-21ksoftirqd/010:28:520
3139699130,2cyclictest16164-21bash10:58:560
272632130,0sleep20-21swapper/210:20:232
118362130,0sleep30-21swapper/312:07:563
43782120,0sleep00-21swapper/010:19:010
3142599122,4cyclictest22791-21sshd10:42:297
31425991210,1cyclictest73-21ksoftirqd/711:23:217
31425991210,1cyclictest0-21swapper/709:43:227
3142499129,3cyclictest0-21swapper/610:42:026
3142499126,5cyclictest842-21grepconf.sh11:11:036
3142499125,6cyclictest13164-21grepconf.sh12:11:456
3142499125,6cyclictest10451-21grepconf.sh09:30:486
3142499124,2cyclictest691-21systemd-logind12:31:426
3142499124,2cyclictest5826-21rm10:49:006
3142499123,8cyclictest29914-21rm10:07:226
3142499123,8cyclictest2828-21systemd12:09:206
3142499123,8cyclictest14113-21rm09:42:066
3142499123,2cyclictest885-21polkitd11:38:016
3142499123,2cyclictest24885-21latency_hist11:55:406
3142499123,2cyclictest22416-21grep12:01:016
3142499122,2cyclictest18476-21sshd10:04:486
3142499122,2cyclictest11267-21systemd10:17:306
3142499121,5cyclictest27352-21sshd09:48:326
3142499120,5cyclictest691-21systemd-logind11:21:026
3142499120,0cyclictest0-21swapper/607:45:566
3142399129,3cyclictest57-21ksoftirqd/510:12:185
3142399123,4cyclictest15578-21systemd11:30:445
3142399123,4cyclictest15578-21systemd11:30:445
31423991211,1cyclictest57-21ksoftirqd/511:01:015
31423991211,1cyclictest57-21ksoftirqd/510:34:065
31423991210,1cyclictest691-21systemd-logind11:26:335
31423991210,1cyclictest691-21systemd-logind11:26:335
31423991210,1cyclictest57-21ksoftirqd/511:52:065
31423991210,1cyclictest57-21ksoftirqd/510:58:425
3142399120,11cyclictest7775-21grepconf.sh12:24:375
3142399120,1cyclictest27917-21systemd11:48:175
3142299126,1cyclictest691-21systemd-logind09:07:484
3142299122,4cyclictest558-21sshd11:54:134
3142299122,4cyclictest0-21swapper/410:16:174
31422991210,1cyclictest49-21ksoftirqd/409:32:154
3142299121,5cyclictest20462-21sshd10:23:414
3142299120,12cyclictest0-21swapper/409:57:234
3142299120,11cyclictest10840-21grep12:19:104
3141899122,4cyclictest9155-21sshd09:38:093
31418991210,1cyclictest41-21ksoftirqd/309:41:423
31418991210,1cyclictest41-21ksoftirqd/309:33:393
31418991210,1cyclictest41-21ksoftirqd/309:08:583
3141899120,11cyclictest2955-21bash09:54:363
3141199129,3cyclictest33-21ksoftirqd/212:18:582
3141199122,4cyclictest691-21systemd-logind10:06:212
3141199122,4cyclictest31952-21sshd09:39:322
3141199122,4cyclictest2161-21systemd09:58:142
31411991211,1cyclictest33-21ksoftirqd/210:12:302
3141199121,5cyclictest9063-21bash10:43:352
3141199121,5cyclictest18176-21bash11:14:012
3141199120,2cyclictest1682-21grep11:16:442
3141199120,12cyclictest0-21swapper/209:30:542
3140599129,1cyclictest25-21ksoftirqd/111:11:341
31405991211,1cyclictest25-21ksoftirqd/111:15:411
31405991210,2cyclictest25-21ksoftirqd/110:49:101
31405991210,1cyclictest25-21ksoftirqd/112:30:281
31405991210,1cyclictest25-21ksoftirqd/109:35:451
31405991210,1cyclictest25-21ksoftirqd/109:17:061
3140599120,12cyclictest0-21swapper/109:08:281
3140599120,11cyclictest686-21dbus-daemon10:01:151
3139699126,5cyclictest686-21dbus-daemon09:17:260
3139699124,5cyclictest13171-21systemd10:32:350
3139699122,4cyclictest31290-21sshd12:31:310
31396991211,1cyclictest9-21ksoftirqd/011:35:380
31396991211,1cyclictest9-21ksoftirqd/011:35:380
31396991210,1cyclictest9-21ksoftirqd/011:18:050
31396991210,1cyclictest0-21swapper/011:45:330
3139699121,4cyclictest0-21swapper/010:45:540
3139699120,4cyclictest0-21swapper/012:29:300
3139699120,2cyclictest0-21swapper/011:37:420
217242120,0sleep30-21swapper/310:12:313
171752120,0sleep30-21swapper/312:25:113
129452120,0sleep50-21swapper/510:49:255
110802120,0sleep40-21swapper/410:53:014
104862120,0sleep30-21swapper/311:47:143
104782120,0sleep40-21swapper/410:06:074
48102110,0sleep30-21swapper/312:03:483
3142599119,1cyclictest73-21ksoftirqd/712:32:207
3142599119,1cyclictest73-21ksoftirqd/712:29:267
3142599119,1cyclictest13811-21grep10:21:227
3142599119,1cyclictest1-21systemd10:27:027
3142599116,3cyclictest73-21ksoftirqd/711:43:277
3142599116,3cyclictest12639-21kill10:40:067
3142599114,4cyclictest24135-21systemd09:59:327
3142599112,3cyclictest0-21swapper/711:57:067
31425991110,1cyclictest15122-21bash12:11:537
3142599111,4cyclictest0-21swapper/711:36:537
3142599110,11cyclictest0-21swapper/710:11:547
3142599110,10cyclictest21616-21sshd11:12:177
3142599110,1cyclictest0-21swapper/711:27:167
3142599110,1cyclictest0-21swapper/711:27:167
3142499113,3cyclictest16535-21grepconf.sh09:10:446
3142499113,2cyclictest686-21dbus-daemon10:25:456
3142499112,2cyclictest885-21polkitd10:21:166
3142499110,11cyclictest19007-21kworker/6:510:56:156
3142399119,1cyclictest57-21ksoftirqd/510:41:265
3142399119,1cyclictest57-21ksoftirqd/509:52:295
3142399119,1cyclictest57-21ksoftirqd/509:38:045
3142399119,1cyclictest57-21ksoftirqd/509:14:265
3142399118,2cyclictest57-21ksoftirqd/511:42:255
3142399113,5cyclictest0-21swapper/510:20:105
3142399112,4cyclictest0-21swapper/512:07:225
31423991110,1cyclictest57-21ksoftirqd/511:35:565
31423991110,1cyclictest57-21ksoftirqd/509:49:065
3142399110,10cyclictest9073-21sshd10:06:025
3142399110,10cyclictest0-21swapper/511:07:035
3142299119,1cyclictest49-21ksoftirqd/411:55:574
3142299119,1cyclictest49-21ksoftirqd/410:25:554
3142299113,7cyclictest32462-21bash09:43:114
3142299113,3cyclictest46782sleep410:04:004
3142299112,4cyclictest23150-21sshd12:08:374
3142299111,4cyclictest9333-21sshd10:32:224
3142299111,4cyclictest26353-21sshd12:03:104
3142299111,4cyclictest24176-21grep09:14:544
3142299111,4cyclictest0-21swapper/412:33:174
3142299110,11cyclictest5248-21kworker/4:311:16:054
3142299110,11cyclictest2432-21kworker/4:211:07:354
3142299110,1cyclictest0-21swapper/411:32:024
3142299110,1cyclictest0-21swapper/411:32:024
3141899119,1cyclictest41-21ksoftirqd/309:18:263
3141899112,4cyclictest20668-21grepconf.sh09:57:253
3141899112,4cyclictest19152-21systemd-cgroups11:19:413
3141899112,4cyclictest0-21swapper/310:06:563
3141899111,4cyclictest17142-21sshd10:53:223
3141199119,1cyclictest8593-21sshd11:28:242
3141199119,1cyclictest8593-21sshd11:28:242
3141199119,1cyclictest33-21ksoftirqd/212:28:272
3141199119,1cyclictest33-21ksoftirqd/212:05:572
3141199119,1cyclictest33-21ksoftirqd/210:05:332
3141199115,5cyclictest29025-21sshd09:11:222
3141199112,4cyclictest11706-21sshd10:54:582
3141199112,3cyclictest27440-21sshd11:42:372
3141199111,4cyclictest5005-21systemd-cgroups10:47:022
3141199111,4cyclictest27312-21sshd09:09:282
3141199111,4cyclictest1-21systemd11:45:512
3141199110,11cyclictest3719-21kworker/2:309:26:092
3141199110,11cyclictest19697-21kworker/2:011:56:362
3141199110,1cyclictest0-21swapper/211:39:262
3140599119,1cyclictest25-21ksoftirqd/111:52:551
3140599119,1cyclictest25-21ksoftirqd/111:45:541
3140599119,1cyclictest25-21ksoftirqd/111:01:441
3140599119,1cyclictest25-21ksoftirqd/110:15:521
3140599118,2cyclictest25-21ksoftirqd/112:07:251
31405991110,1cyclictest25-21ksoftirqd/112:32:581
31405991110,1cyclictest25-21ksoftirqd/112:18:081
31405991110,1cyclictest25-21ksoftirqd/111:38:401
31405991110,1cyclictest25-21ksoftirqd/111:32:031
31405991110,1cyclictest25-21ksoftirqd/111:32:031
3139699119,1cyclictest9-21ksoftirqd/012:11:540
3139699119,1cyclictest9-21ksoftirqd/011:01:150
3139699119,1cyclictest9-21ksoftirqd/010:50:440
3139699117,1cyclictest9-21ksoftirqd/009:11:010
3139699114,3cyclictest0-21swapper/010:05:460
31396991110,1cyclictest9-21ksoftirqd/009:55:350
31396991110,1cyclictest9-21ksoftirqd/009:38:410
3139699110,4cyclictest0-21swapper/012:09:520
3139699110,4cyclictest0-21swapper/009:21:390
3139699110,10cyclictest27420-21sshd10:40:540
3142599108,1cyclictest73-21ksoftirqd/711:33:107
3142599108,1cyclictest73-21ksoftirqd/711:33:107
3142599108,1cyclictest73-21ksoftirqd/709:51:517
3142599108,1cyclictest73-21ksoftirqd/709:40:027
3142599108,1cyclictest73-21ksoftirqd/709:11:067
3142599107,2cyclictest73-21ksoftirqd/712:23:527
3142599103,6cyclictest8178-21pluginstate10:50:577
3142599103,6cyclictest7787-21sshd10:02:157
3142599103,6cyclictest14222-21sshd12:06:087
3142599103,4cyclictest11498-21grep10:19:277
3142599103,3cyclictest885-21polkitd09:22:367
3142599102,7cyclictest15955-21sshd10:30:547
3142599100,4cyclictest5783-21sshd09:19:247
3142599100,4cyclictest0-21swapper/709:08:207
3142499102,2cyclictest786-21snmpd07:13:106
3142399108,1cyclictest57-21ksoftirqd/510:20:545
3142399107,3cyclictest1-21systemd11:12:055
3142399102,5cyclictest5410-21bash09:19:225
3142399101,5cyclictest14861-21sshd11:17:315
3142399100,4cyclictest0-21swapper/510:29:415
3142399100,10cyclictest0-21swapper/509:29:565
3142299100,4cyclictest3320-21sshd10:56:154
3142299100,4cyclictest1-21systemd10:10:534
3142299100,10cyclictest0-21swapper/409:54:174
3141899109,1cyclictest0-21swapper/309:13:183
3141899108,1cyclictest41-21ksoftirqd/312:17:073
3141899108,1cyclictest41-21ksoftirqd/310:23:383
3141899103,4cyclictest885-21polkitd09:27:273
3141899101,4cyclictest28786-21grepconf.sh12:14:373
3141899101,4cyclictest27136-21systemd-cgroups11:29:313
3141899101,4cyclictest27136-21systemd-cgroups11:29:313
3141899101,4cyclictest14478-21bash11:21:113
3141899101,4cyclictest0-21swapper/310:40:013
3141899100,10cyclictest14188-21kworker/3:011:58:563
3141899100,10cyclictest0-21swapper/312:32:143
3141899100,10cyclictest0-21swapper/311:35:303
3141899100,10cyclictest0-21swapper/311:35:303
3141899100,10cyclictest0-21swapper/310:56:523
3141899100,1cyclictest21426-21systemd11:06:393
3141199103,6cyclictest686-21dbus-daemon12:02:302
3139699109,1cyclictest9-21ksoftirqd/009:07:230
3139699108,1cyclictest9-21ksoftirqd/010:20:460
3139699105,3cyclictest32371-21httpd12:00:310
3139699104,2cyclictest0-21swapper/008:01:490
3139699104,0cyclictest0-21swapper/009:32:270
3139699103,4cyclictest30092-21grep09:56:040
3139699103,4cyclictest1-21systemd11:50:460
3139699102,5cyclictest17906-21systemd09:27:280
3139699102,4cyclictest15428-21systemd11:26:530
3139699102,4cyclictest15428-21systemd11:26:530
3139699102,4cyclictest11062-21sshd10:36:100
3139699102,3cyclictest10388-21ntp_states11:20:590
3139699100,9cyclictest29758-21kworker/0:210:11:250
3139699100,3cyclictest0-21swapper/009:46:190
314259998,1cyclictest73-21ksoftirqd/710:06:577
314259994,4cyclictest32337-21httpd11:16:537
314259993,3cyclictest8141-21kill11:05:557
314249999,0cyclictest0-21swapper/608:00:556
314249993,2cyclictest0-21swapper/608:27:006
314249993,1cyclictest786-21snmpd08:32:516
314249993,1cyclictest786-21snmpd08:23:066
314249993,1cyclictest786-21snmpd08:12:176
314249993,1cyclictest786-21snmpd07:43:506
314249993,1cyclictest786-21snmpd07:39:176
314249993,1cyclictest786-21snmpd07:34:176
314249993,1cyclictest786-21snmpd07:27:446
314249992,2cyclictest8701-21cut07:20:526
314249992,2cyclictest20872-21sshd08:39:386
314249992,1cyclictest786-21snmpd07:59:416
314249992,1cyclictest786-21snmpd07:52:056
314249992,1cyclictest7565-21latency_hist07:20:416
314249992,1cyclictest1168-21tail09:00:536
314249992,1cyclictest1168-21tail09:00:536
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional