You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 05:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Sun Apr 26, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
384464325947,8sleep50-21swapper/519:04:205
3854080994236,5cyclictest328098-21latency_hist00:09:157
38482912403,30sleep70-21swapper/719:04:387
385357623625,8sleep40-21swapper/419:06:114
385408099350,33cyclictest304048-21latency_hist23:59:157
3854073993533,2cyclictest374626-21kworker/u16:1+events_unbound00:27:495
3854073993331,2cyclictest4040065-21kworker/u16:4+events_unbound21:22:545
3854073993331,2cyclictest361937-21kworker/u16:0+events_unbound00:22:405
3854069993330,2cyclictest4160495-21kworker/u16:4+flush-8:023:19:154
3854078993230,2cyclictest219738-21kworker/u16:3+flush-8:023:52:256
3854073993230,2cyclictest4029572-21kworker/u16:2+events_unbound21:14:565
3854078993129,2cyclictest4029572-21kworker/u16:2+flush-8:020:54:156
3854073993028,2cyclictest4160495-21kworker/u16:4+events_unbound22:36:005
3854073993028,2cyclictest136723-21kworker/u16:2+flush-8:022:52:535
3854080992928,0cyclictest0-21swapper/723:09:297
3854073992927,2cyclictest4160495-21kworker/u16:4+events_unbound23:03:085
3854073992927,2cyclictest4145740-21kworker/u16:2+flush-8:021:39:405
3854073992927,2cyclictest39076-21kworker/u16:5+flush-8:022:13:265
3854073992927,2cyclictest39076-21kworker/u16:5+flush-8:022:13:265
3854073992927,2cyclictest374626-21kworker/u16:1+events_unbound00:36:565
3854073992927,2cyclictest219738-21kworker/u16:3+events_unbound00:17:125
3854073992927,2cyclictest219738-21kworker/u16:3+events_unbound00:17:125
3854078992826,2cyclictest99303-21kworker/u16:0+flush-8:022:49:456
3854073992826,2cyclictest219738-21kworker/u16:3+events_unbound00:05:525
3854073992826,2cyclictest136723-21kworker/u16:2+flush-8:022:57:485
3854073992826,2cyclictest136723-21kworker/u16:2+flush-8:022:57:485
3854073992825,2cyclictest4001614-21kworker/u16:3+events_unbound20:29:185
3854078992725,2cyclictest3815746-21kworker/u16:0+events_unbound19:14:336
3854073992725,2cyclictest99303-21kworker/u16:0+events_unbound22:47:395
3854073992725,2cyclictest4124355-21kworker/u16:3+flush-8:021:26:065
3854073992725,2cyclictest4077940-21kworker/u16:1+flush-8:021:01:455
3854073992725,2cyclictest3982391-21kworker/u16:1+events_unbound20:28:545
3854073992725,2cyclictest136723-21kworker/u16:2+flush-8:023:04:305
3854073992725,2cyclictest121021-21kworker/u16:2+flush-8:022:41:575
3854078992624,2cyclictest3915136-21kworker/u16:3+flush-8:019:39:386
3854073992624,2cyclictest4160495-21kworker/u16:4+events_unbound22:24:575
3854073992624,2cyclictest302750-21kworker/u16:2+events_unbound23:57:555
3854073992624,2cyclictest219738-21kworker/u16:3+flush-8:000:12:405
3854073992624,2cyclictest171715-21kworker/u16:0+events_unbound23:45:385
385365422616,7sleep60-21swapper/619:07:186
3854080992521,3cyclictest3915559-21sed19:39:167
3854078992522,2cyclictest4160495-21kworker/u16:4+flush-8:022:24:406
3854073992523,2cyclictest4160495-21kworker/u16:4+flush-8:023:20:285
3854073992523,2cyclictest4124355-21kworker/u16:3+events_unbound21:36:225
3854073992523,2cyclictest4049855-21kworker/u16:0+flush-8:021:11:565
3854073992523,2cyclictest3943861-21kworker/u16:1+events_unbound19:56:435
3854073992523,2cyclictest39075-21kworker/u16:1+flush-8:022:32:025
3854073992523,2cyclictest3853797-21kworker/u16:2+flush-8:019:29:025
3854073992523,2cyclictest243789-21kworker/u16:1+events_unbound23:53:085
3854073992523,2cyclictest243789-21kworker/u16:1+events_unbound00:00:495
3854073992523,2cyclictest171715-21kworker/u16:0+events_unbound23:43:565
3854073992523,2cyclictest171715-21kworker/u16:0+events_unbound23:25:095
3854073992422,2cyclictest4160495-21kworker/u16:4+events_unbound22:20:305
3854073992422,2cyclictest4145740-21kworker/u16:2+flush-8:021:50:545
3854073992422,2cyclictest4124355-21kworker/u16:3+flush-8:021:54:505
3854073992422,2cyclictest4124355-21kworker/u16:3+events_unbound22:04:265
3854073992422,2cyclictest3943861-21kworker/u16:1+flush-8:019:50:225
3854073992422,2cyclictest3915136-21kworker/u16:3+flush-8:019:45:095
3854073992422,2cyclictest243789-21kworker/u16:1+flush-8:023:36:035
3854073992422,2cyclictest243789-21kworker/u16:1+flush-8:023:36:035
3854073992422,2cyclictest219738-21kworker/u16:3+events_unbound00:29:505
3854080992317,5cyclictest3944152-21latency_hist19:54:157
3854078992321,2cyclictest4029572-21kworker/u16:2+flush-8:020:59:156
3854078992321,2cyclictest3963261-21kworker/u16:3+flush-8:020:09:416
3854078992321,2cyclictest243789-21kworker/u16:1+flush-8:000:14:446
3854078992321,2cyclictest243789-21kworker/u16:1+flush-8:000:14:446
3854073992321,2cyclictest4160495-21kworker/u16:4+flush-8:023:11:395
3854073992321,2cyclictest3963261-21kworker/u16:3+events_unbound20:14:135
3854073992321,2cyclictest3841198-21kworker/u16:1+events_unbound19:24:135
3854073992321,2cyclictest3815746-21kworker/u16:0+flush-8:019:10:295
3854073992321,2cyclictest3815746-21kworker/u16:0+events_unbound20:41:115
3854073992321,2cyclictest171715-21kworker/u16:0+flush-8:023:14:525
3854073992320,2cyclictest3982391-21kworker/u16:1+flush-8:020:44:165
3854078992220,2cyclictest99303-21kworker/u16:0+flush-8:022:44:306
3854073992220,2cyclictest4160495-21kworker/u16:4+flush-8:021:48:025
3854073992220,2cyclictest4145740-21kworker/u16:2+events_unbound21:32:095
3854073992220,2cyclictest4145740-21kworker/u16:2+events_unbound21:32:095
3854073992220,2cyclictest4124355-21kworker/u16:3+flush-8:022:03:185
3854073992220,2cyclictest4029572-21kworker/u16:2+flush-8:020:53:135
3854073992220,2cyclictest3841198-21kworker/u16:1+flush-8:019:14:165
3854073992220,2cyclictest3815746-21kworker/u16:0+flush-8:019:42:105
3854073992220,2cyclictest171715-21kworker/u16:0+flush-8:023:29:565
3840892220,1chrt384090-21kthreadcore00:29:397
3854073992119,2cyclictest4049855-21kworker/u16:0+events_unbound21:06:265
3854073992119,2cyclictest3991995-21kworker/u16:2+events_unbound20:21:385
3854073992118,2cyclictest38956-21kworker/u16:0+events_unbound22:14:185
385408099200,19cyclictest635-21systemd-journal21:44:167
3854078992018,2cyclictest38956-21kworker/u16:0+events_unbound22:09:396
3854078992018,2cyclictest38956-21kworker/u16:0+events_unbound22:09:396
3854078992018,2cyclictest219738-21kworker/u16:3+events_unbound23:24:366
3854078992018,2cyclictest171715-21kworker/u16:0+flush-8:023:29:396
3854078992018,2cyclictest171715-21kworker/u16:0+flush-8:023:19:406
3854073992018,2cyclictest3915136-21kworker/u16:3+events_unbound19:37:095
3854073992018,2cyclictest3815746-21kworker/u16:0+flush-8:019:30:095
3854080991914,4cyclictest4160074-21latency_hist21:39:157
3854078991917,2cyclictest4124355-21kworker/u16:3+flush-8:021:30:266
3854078991917,2cyclictest4124355-21kworker/u16:3+flush-8:021:30:266
3854078991917,2cyclictest39075-21kworker/u16:1+events_unbound22:59:296
3854078991917,2cyclictest3841198-21kworker/u16:1+flush-8:019:19:336
3854073991917,2cyclictest3953642-21kworker/u16:2+flush-8:020:09:015
3854073991917,2cyclictest3953642-21kworker/u16:2+flush-8:020:09:015
3854073991917,2cyclictest3815746-21kworker/u16:0+flush-8:020:01:135
3854073991917,2cyclictest3815746-21kworker/u16:0+events_unbound20:16:305
3854080991812,5cyclictest635-21systemd-journal23:09:157
385408099180,17cyclictest0-21swapper/720:04:417
385408099180,17cyclictest0-21swapper/720:04:417
3854078991816,2cyclictest3815746-21kworker/u16:0+flush-8:019:29:436
3854078991816,2cyclictest3815746-21kworker/u16:0+events_unbound20:39:296
3854078991815,2cyclictest4160495-21kworker/u16:4+flush-8:023:09:256
3854073991816,2cyclictest4029572-21kworker/u16:2+flush-8:020:57:505
3854073991816,2cyclictest4001614-21kworker/u16:3+events_unbound20:38:585
385408099179,7cyclictest6514-21gmain19:14:417
385408099174,11cyclictest1234-21snmpd22:21:057
3854080991715,1cyclictest2442-21systemd-run21:54:167
3854080991713,3cyclictest1234-21snmpd23:20:137
385408099170,15cyclictest252734-21ssh23:34:387
385408099170,15cyclictest252734-21ssh23:34:387
3854069991714,2cyclictest6372-21gvfs-udisks2-vo23:28:544
3854069991714,2cyclictest5944-21gsd-housekeepin23:13:144
3854069991714,2cyclictest5944-21gsd-housekeepin20:51:154
3854080991615,0cyclictest0-21swapper/723:15:227
3854080991614,1cyclictest0-21swapper/721:54:467
3854080991613,2cyclictest1234-21snmpd00:13:357
385408099160,15cyclictest124-21kswapd022:04:307
385408099160,14cyclictest0-21swapper/723:24:407
3854078991615,1cyclictest0-21swapper/622:20:536
3854078991614,2cyclictest4040065-21kworker/u16:4+flush-8:021:04:116
3854078991614,2cyclictest219738-21kworker/u16:3+flush-8:023:34:296
3854078991614,2cyclictest219738-21kworker/u16:3+flush-8:023:34:296
3854078991613,2cyclictest4180462-21kthreadcore21:44:376
3854078991613,2cyclictest4049855-21kworker/u16:0+flush-8:021:09:206
3854069991615,1cyclictest39414-21grep22:09:274
3854069991615,1cyclictest39414-21grep22:09:274
3854069991614,2cyclictest5944-21gsd-housekeepin23:59:144
3854069991614,2cyclictest5944-21gsd-housekeepin23:47:144
3854069991614,2cyclictest5944-21gsd-housekeepin20:19:154
3854069991614,2cyclictest5944-21gsd-housekeepin19:43:154
3854069991614,2cyclictest5944-21gsd-housekeepin19:27:154
3854069991614,2cyclictest5944-21gsd-housekeepin19:19:154
3854069991614,2cyclictest171715-21kworker/u16:0+events_unbound23:21:104
3854080991512,2cyclictest0-21swapper/721:19:167
3854078991513,2cyclictest39075-21kworker/u16:1+events_unbound22:32:256
3854078991513,2cyclictest3815746-21kworker/u16:0+flush-8:019:34:336
3854069991513,2cyclictest3953642-21kworker/u16:2+events_unbound20:09:104
3854069991513,2cyclictest3953642-21kworker/u16:2+events_unbound20:09:104
3854069991513,1cyclictest51518-21/usr/sbin/munin22:14:294
3854069991513,1cyclictest3944626-21/usr/sbin/munin19:54:274
3854069991513,1cyclictest201rcu_preempt21:38:174
3854069991512,2cyclictest5944-21gsd-housekeepin21:22:144
3854069991512,2cyclictest5826-21JS15:59:264
3854069991512,1cyclictest0-21swapper/400:01:454
385406999150,2cyclictest65-21ksoftirqd/419:29:414
3854080991413,0cyclictest0-21swapper/722:16:037
3854078991413,1cyclictest0-21swapper/622:01:206
3854078991413,1cyclictest0-21swapper/600:24:016
3854078991412,2cyclictest99303-21kworker/u16:0+flush-8:022:43:256
3854078991412,2cyclictest4101905-21kworker/u16:1+events_unbound21:19:256
3854078991412,2cyclictest39075-21kworker/u16:1+events_unbound22:56:256
3854078991412,2cyclictest39075-21kworker/u16:1+events_unbound22:56:256
385407899140,1cyclictest0-21swapper/621:37:126
385407899140,1cyclictest0-21swapper/620:45:116
385407899140,14cyclictest0-21swapper/620:34:376
3854069991413,1cyclictest3858400-21tr19:09:354
3854069991413,1cyclictest0-21swapper/421:45:324
3854069991412,2cyclictest5944-21gsd-housekeepin20:35:154
3854069991412,1cyclictest4060070-21fschecks_time20:54:294
3854069991412,1cyclictest3938671-21kthreadcore19:49:344
3854069991412,1cyclictest335893-21kthreadcore00:09:364
3854069991412,1cyclictest144806-21cat22:49:434
3854069991412,1cyclictest11137-21cut21:54:354
385406999140,1cyclictest0-21swapper/422:20:044
385406999140,1cyclictest0-21swapper/421:24:304
385406999140,14cyclictest0-21swapper/422:56:004
385406999140,14cyclictest0-21swapper/422:56:004
385406999140,14cyclictest0-21swapper/422:31:534
385406999140,14cyclictest0-21swapper/421:30:244
385406999140,14cyclictest0-21swapper/421:30:244
385406999140,0cyclictest0-21swapper/421:53:254
385408099139,3cyclictest1234-21snmpd20:33:027
385408099139,3cyclictest1234-21snmpd20:15:257
385408099139,3cyclictest1234-21snmpd19:32:397
385408099137,5cyclictest3896187-21latency_hist19:29:167
385408099137,5cyclictest159487-21latency_hist22:59:157
385408099137,5cyclictest159487-21latency_hist22:59:157
385408099136,6cyclictest6382-21gvfs-afc-volume22:24:407
3854080991310,2cyclictest0-21swapper/700:34:407
3854080991310,2cyclictest0-21swapper/700:19:447
385408099130,11cyclictest1234-21snmpd22:30:477
385408099130,11cyclictest1234-21snmpd20:56:357
385407899136,7cyclictest0-21swapper/619:24:326
3854078991312,1cyclictest0-21swapper/621:53:086
3854078991312,1cyclictest0-21swapper/621:14:496
385407899130,13cyclictest0-21swapper/620:14:266
385406999134,4cyclictest247688-21kthreadcore23:34:334
385406999134,4cyclictest247688-21kthreadcore23:34:334
3854069991312,1cyclictest82604-21grep22:24:364
3854069991312,1cyclictest4100664-21expr21:14:284
3854069991312,1cyclictest4089249-21/usr/sbin/munin21:09:334
3854069991312,1cyclictest4082748-21kthreadcore21:04:354
3854069991312,1cyclictest4069960-21sed20:59:334
3854069991312,1cyclictest4011559-21/usr/sbin/munin20:29:424
3854069991312,1cyclictest4003094-21irqcore20:24:324
3854069991312,1cyclictest3931552-21kthreadcore19:44:364
3854069991312,1cyclictest3885429-21cat19:19:374
3854069991312,1cyclictest172877-21iptables23:04:324
3854069991312,1cyclictest0-21swapper/422:44:114
3854069991311,1cyclictest4039160-21switchtime20:39:424
3854069991311,1cyclictest129610-21tr22:44:364
3854069991311,1cyclictest103638-21kthreadcore22:34:344
3854069991310,2cyclictest349121-21ntpq00:14:394
3854069991310,2cyclictest349121-21ntpq00:14:394
3854069991310,1cyclictest201rcu_preempt19:37:154
385408099129,2cyclictest1234-21snmpd19:19:277
385408099128,3cyclictest1234-21snmpd21:08:027
385408099128,3cyclictest1234-21snmpd20:39:267
385408099128,3cyclictest1234-21snmpd20:03:587
385408099128,3cyclictest1234-21snmpd19:54:197
385408099128,3cyclictest1234-21snmpd00:14:357
385408099128,3cyclictest1234-21snmpd00:14:357
385408099125,6cyclictest5975-21gmain19:39:297
3854080991212,0cyclictest0-21swapper/721:33:387
3854080991212,0cyclictest0-21swapper/721:33:387
3854080991211,0cyclictest0-21swapper/719:10:107
385408099120,11cyclictest1234-21snmpd20:52:357
3854078991211,1cyclictest0-21swapper/620:24:416
3854078991210,2cyclictest4101905-21kworker/u16:1+events_unbound21:26:256
3854078991210,2cyclictest302750-21kworker/u16:2+flush-8:000:00:256
3854078991210,2cyclictest219738-21kworker/u16:3+flush-8:023:54:246
3854078991210,2cyclictest219738-21kworker/u16:3+flush-8:000:34:266
3854078991210,2cyclictest171715-21kworker/u16:0+events_unbound23:44:396
3854069991211,1cyclictest3956913-21kthreadcore19:59:364
3854069991211,1cyclictest287337-21kthreadcore23:49:354
3854069991211,1cyclictest233175-21sed23:29:334
3854069991211,1cyclictest0-21swapper/422:04:334
3854069991211,1cyclictest0-21swapper/420:19:324
3854069991210,2cyclictest4029572-21kworker/u16:2+events_unbound20:47:204
3854069991210,1cyclictest376219-21perf00:34:104
3854069991210,1cyclictest316928-21ls00:04:284
3854069991210,1cyclictest257574-21kthreadcore23:39:324
3854069991210,1cyclictest1-21systemd00:39:154
385408099119,1cyclictest0-21swapper/723:29:157
385408099118,2cyclictest1234-21snmpd23:59:297
385408099118,2cyclictest1234-21snmpd21:26:547
385408099118,2cyclictest1234-21snmpd20:59:327
385408099118,2cyclictest0-21swapper/722:44:347
385408099117,3cyclictest1234-21snmpd23:51:207
385408099117,3cyclictest1234-21snmpd23:42:057
385408099117,3cyclictest1234-21snmpd20:11:347
385408099117,3cyclictest1234-21snmpd19:46:467
385408099116,5cyclictest6382-21gvfs-afc-volume22:03:067
385408099116,4cyclictest1198-21tuned-ppd21:44:047
385408099115,5cyclictest6382-21gvfs-afc-volume22:39:207
3854080991111,0cyclictest0-21swapper/721:12:597
385408099110,9cyclictest1234-21snmpd23:44:327
385408099110,9cyclictest1234-21snmpd20:25:287
385407899117,3cyclictest3945320-21cat19:54:306
385407899114,6cyclictest325251-21switchtime00:04:446
385407899113,7cyclictest262377-21kthreadcore23:39:356
385407899113,3cyclictest4160991-21expr21:39:276
3854078991110,1cyclictest0-21swapper/621:07:536
385407899110,10cyclictest3994770-21cut20:19:336
385406999112,5cyclictest65-21ksoftirqd/421:39:274
385406999111,6cyclictest65-21ksoftirqd/421:59:344
385406999111,6cyclictest65-21ksoftirqd/420:09:324
385408099108,1cyclictest0-21swapper/722:34:397
385408099108,1cyclictest0-21swapper/720:44:457
385408099107,2cyclictest1129-21containerd22:52:407
385408099107,2cyclictest0-21swapper/700:24:287
385408099106,3cyclictest6895-21gmain21:19:327
385408099106,3cyclictest1234-21snmpd20:19:347
385408099106,3cyclictest0-21swapper/722:09:307
385408099106,3cyclictest0-21swapper/722:09:307
385408099104,5cyclictest4021672-21seq20:34:287
385407899108,2cyclictest86-21ksoftirqd/622:04:426
385407899108,2cyclictest219738-21kworker/u16:3+flush-8:000:09:406
385407899108,2cyclictest219738-21kworker/u16:3+events_unbound00:24:286
385407899107,2cyclictest108222-21ntpq22:34:396
385407899106,3cyclictest3954915-21cat19:59:336
385407899104,5cyclictest0-21swapper/623:14:366
385407899100,9cyclictest3931872-21kthreadcore19:44:366
385407899100,4cyclictest56612-21kthreadcore22:14:346
385406999108,1cyclictest376011-21pool-udisksd00:28:544
38540809996,2cyclictest0-21swapper/723:00:067
38540789997,2cyclictest86-21ksoftirqd/600:29:306
38540789996,2cyclictest3934957-21/usr/sbin/munin19:49:436
38540789995,3cyclictest173494-21kthreadcore23:04:336
38540789990,8cyclictest6863-21kthreadcore21:54:336
38540789986,2cyclictest86-21ksoftirqd/619:09:296
38540789983,4cyclictest0-21swapper/620:29:316
38540789980,2cyclictest3963713-21/usr/sbin/munin20:04:326
38540789980,2cyclictest3963713-21/usr/sbin/munin20:04:326
38540699985,1cyclictest991rcuop/700:19:364
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional