You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 13:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Wed Jun 03, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
142815525747,7sleep40-21swapper/407:05:064
142796824922,8sleep50-21swapper/507:02:265
1428558994845,2cyclictest1566072-21kworker/u16:2+flush-8:008:26:426
1428551994139,2cyclictest1820729-21kworker/u16:3+flush-8:010:42:084
14273232402,31sleep70-21swapper/707:02:127
1428554993836,2cyclictest1442202-21kworker/u16:0+events_unbound09:42:395
142856099370,35cyclictest124-21kswapd012:06:577
1428554993735,2cyclictest1820729-21kworker/u16:3+events_unbound10:42:065
1428554993432,2cyclictest2086959-21kworker/u16:4+events_unbound12:07:045
1428560993328,4cyclictest1808498-21latency_hist10:06:427
1428558993229,2cyclictest1932149-21kworker/u16:0+events_unbound11:11:426
1428554993230,2cyclictest2124381-21kworker/u16:3+events_unbound12:32:095
1428554993230,2cyclictest1820729-21kworker/u16:3+events_unbound10:37:095
142804323222,7sleep60-21swapper/607:03:326
1428560993126,4cyclictest1499456-21latency_hist07:41:437
1428558993129,2cyclictest1442202-21kworker/u16:0+flush-8:009:42:076
1428554993129,2cyclictest2124382-21kworker/u16:4+events_unbound12:29:585
1428554993129,2cyclictest1932149-21kworker/u16:0+events_unbound12:04:345
1428554993129,2cyclictest1905831-21kworker/u16:4+events_unbound10:47:385
1428554993129,2cyclictest1735445-21kworker/u16:1+events_unbound09:52:555
1428554993129,2cyclictest1409157-21kworker/u16:3+events_unbound07:18:415
1428551993129,2cyclictest1675457-21kworker/u16:4+events_unbound09:17:074
1428558993028,2cyclictest1735445-21kworker/u16:1+flush-8:010:02:216
1428558993028,2cyclictest1653755-21kworker/u16:2+events_unbound09:07:076
1428554993028,2cyclictest1932149-21kworker/u16:0+events_unbound12:21:185
1428554993028,2cyclictest1841811-21kworker/u16:0+events_unbound10:30:475
1428554993028,2cyclictest1841811-21kworker/u16:0+events_unbound10:25:075
1428554993028,2cyclictest1735445-21kworker/u16:1+events_unbound10:17:015
1428554993028,2cyclictest1442202-21kworker/u16:0+flush-8:010:10:555
1428554993028,2cyclictest1442202-21kworker/u16:0+events_unbound09:10:385
1428554992927,2cyclictest1932149-21kworker/u16:0+events_unbound11:28:175
1428554992927,2cyclictest1932149-21kworker/u16:0+events_unbound11:25:385
1428554992927,2cyclictest1566072-21kworker/u16:2+events_unbound08:39:165
1428554992927,2cyclictest1499647-21kworker/u16:1+events_unbound07:51:175
1428554992927,2cyclictest1442202-21kworker/u16:0+events_unbound08:28:255
1428554992927,2cyclictest1409158-21kworker/u16:4+events_unbound07:32:105
1428551992927,2cyclictest1442202-21kworker/u16:0+flush-8:008:12:124
20623452280,1chrt2062346-21ssh11:51:017
1428554992826,2cyclictest2124382-21kworker/u16:4+events_unbound12:24:535
1428554992826,2cyclictest1987095-21kworker/u16:3+flush-8:012:01:055
1428554992826,2cyclictest1987095-21kworker/u16:3+events_unbound11:41:505
1428554992826,2cyclictest1987095-21kworker/u16:3+events_unbound11:33:335
1428554992826,2cyclictest1987095-21kworker/u16:3+events_unbound11:33:335
1428554992826,2cyclictest1932149-21kworker/u16:0+events_unbound11:20:305
1428554992826,2cyclictest1820729-21kworker/u16:3+events_unbound10:12:375
1428554992826,2cyclictest1735445-21kworker/u16:1+events_unbound09:57:385
1428554992826,2cyclictest1653755-21kworker/u16:2+events_unbound10:03:065
1428554992826,2cyclictest1566072-21kworker/u16:2+events_unbound08:18:255
1428554992826,2cyclictest1409157-21kworker/u16:3+events_unbound07:24:255
1428554992825,2cyclictest1409158-21kworker/u16:4+events_unbound07:41:475
1428551992826,2cyclictest1624737-21kworker/u16:3+flush-8:009:01:574
1428554992725,2cyclictest1932149-21kworker/u16:0+events_unbound11:06:145
1428554992725,2cyclictest1882796-21kworker/u16:1+flush-8:010:52:285
1428554992725,2cyclictest1882796-21kworker/u16:1+events_unbound11:08:465
1428554992725,2cyclictest1820729-21kworker/u16:3+events_unbound10:32:005
1428554992725,2cyclictest1653755-21kworker/u16:2+flush-8:009:47:075
1428554992725,2cyclictest1442202-21kworker/u16:0+flush-8:008:12:245
1428554992725,2cyclictest1442202-21kworker/u16:0+events_unbound08:55:085
1428554992725,2cyclictest1442202-21kworker/u16:0+events_unbound08:55:085
1428554992725,2cyclictest1442202-21kworker/u16:0+events_unbound08:25:555
1428558992624,2cyclictest1442202-21kworker/u16:0+flush-8:009:16:546
1428554992624,2cyclictest2105717-21kworker/u16:2+events_unbound12:16:335
1428554992624,2cyclictest2105717-21kworker/u16:2+events_unbound12:16:335
1428554992624,2cyclictest1932149-21kworker/u16:0+flush-8:011:37:025
1428554992624,2cyclictest1675032-21kworker/u16:1+flush-8:009:14:315
1428554992624,2cyclictest1442202-21kworker/u16:0+flush-8:009:03:565
1428554992624,2cyclictest1442202-21kworker/u16:0+events_unbound09:32:535
1428554992624,2cyclictest1409158-21kworker/u16:4+events_unbound07:39:045
1428554992624,2cyclictest1409158-21kworker/u16:4+events_unbound07:14:565
1428554992524,1cyclictest1442202-21kworker/u16:0+flush-8:007:57:475
1428554992523,2cyclictest1932149-21kworker/u16:0+flush-8:011:12:035
1428554992523,2cyclictest1932149-21kworker/u16:0+events_unbound10:58:075
1428554992523,2cyclictest1566072-21kworker/u16:2+flush-8:008:50:275
1428554992523,2cyclictest1442202-21kworker/u16:0+events_unbound08:33:485
1428554992523,2cyclictest1409158-21kworker/u16:4+events_unbound07:29:165
1428554992523,2cyclictest1409158-21kworker/u16:4+events_unbound07:08:165
1428554992422,2cyclictest1735445-21kworker/u16:1+flush-8:009:37:415
1428554992422,2cyclictest1566072-21kworker/u16:2+events_unbound08:44:015
1428554992422,2cyclictest1499647-21kworker/u16:1+events_unbound08:02:495
1428554992422,2cyclictest1442202-21kworker/u16:0+events_unbound09:28:075
1428554992422,2cyclictest1442202-21kworker/u16:0+events_unbound09:28:075
1428554992422,2cyclictest1409158-21kworker/u16:4+events_unbound08:10:405
1428554992422,2cyclictest1409158-21kworker/u16:4+events_unbound07:54:445
1428558992321,2cyclictest1409158-21kworker/u16:4+flush-8:007:46:436
142856099220,20cyclictest2050640-21latency_hist11:46:427
142856099220,20cyclictest1796376-21latency_hist10:01:437
1428558992220,2cyclictest1409157-21kworker/u16:3+events_unbound07:37:136
1428554992220,2cyclictest1675457-21kworker/u16:4+events_unbound09:23:555
1428558992119,2cyclictest1820729-21kworker/u16:3+flush-8:010:32:236
1428558992119,2cyclictest1675457-21kworker/u16:4+flush-8:009:31:376
1428558992119,2cyclictest1675457-21kworker/u16:4+flush-8:009:31:376
1428558992119,2cyclictest1409158-21kworker/u16:4+events_unbound07:47:076
1428551992119,2cyclictest1409158-21kworker/u16:4+events_unbound08:41:584
1428560992017,1cyclictest2035384-21sed11:37:077
1428560992015,4cyclictest1747856-21latency_hist09:41:427
1428554992018,2cyclictest1932149-21kworker/u16:0+events_unbound11:52:175
1428554992018,2cyclictest1624737-21kworker/u16:3+flush-8:008:59:205
1428558991918,1cyclictest0-21swapper/611:53:156
1428558991917,2cyclictest1987095-21kworker/u16:3+flush-8:011:21:376
1428558991917,2cyclictest1932149-21kworker/u16:0+flush-8:012:22:036
1428558991916,3cyclictest1820729-21kworker/u16:3+flush-8:010:16:426
1428554991917,2cyclictest1675457-21kworker/u16:4+events_unbound09:20:205
1428560991817,0cyclictest0-21swapper/709:42:037
142856099180,17cyclictest0-21swapper/709:32:067
1428551991817,1cyclictest1882796-21kworker/u16:1+events_unbound10:41:154
142856099178,8cyclictest6032-21gmain10:35:597
1428560991714,2cyclictest0-21swapper/712:31:427
1428560991712,4cyclictest1723688-21latency_hist09:31:427
1428560991712,4cyclictest1723688-21latency_hist09:31:427
142856099170,1cyclictest0-21swapper/708:42:077
1428558991714,2cyclictest0-21swapper/607:27:036
1428560991613,2cyclictest0-21swapper/710:47:087
1428560991611,4cyclictest1869118-21latency_hist10:31:427
1428558991615,1cyclictest1882796-21kworker/u16:1+events_unbound10:57:286
1428558991614,2cyclictest1653755-21kworker/u16:2+flush-8:009:56:426
1428558991614,2cyclictest1409158-21kworker/u16:4+events_unbound08:31:566
142855899160,1cyclictest0-21swapper/607:58:076
142856099157,7cyclictest6514-21gmain08:22:037
1428560991513,1cyclictest0-21swapper/711:16:437
1428560991511,3cyclictest1234-21snmpd11:08:177
1428560991511,2cyclictest1662972-21munin-run09:06:427
142856099150,13cyclictest1234-21snmpd11:57:517
142856099150,13cyclictest0-21swapper/708:07:077
1428558991513,2cyclictest1442202-21kworker/u16:0+flush-8:008:51:576
1428558991513,2cyclictest1442202-21kworker/u16:0+flush-8:008:51:576
1428551991511,3cyclictest1409157-21kworker/u16:3+flush-8:007:27:084
142855199150,1cyclictest0-21swapper/412:32:244
142855199150,15cyclictest0-21swapper/409:54:064
142855199150,15cyclictest0-21swapper/409:41:584
1428560991413,0cyclictest0-21swapper/709:46:587
1428560991412,1cyclictest1831263-21ssh10:13:567
1428560991412,1cyclictest0-21swapper/707:42:067
1428560991411,2cyclictest0-21swapper/711:02:087
1428560991410,3cyclictest1234-21snmpd11:13:537
1428560991410,3cyclictest1234-21snmpd10:36:467
1428560991410,3cyclictest1234-21snmpd08:01:427
1428558991413,1cyclictest0-21swapper/610:09:366
1428558991412,2cyclictest1409158-21kworker/u16:4+events_unbound07:21:586
1428554991412,2cyclictest1987095-21kworker/u16:3+flush-8:011:50:255
1428551991413,1cyclictest0-21swapper/410:47:144
1428551991413,1cyclictest0-21swapper/410:31:284
1428551991413,1cyclictest0-21swapper/410:19:104
1428551991413,1cyclictest0-21swapper/409:30:374
1428551991413,1cyclictest0-21swapper/409:30:374
1428551991413,1cyclictest0-21swapper/408:59:524
142855199140,14cyclictest0-21swapper/409:10:164
142856099139,3cyclictest1234-21snmpd12:05:187
142856099139,3cyclictest1234-21snmpd10:46:077
142856099139,3cyclictest1234-21snmpd09:09:027
142856099139,3cyclictest1234-21snmpd08:38:347
142856099138,4cyclictest2124307-21cat12:16:567
142856099133,9cyclictest1206-21containerd12:22:217
1428560991311,1cyclictest0-21swapper/710:16:577
1428560991310,2cyclictest0-21swapper/711:51:427
1428558991312,1cyclictest0-21swapper/611:04:286
1428558991311,2cyclictest1442202-21kworker/u16:0+events_unbound09:57:036
142855899130,0cyclictest0-21swapper/610:22:326
1428551991312,1cyclictest1409158-21kworker/u16:4+events_unbound07:07:014
1428551991312,1cyclictest0-21swapper/412:18:224
1428551991312,1cyclictest0-21swapper/412:02:554
1428551991312,1cyclictest0-21swapper/411:16:154
142856099129,2cyclictest1857003-21munin-run10:26:427
142856099129,2cyclictest0-21swapper/711:26:577
142856099129,2cyclictest0-21swapper/710:57:147
142856099129,2cyclictest0-21swapper/707:11:427
142856099128,3cyclictest6101-21gmain09:16:597
142856099128,3cyclictest1234-21snmpd10:53:347
142856099128,3cyclictest1234-21snmpd09:25:087
142856099128,3cyclictest1234-21snmpd08:55:417
142856099128,3cyclictest1234-21snmpd08:55:417
142856099128,3cyclictest1234-21snmpd08:31:107
142856099128,3cyclictest1234-21snmpd08:19:497
142856099128,3cyclictest1234-21snmpd07:49:037
142856099128,3cyclictest1234-21snmpd07:32:337
142856099128,3cyclictest1234-21snmpd07:20:417
142856099128,3cyclictest1234-21snmpd07:09:597
142856099126,5cyclictest827-21dbus-daemon07:58:137
142856099125,6cyclictest6382-21gvfs-afc-volume11:24:207
142856099120,11cyclictest0-21swapper/708:58:057
142855899129,3cyclictest1442202-21kworker/u16:0+events_unbound08:57:016
142855899128,3cyclictest1558436-21cat08:11:586
142855899128,3cyclictest1499647-21kworker/u16:1+flush-8:007:51:556
1428558991211,1cyclictest0-21swapper/609:32:336
1428558991210,2cyclictest1409158-21kworker/u16:4+flush-8:008:01:596
1428551991211,1cyclictest0-21swapper/410:06:334
1428551991211,1cyclictest0-21swapper/408:39:414
1428551991211,1cyclictest0-21swapper/407:16:554
142855199120,1cyclictest0-21swapper/407:41:504
142856099118,2cyclictest2148233-21df_inode12:26:557
142856099118,2cyclictest0-21swapper/709:12:027
142856099117,3cyclictest5975-21gmain12:12:037
142856099117,3cyclictest5975-21gmain12:12:037
142856099117,3cyclictest1234-21snmpd11:33:357
142856099117,3cyclictest1234-21snmpd11:33:357
142856099117,3cyclictest1234-21snmpd08:49:047
142856099117,3cyclictest1234-21snmpd08:31:497
142856099117,3cyclictest1234-21snmpd07:30:037
142856099117,3cyclictest0-21swapper/710:08:157
142856099113,7cyclictest6382-21gvfs-afc-volume08:12:007
1428560991110,0cyclictest0-21swapper/707:52:007
142855899118,2cyclictest86-21ksoftirqd/609:12:056
142855899117,3cyclictest1700119-21cpuspeed_turbos09:21:566
1428558991110,1cyclictest0-21swapper/612:14:396
1428558991110,1cyclictest0-21swapper/612:14:396
1428558991110,1cyclictest0-21swapper/610:36:576
1428558991110,1cyclictest0-21swapper/608:38:096
142855899110,3cyclictest1619340-21kthreadcore08:42:026
142855899110,11cyclictest0-21swapper/608:48:536
142855899110,11cyclictest0-21swapper/608:10:436
142855899110,10cyclictest1575570-21ntp_states08:17:086
1428551991110,1cyclictest0-21swapper/408:48:594
1428551991110,1cyclictest0-21swapper/408:28:014
1428551991110,1cyclictest0-21swapper/407:59:294
142856099106,3cyclictest1234-21snmpd07:22:507
142856099104,5cyclictest6382-21gvfs-afc-volume09:52:457
142855899108,2cyclictest86-21ksoftirqd/612:32:476
142855899108,2cyclictest86-21ksoftirqd/612:20:456
142855899108,2cyclictest86-21ksoftirqd/610:17:106
142855899108,2cyclictest86-21ksoftirqd/609:47:436
142855899104,5cyclictest0-21swapper/609:37:006
142855899100,9cyclictest0-21swapper/608:26:576
142855899100,3cyclictest1654732-21sed09:01:586
142855899100,2cyclictest1428776-21/usr/sbin/munin07:07:076
142855199108,2cyclictest1735445-21kworker/u16:1+flush-8:010:07:404
14285589998,1cyclictest86-21ksoftirqd/611:59:186
14285589997,2cyclictest86-21ksoftirqd/612:09:196
14285589997,2cyclictest86-21ksoftirqd/611:47:426
14285589997,2cyclictest86-21ksoftirqd/611:42:286
14285589997,2cyclictest86-21ksoftirqd/611:37:216
14285589997,2cyclictest86-21ksoftirqd/611:31:306
14285589997,2cyclictest86-21ksoftirqd/611:13:206
14285589997,2cyclictest86-21ksoftirqd/610:53:266
14285589997,2cyclictest86-21ksoftirqd/610:49:266
14285589997,2cyclictest86-21ksoftirqd/610:45:426
14285589997,2cyclictest86-21ksoftirqd/610:27:306
14285589996,2cyclictest1438789-21kthreadcore07:11:446
14285589990,2cyclictest1487307-21grep07:32:036
14285589990,2cyclictest1453587-21cut07:17:006
14285519997,2cyclictest1882796-21kworker/u16:1+flush-8:010:52:074
14285519995,3cyclictest1724677-21df09:31:544
14285519995,3cyclictest1577454-21tune2fs08:21:574
14285519995,3cyclictest1519621-21tune2fs07:51:574
14285519994,4cyclictest1744535-21memory09:37:034
14285589986,2cyclictest86-21ksoftirqd/612:02:136
14285589986,2cyclictest86-21ksoftirqd/611:33:116
14285589986,2cyclictest86-21ksoftirqd/611:33:116
14285589986,2cyclictest86-21ksoftirqd/611:22:546
14285589980,8cyclictest2124382-21kworker/u16:4+rpciod12:27:446
14285519986,1cyclictest0-21swapper/409:12:124
14285519984,3cyclictest1702821-21tr09:22:024
14285519984,1cyclictest1518659-21turbostat07:51:424
14285519983,4cyclictest1785380-21fschecks_time09:56:574
14285519983,4cyclictest1761483-21sed09:46:564
14285519983,4cyclictest1635167-21fschecks_time08:51:564
14285519983,4cyclictest1635167-21fschecks_time08:51:564
14285519983,4cyclictest1604373-21ntpq08:32:064
14285519983,4cyclictest1554898-21cut08:07:034
14285519983,4cyclictest1545167-21cut08:02:034
14285519983,4cyclictest1496529-21grep07:37:044
14285519983,4cyclictest1489148-21wc07:32:104
14285519982,5cyclictest6376-21gdbus07:16:274
14285519974,2cyclictest20126722sleep411:28:394
14285519973,3cyclictest1463628-21cat07:22:014
14285519973,3cyclictest1-21systemd11:56:424
14285519972,4cyclictest1567670-21expr08:16:564
14285519972,2cyclictest0-21swapper/411:22:304
14285519964,2cyclictest1932149-21kworker/u16:0+nfsiod11:04:434
14285519964,2cyclictest1932149-21kworker/u16:0+flush-8:011:16:524
14285519964,2cyclictest1882796-21kworker/u16:1+nfsiod10:59:074
14285519963,2cyclictest21577742sleep412:28:504
14285519961,3cyclictest0-21swapper/410:12:014
14285519961,1cyclictest0-21swapper/410:22:104
14285519960,5cyclictest2147235-21turbostat12:26:414
14285519960,1cyclictest0-21swapper/412:14:164
14285519960,1cyclictest0-21swapper/412:14:164
14285519960,1cyclictest0-21swapper/412:09:144
14285519960,1cyclictest0-21swapper/411:42:114
14285519960,1cyclictest0-21swapper/411:37:514
14285519951,1cyclictest201rcu_preempt11:46:484
14285519951,1cyclictest201rcu_preempt11:31:534
14285519951,1cyclictest201rcu_preempt11:31:534
14285519951,1cyclictest201rcu_preempt11:07:054
14285519950,5cyclictest0-21swapper/410:31:444
14285519950,4cyclictest2075181-21chrt11:56:434
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional