You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 01:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Wed May 20, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17778962950,1sleep71777898-21cut20:37:597
159577225948,8sleep50-21swapper/519:07:285
15948382469,31sleep70-21swapper/719:03:137
1596069994039,0cyclictest0-21swapper/721:23:037
1596069994039,0cyclictest0-21swapper/721:23:037
1596069993732,4cyclictest2048134-21latency_hist22:37:407
159577123626,7sleep40-21swapper/419:07:274
1596069993330,1cyclictest1743883-21munin-run20:22:407
1596069993328,4cyclictest2265438-21latency_hist00:07:397
1596063993329,3cyclictest2277990-21kworker/u16:4+flush-8:000:23:025
15957052339,8sleep60-21swapper/619:06:336
1596063993129,2cyclictest1951407-21kworker/u16:2+flush-8:022:58:025
1596058993129,2cyclictest1609642-21kworker/u16:2+events_unbound19:12:554
1596069993027,2cyclictest1976090-21ssh22:07:467
1596058993028,2cyclictest2217373-21kworker/u16:1+events_unbound23:53:064
1596069992825,1cyclictest1937200-21ssh21:48:557
1596058992826,2cyclictest1951408-21kworker/u16:4+flush-8:023:22:344
1596058992826,2cyclictest1696054-21kworker/u16:3+flush-8:021:18:024
1596058992825,2cyclictest1876448-21kworker/u16:1+events_unbound21:57:544
1596069992726,0cyclictest0-21swapper/723:17:197
1596069992726,0cyclictest0-21swapper/721:35:237
159606999270,25cyclictest1924951-21sshd-session21:43:427
1596063992725,2cyclictest1890998-21kworker/u16:4+events_unbound21:43:125
1596069992625,0cyclictest0-21swapper/723:28:507
1596069992623,2cyclictest124-21kswapd023:02:527
1596069992623,1cyclictest2071817-21ssh22:46:477
1596069992623,1cyclictest2071817-21ssh22:46:477
1596058992624,2cyclictest2024369-21kworker/u16:0+flush-8:022:43:024
1596058992624,2cyclictest2024369-21kworker/u16:0+flush-8:022:43:024
1596058992624,2cyclictest1951407-21kworker/u16:2+flush-8:022:08:174
1596069992524,0cyclictest0-21swapper/721:40:077
1596069992523,1cyclictest1974118-21ssh22:04:507
1596069992523,1cyclictest1974118-21ssh22:04:507
1596069992523,1cyclictest1830350-21diskmemload00:13:497
1596063992521,3cyclictest1951407-21kworker/u16:2+flush-8:000:12:445
1596058992523,2cyclictest1696054-21kworker/u16:3+flush-8:021:53:094
1596069992423,0cyclictest0-21swapper/723:52:027
1596069992422,1cyclictest2153738-21ssh23:18:067
159606999240,22cyclictest1866653-21perf21:22:407
1596058992423,1cyclictest1951408-21kworker/u16:4+events_unbound22:06:364
1596058992423,1cyclictest1951408-21kworker/u16:4+events_unbound22:06:364
1596069992321,1cyclictest1950114-21ssh21:55:237
1596069992321,1cyclictest1841107-21ssh21:10:157
1596063992321,2cyclictest1951407-21kworker/u16:2+flush-8:000:32:355
1596063992320,3cyclictest1951408-21kworker/u16:4+flush-8:022:28:065
1596069992221,0cyclictest0-21swapper/722:57:597
1596069992221,0cyclictest0-21swapper/722:53:517
1596069992220,1cyclictest1998111-21ssh22:14:317
1596069992217,4cyclictest2277521-21updatedb00:12:387
1596063992220,2cyclictest1924757-21kworker/u16:0+flush-8:021:48:125
1596063992220,2cyclictest1782313-21kworker/u16:0+events_unbound21:32:555
1596063992220,2cyclictest1696054-21kworker/u16:3+flush-8:020:33:035
1596063992219,2cyclictest1696054-21kworker/u16:3+flush-8:021:12:555
1596058992218,3cyclictest2277565-21kworker/u16:3+events_unbound00:13:024
1596069992120,0cyclictest0-21swapper/722:18:347
1596069992120,0cyclictest0-21swapper/721:31:487
1596069992119,1cyclictest2336209-21ssh00:34:107
1596069992115,4cyclictest635-21systemd-journal20:17:407
159606999210,19cyclictest2240751-21sshd-session23:56:477
1596058992119,2cyclictest1951407-21kworker/u16:2+events_unbound23:03:084
1596058992119,2cyclictest1674401-21kworker/u16:2+flush-8:020:12:594
1596058992118,2cyclictest1951408-21kworker/u16:4+flush-8:023:32:594
1596058992117,3cyclictest1657295-21kworker/u16:0+events_unbound19:37:544
1596069992019,0cyclictest0-21swapper/722:49:417
1596069992015,4cyclictest2313837-21latency_hist00:27:407
159606999200,18cyclictest2022595-21sh22:25:107
1596064992018,2cyclictest2024369-21kworker/u16:0+flush-8:023:37:536
1596058992018,2cyclictest1674401-21kworker/u16:2+events_unbound20:38:084
1596058992017,3cyclictest1674401-21kworker/u16:2+flush-8:019:53:034
1596069991918,0cyclictest0-21swapper/723:41:547
1596069991918,0cyclictest0-21swapper/700:28:137
1596069991917,1cyclictest1830350-21diskmemload23:11:407
1596069991917,1cyclictest0-21swapper/723:46:397
1596069991916,2cyclictest1961576-21ssh21:59:047
1596069991916,2cyclictest1638190-21munin-run19:27:407
1596069991914,4cyclictest2168842-21latency_hist23:27:407
1596069991914,4cyclictest2168842-21latency_hist23:27:407
1596058991917,2cyclictest1951408-21kworker/u16:4+flush-8:023:23:054
1596058991917,2cyclictest1951408-21kworker/u16:4+flush-8:023:23:054
1596058991917,2cyclictest1951407-21kworker/u16:2+events_unbound22:52:534
1596069991817,0cyclictest0-21swapper/719:33:067
159605899184,13cyclictest0-21swapper/420:42:554
159605899184,13cyclictest0-21swapper/420:42:554
1596058991816,2cyclictest1924757-21kworker/u16:0+events_unbound21:48:024
1596058991816,2cyclictest1842842-21kworker/u16:4+events_unbound21:17:404
1596058991815,2cyclictest1782313-21kworker/u16:0+flush-8:020:53:034
1596069991716,0cyclictest0-21swapper/723:36:477
1596069991716,0cyclictest0-21swapper/719:58:027
1596064991715,2cyclictest1657295-21kworker/u16:0+flush-8:019:53:376
1596063991715,2cyclictest1951407-21kworker/u16:2+flush-8:023:53:025
1596063991715,2cyclictest1951407-21kworker/u16:2+flush-8:022:08:085
1596063991715,2cyclictest1696054-21kworker/u16:3+flush-8:021:28:125
1596069991614,1cyclictest2058569-21ssh22:39:397
1596064991614,2cyclictest1876448-21kworker/u16:1+flush-8:022:13:076
1596063991614,2cyclictest1951408-21kworker/u16:4+flush-8:022:33:075
1596058991613,2cyclictest1337918-21kworker/u16:1+events_unbound19:07:584
1596058991613,2cyclictest1337918-21kworker/u16:1+events_unbound19:07:584
159606999156,7cyclictest6101-21gmain21:02:587
1596069991514,0cyclictest0-21swapper/700:21:547
159606499152,5cyclictest0-21swapper/600:17:426
1596064991514,1cyclictest1951407-21kworker/u16:2+events_unbound22:07:566
159606499150,1cyclictest0-21swapper/620:38:066
1596063991513,2cyclictest1951407-21kworker/u16:2+flush-8:023:42:455
1596063991511,3cyclictest1951407-21kworker/u16:2+flush-8:000:33:075
1596063991511,3cyclictest1876448-21kworker/u16:1+flush-8:021:42:405
1596063991511,3cyclictest1696054-21kworker/u16:3+flush-8:020:38:065
159606399150,14cyclictest2274517-21ntp_states00:08:055
1596058991513,2cyclictest2024369-21kworker/u16:0+events_unbound00:08:094
1596058991513,2cyclictest1674401-21kworker/u16:2+flush-8:021:08:064
1596058991512,3cyclictest2217373-21kworker/u16:1+flush-8:000:02:394
1596058991512,2cyclictest1657295-21kworker/u16:0+flush-8:019:43:094
1596064991413,1cyclictest0-21swapper/600:08:336
1596064991410,3cyclictest1696054-21kworker/u16:3+flush-8:020:27:566
159606499140,1cyclictest0-21swapper/600:16:566
1596063991413,1cyclictest0-21swapper/523:19:225
1596063991413,1cyclictest0-21swapper/521:21:265
1596063991412,2cyclictest1696054-21kworker/u16:3+flush-8:022:02:455
1596063991412,2cyclictest1696054-21kworker/u16:3+flush-8:022:02:455
1596063991412,2cyclictest1646823-21kworker/u16:2+flush-8:019:33:135
1596063991411,3cyclictest2217373-21kworker/u16:1+flush-8:023:48:015
1596058991413,1cyclictest0-21swapper/421:47:174
1596058991412,2cyclictest2277990-21kworker/u16:4+flush-8:000:23:084
1596058991412,2cyclictest1951407-21kworker/u16:2+events_unbound22:57:544
159605899140,14cyclictest0-21swapper/400:34:524
159606999139,3cyclictest6382-21gvfs-afc-volume22:28:037
159606999139,3cyclictest1234-21snmpd21:13:057
1596069991310,2cyclictest2251844-21ssh23:59:517
1596069991310,2cyclictest0-21swapper/719:38:037
159606499138,4cyclictest2121895-21cat23:07:546
159606499133,9cyclictest0-21swapper/620:52:546
1596064991312,1cyclictest0-21swapper/622:02:086
1596064991312,1cyclictest0-21swapper/621:17:316
1596064991311,2cyclictest1696054-21kworker/u16:3+flush-8:020:48:066
159606499130,13cyclictest0-21swapper/621:47:376
159606499130,13cyclictest0-21swapper/621:31:336
1596063991311,2cyclictest1696054-21kworker/u16:3+flush-8:019:58:045
159606399130,13cyclictest0-21swapper/522:23:055
159606399130,13cyclictest0-21swapper/521:08:055
1596058991312,1cyclictest0-21swapper/423:42:134
1596058991311,2cyclictest1876448-21kworker/u16:1+flush-8:021:28:054
159605899130,1cyclictest0-21swapper/419:23:394
159606999129,2cyclictest1234-21snmpd20:46:567
159606999129,2cyclictest1234-21snmpd20:46:567
159606999128,3cyclictest6895-21gmain20:28:027
159606999128,3cyclictest1234-21snmpd21:01:027
159606999128,3cyclictest1234-21snmpd20:32:437
159606999128,3cyclictest1234-21snmpd20:27:227
159606999128,3cyclictest1234-21snmpd20:12:377
159606999128,3cyclictest1234-21snmpd19:12:117
159606999128,3cyclictest1234-21snmpd19:12:117
159606999127,3cyclictest1234-21snmpd20:52:597
159606999124,7cyclictest6895-21gmain19:17:587
159606499128,3cyclictest2013129-21cat22:22:546
159606499120,1cyclictest0-21swapper/619:17:046
1596063991211,1cyclictest0-21swapper/522:01:485
1596063991211,1cyclictest0-21swapper/519:46:035
1596063991210,2cyclictest2024369-21kworker/u16:0+events_unbound22:38:035
1596063991210,2cyclictest1951407-21kworker/u16:2+flush-8:022:18:135
159605899129,2cyclictest2277990-21kworker/u16:4+flush-8:000:17:594
1596058991211,1cyclictest0-21swapper/421:33:054
1596058991210,2cyclictest1951407-21kworker/u16:2+events_unbound22:27:524
1596058991210,2cyclictest1696054-21kworker/u16:3+flush-8:020:03:114
159605899120,1cyclictest0-21swapper/421:00:084
159606999117,3cyclictest6101-21gmain19:53:067
159606999115,4cyclictest6101-21gmain19:12:427
1596069991110,0cyclictest0-21swapper/719:42:597
159606999110,1cyclictest0-21swapper/720:03:047
159606999110,10cyclictest1234-21snmpd19:50:157
159606499117,3cyclictest2221149-21kthreadcore23:47:576
159606499115,5cyclictest0-21swapper/622:57:586
1596064991110,1cyclictest0-21swapper/622:52:166
1596064991110,1cyclictest0-21swapper/620:21:336
159606499110,1cyclictest0-21swapper/622:52:526
159606499110,1cyclictest0-21swapper/619:59:196
159606499110,11cyclictest0-21swapper/620:47:056
159606499110,11cyclictest0-21swapper/620:47:056
159606499110,11cyclictest0-21swapper/620:14:276
159606499110,11cyclictest0-21swapper/619:26:596
159606399118,3cyclictest2024369-21kworker/u16:0+flush-8:022:48:075
159606399117,3cyclictest1725816-21cat20:12:565
1596063991110,1cyclictest0-21swapper/519:53:375
1596063991110,1cyclictest0-21swapper/519:30:465
159606399110,11cyclictest0-21swapper/520:50:425
159606399110,11cyclictest0-21swapper/520:24:035
159606399110,11cyclictest0-21swapper/519:20:125
159605899119,2cyclictest2024369-21kworker/u16:0+flush-8:022:52:354
159605899118,3cyclictest1951407-21kworker/u16:2+flush-8:022:12:544
159605899117,3cyclictest2001341-21irqcore22:17:574
1596058991110,1cyclictest0-21swapper/420:51:284
1596058991110,1cyclictest0-21swapper/420:12:034
159605899110,11cyclictest0-21swapper/420:33:494
159606999106,3cyclictest6895-21gmain19:28:027
159606999106,3cyclictest1234-21snmpd20:48:207
159606499109,1cyclictest0-21swapper/619:43:146
159606499106,3cyclictest1899099-21cut21:33:006
159606499105,4cyclictest2170150-21cat23:27:546
159606499105,4cyclictest1874204-21kthreadcore21:22:596
159606499105,4cyclictest1874204-21kthreadcore21:22:596
159606499103,6cyclictest2319178-21kthreadcore00:27:596
159606499102,7cyclictest0-21swapper/622:38:006
159606499102,7cyclictest0-21swapper/621:48:026
159606499101,8cyclictest0-21swapper/622:17:586
159606499100,9cyclictest2135984-21kthreadcore23:12:596
159606499100,9cyclictest1858235-21kthreadcore21:17:586
159606499100,9cyclictest1678175-21irqstats19:47:576
159606499100,9cyclictest1643648-21kthreadcore19:27:586
159606499100,9cyclictest0-21swapper/621:03:006
159606499100,3cyclictest2182655-21kthreadcore23:32:586
159606499100,3cyclictest1718596-21kthreadcore20:08:006
159606499100,10cyclictest0-21swapper/619:36:086
159606399106,3cyclictest5829-21JS15:59:265
159606399106,3cyclictest5829-21JS15:59:265
159606399106,3cyclictest1716213-21cat20:07:575
159606399100,0cyclictest0-21swapper/519:10:355
159606399100,0cyclictest0-21swapper/519:10:355
159605899109,1cyclictest0-21swapper/419:33:454
159605899107,3cyclictest1696054-21kworker/u16:3+flush-8:020:22:574
15960649997,2cyclictest86-21ksoftirqd/623:45:426
15960649997,2cyclictest86-21ksoftirqd/622:44:286
15960649997,2cyclictest86-21ksoftirqd/622:44:286
15960649996,2cyclictest2036858-21cstates22:32:526
15960649996,2cyclictest1903507-21cpuspeed21:37:526
15960649995,3cyclictest2333069-21kthreadcore00:33:006
15960649995,3cyclictest2238903-21chrt23:53:196
15960649990,8cyclictest2152202-21cut23:18:016
15960649990,8cyclictest2109321-21expr23:02:516
15960649990,8cyclictest1831294-21cstates21:07:536
15960649990,8cyclictest1597098-21awk19:07:596
15960649990,8cyclictest1597098-21awk19:07:596
15960649990,4cyclictest2160420-21grep23:22:596
15960649990,4cyclictest2160420-21grep23:22:596
15960649990,3cyclictest2255220-21kthreadcore00:03:026
15960649990,3cyclictest2027454-21kthreadcore22:27:576
15960649990,2cyclictest1706846-21sed20:02:576
15960639998,1cyclictest14150irq/27-ahci[0000:00:1f.2]22:53:055
15960639998,1cyclictest0-21swapper/520:59:225
15960639998,1cyclictest0-21swapper/520:32:345
15960639997,2cyclictest1951408-21kworker/u16:4+flush-8:023:32:555
15960639996,2cyclictest2291059-21irqcore00:17:585
15960589998,1cyclictest0-21swapper/419:47:564
15960589997,2cyclictest2277990-21kworker/u16:4+events_unbound00:27:574
15960589997,2cyclictest1951408-21kworker/u16:4+events_unbound23:08:054
15960589997,2cyclictest1696054-21kworker/u16:3+events_unbound21:22:534
15960589997,2cyclictest1696054-21kworker/u16:3+events_unbound21:22:534
15960589997,1cyclictest0-21swapper/400:03:054
15960649987,1cyclictest0-21swapper/620:57:576
15960649987,1cyclictest0-21swapper/620:32:586
15960649986,2cyclictest86-21ksoftirqd/600:22:546
15960649985,2cyclictest0-21swapper/619:37:526
15960649984,3cyclictest1964763-21cut22:02:556
15960649984,3cyclictest1964763-21cut22:02:556
15960649982,5cyclictest0-21swapper/623:58:016
15960649980,7cyclictest1941523-21kthreadcore21:52:576
15960649980,2cyclictest1619789-21df19:17:526
15960639987,1cyclictest0-21swapper/519:38:295
15960639987,1cyclictest0-21swapper/500:07:375
15960639986,1cyclictest0-21swapper/523:13:005
15960639986,1cyclictest0-21swapper/521:23:005
15960639986,1cyclictest0-21swapper/521:23:005
15960639986,1cyclictest0-21swapper/521:03:005
15960639985,2cyclictest0-21swapper/520:42:575
15960639985,2cyclictest0-21swapper/520:42:575
15960639984,3cyclictest2123361-21grep23:07:565
15960639984,3cyclictest2117608-21wc23:03:055
15960639984,3cyclictest1677769-21cat19:47:565
15960639984,1cyclictest681rcuog/422:13:055
15960639983,4cyclictest2178131-21threads23:28:075
15960639983,4cyclictest1802066-21grep20:52:515
15960639983,4cyclictest1743419-21unixbench-2d20:18:085
15960639983,4cyclictest1629690-21sed19:22:555
15960589987,1cyclictest0-21swapper/420:18:124
15960589983,4cyclictest2218769-21cut23:47:564
15960589983,4cyclictest2213184-21cut23:43:014
15960589983,4cyclictest2039663-21cut22:32:584
15960589983,4cyclictest2018219-21cut22:22:594
15960589983,4cyclictest1821304-21grep21:02:524
15960589983,4cyclictest1640581-21kthreadcore19:27:564
15960589983,4cyclictest1625025-21grep19:17:594
15960649973,3cyclictest1744690-21expr20:22:536
15960639975,1cyclictest0-21swapper/523:57:535
15960639974,2cyclictest1706136-21cstates20:02:535
15960639973,3cyclictest2194544-21sed23:37:555
15960639973,3cyclictest1940030-21expr21:52:525
15960639972,4cyclictest2060892-21expr22:42:515
15960639972,4cyclictest2060892-21expr22:42:515
15960639972,4cyclictest1606189-21grep19:12:425
15960589975,1cyclictest0-21swapper/420:27:584
15960589973,3cyclictest2048904-21expr22:37:524
15960589973,3cyclictest1903615-21expr21:37:524
15960589972,4cyclictest2169864-21entropy23:27:534
15960589972,4cyclictest2133939-21sed23:12:564
15960589972,4cyclictest1697445-21cut19:57:574
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional