You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 05:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Sat Apr 18, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
170535599420,40cyclictest2350466-21latency_hist23:59:467
17050022416,30sleep70-21swapper/719:09:037
170496324130,8sleep40-21swapper/419:08:284
1705355993731,5cyclictest1824052-21latency_hist20:09:487
1705353993735,2cyclictest1795380-21kworker/u16:0+flush-8:020:59:486
1705353993331,2cyclictest1872471-21kworker/u16:2+flush-8:021:19:476
1705348993129,2cyclictest1910492-21kworker/u16:3+flush-8:022:09:424
21801822300,1chrt2180183-21ssh22:48:097
1705355993029,0cyclictest0-21swapper/720:35:017
1705355993025,4cyclictest2314265-21latency_hist23:44:477
170502923020,7sleep50-21swapper/519:09:255
170502123019,8sleep60-21swapper/619:09:186
1705353992927,2cyclictest1833815-21kworker/u16:3+events_unbound20:45:106
21564582270,1chrt2156459-21ssh22:38:567
170535599270,25cyclictest2386781-21latency_hist00:14:477
1705353992725,2cyclictest1795380-21kworker/u16:0+flush-8:021:10:116
1705353992725,2cyclictest1776482-21kworker/u16:4+events_unbound20:05:106
1705353992624,2cyclictest1910492-21kworker/u16:3+flush-8:022:05:096
1705348992624,2cyclictest2194963-21kworker/u16:0+events_unbound22:57:564
1705348992624,2cyclictest2022000-21kworker/u16:1+events_unbound22:29:414
1705355992520,4cyclictest2326321-21latency_hist23:49:477
1705353992523,2cyclictest2290465-21kworker/u16:4+events_unbound23:45:096
1705353992523,2cyclictest2034139-21kworker/u16:0+events_unbound21:50:096
1705348992523,2cyclictest2106066-21kworker/u16:4+flush-8:022:30:014
1705353992422,2cyclictest2253936-21kworker/u16:2+events_unbound23:35:136
1705348992421,2cyclictest2311819-21kworker/u16:0+flush-8:023:44:574
1705353992321,2cyclictest2155451-21kworker/u16:3+flush-8:023:24:416
1705348992321,2cyclictest2239423-21kworker/u16:1+flush-8:023:25:114
1705348992321,2cyclictest2239423-21kworker/u16:1+flush-8:023:25:114
1705348992321,2cyclictest2022000-21kworker/u16:1+events_unbound22:22:214
170535599220,20cyclictest2398955-21sed00:19:477
1705353992220,2cyclictest2348220-21kworker/u16:2+events_unbound00:25:016
1705353992220,2cyclictest2326515-21kworker/u16:1+events_unbound00:20:106
1705353992220,2cyclictest2022000-21kworker/u16:1+flush-8:022:29:426
1705348992220,2cyclictest2290465-21kworker/u16:4+flush-8:023:44:424
1705353992119,2cyclictest2194963-21kworker/u16:0+events_unbound23:04:426
1705353992119,2cyclictest2133146-21kworker/u16:2+flush-8:022:35:116
1705353992119,2cyclictest1910493-21kworker/u16:4+flush-8:021:40:186
1705348992119,2cyclictest2022000-21kworker/u16:1+flush-8:021:59:264
1705348992119,2cyclictest2022000-21kworker/u16:1+flush-8:021:59:264
1705348992119,2cyclictest1910492-21kworker/u16:3+events_unbound21:46:404
1705348992119,2cyclictest1833815-21kworker/u16:3+flush-8:020:15:104
1705353992018,2cyclictest1872471-21kworker/u16:2+flush-8:021:30:096
1705353992018,2cyclictest1747758-21kworker/u16:1+flush-8:020:00:296
1705348992018,2cyclictest2311819-21kworker/u16:0+flush-8:000:04:464
1705348992018,2cyclictest1686375-21kworker/u16:2+flush-8:019:31:304
1705353991917,2cyclictest263001-21kworker/u16:1+events_unbound19:15:106
1705353991917,2cyclictest2348220-21kworker/u16:2+events_unbound00:03:576
1705353991917,2cyclictest1910492-21kworker/u16:3+flush-8:022:11:576
1705348991917,2cyclictest2311819-21kworker/u16:0+flush-8:023:54:424
1705348991917,2cyclictest2036333-21kworker/u16:2+events_unbound22:14:524
1705348991917,2cyclictest1910492-21kworker/u16:3+flush-8:021:52:264
1705348991917,2cyclictest1795380-21kworker/u16:0+flush-8:021:12:104
1705355991814,3cyclictest1234-21snmpd21:07:507
1705353991816,2cyclictest2348220-21kworker/u16:2+events_unbound00:15:116
1705353991816,2cyclictest2106066-21kworker/u16:4+flush-8:022:20:136
1705353991815,2cyclictest2155451-21kworker/u16:3+events_unbound23:29:496
1705348991816,2cyclictest2311819-21kworker/u16:0+events_unbound00:05:094
1705348991816,2cyclictest2118179-21kworker/u16:0+events_unbound22:45:194
1705348991816,2cyclictest1910492-21kworker/u16:3+events_unbound22:10:054
1705348991816,2cyclictest1872471-21kworker/u16:2+flush-8:021:00:454
1705348991816,2cyclictest1776482-21kworker/u16:4+events_unbound20:04:234
1705348991816,2cyclictest1686375-21kworker/u16:2+flush-8:019:35:264
170535599170,1cyclictest0-21swapper/719:35:117
1705353991715,2cyclictest2326515-21kworker/u16:1+flush-8:000:14:426
1705353991715,2cyclictest1963513-21kworker/u16:1+flush-8:021:20:136
170534999170,1cyclictest0-21swapper/500:10:085
1705348991715,2cyclictest999416-21kworker/u16:3+flush-8:019:19:484
1705348991715,2cyclictest2410955-21kworker/u16:4+flush-8:000:35:114
1705348991715,2cyclictest2326515-21kworker/u16:1+events_unbound00:32:484
1705348991715,2cyclictest2253936-21kworker/u16:2+events_unbound23:35:114
1705348991715,2cyclictest2179899-21kworker/u16:1+events_unbound22:49:574
1705348991715,2cyclictest2133146-21kworker/u16:2+flush-8:022:35:134
1705348991715,2cyclictest1795380-21kworker/u16:0+flush-8:020:27:074
1705355991613,2cyclictest2205295-21latency_hist22:59:477
1705355991612,3cyclictest1234-21snmpd19:16:187
1705355991610,5cyclictest635-21systemd-journal00:19:477
170535599160,14cyclictest0-21swapper/721:45:117
1705348991614,2cyclictest999416-21kworker/u16:3+flush-8:019:45:204
1705348991614,2cyclictest2326515-21kworker/u16:1+flush-8:000:15:134
1705348991614,2cyclictest2311819-21kworker/u16:0+events_unbound23:55:094
1705348991614,2cyclictest2194963-21kworker/u16:0+flush-8:023:02:264
1705348991614,2cyclictest2155451-21kworker/u16:3+flush-8:022:41:474
1705348991614,2cyclictest2155451-21kworker/u16:3+flush-8:022:41:474
1705348991614,2cyclictest2034139-21kworker/u16:0+flush-8:022:02:254
1705348991614,2cyclictest2034139-21kworker/u16:0+flush-8:022:02:254
1705348991614,2cyclictest1910493-21kworker/u16:4+flush-8:021:40:194
1705348991614,2cyclictest1910492-21kworker/u16:3+flush-8:021:32:014
1705348991614,2cyclictest1910492-21kworker/u16:3+flush-8:021:24:424
1705348991614,2cyclictest1872471-21kworker/u16:2+flush-8:021:05:014
1705348991614,2cyclictest1872471-21kworker/u16:2+events_unbound20:46:304
1705348991614,2cyclictest1795380-21kworker/u16:0+flush-8:020:50:134
1705348991614,2cyclictest1747758-21kworker/u16:1+flush-8:020:12:214
1705348991614,2cyclictest1747758-21kworker/u16:1+events_unbound20:33:014
1705348991614,2cyclictest1747758-21kworker/u16:1+events_unbound20:33:014
1705348991614,2cyclictest1686375-21kworker/u16:2+events_unbound19:13:294
1705348991614,2cyclictest1676168-21kworker/u16:0+events_unbound19:22:014
170535599159,5cyclictest2302134-21latency_hist23:39:477
1705355991514,0cyclictest0-21swapper/700:25:047
1705353991513,2cyclictest2311819-21kworker/u16:0+flush-8:023:55:006
1705353991513,2cyclictest2179899-21kworker/u16:1+flush-8:022:56:186
1705353991513,2cyclictest2167819-21kworker/u16:2+flush-8:022:45:096
1705353991513,2cyclictest2155451-21kworker/u16:3+flush-8:023:05:136
1705353991513,2cyclictest2118179-21kworker/u16:0+flush-8:022:30:506
1705353991513,2cyclictest1795380-21kworker/u16:0+flush-8:019:55:166
1705353991513,2cyclictest1676168-21kworker/u16:0+flush-8:019:10:136
1705348991513,2cyclictest2326515-21kworker/u16:1+events_unbound00:11:544
1705348991513,2cyclictest2155451-21kworker/u16:3+flush-8:023:15:134
1705348991513,2cyclictest1910493-21kworker/u16:4+flush-8:020:54:594
1705348991513,2cyclictest1776482-21kworker/u16:4+flush-8:019:52:134
1705348991511,3cyclictest2285396-21kthreadcore23:30:074
1705355991412,1cyclictest0-21swapper/723:20:017
1705355991412,1cyclictest0-21swapper/719:30:047
1705355991411,2cyclictest0-21swapper/722:04:477
1705355991410,3cyclictest1234-21snmpd22:21:587
170535599140,1cyclictest0-21swapper/722:25:107
170535599140,1cyclictest0-21swapper/720:50:087
1705353991412,2cyclictest2326515-21kworker/u16:1+events_unbound00:30:046
1705353991411,2cyclictest1910493-21kworker/u16:4+flush-8:021:49:266
170534999149,4cyclictest2206582-21cat23:00:025
1705349991413,1cyclictest0-21swapper/523:40:015
170534999140,1cyclictest0-21swapper/521:30:545
170534999140,14cyclictest0-21swapper/500:00:105
1705348991412,2cyclictest999416-21kworker/u16:3+events_unbound19:27:314
1705348991412,2cyclictest2009315-21kworker/u16:0+flush-8:021:37:254
1705348991412,2cyclictest1776482-21kworker/u16:4+events_unbound20:20:154
170534899140,14cyclictest0-21swapper/420:35:074
170535599139,3cyclictest864-21NetworkManager21:10:097
170535599139,3cyclictest1234-21snmpd23:15:507
170535599139,3cyclictest1234-21snmpd21:35:367
170535599139,3cyclictest1234-21snmpd20:34:237
170535599139,3cyclictest1234-21snmpd20:34:237
170535599139,3cyclictest1234-21snmpd20:15:527
170535599139,3cyclictest1234-21snmpd20:13:257
170535599139,3cyclictest1234-21snmpd00:01:047
170535599138,4cyclictest2290005-21latency_hist23:34:477
170535599137,5cyclictest1891249-21latency_hist20:44:477
1705355991310,2cyclictest1234-21snmpd21:29:337
1705353991312,1cyclictest0-21swapper/623:15:126
1705353991312,1cyclictest0-21swapper/622:54:336
1705353991311,2cyclictest2239423-21kworker/u16:1+events_unbound23:27:096
1705353991311,2cyclictest2239423-21kworker/u16:1+events_unbound23:27:096
1705353991311,2cyclictest2239423-21kworker/u16:1+events_unbound23:13:476
170535399130,6cyclictest0-21swapper/600:05:016
1705349991312,1cyclictest0-21swapper/523:55:115
1705349991312,1cyclictest0-21swapper/523:12:545
1705349991312,1cyclictest0-21swapper/522:54:375
1705349991312,1cyclictest0-21swapper/521:00:095
1705349991310,2cyclictest1710125-21cut19:10:065
170534999130,1cyclictest0-21swapper/522:36:485
170534999130,13cyclictest0-21swapper/521:15:275
1705348991311,2cyclictest999416-21kworker/u16:3+flush-8:019:40:214
1705348991311,2cyclictest2194963-21kworker/u16:0+events_unbound23:22:584
1705348991311,2cyclictest2155451-21kworker/u16:3+events_unbound23:11:584
1705348991311,2cyclictest1872471-21kworker/u16:2+flush-8:021:25:304
1705348991311,2cyclictest1872471-21kworker/u16:2+flush-8:021:15:124
1705348991311,2cyclictest1776482-21kworker/u16:4+events_unbound20:08:164
170535599129,2cyclictest2326793-21ssh23:49:577
170535599129,2cyclictest1234-21snmpd23:01:147
170535599129,2cyclictest1234-21snmpd21:57:437
170535599129,2cyclictest1234-21snmpd21:57:437
170535599129,2cyclictest0-21swapper/721:15:057
170535599128,3cyclictest1234-21snmpd23:12:417
170535599128,3cyclictest1234-21snmpd21:39:487
170535599128,3cyclictest1234-21snmpd21:32:577
170535599128,3cyclictest1234-21snmpd20:23:497
170535599128,3cyclictest1234-21snmpd19:51:107
170535599127,4cyclictest1814509-21latency_hist20:04:487
170535599126,5cyclictest1900790-21latency_hist20:49:487
1705355991210,1cyclictest2228240-21ssh23:07:247
170535599120,11cyclictest1234-21snmpd23:27:247
170535599120,11cyclictest1234-21snmpd23:27:247
170535599120,10cyclictest1796306-21taskset19:55:017
170535399129,3cyclictest2253936-21kworker/u16:2+flush-8:023:39:526
170535399129,2cyclictest2158022-21fschecks_count22:40:016
170535399129,2cyclictest2158022-21fschecks_count22:40:016
1705353991210,2cyclictest1795380-21kworker/u16:0+flush-8:021:00:116
1705353991210,2cyclictest1676168-21kworker/u16:0+flush-8:019:35:046
170534999129,2cyclictest1979373-21kthreadcore21:25:055
1705349991211,1cyclictest0-21swapper/522:02:545
1705349991211,1cyclictest0-21swapper/522:02:545
1705349991211,1cyclictest0-21swapper/521:45:245
1705348991210,2cyclictest2348220-21kworker/u16:2+flush-8:000:25:114
1705348991210,2cyclictest2167819-21kworker/u16:2+flush-8:023:05:174
170535599119,1cyclictest0-21swapper/722:40:017
170535599119,1cyclictest0-21swapper/722:40:017
170535599118,2cyclictest1234-21snmpd22:15:287
170535599118,2cyclictest1234-21snmpd21:20:337
170535599118,2cyclictest1234-21snmpd19:13:187
170535599117,3cyclictest1234-21snmpd21:59:557
170535599117,3cyclictest1234-21snmpd21:59:557
170535599117,3cyclictest1234-21snmpd20:57:207
170535599117,3cyclictest1234-21snmpd20:26:587
170535599117,3cyclictest1234-21snmpd19:42:067
170535599117,3cyclictest1234-21snmpd19:28:457
170535599117,3cyclictest1234-21snmpd00:36:567
170535599116,5cyclictest6382-21gvfs-afc-volume22:14:287
170535399119,2cyclictest2326515-21kworker/u16:1+flush-8:023:50:186
170535399119,2cyclictest2022000-21kworker/u16:1+flush-8:022:04:456
170535399119,2cyclictest2022000-21kworker/u16:1+flush-8:022:04:456
170535399119,2cyclictest2009315-21kworker/u16:0+flush-8:021:35:226
1705353991110,1cyclictest0-21swapper/620:33:456
1705353991110,1cyclictest0-21swapper/620:33:456
1705353991110,1cyclictest0-21swapper/620:18:476
170535399110,4cyclictest1824584-21tr20:09:596
170535399110,1cyclictest0-21swapper/619:51:216
170535399110,11cyclictest0-21swapper/619:31:006
170534999113,1cyclictest0-21swapper/522:25:025
1705349991110,1cyclictest0-21swapper/522:19:465
1705349991110,1cyclictest0-21swapper/520:31:565
1705349991110,1cyclictest0-21swapper/520:31:565
1705349991110,1cyclictest0-21swapper/520:17:065
1705349991110,1cyclictest0-21swapper/520:04:015
1705349991110,1cyclictest0-21swapper/519:49:225
170534999110,1cyclictest0-21swapper/500:35:135
170534999110,11cyclictest0-21swapper/520:46:265
170534999110,11cyclictest0-21swapper/519:28:425
170534899119,2cyclictest2326515-21kworker/u16:1+flush-8:000:21:174
170534899110,11cyclictest0-21swapper/419:56:204
170535599107,2cyclictest1234-21snmpd21:50:467
170535599106,3cyclictest1234-21snmpd22:52:327
170535599103,6cyclictest6101-21gmain19:20:017
170535399108,2cyclictest1833815-21kworker/u16:3+flush-8:020:40:186
170535399107,2cyclictest1833815-21kworker/u16:3+flush-8:020:19:596
170535399100,9cyclictest2049236-21cat21:55:016
170535399100,9cyclictest2049236-21cat21:55:016
170534999106,3cyclictest2363874-21cat00:05:015
170534999105,4cyclictest1873265-21cat20:35:025
170534899108,2cyclictest1872471-21kworker/u16:2+events_unbound20:42:554
17053559996,2cyclictest0-21swapper/700:30:097
17053559994,4cyclictest2371596-21rm00:05:107
17053559994,4cyclictest2142729-21sshd-session22:30:597
17053559994,4cyclictest1927007-21cut21:00:077
17053539992,7cyclictest0-21swapper/621:25:026
17053539990,8cyclictest2444041-21ntpq00:35:116
17053539990,8cyclictest1776488-21/usr/sbin/munin19:45:116
17053539990,8cyclictest0-21swapper/619:25:046
17053539990,3cyclictest2098133-21kernelversion22:15:036
17053539990,2cyclictest1934466-21grep21:05:056
17053539990,2cyclictest1902610-21grep20:50:026
17053499998,1cyclictest0-21swapper/522:10:005
17053499995,3cyclictest2242979-21cat23:15:015
17053499994,4cyclictest2315556-21cat23:45:015
17053499994,4cyclictest1901956-21cat20:50:005
17053499991,5cyclictest1734432-21kthreadcore19:20:065
17053499990,8cyclictest0-21swapper/523:30:035
17053559984,3cyclictest1234-21snmpd19:46:017
17053539987,1cyclictest0-21swapper/619:19:586
17053539986,1cyclictest0-21swapper/619:40:056
17053539984,3cyclictest1853616-21expr20:24:586
17053539980,3cyclictest1872534-21awk20:34:596
17053499986,1cyclictest0-21swapper/522:45:035
17053499986,1cyclictest0-21swapper/522:20:035
17053499986,1cyclictest0-21swapper/521:10:005
17053499986,1cyclictest0-21swapper/520:25:035
17053499986,1cyclictest0-21swapper/500:30:055
17053499986,1cyclictest0-21swapper/500:25:165
17053499985,2cyclictest2257816-21kthreadcore23:20:045
17053499984,3cyclictest2396251-21grep00:15:165
17053499984,3cyclictest2220351-21kthreadcore23:05:055
17053499984,3cyclictest1851965-21open_inodes20:20:135
17053499983,4cyclictest2162019-21cut22:40:065
17053499983,4cyclictest2162019-21cut22:40:065
17053499983,4cyclictest2078732-21grep22:05:075
17053499983,4cyclictest2043337-21grep21:50:085
17053499983,4cyclictest1914410-21grep20:55:045
17053499983,4cyclictest1818774-21cut20:05:055
17053499983,4cyclictest1761111-21cut19:35:065
17053499983,4cyclictest1756494-21unixbench-2d19:30:145
17053499982,4cyclictest2000679-21diskstats21:35:015
17053499980,7cyclictest2292629-21cut23:35:045
17053499980,4cyclictest2018329-21kthreadcore21:40:065
17053499975,1cyclictest0-21swapper/523:24:585
17053499975,1cyclictest0-21swapper/523:24:585
17053499975,1cyclictest0-21swapper/521:05:045
17053499975,1cyclictest0-21swapper/520:40:005
17053499975,1cyclictest0-21swapper/519:40:015
17053499974,2cyclictest1786297-21cpuspeed_turbos19:49:595
17053499973,3cyclictest2399508-21tr00:19:585
17053499973,3cyclictest2193783-21ls22:55:005
17053499973,3cyclictest2048976-21dnf21:54:595
17053499973,3cyclictest2048976-21dnf21:54:595
17053499973,3cyclictest1964112-21grep21:19:595
17053499973,3cyclictest1795822-21cat19:54:595
17053499972,4cyclictest2327940-21irqcore23:50:025
17053499972,4cyclictest2134253-21cut22:30:035
17053499972,4cyclictest1831104-21tr20:10:075
17053499972,4cyclictest1715497-21cut19:14:495
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional