You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 02:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Fri May 01, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
184838625443,8sleep40-21swapper/419:06:324
1848852994842,5cyclictest2287274-21latency_hist22:33:557
1848852994842,5cyclictest2287274-21latency_hist22:33:557
183940624736,7sleep50-21swapper/519:04:005
1848842994542,2cyclictest1966507-21kworker/u16:3+events_unbound21:13:574
1848852994438,5cyclictest2419837-21latency_hist23:28:557
1848847994340,2cyclictest2053706-21kworker/u16:4+flush-8:020:59:136
1848852994140,0cyclictest0-21swapper/719:13:597
1848847994138,2cyclictest2118590-21kworker/u16:4+events_unbound23:39:256
628089400,33rtkit-daemon0-21swapper/619:04:206
18749012400,0sleep40-21swapper/419:19:134
1848842994037,2cyclictest2118590-21kworker/u16:4+events_unbound00:08:574
18399362392,31sleep70-21swapper/719:04:107
1848842993836,2cyclictest2190802-21kworker/u16:2+flush-8:022:59:334
1848842993836,2cyclictest2151858-21kworker/u16:0+events_unbound22:43:574
1848842993735,2cyclictest2369247-21kworker/u16:0+events_unbound23:48:534
1848842993735,2cyclictest2118590-21kworker/u16:4+events_unbound23:08:444
1848842993735,2cyclictest2082397-21kworker/u16:1+events_unbound21:20:064
1848842993634,2cyclictest2369247-21kworker/u16:0+events_unbound00:01:414
1848842993533,2cyclictest2369247-21kworker/u16:0+events_unbound00:06:544
1848842993533,2cyclictest2190802-21kworker/u16:2+events_unbound22:33:574
1848842993533,2cyclictest2190802-21kworker/u16:2+events_unbound22:28:054
1848842993532,2cyclictest2369247-21kworker/u16:0+events_unbound23:23:584
1848842993433,1cyclictest2190802-21kworker/u16:2+events_unbound22:18:344
1848842993331,2cyclictest2118590-21kworker/u16:4+events_unbound23:20:064
1848842993330,2cyclictest2118590-21kworker/u16:4+events_unbound22:03:574
25753952320,1chrt2575396-21kthreadcore00:34:177
25753952320,1chrt2575396-21kthreadcore00:34:177
24270392320,0chrt0-21swapper/623:29:166
1848852993226,5cyclictest2063263-21latency_hist20:58:557
1848842993230,2cyclictest2426695-21kworker/u16:2+events_unbound00:19:254
1848842993230,2cyclictest2347608-21kworker/u16:1+events_unbound23:17:374
1848842993230,2cyclictest2151858-21kworker/u16:0+events_unbound21:44:574
1848842993230,2cyclictest2151858-21kworker/u16:0+events_unbound21:42:054
1848842993230,2cyclictest2118590-21kworker/u16:4+flush-8:022:39:334
1848842993230,2cyclictest2118590-21kworker/u16:4+events_unbound23:57:574
1848842993230,2cyclictest2118590-21kworker/u16:4+events_unbound23:57:574
1848842993129,2cyclictest2369247-21kworker/u16:0+events_unbound23:09:464
1848842993129,2cyclictest2190802-21kworker/u16:2+events_unbound22:21:054
1848842993129,2cyclictest2151858-21kworker/u16:0+events_unbound22:55:054
1848842993129,2cyclictest2151858-21kworker/u16:0+events_unbound22:49:054
1848842993129,2cyclictest2151858-21kworker/u16:0+events_unbound21:55:054
1848842993129,2cyclictest2118590-21kworker/u16:4+events_unbound00:37:044
1848842993129,2cyclictest2118590-21kworker/u16:4+events_unbound00:37:044
1848842993129,2cyclictest2082397-21kworker/u16:1+events_unbound21:38:054
1848847993028,2cyclictest2151858-21kworker/u16:0+flush-8:021:34:576
1848842993028,2cyclictest2518493-21kworker/u16:3+events_unbound00:33:424
1848852992924,4cyclictest2335517-21latency_hist22:53:567
184885299290,27cyclictest1900439-21latency_hist19:33:567
1848847992927,2cyclictest2151858-21kworker/u16:0+flush-8:022:38:506
1848842992927,2cyclictest2151858-21kworker/u16:0+events_unbound22:12:054
1848842992927,2cyclictest2118590-21kworker/u16:4+flush-8:023:29:014
1848842992927,2cyclictest2118590-21kworker/u16:4+events_unbound21:53:064
1848842992927,2cyclictest2118590-21kworker/u16:4+events_unbound21:53:064
1848852992827,0cyclictest0-21swapper/720:29:117
1848842992826,2cyclictest2118590-21kworker/u16:4+events_unbound23:38:014
1848842992825,2cyclictest2103438-21kworker/u16:2+flush-8:021:24:014
1848847992725,2cyclictest2369247-21kworker/u16:0+flush-8:000:09:506
1848847992724,3cyclictest1839034-21kworker/u16:1+flush-8:019:24:176
1848842992725,2cyclictest2426695-21kworker/u16:2+events_unbound23:41:064
1848842992725,2cyclictest2190802-21kworker/u16:2+events_unbound22:31:484
1848842992725,2cyclictest2190802-21kworker/u16:2+events_unbound22:31:484
1848842992725,2cyclictest2151858-21kworker/u16:0+events_unbound22:00:494
1848842992725,2cyclictest2103438-21kworker/u16:2+events_unbound21:30:534
1848842992725,2cyclictest2082397-21kworker/u16:1+events_unbound21:13:374
1848847992624,2cyclictest2033479-21kworker/u16:0+events_unbound21:09:156
1848847992623,2cyclictest2082397-21kworker/u16:1+flush-8:021:18:566
1848842992624,2cyclictest2118590-21kworker/u16:4+events_unbound00:26:094
1848842992624,2cyclictest2033479-21kworker/u16:0+flush-8:020:44:194
1848842992624,2cyclictest2033479-21kworker/u16:0+events_unbound20:55:054
1848842992624,2cyclictest1839034-21kworker/u16:1+flush-8:019:33:514
1848852992524,0cyclictest0-21swapper/722:34:107
1848847992522,2cyclictest2347608-21kworker/u16:1+flush-8:023:09:006
1848847992522,2cyclictest2151858-21kworker/u16:0+events_unbound22:54:126
1848842992523,2cyclictest2426695-21kworker/u16:2+events_unbound00:15:304
1848842992523,2cyclictest2369247-21kworker/u16:0+events_unbound23:53:374
1848842992523,2cyclictest1900479-21kworker/u16:0+events_unbound19:49:184
1848842992522,2cyclictest1966507-21kworker/u16:3+flush-8:020:13:564
1848852992423,0cyclictest0-21swapper/723:29:237
1848852992423,0cyclictest0-21swapper/723:14:027
1848847992422,2cyclictest2190802-21kworker/u16:2+flush-8:023:00:066
1848847992422,2cyclictest1839034-21kworker/u16:1+flush-8:020:24:216
1848847992421,2cyclictest2118590-21kworker/u16:4+flush-8:000:24:056
1848842992422,2cyclictest2053706-21kworker/u16:4+events_unbound21:06:064
1848842992422,2cyclictest1839034-21kworker/u16:1+events_unbound20:37:054
1848852992322,0cyclictest0-21swapper/722:24:137
1848852992322,0cyclictest0-21swapper/721:39:237
1848852992320,2cyclictest124-21kswapd022:02:577
1848852992316,5cyclictest2203006-21latency_hist21:58:567
1848847992321,2cyclictest2369247-21kworker/u16:0+events_unbound00:00:046
1848847992320,2cyclictest2190802-21kworker/u16:2+events_unbound22:29:156
1848847992320,2cyclictest2190802-21kworker/u16:2+events_unbound22:29:156
1848842992321,2cyclictest292198-21kworker/u16:0+events_unbound19:14:054
1848842992321,2cyclictest1900479-21kworker/u16:0+events_unbound19:43:064
1848842992321,2cyclictest1900479-21kworker/u16:0+events_unbound19:43:064
1848852992221,0cyclictest0-21swapper/722:39:197
1848847992220,2cyclictest2118590-21kworker/u16:4+events_unbound23:45:016
1848847992220,2cyclictest1839034-21kworker/u16:1+flush-8:019:53:566
1848842992220,2cyclictest1966507-21kworker/u16:3+events_unbound20:07:054
1848852992120,0cyclictest0-21swapper/721:29:257
1848852992119,1cyclictest0-21swapper/720:24:137
1848852992115,5cyclictest2468045-21latency_hist23:48:557
1848852992115,5cyclictest1938792-21latency_hist19:53:567
1848847992119,2cyclictest2190802-21kworker/u16:2+events_unbound22:27:066
1848847992119,2cyclictest2118590-21kworker/u16:4+flush-8:023:49:116
1848847992119,2cyclictest2118590-21kworker/u16:4+flush-8:023:04:276
1848847992119,2cyclictest2118590-21kworker/u16:4+flush-8:022:49:416
1848847992118,2cyclictest1900479-21kworker/u16:0+events_unbound19:59:086
1848842992119,2cyclictest1900479-21kworker/u16:0+events_unbound19:38:074
1848852992019,0cyclictest0-21swapper/719:19:107
1848847992018,2cyclictest2518493-21kworker/u16:3+events_unbound00:32:056
1848847992018,2cyclictest2518493-21kworker/u16:3+events_unbound00:23:056
1848847992018,2cyclictest2118590-21kworker/u16:4+events_unbound00:15:056
1848847992018,2cyclictest1966507-21kworker/u16:3+flush-8:021:14:216
1848847992017,2cyclictest2151858-21kworker/u16:0+flush-8:021:39:066
1848842992018,2cyclictest2053706-21kworker/u16:4+events_unbound21:03:064
1848842992018,2cyclictest1900479-21kworker/u16:0+events_unbound20:01:054
1848842992017,2cyclictest1839034-21kworker/u16:1+flush-8:020:29:064
1848852991918,0cyclictest0-21swapper/719:44:197
184885299190,17cyclictest2440872-21ssh23:34:217
184885299190,17cyclictest0-21swapper/719:24:197
1848847991917,2cyclictest2118590-21kworker/u16:4+events_unbound21:24:246
1848847991917,2cyclictest1839034-21kworker/u16:1+events_unbound20:09:276
1848847991916,2cyclictest2118590-21kworker/u16:4+events_unbound23:18:576
1848843991915,3cyclictest2508445-21cat00:09:075
1848842991917,2cyclictest1839034-21kworker/u16:1+flush-8:019:24:134
1848852991813,4cyclictest2034496-21latency_hist20:43:567
184885299180,1cyclictest0-21swapper/722:54:207
184885299180,16cyclictest0-21swapper/721:24:217
1848847991816,2cyclictest1839034-21kworker/u16:1+flush-8:020:04:186
1848847991816,2cyclictest1839034-21kworker/u16:1+flush-8:019:14:186
1848847991811,7cyclictest2118590-21kworker/u16:4+flush-8:021:50:576
1848847991811,7cyclictest2118590-21kworker/u16:4+flush-8:021:50:576
184884299180,17cyclictest2049533-21kthreadcore20:49:164
1848852991716,0cyclictest0-21swapper/720:23:247
1848852991716,0cyclictest0-21swapper/700:29:167
1848847991715,2cyclictest2151858-21kworker/u16:0+events_unbound21:44:266
1848847991715,2cyclictest2118590-21kworker/u16:4+flush-8:023:34:216
1848847991715,2cyclictest1726048-21kworker/u16:3+flush-8:019:19:176
1848842991715,2cyclictest1880938-21kworker/u16:4+events_unbound19:47:054
1848842991715,2cyclictest1839034-21kworker/u16:1+events_unbound20:25:074
1848842991715,2cyclictest1839034-21kworker/u16:1+events_unbound20:19:214
1848842991715,2cyclictest1839034-21kworker/u16:1+events_unbound19:12:064
1848852991615,0cyclictest0-21swapper/720:44:367
1848852991615,0cyclictest0-21swapper/720:34:137
1848852991615,0cyclictest0-21swapper/719:34:117
1848852991615,0cyclictest0-21swapper/719:09:027
1848852991614,1cyclictest2504131-21ssh00:03:547
1848852991614,1cyclictest0-21swapper/722:44:067
1848852991613,2cyclictest1234-21snmpd00:12:347
1848852991613,2cyclictest1234-21snmpd00:08:467
184885299160,14cyclictest2251183-21latency_hist22:18:567
1848847991614,2cyclictest2369247-21kworker/u16:0+events_unbound00:07:046
1848847991614,2cyclictest2118590-21kworker/u16:4+events_unbound22:16:066
184884399160,1cyclictest0-21swapper/523:13:495
184884399160,16cyclictest0-21swapper/521:44:515
184885299157,7cyclictest6101-21gmain21:19:217
1848852991513,1cyclictest1919681-21sed19:43:567
1848852991513,1cyclictest1919681-21sed19:43:567
1848852991512,2cyclictest2454663-21ssh23:41:267
184885299150,14cyclictest0-21swapper/723:56:047
184885299150,14cyclictest0-21swapper/723:56:047
1848847991513,2cyclictest2151858-21kworker/u16:0+events_unbound22:47:456
1848847991513,2cyclictest2151858-21kworker/u16:0+events_unbound21:59:256
1848847991513,2cyclictest2118590-21kworker/u16:4+events_unbound22:10:066
1848847991513,2cyclictest1966507-21kworker/u16:3+flush-8:020:54:206
1848847991512,2cyclictest2151858-21kworker/u16:0+events_unbound22:18:586
184884799150,1cyclictest0-21swapper/620:34:136
184884399150,3cyclictest19951041missed_timers20:19:165
1848842991513,2cyclictest1966507-21kworker/u16:3+events_unbound20:41:054
184885299149,4cyclictest1234-21snmpd20:01:247
1848852991413,0cyclictest0-21swapper/722:05:507
1848852991413,0cyclictest0-21swapper/700:14:117
1848852991411,2cyclictest0-21swapper/721:14:237
184885299140,13cyclictest0-21swapper/721:44:187
1848847991413,1cyclictest0-21swapper/620:44:196
1848847991412,2cyclictest2190802-21kworker/u16:2+events_unbound21:56:456
184884799140,1cyclictest0-21swapper/620:39:076
184884799140,14cyclictest0-21swapper/623:54:086
184884799140,14cyclictest0-21swapper/623:54:086
184884399147,6cyclictest2180141-21cat21:49:115
184884399147,6cyclictest2180141-21cat21:49:115
1848843991413,1cyclictest0-21swapper/523:56:295
1848843991413,1cyclictest0-21swapper/523:56:295
1848843991413,1cyclictest0-21swapper/522:53:265
1848843991413,1cyclictest0-21swapper/522:08:395
1848843991413,1cyclictest0-21swapper/521:12:505
1848843991412,2cyclictest0-21swapper/520:44:475
184884399140,4cyclictest19633161kthreadcore20:04:145
184884399140,3cyclictest24141431cut23:24:145
184884399140,14cyclictest0-21swapper/522:27:445
184885299139,3cyclictest1234-21snmpd20:13:587
184885299138,4cyclictest5975-21gmain23:04:167
1848852991310,2cyclictest0-21swapper/700:19:187
1848847991312,1cyclictest0-21swapper/620:29:206
1848843991312,1cyclictest0-21swapper/521:56:215
1848843991312,1cyclictest0-21swapper/521:23:435
184884399130,4cyclictest22759961cpuspeed_turbos22:29:095
184884399130,4cyclictest22759961cpuspeed_turbos22:29:095
184884399130,3cyclictest22574121kthreadcore22:19:155
184884399130,13cyclictest0-21swapper/519:54:105
184885299128,3cyclictest1234-21snmpd22:09:247
184885299128,3cyclictest1234-21snmpd21:11:147
184885299128,3cyclictest1234-21snmpd21:05:237
184885299128,3cyclictest1234-21snmpd20:59:537
184885299128,3cyclictest1234-21snmpd19:54:097
184885299127,4cyclictest2154823-21systemd-run21:38:567
184885299125,6cyclictest6382-21gvfs-afc-volume23:11:177
184885299125,5cyclictest6382-21gvfs-afc-volume20:04:157
184885299123,7cyclictest6382-21gvfs-afc-volume21:49:207
184885299123,7cyclictest6382-21gvfs-afc-volume21:49:207
184885299120,11cyclictest1234-21snmpd22:21:167
1848847991211,1cyclictest0-21swapper/619:38:536
1848847991210,2cyclictest1966507-21kworker/u16:3+events_unbound20:14:136
184884799120,1cyclictest0-21swapper/619:39:596
184884799120,1cyclictest0-21swapper/619:39:596
1848843991211,1cyclictest0-21swapper/521:33:305
1848843991211,1cyclictest0-21swapper/520:58:485
184884399120,4cyclictest2564050-21latency00:29:185
184884399120,4cyclictest2440867-21ntpq23:34:215
184884399120,4cyclictest24231611kthreadcore23:29:145
184884399120,4cyclictest2384700-21sh23:14:085
184884399120,4cyclictest1928877-21chrt19:45:105
184884399120,4cyclictest1871450-21taskset19:15:135
184884399120,3cyclictest21279641timerwakeupswit21:24:255
184884399120,11cyclictest0-21swapper/523:04:205
184884299128,3cyclictest1839034-21kworker/u16:1+flush-8:020:09:234
184885299118,3cyclictest5975-21gmain23:50:447
184885299114,6cyclictest6101-21gmain23:19:127
1848852991111,0cyclictest0-21swapper/720:49:307
184885299110,9cyclictest1234-21snmpd00:24:147
184884799119,2cyclictest86-21ksoftirqd/623:24:236
184884799119,2cyclictest2118590-21kworker/u16:4+events_unbound22:41:266
184884799119,2cyclictest2118590-21kworker/u16:4+events_unbound21:30:306
184884799119,2cyclictest1900479-21kworker/u16:0+events_unbound19:54:096
184884799116,4cyclictest1849838-21cat19:09:116
184884799111,9cyclictest2215733-21cpuspeed_turbos22:04:076
184884399117,3cyclictest2228337-21cat22:09:115
184884399115,5cyclictest2500963-21needreboot23:59:195
184884399113,7cyclictest2521324-21cut00:14:135
184884399113,7cyclictest2350507-21kthreadcore22:59:135
184884399113,7cyclictest2290180-21cat22:34:135
184884399113,7cyclictest2245458-21cut22:14:155
184884399113,7cyclictest2027181-21cut20:39:115
184884399113,7cyclictest1949091-21expr19:59:085
184884399113,7cyclictest1910543-21cat19:39:085
184884399113,7cyclictest1910543-21cat19:39:085
184884399113,7cyclictest1887790-21tr19:24:165
184884399112,8cyclictest2474934-21kthreadcore23:49:175
184884399112,8cyclictest2204905-21cut21:59:135
184884399112,8cyclictest2155828-21cut21:39:105
184884399112,8cyclictest1972283-21cut20:09:185
184884399112,8cyclictest0-21swapper/521:04:125
184884399111,9cyclictest2532773-21irqcore00:19:115
184884399111,1cyclictest681rcuog/400:08:105
184884399110,4cyclictest2464985-21cat23:44:195
184884399110,4cyclictest2448020-21cut23:39:165
184884399110,4cyclictest2147748-21cut21:34:135
184884399110,4cyclictest2072807-21taskset21:03:385
184884399110,4cyclictest1909700-21taskset19:34:285
184884399110,4cyclictest1895865-21cut19:29:145
184884399110,3cyclictest2567899-21grep00:34:075
184884399110,3cyclictest2567899-21grep00:34:075
184884399110,3cyclictest2544083-21cpuspeed_turbos00:24:105
184884399110,3cyclictest2300641-21iostat_ios22:39:115
184884399110,11cyclictest0-21swapper/519:50:425
184884799108,2cyclictest2518493-21kworker/u16:3+events_unbound00:33:586
184884799108,2cyclictest2518493-21kworker/u16:3+events_unbound00:33:586
184884799108,2cyclictest2118590-21kworker/u16:4+events_unbound23:15:176
184884799108,2cyclictest1966507-21kworker/u16:3+flush-8:020:49:246
184884399102,7cyclictest2010970-21kthreadcore20:29:165
184884399100,9cyclictest2336122-21grep22:54:085
184884399100,9cyclictest1872493-21cstates19:19:085
184884399100,8cyclictest2094926-21/usr/sbin/munin21:14:095
184884399100,8cyclictest2016106-21cstates20:34:065
184884399100,8cyclictest1997077-21cat20:24:075
184884399100,4cyclictest2312124-21cstates22:44:095
184884399100,4cyclictest2044956-21expr20:49:095
184884399100,4cyclictest1979550-21kthreadcore20:14:135
184884399100,4cyclictest1849137-21cpuspeed19:09:085
184884399100,3cyclictest2396331-21cat23:19:075
18488529996,2cyclictest1234-21snmpd22:58:597
18488529996,2cyclictest1234-21snmpd20:11:137
18488479997,2cyclictest1880937-21kworker/u16:2+flush-8:019:29:246
18488479990,8cyclictest1995654-21cat20:19:226
18488479990,8cyclictest1922354-21kthreadcore19:44:136
18488479980,7cyclictest0-21swapper/621:04:096
18488429974,2cyclictest1940392-21kernelversion19:54:124
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional