You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 09:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Sat May 30, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21931742970,1sleep72193175-21sh22:08:307
180327625238,9sleep40-21swapper/419:03:184
24019602470,4sleep72401961-21tr23:37:177
1803833994439,4cyclictest2074471-21latency_hist21:22:007
1803819994139,2cyclictest1826531-21kworker/u16:4+events_unbound19:22:234
180330823928,7sleep50-21swapper/519:03:435
17951772391,31sleep70-21swapper/719:02:167
1803819993733,3cyclictest2327778-21kworker/u16:0+flush-8:023:12:004
1803824993230,2cyclictest1961422-21kworker/u16:2+events_unbound21:02:295
1803819993129,2cyclictest1826531-21kworker/u16:4+events_unbound19:27:134
1803819993028,2cyclictest2312763-21kworker/u16:3+events_unbound23:27:254
1803826992927,2cyclictest1826531-21kworker/u16:4+events_unbound20:47:146
180328922919,7sleep60-21swapper/619:03:286
1803819992826,2cyclictest1804042-21kworker/u16:0+events_unbound19:11:544
25085572270,1chrt2508555-21ssh00:21:417
1803819992725,2cyclictest2061461-21kworker/u16:0+events_unbound21:35:054
1803819992725,2cyclictest1826531-21kworker/u16:4+events_unbound20:15:334
1803819992725,2cyclictest1804042-21kworker/u16:0+events_unbound19:12:064
1803819992624,2cyclictest2327778-21kworker/u16:0+flush-8:023:39:084
1803819992624,2cyclictest2327778-21kworker/u16:0+events_unbound23:18:444
1803819992624,2cyclictest1999949-21kworker/u16:1+events_unbound20:59:454
1803819992624,2cyclictest1826531-21kworker/u16:4+events_unbound20:30:224
1803833992519,5cyclictest1855749-21latency_hist19:32:017
1803819992523,2cyclictest2170976-21kworker/u16:3+flush-8:022:27:224
1803819992523,2cyclictest2061461-21kworker/u16:0+events_unbound22:17:534
1803819992422,2cyclictest2327778-21kworker/u16:0+flush-8:023:22:454
1803819992422,2cyclictest2327778-21kworker/u16:0+events_unbound00:12:134
1803819992422,2cyclictest2327778-21kworker/u16:0+events_unbound00:12:134
1803819992422,2cyclictest2061461-21kworker/u16:0+flush-8:022:16:114
1803819992422,2cyclictest2061461-21kworker/u16:0+flush-8:022:16:114
1803819992422,2cyclictest2061461-21kworker/u16:0+flush-8:022:02:164
1803819992422,2cyclictest1793707-21kworker/u16:2+flush-8:020:07:234
1803819992422,2cyclictest1793707-21kworker/u16:2+events_unbound19:41:464
1803819992321,2cyclictest2241046-21kworker/u16:2+events_unbound22:40:204
1803819992321,2cyclictest1999949-21kworker/u16:1+flush-8:020:54:114
1803819992321,2cyclictest1826531-21kworker/u16:4+flush-8:021:15:574
1803819992321,2cyclictest1826531-21kworker/u16:4+events_unbound19:47:184
1803819992220,2cyclictest2436310-21kworker/u16:3+events_unbound23:54:244
1803819992220,2cyclictest2241046-21kworker/u16:2+events_unbound22:35:134
1803819992220,2cyclictest1904344-21kworker/u16:1+flush-8:020:24:294
1803833992115,5cyclictest2544913-21latency_hist00:37:007
1803824992119,2cyclictest2327778-21kworker/u16:0+events_unbound00:00:215
1803824992119,2cyclictest2207117-21kworker/u16:1+events_unbound22:35:505
1803824992119,2cyclictest2207117-21kworker/u16:1+events_unbound22:24:025
1803824992119,2cyclictest2074859-21kworker/u16:2+events_unbound21:35:425
1803819992119,2cyclictest2448784-21kworker/u16:4+events_unbound00:03:074
1803819992119,2cyclictest2327778-21kworker/u16:0+flush-8:023:34:524
1803819992119,2cyclictest2327778-21kworker/u16:0+flush-8:023:34:524
1803819992119,2cyclictest2241046-21kworker/u16:2+flush-8:023:49:324
1803819992119,2cyclictest2061461-21kworker/u16:0+flush-8:021:52:234
1803819992119,2cyclictest2061461-21kworker/u16:0+events_unbound22:23:174
1803819992119,2cyclictest1961422-21kworker/u16:2+events_unbound20:48:464
1803819992119,2cyclictest1961422-21kworker/u16:2+events_unbound20:39:374
1803819992119,2cyclictest1942309-21kworker/u16:0+events_unbound20:19:414
1803819992119,2cyclictest1826531-21kworker/u16:4+events_unbound20:34:304
1803819992118,2cyclictest1856131-21kworker/u16:0+events_unbound19:42:044
1803824992018,2cyclictest2472860-21kworker/u16:3+events_unbound00:20:585
1803824992018,2cyclictest2241046-21kworker/u16:2+events_unbound00:36:215
1803824992018,2cyclictest2074859-21kworker/u16:2+events_unbound22:04:555
1803824992018,2cyclictest1999949-21kworker/u16:1+events_unbound21:31:595
1803824992018,2cyclictest1999949-21kworker/u16:1+events_unbound21:31:595
1803819992018,2cyclictest2472860-21kworker/u16:3+events_unbound00:24:474
1803819992018,2cyclictest2074859-21kworker/u16:2+events_unbound21:37:534
1803819992018,2cyclictest2061461-21kworker/u16:0+events_unbound22:07:344
1803819992018,2cyclictest2061461-21kworker/u16:0+events_unbound21:26:474
1803819992018,2cyclictest1999949-21kworker/u16:1+flush-8:021:51:474
1803819992017,2cyclictest2448784-21kworker/u16:4+flush-8:023:57:254
1803824991917,2cyclictest2241046-21kworker/u16:2+events_unbound23:51:345
1803824991917,2cyclictest2241046-21kworker/u16:2+events_unbound23:19:215
1803824991917,2cyclictest2061461-21kworker/u16:0+events_unbound22:18:345
1803819991917,2cyclictest2388077-21kworker/u16:1+flush-8:023:44:454
1803819991917,2cyclictest2241046-21kworker/u16:2+events_unbound23:05:564
1803819991917,2cyclictest2207117-21kworker/u16:1+events_unbound22:47:414
1803819991917,2cyclictest1961422-21kworker/u16:2+events_unbound20:45:214
1803819991917,2cyclictest1856131-21kworker/u16:0+flush-8:019:32:244
1803819991917,2cyclictest1825912-21kworker/u16:1+events_unbound19:17:134
1803819991917,2cyclictest1825912-21kworker/u16:1+events_unbound19:17:134
1803833991817,0cyclictest0-21swapper/720:22:157
1803833991812,5cyclictest2472471-21latency_hist00:06:597
1803824991816,2cyclictest2388077-21kworker/u16:1+events_unbound23:44:455
1803824991816,2cyclictest2241046-21kworker/u16:2+events_unbound00:14:495
1803824991816,2cyclictest2241046-21kworker/u16:2+events_unbound00:14:495
1803824991816,2cyclictest1826531-21kworker/u16:4+events_unbound21:16:355
1803824991816,2cyclictest1793707-21kworker/u16:2+events_unbound19:33:265
1803819991816,2cyclictest2472860-21kworker/u16:3+events_unbound00:08:454
1803819991816,2cyclictest2241046-21kworker/u16:2+events_unbound00:27:514
1803819991816,2cyclictest1999949-21kworker/u16:1+events_unbound21:04:444
1803819991816,2cyclictest1826531-21kworker/u16:4+flush-8:020:04:214
1803819991816,2cyclictest1826531-21kworker/u16:4+flush-8:020:04:214
1803833991715,1cyclictest0-21swapper/720:47:267
180383399171,14cyclictest2312624-21ssh22:57:227
180383399170,15cyclictest2219154-21latency_hist22:22:007
1803824991715,2cyclictest2241046-21kworker/u16:2+events_unbound23:35:305
1803824991715,2cyclictest2241046-21kworker/u16:2+events_unbound23:35:305
1803824991715,2cyclictest2241046-21kworker/u16:2+events_unbound23:05:225
1803824991715,2cyclictest2074859-21kworker/u16:2+events_unbound22:08:095
1803824991715,2cyclictest1999949-21kworker/u16:1+events_unbound21:54:515
1803824991715,2cyclictest1793707-21kworker/u16:2+events_unbound19:24:545
1803819991715,2cyclictest1826531-21kworker/u16:4+events_unbound19:55:134
1803819991714,2cyclictest1904344-21kworker/u16:1+events_unbound20:02:004
1803819991713,3cyclictest1999949-21kworker/u16:1+flush-8:021:07:194
180383399160,2cyclictest2384923-21ssh23:27:227
180383399160,1cyclictest0-21swapper/721:32:247
180382699160,13cyclictest0-21swapper/623:27:506
1803824991614,2cyclictest2061461-21kworker/u16:0+events_unbound21:23:185
1803824991614,2cyclictest1825912-21kworker/u16:1+events_unbound19:21:505
1803824991614,2cyclictest1825912-21kworker/u16:1+events_unbound19:21:505
1803824991613,2cyclictest1793707-21kworker/u16:2+events_unbound19:27:035
1803819991614,2cyclictest2241046-21kworker/u16:2+events_unbound22:45:484
1803833991512,2cyclictest0-21swapper/723:22:017
1803833991510,4cyclictest2170952-21latency_hist22:02:017
180383399150,14cyclictest0-21swapper/722:37:247
180383399150,14cyclictest0-21swapper/720:42:247
1803826991513,2cyclictest0-21swapper/621:54:216
1803826991512,1cyclictest0-21swapper/622:38:016
1803826991511,3cyclictest86-21ksoftirqd/622:42:226
1803826991511,3cyclictest2208354-21cat22:17:156
1803824991514,1cyclictest2383967-21cut23:27:195
1803824991514,1cyclictest0-21swapper/500:31:575
1803824991513,2cyclictest2207117-21kworker/u16:1+events_unbound22:47:395
1803824991513,2cyclictest2061461-21kworker/u16:0+events_unbound22:39:135
1803824991513,2cyclictest1999949-21kworker/u16:1+events_unbound21:58:245
1803824991513,2cyclictest1999949-21kworker/u16:1+events_unbound21:49:455
1803824991513,2cyclictest1961422-21kworker/u16:2+events_unbound20:54:545
1803824991513,2cyclictest1961422-21kworker/u16:2+events_unbound20:42:585
1803824991513,2cyclictest1904344-21kworker/u16:1+events_unbound20:19:275
1803824991513,2cyclictest1904344-21kworker/u16:1+events_unbound19:58:155
1803824991513,2cyclictest1804042-21kworker/u16:0+events_unbound19:07:305
1803824991513,2cyclictest1756652-21kworker/u16:3+events_unbound19:12:515
1803824991512,2cyclictest2312620-21ntpq22:57:225
180382499150,6cyclictest0-21swapper/522:42:145
1803819991513,2cyclictest1999949-21kworker/u16:1+events_unbound21:27:574
1803819991513,2cyclictest1999949-21kworker/u16:1+events_unbound21:27:574
1803819991512,2cyclictest2327778-21kworker/u16:0+events_unbound00:17:214
1803833991413,0cyclictest0-21swapper/721:28:337
1803833991413,0cyclictest0-21swapper/721:28:337
1803833991410,3cyclictest1234-21snmpd22:32:557
180383399140,1cyclictest0-21swapper/719:07:237
180383399140,13cyclictest0-21swapper/721:42:277
180383399140,13cyclictest0-21swapper/719:37:247
1803826991413,1cyclictest0-21swapper/623:03:336
1803826991413,1cyclictest0-21swapper/622:29:026
1803826991413,1cyclictest0-21swapper/619:52:286
180382699140,14cyclictest0-21swapper/600:23:486
1803824991413,1cyclictest2442532-21grep23:52:205
1803824991413,1cyclictest1962294-21/usr/sbin/munin20:27:135
1803824991413,1cyclictest0-21swapper/521:37:165
1803824991412,2cyclictest1826531-21kworker/u16:4+events_unbound20:23:025
1803824991412,2cyclictest1826531-21kworker/u16:4+events_unbound20:13:105
1803824991412,2cyclictest1826531-21kworker/u16:4+events_unbound19:56:265
1803824991411,2cyclictest2462143-21irqstats00:02:175
1803824991411,1cyclictest0-21swapper/523:14:045
180382499140,1cyclictest0-21swapper/521:09:035
180382499140,14cyclictest0-21swapper/523:40:525
180382499140,14cyclictest0-21swapper/522:27:155
1803819991413,1cyclictest0-21swapper/423:13:084
1803819991412,2cyclictest2472860-21kworker/u16:3+flush-8:000:32:124
1803819991412,2cyclictest2061461-21kworker/u16:0+events_unbound22:52:174
180381999140,14cyclictest0-21swapper/421:58:434
180383399139,3cyclictest1234-21snmpd23:50:457
180383399139,3cyclictest1234-21snmpd21:56:577
180383399139,3cyclictest1234-21snmpd20:59:437
180383399139,3cyclictest1234-21snmpd20:53:197
180383399139,3cyclictest1234-21snmpd20:17:577
180383399139,3cyclictest1234-21snmpd00:31:437
180383399139,3cyclictest1234-21snmpd00:23:407
180383399138,4cyclictest6382-21gvfs-afc-volume23:12:147
180383399138,4cyclictest1234-21snmpd20:34:437
180383399135,6cyclictest6101-21gmain22:22:137
1803833991312,0cyclictest0-21swapper/722:12:137
1803833991312,0cyclictest0-21swapper/722:12:137
1803833991310,2cyclictest1234-21snmpd19:21:447
1803833991310,2cyclictest1234-21snmpd19:21:447
1803833991310,2cyclictest0-21swapper/719:52:007
180383399130,11cyclictest1234-21snmpd20:09:007
1803826991312,1cyclictest0-21swapper/621:27:146
1803826991312,1cyclictest0-21swapper/621:27:146
1803826991312,1cyclictest0-21swapper/600:07:346
180382699130,13cyclictest0-21swapper/622:55:126
180382699130,13cyclictest0-21swapper/622:11:136
180382699130,0cyclictest0-21swapper/623:54:006
180382699130,0cyclictest0-21swapper/623:13:586
180382699130,0cyclictest0-21swapper/621:12:436
180382499138,3cyclictest76-21ksoftirqd/521:19:355
1803824991312,1cyclictest2005515-21cut20:47:195
1803824991312,1cyclictest1932179-21sed20:07:285
1803824991312,1cyclictest1886832-21tr19:47:175
1803824991311,2cyclictest5944-21gsd-housekeepin21:00:595
1803824991311,2cyclictest2473787-21if_err_p4p100:07:175
1803824991311,2cyclictest1904344-21kworker/u16:1+events_unbound20:34:055
1803824991311,2cyclictest1793707-21kworker/u16:2+events_unbound19:38:505
1803824991311,1cyclictest2510504-21kthreadcore00:22:205
1803824991311,1cyclictest2369268-21kthreadcore23:22:195
1803824991311,1cyclictest2300608-21ntp_states22:52:235
1803824991311,1cyclictest2131822-21smart_sda21:42:275
1803824991310,2cyclictest2336729-21ntp_states23:07:245
1803824991310,2cyclictest2196347-21iostat_ios22:12:155
1803824991310,2cyclictest2196347-21iostat_ios22:12:155
1803819991311,2cyclictest2241046-21kworker/u16:2+events_unbound22:57:224
1803819991311,2cyclictest1826531-21kworker/u16:4+events_unbound21:17:264
180383399129,2cyclictest1234-21snmpd23:58:157
180383399129,2cyclictest1234-21snmpd22:50:437
180383399129,2cyclictest1234-21snmpd20:04:187
180383399129,2cyclictest1234-21snmpd20:04:187
180383399129,2cyclictest0-21swapper/723:42:007
180383399129,2cyclictest0-21swapper/721:37:137
180383399128,3cyclictest1234-21snmpd23:18:237
180383399128,3cyclictest1234-21snmpd23:08:117
180383399128,3cyclictest1234-21snmpd22:04:427
180383399128,3cyclictest1234-21snmpd21:11:087
180383399128,3cyclictest1234-21snmpd19:23:477
180383399127,4cyclictest6382-21gvfs-afc-volume21:02:137
180383399126,6cyclictest6382-21gvfs-afc-volume22:55:557
180383399120,10cyclictest1234-21snmpd19:57:247
180382699129,2cyclictest1957388-21kthreadcore20:22:196
1803826991211,1cyclictest0-21swapper/623:40:176
1803826991211,1cyclictest0-21swapper/621:47:056
1803826991211,1cyclictest0-21swapper/620:31:256
1803826991211,1cyclictest0-21swapper/619:28:496
1803826991211,1cyclictest0-21swapper/600:12:146
1803826991211,1cyclictest0-21swapper/600:12:146
1803826991210,2cyclictest86-21ksoftirqd/619:07:216
180382699120,4cyclictest1867822-21kthreadcore19:37:166
180382699120,1cyclictest0-21swapper/620:06:496
180382699120,1cyclictest0-21swapper/620:06:496
180382499129,2cyclictest1914269-21diskstats20:02:155
180382499129,2cyclictest1914269-21diskstats20:02:155
1803824991211,1cyclictest0-21swapper/520:38:565
1803819991210,2cyclictest1999949-21kworker/u16:1+flush-8:021:42:114
180383399118,2cyclictest1234-21snmpd00:12:127
180383399118,2cyclictest1234-21snmpd00:12:127
180383399118,2cyclictest0-21swapper/700:07:167
180383399117,3cyclictest1234-21snmpd21:48:187
180383399117,3cyclictest1234-21snmpd20:27:557
180383399117,3cyclictest1234-21snmpd20:14:307
180383399116,4cyclictest6382-21gvfs-afc-volume19:32:277
180383399115,6cyclictest6382-21gvfs-afc-volume22:45:207
180383399115,5cyclictest6382-21gvfs-afc-volume23:54:277
180383399115,5cyclictest6382-21gvfs-afc-volume21:12:277
180383399114,6cyclictest1990193-21latency_hist20:42:007
180382699119,2cyclictest2508769-21kworker/u16:4+flush-8:000:32:006
180382699118,2cyclictest2030772-21cut21:02:186
1803826991111,0cyclictest0-21swapper/621:33:416
1803826991110,1cyclictest0-21swapper/621:20:176
1803826991110,1cyclictest0-21swapper/620:55:426
1803826991110,1cyclictest0-21swapper/620:44:496
180382699110,4cyclictest2162093-21cut21:57:176
180382699110,11cyclictest0-21swapper/620:18:486
180382699110,10cyclictest1858807-21kthreadcore19:32:186
180382499119,1cyclictest1875579-21cpuspeed_turbos19:42:125
180383399107,2cyclictest1234-21snmpd23:35:087
180383399107,2cyclictest1234-21snmpd23:35:087
180383399107,2cyclictest1234-21snmpd23:04:477
180383399107,2cyclictest0-21swapper/722:27:107
180383399107,2cyclictest0-21swapper/721:22:007
180383399106,3cyclictest1234-21snmpd19:47:147
180383399106,3cyclictest1234-21snmpd19:16:167
180383399103,5cyclictest6101-21gmain19:42:177
180382699109,1cyclictest0-21swapper/621:40:196
180382699108,2cyclictest86-21ksoftirqd/622:12:266
180382699108,2cyclictest86-21ksoftirqd/622:12:266
180382699108,2cyclictest86-21ksoftirqd/620:37:256
180382699107,2cyclictest1971689-21expr20:32:126
180382699106,3cyclictest1933772-21cat20:12:156
180382699106,3cyclictest1832591-21cut19:17:186
180382699106,3cyclictest1832591-21cut19:17:186
180382699105,4cyclictest2335804-21kthreadcore23:07:206
180382699104,5cyclictest0-21swapper/621:07:186
180382699101,8cyclictest2076612-21kthreadcore21:22:186
180382699100,9cyclictest2541817-21ntp_kernel_pll_00:32:236
180382699100,9cyclictest2388631-21cat23:32:126
180382699100,9cyclictest2388631-21cat23:32:126
180382699100,9cyclictest2247432-21kthreadcore22:32:196
180382699100,9cyclictest2176294-21grep22:02:206
180382699100,4cyclictest2429855-21grep23:47:186
180382699100,4cyclictest2279940-21/usr/sbin/munin22:47:276
180382699100,4cyclictest2222492-21kthreadcore22:22:166
18038269997,2cyclictest86-21ksoftirqd/623:00:026
18038269997,2cyclictest86-21ksoftirqd/600:20:146
18038269996,2cyclictest2354575-21kthreadcore23:17:166
18038269996,2cyclictest1818316-21hddtemp_smartct19:12:136
18038269995,3cyclictest2129589-21kthreadcore21:42:206
18038269994,4cyclictest2463231-21kthreadcore00:02:186
18038269993,5cyclictest0-21swapper/623:57:206
18038269990,8cyclictest2370259-21kthreadcore23:22:196
18038269990,8cyclictest1926485-21kthreadcore20:07:186
18038269990,3cyclictest1893195-21ntpq19:47:236
18038269990,2cyclictest2414933-21cat23:42:166
18038269983,4cyclictest1905432-21cut19:57:156
18038269980,7cyclictest1875360-21/usr/sbin/munin19:42:166
18038269973,3cyclictest2019792-21cat20:57:136
18038269970,1cyclictest0-21swapper/619:22:206
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional