You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 14:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Sat Dec 27, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
180299724636,7sleep60-21swapper/607:06:496
180300524432,9sleep50-21swapper/507:06:565
18031112406,30sleep70-21swapper/707:08:277
180303123927,8sleep40-21swapper/407:07:194
1803459993629,6cyclictest2185978-21latency_hist10:23:597
1803450993533,2cyclictest1784108-21kworker/u16:3+flush-8:007:09:144
1803450993331,2cyclictest2118398-21kworker/u16:0+events_unbound10:24:154
1803459993125,5cyclictest2079144-21latency_hist09:29:007
22246672300,0chrt2224665-21sshd-session10:42:187
1803458993028,2cyclictest2233617-21kworker/u16:1+events_unbound10:44:256
1803458993028,2cyclictest1924387-21kworker/u16:0+events_unbound08:11:066
1803458992927,2cyclictest2118398-21kworker/u16:0+events_unbound09:53:176
1803458992927,2cyclictest2118398-21kworker/u16:0+events_unbound09:53:176
1803458992826,2cyclictest1835976-21kworker/u16:4+events_unbound07:30:236
1803458992826,2cyclictest1535055-21kworker/u16:2+events_unbound07:39:546
1803450992825,2cyclictest1903966-21kworker/u16:3+events_unbound09:54:194
1803458992725,2cyclictest2430545-21kworker/u16:1+flush-8:012:37:256
1803458992725,2cyclictest2301648-21kworker/u16:3+events_unbound11:21:546
1803458992725,2cyclictest2156860-21kworker/u16:3+flush-8:011:09:006
1803458992725,2cyclictest2156860-21kworker/u16:3+events_unbound10:59:436
1803458992624,2cyclictest2312017-21kworker/u16:2+events_unbound11:26:436
1803458992624,2cyclictest2312017-21kworker/u16:2+events_unbound11:26:436
1803458992624,2cyclictest1942808-21kworker/u16:1+events_unbound09:32:186
1803458992624,2cyclictest1835976-21kworker/u16:4+flush-8:007:25:586
1803458992624,2cyclictest1803213-21kworker/u16:1+events_unbound07:13:546
1803450992624,2cyclictest2030747-21kworker/u16:0+events_unbound09:04:154
1803458992523,2cyclictest2361000-21kworker/u16:5+events_unbound12:18:176
1803458992523,2cyclictest2361000-21kworker/u16:5+events_unbound12:02:456
1803458992523,2cyclictest2312017-21kworker/u16:2+flush-8:011:39:306
1803458992523,2cyclictest2254388-21kworker/u16:2+events_unbound11:15:066
1803458992523,2cyclictest2156860-21kworker/u16:3+events_unbound11:13:226
1803458992523,2cyclictest2020674-21kworker/u16:2+events_unbound09:38:576
1803458992523,2cyclictest1942808-21kworker/u16:1+events_unbound10:09:266
1803458992523,2cyclictest1942808-21kworker/u16:1+events_unbound08:59:466
1803458992523,2cyclictest1903966-21kworker/u16:3+events_unbound08:41:376
1803458992523,2cyclictest1784108-21kworker/u16:3+events_unbound07:23:036
1803450992523,2cyclictest2254388-21kworker/u16:2+events_unbound11:04:274
1803450992523,2cyclictest1535055-21kworker/u16:2+events_unbound08:14:124
1803450992523,2cyclictest1535055-21kworker/u16:2+events_unbound08:14:124
1803458992422,2cyclictest2361000-21kworker/u16:5+events_unbound12:11:346
1803458992422,2cyclictest2361000-21kworker/u16:5+events_unbound12:07:136
1803458992422,2cyclictest2312017-21kworker/u16:2+events_unbound11:52:066
1803458992422,2cyclictest2200556-21kworker/u16:2+events_unbound10:33:136
1803458992422,2cyclictest2118398-21kworker/u16:0+events_unbound10:20:176
1803458992422,2cyclictest1942808-21kworker/u16:1+events_unbound09:41:236
1803458992422,2cyclictest1942808-21kworker/u16:1+events_unbound09:13:586
1803458992422,2cyclictest1924387-21kworker/u16:0+events_unbound08:23:546
1803458992422,2cyclictest1903966-21kworker/u16:3+events_unbound08:16:346
1803458992422,2cyclictest1903966-21kworker/u16:3+events_unbound08:16:346
1803458992422,2cyclictest1784108-21kworker/u16:3+events_unbound07:17:236
1803458992321,2cyclictest2312017-21kworker/u16:2+events_unbound12:33:576
1803458992321,2cyclictest2284099-21kworker/u16:1+events_unbound11:48:256
1803458992321,2cyclictest2273455-21kworker/u16:0+events_unbound11:33:226
1803458992321,2cyclictest2216224-21kworker/u16:4+events_unbound10:53:186
1803458992321,2cyclictest2020674-21kworker/u16:2+events_unbound09:17:586
1803458992321,2cyclictest1942808-21kworker/u16:1+events_unbound09:28:356
1803458992321,2cyclictest1942808-21kworker/u16:1+events_unbound08:35:226
1803450992321,2cyclictest2430545-21kworker/u16:1+flush-8:012:33:544
1803450992321,2cyclictest2020674-21kworker/u16:2+flush-8:009:38:544
1803450992321,2cyclictest1942808-21kworker/u16:1+events_unbound09:09:224
1803450992321,2cyclictest1924387-21kworker/u16:0+events_unbound08:29:264
1803450992321,2cyclictest1835976-21kworker/u16:4+flush-8:007:44:304
1803458992220,2cyclictest2312017-21kworker/u16:2+events_unbound11:58:256
1803458992220,2cyclictest2020674-21kworker/u16:2+flush-8:009:06:136
1803458992220,2cyclictest2010863-21kworker/u16:0+events_unbound08:52:186
1803458992220,2cyclictest1942808-21kworker/u16:1+events_unbound08:32:466
1803458992220,2cyclictest1903966-21kworker/u16:3+events_unbound08:26:076
1803458992220,2cyclictest1903966-21kworker/u16:3+events_unbound07:57:066
1803458992220,2cyclictest1535055-21kworker/u16:2+events_unbound07:52:226
1803450992220,2cyclictest2284099-21kworker/u16:1+flush-8:011:24:254
1803450992220,2cyclictest2284099-21kworker/u16:1+flush-8:011:24:254
1803450992220,2cyclictest2273455-21kworker/u16:0+flush-8:011:33:544
1803450992220,2cyclictest2118398-21kworker/u16:0+events_unbound10:49:184
1803450992220,2cyclictest1903966-21kworker/u16:3+flush-8:009:59:134
180345999210,19cyclictest2370611-21latency_hist11:58:597
1803458992119,2cyclictest2312017-21kworker/u16:2+events_unbound12:26:496
1803458992119,2cyclictest2146830-21kworker/u16:2+events_unbound10:00:586
1803458992119,2cyclictest1942808-21kworker/u16:1+events_unbound10:17:346
1803458992119,2cyclictest1942808-21kworker/u16:1+events_unbound08:46:076
1803458992119,2cyclictest1903966-21kworker/u16:3+events_unbound09:57:546
1803458992119,2cyclictest1903966-21kworker/u16:3+events_unbound09:46:186
1803458992119,2cyclictest1903966-21kworker/u16:3+events_unbound08:03:256
1803458992119,2cyclictest1875529-21kworker/u16:1+events_unbound08:06:346
1803458992119,2cyclictest1535055-21kworker/u16:2+events_unbound07:36:586
1803450992119,2cyclictest2284099-21kworker/u16:1+flush-8:011:34:254
1803450992119,2cyclictest2233617-21kworker/u16:1+events_unbound10:54:254
1803450992119,2cyclictest2118398-21kworker/u16:0+flush-8:010:34:224
1803450992119,2cyclictest2020674-21kworker/u16:2+events_unbound09:29:224
1803450992119,2cyclictest1942808-21kworker/u16:1+flush-8:008:28:554
1803450992119,2cyclictest1903966-21kworker/u16:3+events_unbound09:44:194
1803458992018,2cyclictest2233617-21kworker/u16:1+events_unbound10:58:496
1803458992018,2cyclictest1903966-21kworker/u16:3+flush-8:008:54:426
1803458992018,2cyclictest1835976-21kworker/u16:4+events_unbound07:45:596
1803450992018,2cyclictest2312017-21kworker/u16:2+events_unbound11:44:344
1803450992018,2cyclictest2273455-21kworker/u16:0+flush-8:011:19:134
1803450992018,2cyclictest1962945-21kworker/u16:4+events_unbound08:39:284
1803450992018,2cyclictest1924387-21kworker/u16:0+events_unbound08:34:274
1803450992018,2cyclictest1803213-21kworker/u16:1+events_unbound07:24:144
1803458991917,2cyclictest2284099-21kworker/u16:1+events_unbound11:36:186
1803458991917,2cyclictest2118398-21kworker/u16:0+events_unbound10:36:306
1803458991917,2cyclictest2118398-21kworker/u16:0+events_unbound10:26:346
1803458991917,2cyclictest1903966-21kworker/u16:3+flush-8:009:23:126
1803450991917,2cyclictest2361000-21kworker/u16:5+events_unbound12:24:134
1803450991917,2cyclictest2020674-21kworker/u16:2+flush-8:009:28:554
1803450991917,2cyclictest2020674-21kworker/u16:2+events_unbound08:59:244
1803450991917,2cyclictest1886068-21kworker/u16:0+flush-8:007:49:294
1803450991917,2cyclictest1535055-21kworker/u16:2+events_unbound08:09:284
1803459991814,3cyclictest1267-21snmpd11:40:377
1803459991812,5cyclictest2108299-21latency_hist09:43:597
180345999180,17cyclictest0-21swapper/711:19:247
1803458991816,2cyclictest1942808-21kworker/u16:1+flush-8:010:07:126
1803450991816,2cyclictest2351317-21kworker/u16:4+events_unbound12:18:544
1803450991816,2cyclictest1942808-21kworker/u16:1+flush-8:008:50:114
1803459991716,0cyclictest0-21swapper/709:14:157
180345999170,2cyclictest0-21swapper/712:34:247
180345999170,1cyclictest0-21swapper/709:19:247
180345999170,16cyclictest0-21swapper/711:49:227
1803458991715,2cyclictest2361000-21kworker/u16:5+flush-8:012:20:216
1803458991715,2cyclictest2216224-21kworker/u16:4+events_unbound10:42:576
180345499170,16cyclictest0-21swapper/509:19:005
1803450991715,2cyclictest2361000-21kworker/u16:5+events_unbound12:04:264
1803450991715,2cyclictest1903966-21kworker/u16:3+flush-8:008:44:174
1803450991714,2cyclictest1784108-21kworker/u16:3+events_unbound07:29:074
1803459991614,1cyclictest0-21swapper/712:19:227
1803459991612,3cyclictest1267-21snmpd08:11:227
180345499163,7cyclictest1881524-21cut07:44:215
1803454991613,3cyclictest0-21swapper/511:44:315
1803454991611,5cyclictest1962945-21kworker/u16:4+flush-8:008:44:255
180345499160,1cyclictest0-21swapper/511:35:135
180345499160,1cyclictest0-21swapper/507:28:105
1803450991614,2cyclictest2351317-21kworker/u16:4+flush-8:012:19:234
1803450991614,2cyclictest2254388-21kworker/u16:2+events_unbound10:59:204
1803450991614,2cyclictest2156860-21kworker/u16:3+events_unbound10:19:224
1803450991614,2cyclictest2156860-21kworker/u16:3+events_unbound10:09:244
1803450991614,2cyclictest2118398-21kworker/u16:0+flush-8:010:29:294
1803450991614,2cyclictest2098673-21kworker/u16:4+events_unbound09:39:244
1803450991614,2cyclictest1903966-21kworker/u16:3+flush-8:009:19:274
1803450991614,2cyclictest1784108-21kworker/u16:3+events_unbound07:14:244
1803450991614,2cyclictest1708430-21kworker/u16:0+events_unbound07:19:284
180345999158,7cyclictest6344-21gmain11:24:217
180345999158,7cyclictest6344-21gmain11:24:217
1803459991512,2cyclictest1267-21snmpd11:59:047
1803459991512,2cyclictest1267-21snmpd11:37:277
1803459991511,3cyclictest1267-21snmpd09:48:527
180345999150,13cyclictest0-21swapper/711:44:267
180345999150,13cyclictest0-21swapper/708:34:237
180345499150,15cyclictest0-21swapper/508:52:595
180345499150,0cyclictest0-21swapper/507:14:275
1803450991513,2cyclictest2351317-21kworker/u16:4+events_unbound12:09:124
1803450991513,2cyclictest2254388-21kworker/u16:2+flush-8:011:14:104
1803450991513,2cyclictest1903966-21kworker/u16:3+events_unbound09:49:224
1803450991513,2cyclictest1903966-21kworker/u16:3+events_unbound09:49:224
1803450991513,2cyclictest1535055-21kworker/u16:2+events_unbound08:04:144
180345999148,5cyclictest2322016-21latency_hist11:33:597
1803459991411,2cyclictest0-21swapper/707:54:007
180345999140,1cyclictest0-21swapper/708:14:247
180345999140,1cyclictest0-21swapper/708:14:247
180345999140,1cyclictest0-21swapper/707:29:247
180345999140,12cyclictest0-21swapper/707:24:247
1803454991413,1cyclictest0-21swapper/512:19:215
1803454991413,1cyclictest0-21swapper/510:07:155
1803454991412,2cyclictest0-21swapper/507:21:145
180345499140,1cyclictest0-21swapper/512:37:485
180345499140,13cyclictest2371051-21cpuspeed11:59:115
180345499140,0cyclictest0-21swapper/511:25:555
180345499140,0cyclictest0-21swapper/511:25:555
180345499140,0cyclictest0-21swapper/508:30:565
1803450991412,2cyclictest2351317-21kworker/u16:4+events_unbound12:02:164
1803450991412,2cyclictest2284099-21kworker/u16:1+events_unbound11:41:194
1803450991412,2cyclictest2118398-21kworker/u16:0+flush-8:010:07:024
1803450991412,2cyclictest1875529-21kworker/u16:1+events_unbound07:58:554
1803450991412,2cyclictest1535055-21kworker/u16:2+flush-8:007:39:214
180345099140,1cyclictest0-21swapper/408:19:194
180345999139,3cyclictest1267-21snmpd11:14:187
180345999139,3cyclictest1267-21snmpd09:59:557
1803459991310,2cyclictest0-21swapper/709:13:597
180345999130,6cyclictest0-21swapper/707:59:157
180345999130,4cyclictest2392983-21kthreadcore12:09:177
180345999130,2cyclictest0-21swapper/707:09:247
1803454991312,1cyclictest0-21swapper/511:57:175
1803454991311,2cyclictest0-21swapper/511:00:035
180345499130,6cyclictest0-21swapper/508:34:135
180345499130,1cyclictest0-21swapper/509:07:305
180345499130,13cyclictest0-21swapper/510:26:485
180345499130,13cyclictest0-21swapper/510:20:105
180345499130,13cyclictest0-21swapper/509:27:595
180345499130,0cyclictest0-21swapper/508:04:545
1803450991311,2cyclictest2156860-21kworker/u16:3+flush-8:011:09:194
1803450991311,2cyclictest1942808-21kworker/u16:1+events_unbound10:14:234
180345999129,2cyclictest0-21swapper/708:48:597
180345999128,3cyclictest1817228-21/usr/sbin/munin07:14:237
180345999128,3cyclictest1267-21snmpd10:15:137
180345999128,3cyclictest1267-21snmpd10:07:527
180345999128,3cyclictest1267-21snmpd09:57:197
180345999128,3cyclictest1267-21snmpd09:49:287
180345999128,3cyclictest1267-21snmpd09:49:287
180345999128,3cyclictest1267-21snmpd08:56:147
180345999128,3cyclictest1267-21snmpd08:42:417
180345999128,3cyclictest1267-21snmpd08:05:377
180345999128,3cyclictest1267-21snmpd07:39:547
180345999127,4cyclictest1965578-21kthreadcore08:29:197
180345999126,5cyclictest6184-21gvfs-afc-volume12:14:297
180345999125,6cyclictest0-21swapper/710:45:187
180345999125,6cyclictest0-21swapper/709:03:187
180345999121,2cyclictest0-21swapper/708:24:287
1803459991211,0cyclictest0-21swapper/707:22:027
1803459991210,1cyclictest2166559-21turbostat10:13:597
180345999120,6cyclictest1952698-21sshd-session08:22:187
180345999120,12cyclictest0-21swapper/712:24:237
180345999120,11cyclictest2438723-21cat12:33:597
180345999120,10cyclictest2198585-21sshd-session10:29:187
180345999120,10cyclictest1267-21snmpd09:04:117
180345499126,6cyclictest0-21swapper/511:19:275
180345499124,7cyclictest2313497-21cat11:29:145
180345499123,8cyclictest2206780-21cut10:34:165
180345499123,8cyclictest2134922-21cut09:54:215
1803454991211,1cyclictest0-21swapper/508:10:545
1803454991210,2cyclictest0-21swapper/510:39:535
1803454991210,2cyclictest0-21swapper/507:11:185
180345499120,7cyclictest1894596-21turbostat07:54:005
180345499120,6cyclictest1911475-21grep07:59:215
180345499120,12cyclictest0-21swapper/509:45:585
180345499120,12cyclictest0-21swapper/509:36:595
180345499120,12cyclictest0-21swapper/508:55:505
180345499120,12cyclictest0-21swapper/508:22:535
180345499120,12cyclictest0-21swapper/507:55:275
1803450991210,2cyclictest2322050-21kworker/u16:3+events_unbound11:49:124
180345099120,1cyclictest0-21swapper/409:15:364
180345099120,1cyclictest0-21swapper/408:03:424
180345999118,2cyclictest1267-21snmpd12:04:377
180345999118,2cyclictest0-21swapper/710:34:237
180345999117,3cyclictest1267-21snmpd11:03:337
180345999117,3cyclictest1267-21snmpd10:24:297
180345999117,3cyclictest1267-21snmpd09:29:037
180345999117,3cyclictest1267-21snmpd07:49:017
1803459991110,1cyclictest0-21swapper/707:44:287
180345999110,9cyclictest2240337-21grep10:49:197
180345999110,4cyclictest2273846-21/usr/sbin/munin11:09:237
180345999110,2cyclictest0-21swapper/711:04:127
180345999110,10cyclictest1863789-21kthreadcore07:34:207
180345999110,10cyclictest1267-21snmpd10:57:087
180345499119,2cyclictest0-21swapper/510:16:525
180345499116,4cyclictest0-21swapper/512:14:265
180345499116,4cyclictest0-21swapper/509:29:125
180345499113,7cyclictest2427965-21ldconfig12:24:215
180345499113,7cyclictest2335422-21tr11:39:175
180345499113,7cyclictest2266658-21cut11:04:165
180345499113,7cyclictest2143958-21cut09:59:205
180345499113,7cyclictest2118704-21cat09:49:125
180345499113,7cyclictest2118704-21cat09:49:125
1803454991110,1cyclictest0-21swapper/509:42:585
1803454991110,1cyclictest0-21swapper/508:28:525
180345499110,8cyclictest21606781kthreadcore10:09:195
180345499110,10cyclictest1854642-21memory07:29:215
180345099119,2cyclictest2399487-21kworker/u16:0+events_unbound12:36:104
180345099119,2cyclictest1535055-21kworker/u16:2+flush-8:007:34:274
180345099118,2cyclictest2012541-21irqcore08:54:184
1803450991110,1cyclictest0-21swapper/411:58:464
180345099110,11cyclictest0-21swapper/410:40:444
180345999106,3cyclictest1267-21snmpd08:44:117
180345999100,9cyclictest2098746-21grep09:38:597
180345499109,1cyclictest0-21swapper/510:53:265
180345499107,2cyclictest0-21swapper/511:49:145
180345499104,5cyclictest2052630-21kthreadcore09:14:185
180345499103,6cyclictest2023658-21cut08:59:185
180345499102,7cyclictest2229070-21cut10:44:185
180345499102,7cyclictest2197257-21uname10:29:175
180345499100,9cyclictest2385493-21grep12:04:195
180345499100,9cyclictest2274568-21grep11:09:145
180345499100,9cyclictest2245544-21irqcore10:54:175
180345499100,9cyclictest2048696-21kthreadcore09:09:215
180345499100,9cyclictest1983314-21irqcore08:39:165
180345499100,9cyclictest1937109-21kthreadcore08:14:185
180345499100,9cyclictest1937109-21kthreadcore08:14:185
180345499100,9cyclictest1867810-21cat07:39:175
180345499100,8cyclictest2429446-21tr12:29:105
180345499100,5cyclictest0-21swapper/507:34:175
18034549990,8cyclictest2390653-21cpuspeed_turbos12:09:115
18034549990,8cyclictest2292648-21chrt11:15:095
18034509997,2cyclictest2216224-21kworker/u16:4+flush-8:010:44:114
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional