You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-13 - 20:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Sat Dec 13, 2025 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
235288525419,30sleep70-21swapper/707:05:317
235319624939,7sleep40-21swapper/407:09:534
626589450,38rtkit-daemon0-21swapper/507:05:465
2353496994337,5cyclictest2444525-21latency_hist07:54:557
235306223727,7sleep60-21swapper/607:08:026
2353486993330,2cyclictest2686814-21kworker/u16:4+flush-8:010:04:554
2353491993230,2cyclictest2580747-21kworker/u16:0+flush-8:009:50:105
2353491993128,2cyclictest2921479-21kworker/u16:1+flush-8:012:25:095
2353486993028,2cyclictest2687985-21kworker/u16:5+events_unbound10:25:124
2353491992925,3cyclictest2570917-21kworker/u16:3+flush-8:009:10:205
2353486992927,2cyclictest2812497-21kworker/u16:4+events_unbound11:25:244
2353491992725,2cyclictest2740472-21kworker/u16:1+events_unbound10:55:245
2353491992624,2cyclictest2921479-21kworker/u16:1+flush-8:012:15:185
2353491992624,2cyclictest2718287-21kworker/u16:0+flush-8:010:35:285
2353491992623,3cyclictest2921479-21kworker/u16:1+flush-8:012:20:225
2353491992522,2cyclictest2740472-21kworker/u16:1+flush-8:011:20:225
2353491992522,2cyclictest2740472-21kworker/u16:1+flush-8:011:20:225
2353486992523,2cyclictest2580747-21kworker/u16:0+events_unbound09:45:244
2353486992523,2cyclictest2580747-21kworker/u16:0+events_unbound09:45:244
235349699240,22cyclictest2610010-21latency_hist09:19:557
2353491992422,2cyclictest2740472-21kworker/u16:1+events_unbound11:14:085
2353491992422,2cyclictest2687985-21kworker/u16:5+events_unbound10:41:085
2353491992422,2cyclictest2425184-21kworker/u16:2+events_unbound08:07:575
235349699230,16cyclictest0-21swapper/708:59:507
235349699230,16cyclictest0-21swapper/708:59:507
2353493992319,3cyclictest2686814-21kworker/u16:4+flush-8:010:15:206
2353491992321,2cyclictest2775487-21kworker/u16:3+flush-8:010:50:145
2353491992321,2cyclictest2668382-21kworker/u16:2+events_unbound10:45:185
2353491992321,2cyclictest2425185-21kworker/u16:3+events_unbound07:57:245
2353491992321,2cyclictest2425184-21kworker/u16:2+events_unbound08:54:085
2353491992320,2cyclictest2740472-21kworker/u16:1+flush-8:011:30:125
2353486992321,2cyclictest2474129-21kworker/u16:1+flush-8:008:44:504
2353486992321,2cyclictest2425185-21kworker/u16:3+flush-8:007:50:244
235349699220,21cyclictest2574522-21cut09:00:137
2353491992220,2cyclictest2863293-21kworker/u16:3+flush-8:012:00:145
2353491992220,2cyclictest2740472-21kworker/u16:1+events_unbound11:04:515
2353491992220,2cyclictest2687985-21kworker/u16:5+events_unbound10:20:195
2353491992219,2cyclictest2610236-21kworker/u16:4+events_unbound09:30:155
2353486992220,2cyclictest2610236-21kworker/u16:4+events_unbound09:20:124
2353486992220,2cyclictest2570917-21kworker/u16:3+events_unbound09:05:204
26540932210,1chrt0-21swapper/509:40:325
2353491992119,2cyclictest2718287-21kworker/u16:0+events_unbound11:07:355
2353491992119,2cyclictest2668382-21kworker/u16:2+events_unbound10:11:125
2353486992119,2cyclictest2863293-21kworker/u16:3+flush-8:011:45:204
2353486992118,2cyclictest2482656-21kworker/u16:4+events_unbound08:24:574
2353496992015,4cyclictest1267-21snmpd08:35:247
2353496992013,1cyclictest0-21swapper/707:20:187
2353491992018,2cyclictest2668382-21kworker/u16:2+flush-8:010:28:115
2353491992018,2cyclictest2580747-21kworker/u16:0+events_unbound09:36:055
2353491992018,2cyclictest2354504-21kworker/u16:2+flush-8:007:30:325
2353486992018,2cyclictest2970047-21kworker/u16:2+flush-8:012:25:194
2353486992017,2cyclictest2812497-21kworker/u16:4+events_unbound11:29:574
2353496991915,3cyclictest1267-21snmpd08:26:307
235349699190,17cyclictest650-21systemd-journal09:05:177
2353493991916,2cyclictest2551857-21kworker/u16:4+flush-8:008:59:476
2353493991916,2cyclictest2551857-21kworker/u16:4+flush-8:008:59:476
2353491991917,2cyclictest2902343-21kworker/u16:0+flush-8:011:50:165
2353491991917,2cyclictest2891271-21kworker/u16:5+flush-8:012:11:165
2353491991917,2cyclictest2891271-21kworker/u16:5+flush-8:012:11:165
2353491991917,2cyclictest2570916-21kworker/u16:1+flush-8:009:24:125
2353491991917,2cyclictest2570916-21kworker/u16:1+events_unbound09:08:485
2353491991917,2cyclictest2425185-21kworker/u16:3+events_unbound08:30:005
2353491991917,2cyclictest2354504-21kworker/u16:2+flush-8:007:10:445
2353486991917,2cyclictest2740472-21kworker/u16:1+events_unbound11:20:234
2353486991917,2cyclictest2740472-21kworker/u16:1+events_unbound11:20:234
2353486991917,2cyclictest2580747-21kworker/u16:0+flush-8:009:50:234
2353486991917,2cyclictest2241039-21kworker/u16:4+events_unbound07:33:084
2353491991816,2cyclictest2902343-21kworker/u16:0+flush-8:011:55:245
2353491991816,2cyclictest2570917-21kworker/u16:3+events_unbound09:03:215
2353491991816,2cyclictest2532047-21kworker/u16:0+events_unbound08:49:095
2353491991816,2cyclictest2474129-21kworker/u16:1+flush-8:008:24:485
2353491991816,2cyclictest2425184-21kworker/u16:2+events_unbound08:17:375
2353491991816,2cyclictest2354504-21kworker/u16:2+flush-8:007:23:125
2353491991816,2cyclictest2241039-21kworker/u16:4+events_unbound07:39:545
2353486991816,2cyclictest2970047-21kworker/u16:2+flush-8:012:34:544
2353486991816,2cyclictest2812497-21kworker/u16:4+events_unbound11:35:124
2353486991816,2cyclictest2740472-21kworker/u16:1+events_unbound10:55:224
2353486991816,2cyclictest2580747-21kworker/u16:0+flush-8:009:15:154
2353486991815,2cyclictest2718287-21kworker/u16:0+events_unbound11:14:554
2353496991711,5cyclictest2815491-21cat11:05:097
235349699170,1cyclictest0-21swapper/707:35:207
235349399170,3cyclictest0-21swapper/610:59:536
2353491991715,2cyclictest2970047-21kworker/u16:2+events_unbound12:30:365
2353491991715,2cyclictest2902343-21kworker/u16:0+events_unbound12:39:285
2353491991715,2cyclictest2740472-21kworker/u16:1+events_unbound11:26:485
2353491991715,2cyclictest2686814-21kworker/u16:4+flush-8:010:03:375
2353491991715,2cyclictest2474129-21kworker/u16:1+events_unbound08:39:445
2353491991715,2cyclictest2425185-21kworker/u16:3+flush-8:008:40:415
2353491991715,2cyclictest2288614-21kworker/u16:0+events_unbound07:49:135
2353491991715,2cyclictest2241039-21kworker/u16:4+flush-8:007:19:475
2353486991715,2cyclictest2610236-21kworker/u16:4+events_unbound09:25:094
2353486991714,2cyclictest2610236-21kworker/u16:4+flush-8:009:35:154
235349699166,5cyclictest6045-21gmain09:40:237
2353496991612,3cyclictest1267-21snmpd10:31:457
2353496991612,3cyclictest1267-21snmpd10:29:367
2353496991610,5cyclictest2600259-21latency_hist09:14:557
235349699160,5cyclictest2736483-21latency_hist10:24:547
2353493991613,2cyclictest2740472-21kworker/u16:1+flush-8:010:40:266
2353491991614,2cyclictest2740472-21kworker/u16:1+events_unbound11:45:165
2353491991614,2cyclictest2668382-21kworker/u16:2+flush-8:009:57:085
2353491991614,2cyclictest2610236-21kworker/u16:4+events_unbound09:26:175
2353491991614,2cyclictest2551857-21kworker/u16:4+events_unbound08:56:255
2353491991614,2cyclictest2551857-21kworker/u16:4+events_unbound08:56:255
2353491991614,2cyclictest2425185-21kworker/u16:3+events_unbound08:25:345
2353491991613,2cyclictest2740472-21kworker/u16:1+flush-8:011:15:195
2353486991614,1cyclictest2579778-21ntp_states09:00:194
2353486991613,2cyclictest2425185-21kworker/u16:3+flush-8:008:15:054
235349699156,7cyclictest0-21swapper/711:51:267
2353496991512,2cyclictest0-21swapper/712:15:167
2353496991511,3cyclictest2891223-21ntpq11:40:197
2353496991511,3cyclictest1267-21snmpd09:57:447
235349399150,15cyclictest0-21swapper/609:10:386
2353491991513,2cyclictest2740472-21kworker/u16:1+events_unbound10:33:525
2353491991513,2cyclictest2618984-21kworker/u16:5+events_unbound09:46:485
2353491991513,2cyclictest2618984-21kworker/u16:5+events_unbound09:46:485
2353491991513,2cyclictest2425184-21kworker/u16:2+events_unbound08:03:375
2353491991513,2cyclictest2425184-21kworker/u16:2+events_unbound07:51:365
2353486991513,2cyclictest2718287-21kworker/u16:0+events_unbound10:21:044
2353486991513,2cyclictest2354504-21kworker/u16:2+events_unbound07:12:054
235349699149,3cyclictest2861991-21ntp_states11:25:227
235349699147,6cyclictest5944-21gmain10:55:107
235349699140,12cyclictest2835413-21irqstats11:15:117
235349699140,12cyclictest2725896-21ntpq10:15:217
2353493991413,1cyclictest0-21swapper/608:00:196
235349399140,7cyclictest0-21swapper/609:24:536
235349399140,14cyclictest0-21swapper/610:39:536
2353491991412,2cyclictest2891271-21kworker/u16:5+flush-8:011:41:455
2353491991412,2cyclictest2718287-21kworker/u16:0+events_unbound10:16:275
2353491991412,2cyclictest2570916-21kworker/u16:1+events_unbound09:17:555
2353491991412,2cyclictest2474129-21kworker/u16:1+events_unbound08:10:145
2353491991412,2cyclictest2354504-21kworker/u16:2+events_unbound07:26:255
2353491991411,2cyclictest2921479-21kworker/u16:1+flush-8:012:05:125
2353486991413,1cyclictest0-21swapper/410:35:234
2353486991412,2cyclictest2740472-21kworker/u16:1+flush-8:011:41:044
2353486991412,2cyclictest2718287-21kworker/u16:0+events_unbound11:05:104
235348699140,13cyclictest0-21swapper/408:45:204
235349699139,3cyclictest2949594-21ntpq12:10:187
235349699139,3cyclictest2949594-21ntpq12:10:187
235349699139,3cyclictest1267-21snmpd10:00:327
235349699139,3cyclictest1267-21snmpd07:31:407
235349699139,3cyclictest1267-21snmpd07:18:527
235349699138,4cyclictest2930199-21ntpq12:00:197
235349699138,4cyclictest2893369-21cat11:45:097
235349699138,4cyclictest2659862-21cat09:45:107
235349699138,4cyclictest2659862-21cat09:45:107
235349699137,5cyclictest2396004-21latency_hist07:29:557
2353496991310,2cyclictest2784236-21ntpq10:45:207
2353496991310,2cyclictest0-21swapper/710:50:207
235349699130,4cyclictest2978776-21ntpq12:25:217
235349699130,11cyclictest2912906-21cat11:55:107
235349699130,11cyclictest0-21swapper/707:40:127
235349399135,8cyclictest0-21swapper/609:34:536
2353493991312,1cyclictest0-21swapper/612:35:166
2353493991312,1cyclictest0-21swapper/609:04:196
2353493991312,1cyclictest0-21swapper/608:45:056
2353491991311,2cyclictest2668382-21kworker/u16:2+events_unbound10:07:395
2353491991311,2cyclictest2241039-21kworker/u16:4+flush-8:007:41:385
2353486991311,2cyclictest2775487-21kworker/u16:3+flush-8:010:50:254
2353486991311,2cyclictest2241039-21kworker/u16:4+events_unbound07:36:454
235348699130,0cyclictest0-21swapper/411:10:044
626589120,1rtkit-daemon0-21swapper/611:35:156
235349699129,2cyclictest1267-21snmpd09:36:017
235349699129,2cyclictest1267-21snmpd08:42:037
235349699128,3cyclictest6184-21gvfs-afc-volume08:00:107
235349699128,3cyclictest2881481-21ntpq11:35:217
235349699128,3cyclictest2677173-21ntp_states09:50:217
235349699128,3cyclictest2542135-21/usr/sbin/munin08:45:247
235349699128,3cyclictest1267-21snmpd10:36:097
235349699128,3cyclictest1267-21snmpd09:33:257
235349699128,3cyclictest1267-21snmpd09:21:377
235349699127,4cyclictest2522314-21latency_hist08:34:557
235349699126,5cyclictest2868785-21cut11:30:167
235349699126,5cyclictest2828717-21kthreadcore11:10:167
235349699120,4cyclictest2989427-21latency_hist12:34:557
235349699120,4cyclictest2710048-21kthreadcore10:10:197
235349699120,3cyclictest2850179-21kthreadcore11:20:157
235349699120,3cyclictest2850179-21kthreadcore11:20:157
235349699120,11cyclictest2807685-21kthreadcore11:00:127
235349699120,11cyclictest0-21swapper/707:45:197
235349699120,10cyclictest2931552-21/usr/sbin/munin12:05:107
2353493991211,1cyclictest0-21swapper/611:52:426
2353493991211,1cyclictest0-21swapper/610:23:096
2353493991211,1cyclictest0-21swapper/609:38:226
2353493991211,1cyclictest0-21swapper/609:29:526
2353493991211,1cyclictest0-21swapper/607:15:326
235349399120,1cyclictest0-21swapper/610:31:406
235349399120,12cyclictest0-21swapper/612:31:006
235349399120,12cyclictest0-21swapper/611:44:116
235349399120,12cyclictest0-21swapper/609:06:226
235349399120,12cyclictest0-21swapper/607:47:336
235349399120,0cyclictest0-21swapper/611:48:266
2353486991211,1cyclictest0-21swapper/412:36:374
2353486991211,1cyclictest0-21swapper/412:23:424
2353486991211,1cyclictest0-21swapper/409:58:014
2353486991210,2cyclictest5750-21gmain07:25:194
2353486991210,2cyclictest2863293-21kworker/u16:3+flush-8:011:55:064
2353486991210,2cyclictest2580747-21kworker/u16:0+flush-8:009:12:054
2353486991210,2cyclictest2474129-21kworker/u16:1+events_unbound08:35:094
2353486991210,2cyclictest2354504-21kworker/u16:2+events_unbound07:22:054
235348699120,1cyclictest0-21swapper/412:06:214
235348699120,1cyclictest0-21swapper/410:16:004
235348699120,11cyclictest0-21swapper/412:15:014
626589110,2rtkit-daemon0-21swapper/611:34:086
235349699117,3cyclictest2444913-21/usr/sbin/munin07:55:217
235349699117,3cyclictest1267-21snmpd10:43:127
235349699117,3cyclictest1267-21snmpd10:06:417
235349699117,3cyclictest1267-21snmpd09:27:347
235349699116,4cyclictest6184-21gvfs-afc-volume08:05:077
235349699116,4cyclictest1267-21snmpd07:13:167
235349699114,6cyclictest0-21swapper/712:20:457
235349699111,9cyclictest2990472-21perl12:35:087
235349699110,9cyclictest0-21swapper/708:15:197
235349699110,10cyclictest1267-21snmpd08:24:337
235349699110,10cyclictest1267-21snmpd08:11:147
2353493991110,1cyclictest0-21swapper/610:52:576
2353493991110,1cyclictest0-21swapper/610:48:416
235349399110,1cyclictest0-21swapper/607:30:316
235349399110,11cyclictest0-21swapper/612:26:456
235349399110,11cyclictest0-21swapper/612:22:296
235349399110,11cyclictest0-21swapper/607:56:036
235349399110,11cyclictest0-21swapper/607:22:006
235349199119,2cyclictest2740472-21kworker/u16:1+events_unbound11:37:075
235348699119,2cyclictest2740472-21kworker/u16:1+flush-8:010:40:314
235348699119,2cyclictest2425184-21kworker/u16:2+events_unbound07:59:054
235348699117,3cyclictest2465164-21cat08:05:094
2353486991110,1cyclictest0-21swapper/408:32:154
235348699110,1cyclictest0-21swapper/411:01:244
235348699110,1cyclictest0-21swapper/410:33:204
235348699110,11cyclictest0-21swapper/409:41:284
235348699110,11cyclictest0-21swapper/408:01:594
235348699110,11cyclictest0-21swapper/407:16:354
28303322100,1sleep60-21swapper/611:10:156
235349399109,1cyclictest0-21swapper/612:09:436
235349399109,1cyclictest0-21swapper/611:29:126
235349399109,1cyclictest0-21swapper/611:22:446
235349399109,1cyclictest0-21swapper/611:22:446
235349399109,1cyclictest0-21swapper/610:25:126
235349399109,1cyclictest0-21swapper/609:40:256
235349399109,1cyclictest0-21swapper/608:34:316
235349399109,1cyclictest0-21swapper/607:41:056
235349399109,1cyclictest0-21swapper/607:39:026
235349399109,1cyclictest0-21swapper/607:11:176
235349399108,2cyclictest2740472-21kworker/u16:1+flush-8:011:05:266
235349399105,4cyclictest1096-21ntpd12:10:196
235349399105,4cyclictest1096-21ntpd12:10:196
235348699109,1cyclictest0-21swapper/409:32:484
235348699108,2cyclictest2863293-21kworker/u16:3+events_unbound12:00:194
235348699108,2cyclictest2551857-21kworker/u16:4+events_unbound08:52:094
23534969995,3cyclictest924-21NetworkManager08:50:087
23534939998,1cyclictest0-21swapper/612:16:026
23534939998,1cyclictest0-21swapper/610:08:106
23534939998,1cyclictest0-21swapper/608:36:346
23534939998,1cyclictest0-21swapper/608:23:486
23534939996,3cyclictest2570916-21kworker/u16:1+flush-8:009:15:096
23534939996,2cyclictest0-21swapper/608:40:186
23534939996,2cyclictest0-21swapper/608:15:106
23534869998,1cyclictest0-21swapper/408:21:234
23534869997,2cyclictest2863293-21kworker/u16:3+flush-8:012:12:074
23534869997,2cyclictest2863293-21kworker/u16:3+flush-8:012:12:074
23534869997,2cyclictest2288614-21kworker/u16:0+events_unbound07:41:054
23534869994,4cyclictest2564425-21tr08:55:134
23534869994,4cyclictest2564425-21tr08:55:134
23534939987,1cyclictest0-21swapper/610:14:386
23534939985,2cyclictest2863293-21kworker/u16:3+flush-8:011:55:216
23534939984,3cyclictest2504091-21cat08:25:106
23534939983,4cyclictest2471331-21cut08:05:156
23534939983,4cyclictest2438909-21kthreadcore07:50:146
23534939980,8cyclictest0-21swapper/609:59:536
23534939980,2cyclictest0-21swapper/611:04:536
23534869986,2cyclictest2863293-21kworker/u16:3+events_unbound11:54:044
23534869986,2cyclictest2668382-21kworker/u16:2+events_unbound10:05:144
23534869983,4cyclictest2431778-21cut07:45:154
23534939976,1cyclictest0-21swapper/611:18:296
23534939973,3cyclictest2552585-21tune2fs08:50:106
23534939973,3cyclictest2386695-21cpu07:25:076
23534939972,4cyclictest2475089-21sed08:10:116
23534939970,7cyclictest0-21swapper/609:54:536
23534869975,2cyclictest2775487-21kworker/u16:3+flush-8:010:45:134
23534869973,3cyclictest2476051-21cut08:10:124
23534939961,3cyclictest0-21swapper/612:00:166
23534939960,1cyclictest0-21swapper/610:01:126
23534869963,3cyclictest2716850-21sshd-session10:11:414
23534939950,4cyclictest2659570-21sshd-session09:45:086
23534939950,4cyclictest2659570-21sshd-session09:45:086
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional