You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 23:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot0.osadl.org (updated Mon Nov 24, 2025 12:45:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28344993130,1cyclictest0-21swapper/110:45:161
2835099245,8cyclictest0-21swapper/209:40:532
2835099230,5cyclictest0-21swapper/209:36:262
28340992320,2cyclictest20412-21sed11:39:000
2834099225,16cyclictest32217-21php7.009:09:010
28340992218,3cyclictest21086-21sshd07:50:260
28340992218,3cyclictest12389-21chrt08:35:090
28340992218,3cyclictest11399-21grep07:35:150
28340992218,3cyclictest10211-21awk09:25:200
2835099212,18cyclictest0-21swapper/211:49:062
2835099212,18cyclictest0-21swapper/210:47:072
2835099210,20cyclictest0-21swapper/211:01:022
2834099215,2cyclictest22603-21tr08:50:160
2834099214,3cyclictest30808-21awk11:55:220
2834099214,16cyclictest6252-21fschecks_count12:10:160
2834099214,16cyclictest30587-21sed07:10:220
2834099214,16cyclictest28294-21cstates10:55:130
2834099213,3cyclictest21622-21sed10:40:220
2834099213,17cyclictest0-21swapper/008:00:200
28340992118,2cyclictest2669-21sort07:20:150
28340992117,3cyclictest19209-21find10:38:590
28340992117,3cyclictest18901-21sed12:30:210
28340992117,2cyclictest1059-21cups-browsed07:30:120
28340992116,2cyclictest0-21swapper/011:04:470
2834099211,19cyclictest0-21swapper/007:16:590
2834099210,20cyclictest0-21swapper/009:57:230
2835099200,2cyclictest4528-21H212:26:332
28344992016,3cyclictest0-21swapper/111:33:591
28344992012,4cyclictest0-21swapper/110:06:291
2834099204,2cyclictest2838-21cat09:15:010
2834099203,2cyclictest27635-21kernelversion09:00:160
2834099203,2cyclictest16178-21cat09:35:230
2834099203,16cyclictest293672chrt08:06:260
2834099203,16cyclictest2775-21cstates12:05:130
2834099203,16cyclictest24933-21sed08:55:170
2834099203,16cyclictest22396-21awk11:40:190
2834099203,16cyclictest0-21swapper/010:28:380
2834099203,16cyclictest0-21swapper/010:05:150
2834099203,16cyclictest0-21swapper/008:25:140
2834099202,17cyclictest0-21swapper/011:20:210
2834099202,17cyclictest0-21swapper/010:55:010
2834099202,17cyclictest0-21swapper/009:20:170
2834099202,17cyclictest0-21swapper/008:40:140
28340992017,2cyclictest5607-21expr07:25:150
28340992017,2cyclictest30738-21cat08:10:130
28340992017,2cyclictest26192-21cat11:50:010
28340992017,2cyclictest13025-21proc_pri12:20:190
28340992017,2cyclictest0-21swapper/012:15:180
28340992017,2cyclictest0-21swapper/008:30:140
28340992016,3cyclictest6992-21latency_hist11:15:010
28340992016,3cyclictest6992-21latency_hist11:15:010
28340992016,3cyclictest17582-21chrt11:33:540
28340992015,4cyclictest4528-21H212:26:330
2834099201,18cyclictest4523-21H212:26:330
2835099190,18cyclictest16606-21nfsd408:40:202
2835099190,18cyclictest0-21swapper/208:33:252
2835099190,16cyclictest4534-21H212:26:332
2835099190,16cyclictest4530-21H212:26:332
2835099190,16cyclictest30024-21cat08:10:012
2834499192,2cyclictest10605-21fschecks_time11:20:151
28344991915,3cyclictest0-21swapper/109:00:001
2834499190,16cyclictest4581-21H212:26:331
2834499190,16cyclictest4528-21H212:26:331
2834499190,16cyclictest4526-21H212:26:331
2834099192,16cyclictest32411-21expr12:00:120
2834099192,16cyclictest13012-21awk09:30:170
2834099192,16cyclictest0-21swapper/010:20:140
2834099192,16cyclictest0-21swapper/009:15:190
2834099192,16cyclictest0-21swapper/008:15:140
28340991916,2cyclictest4523-21H212:26:330
28340991916,2cyclictest13168-21expr11:25:140
28340991916,2cyclictest0-21swapper/011:15:130
28340991916,2cyclictest0-21swapper/010:15:110
28340991916,2cyclictest0-21swapper/010:10:120
28340991916,2cyclictest0-21swapper/007:46:170
28340991916,2cyclictest0-21swapper/007:46:170
28340991915,3cyclictest0-21swapper/011:05:220
28340991914,4cyclictest0-21swapper/009:45:240
2834099191,17cyclictest0-21swapper/009:40:170
2834099191,16cyclictest4526-21H212:26:330
2834099191,16cyclictest4523-21H212:26:330
2834099190,18cyclictest0-21swapper/008:45:010
2834099190,16cyclictest4526-21H212:26:330
2835099183,1cyclictest0-21swapper/208:35:152
2835099182,15cyclictest6056-21mailstats11:10:232
2835099182,15cyclictest6056-21mailstats11:10:232
2835099182,15cyclictest28-21ksoftirqd/212:04:552
28350991816,1cyclictest0-21swapper/211:33:062
28350991816,1cyclictest0-21swapper/207:20:512
28350991815,2cyclictest4534-21H212:26:332
28350991815,2cyclictest0-21swapper/210:35:012
28350991815,1cyclictest28-21ksoftirqd/207:17:062
28350991814,3cyclictest4532-21H212:26:332
2835099181,16cyclictest4534-21H212:26:332
2835099180,2cyclictest4536-21H212:26:332
2835099180,2cyclictest0-21swapper/209:31:142
2835099180,17cyclictest4538-21H212:26:332
2835099180,17cyclictest4528-21H212:26:332
2835099180,16cyclictest0-21swapper/210:55:172
2834499182,15cyclictest28884-21sendmail_mailqu08:05:221
2834499182,15cyclictest21-21ksoftirqd/112:02:591
2834499182,15cyclictest19486-21tr11:35:181
2834499182,15cyclictest18660-21chrt07:49:371
2834499182,15cyclictest18660-21chrt07:49:371
2834499182,15cyclictest0-21swapper/111:56:421
2834499182,10cyclictest8010-21python312:15:011
28344991817,1cyclictest21-21ksoftirqd/109:48:471
28344991816,1cyclictest17942-21munin-plugin-st08:45:011
28344991816,1cyclictest0-21swapper/107:28:351
28344991815,2cyclictest4538-21H212:26:331
28344991815,2cyclictest3350-21master11:02:151
2834499181,2cyclictest20537-21grep07:50:191
2834499181,2cyclictest12779-21nfsd412:20:171
2834499180,2cyclictest4593-21H212:26:331
2834499180,2cyclictest4581-21H212:26:331
2834499180,2cyclictest4536-21H212:26:331
2834499180,2cyclictest4523-21H212:26:331
2834499180,17cyclictest4530-21H212:26:331
2834499180,17cyclictest0-21swapper/108:30:141
2834499180,16cyclictest4536-21H212:26:331
2834499180,15cyclictest4593-21H212:26:331
2834499180,15cyclictest4528-21H212:26:331
2834099182,15cyclictest0-21swapper/010:30:150
28340991815,2cyclictest0-21swapper/012:25:170
2834099181,16cyclictest4530-21H212:26:330
2834099180,1cyclictest0-21swapper/008:21:150
2835099172,14cyclictest0-21swapper/209:20:322
28350991716,1cyclictest28-21ksoftirqd/212:25:132
28350991715,1cyclictest0-21swapper/211:51:282
28350991715,1cyclictest0-21swapper/207:25:162
28350991714,2cyclictest9455-21nvmesmart_nvme007:30:202
28350991714,2cyclictest5466-21chrt09:15:322
28350991714,2cyclictest3350-21master08:13:092
28350991714,2cyclictest31017-21lxd11:15:052
28350991714,2cyclictest25175-21grep08:55:182
28350991713,2cyclictest4530-21H212:26:332
2835099171,15cyclictest0-21swapper/211:55:142
2835099170,2cyclictest5899-21expr10:15:122
2835099170,2cyclictest4593-21H212:26:332
2835099170,2cyclictest4593-21H212:26:332
2835099170,2cyclictest4536-21H212:26:332
2835099170,2cyclictest4536-21H212:26:332
2835099170,2cyclictest4523-21H212:26:332
2835099170,2cyclictest4523-21H212:26:332
2835099170,2cyclictest26859-21nfsd409:55:182
2835099170,2cyclictest2485-21cpuspeed_turbos12:05:132
2835099170,2cyclictest21035-21cp08:50:022
2835099170,2cyclictest14239-21mailstats11:25:212
2835099170,16cyclictest9535-21http_loadtime12:15:172
2835099170,16cyclictest4538-21H212:26:332
2835099170,16cyclictest4536-21H212:26:332
2835099170,16cyclictest4532-21H212:26:332
2835099170,16cyclictest4526-21H212:26:332
2835099170,16cyclictest4526-21H212:26:332
2835099170,16cyclictest4526-21H212:26:332
2835099170,16cyclictest4523-21H212:26:332
2835099170,16cyclictest3247-21cut08:20:012
2835099170,16cyclictest2403-21needreboot11:05:192
2835099170,16cyclictest18057-21cpu08:45:152
2835099170,16cyclictest1403-21lxd10:41:052
2835099170,16cyclictest1059-21cups-browsed07:51:022
2835099170,16cyclictest0-21swapper/211:23:522
28344991717,0cyclictest0-21swapper/107:20:151
28344991715,1cyclictest21-21ksoftirqd/109:07:001
28344991715,1cyclictest0-21swapper/107:18:091
28344991714,2cyclictest9597-21cut10:20:181
28344991714,2cyclictest6787-21cstates09:20:141
28344991714,2cyclictest4536-21H212:26:331
28344991714,2cyclictest4526-21H212:26:331
28344991714,2cyclictest3264-21/usr/sbin/munin09:15:151
28344991714,2cyclictest29441-21sh10:55:181
28344991714,2cyclictest29177-21cstates07:10:141
28344991714,2cyclictest28000-21awk09:00:171
28344991714,2cyclictest23152-21ls09:50:151
28344991714,2cyclictest2267-21python310:10:021
28344991714,2cyclictest1665-21ls11:05:151
28344991714,2cyclictest1579-21sed09:10:191
28344991714,2cyclictest14262-21expr10:30:151
28344991714,2cyclictest13584-21cat09:30:231
28344991713,3cyclictest21628-21grep11:40:151
2834499170,2cyclictest3036-21postgres11:45:121
2834499170,2cyclictest21696-21expr08:50:121
2834499170,2cyclictest20204-21expr10:40:151
2834499170,2cyclictest18987-21grep08:45:181
2834499170,2cyclictest1086-21snmpd11:10:161
2834499170,2cyclictest1086-21snmpd11:10:161
2834499170,16cyclictest9161-21cat12:15:151
2834499170,16cyclictest9001-21apache_volume09:25:141
2834499170,16cyclictest8439-21awk11:15:171
2834499170,16cyclictest4536-21H212:26:331
2834499170,16cyclictest4530-21H212:26:331
2834499170,16cyclictest4528-21H212:26:331
2834499170,16cyclictest26586-21trivial-rewrite08:00:561
2834499170,16cyclictest2398-21apt-get12:05:121
2834499170,16cyclictest18784-21apt-key10:37:401
2834499170,16cyclictest14452-21apt-get09:35:141
2834499170,16cyclictest12425-21sed07:35:211
28350991614,1cyclictest0-21swapper/207:40:142
28350991614,1cyclictest0-21swapper/207:35:162
2835099160,15cyclictest18393-21ntp_kernel_pll_12:30:182
2835099160,15cyclictest0-21swapper/211:40:142
2835099160,15cyclictest0-21swapper/207:10:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional