You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-12-11 - 14:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot0.osadl.org (updated Wed Dec 11, 2024 00:46:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19709992417,6cyclictest24525-21latency_hist22:10:010
1971099230,22cyclictest823-21systemd-network19:18:251
1971099225,11cyclictest0-21swapper/119:45:341
19709992219,2cyclictest18781-21perf22:00:010
19709992216,5cyclictest101rcuc/019:55:010
19711992112,0cyclictest0-21swapper/223:25:132
19709992114,4cyclictest24087-21fschecks_count00:00:130
1971099202,15cyclictest0-21swapper/120:20:201
19709992013,3cyclictest0-21swapper/021:50:170
1970999201,18cyclictest29916-21needreboot19:25:190
1970999200,17cyclictest0-21swapper/020:30:010
19711991915,2cyclictest16678-21fschecks_count20:00:142
1971199191,15cyclictest0-21swapper/220:56:332
1971199190,5cyclictest0-21swapper/222:35:192
1971099193,15cyclictest0-21swapper/123:40:011
1971099193,15cyclictest0-21swapper/123:40:011
19710991915,3cyclictest0-21swapper/122:38:041
19710991914,2cyclictest4523-21H212:26:331
1971099190,4cyclictest823-21systemd-network21:25:061
1971099190,2cyclictest4581-21H212:26:331
1971099190,2cyclictest4534-21H212:26:331
1970999199,5cyclictest17719-21latency_hist23:50:010
1970999193,15cyclictest0-21swapper/021:43:160
1970999192,16cyclictest0-21swapper/022:00:150
19709991915,3cyclictest7732-21php7.021:39:010
1970999190,16cyclictest4528-21H212:26:330
1971199182,15cyclictest293192chrt20:23:292
1971199182,15cyclictest20910-21switchtime22:55:222
1971199182,15cyclictest0-21swapper/219:54:102
19711991816,1cyclictest31566-21cpuspeed_turbos21:25:112
19711991816,1cyclictest0-21swapper/219:21:522
19711991814,1cyclictest0-21swapper/223:55:182
19711991812,5cyclictest11521-21date20:50:012
1971199180,2cyclictest4534-21H212:26:332
1971199180,17cyclictest17348-21tr21:00:142
1971099182,2cyclictest13342-21wc20:50:241
19710991816,1cyclictest0-21swapper/122:47:171
19710991815,2cyclictest1132-21snapd20:41:131
1971099180,2cyclictest4528-21H212:26:331
1970999182,15cyclictest9-21ksoftirqd/020:49:310
1970999182,15cyclictest9-21ksoftirqd/019:20:300
19709991816,1cyclictest0-21swapper/023:06:220
19709991816,1cyclictest0-21swapper/021:01:250
19709991812,5cyclictest823-21systemd-network20:40:480
1970999181,15cyclictest0-21swapper/022:12:320
1970999180,17cyclictest12994-21sendmail-mta21:46:070
1970999180,16cyclictest21179-21nfsd421:05:180
1970999180,16cyclictest21179-21nfsd421:05:180
19711991715,1cyclictest0-21swapper/219:15:152
19711991714,2cyclictest4815-21ps20:35:212
19711991714,2cyclictest4593-21H212:26:332
19711991714,2cyclictest4581-21H212:26:332
19711991714,2cyclictest29794-21taskset22:19:342
19711991714,2cyclictest27805-21mailstats00:05:202
19711991714,2cyclictest10799-21latency_hist00:35:012
19711991714,2cyclictest0-21swapper/221:30:112
19711991714,2cyclictest0-21swapper/200:15:212
19711991713,3cyclictest0-21swapper/222:46:132
1971199171,15cyclictest19708-21cyclictest22:20:132
1971199171,15cyclictest18796-21pluginstate22:55:002
1971199170,2cyclictest7513-21latency_hist19:45:012
1971199170,2cyclictest23949-21tr21:10:192
1971199170,2cyclictest2049-21systemd-journal23:04:592
1971199170,2cyclictest1404-21lxd23:06:532
1971199170,16cyclictest738-21df20:30:152
1971199170,16cyclictest4523-21H212:26:332
1971199170,16cyclictest31172-21nfsd420:25:192
1971199170,16cyclictest30609-21cat23:15:142
1971199170,16cyclictest30609-21cat23:15:142
1971199170,16cyclictest23217-21sendmail_mailqu20:10:222
1971199170,16cyclictest13581-21timerwakeupswit20:50:252
1971199170,16cyclictest11881-21latency00:35:192
1971199170,16cyclictest0-21swapper/223:50:112
1971199170,16cyclictest0-21swapper/219:35:162
1971199170,16cyclictest0-21swapper/200:20:142
1971199170,16cyclictest0-21swapper/200:10:172
1971199170,15cyclictest0-21swapper/221:15:172
1971099172,15cyclictest21-21ksoftirqd/123:39:271
19710991715,1cyclictest31562-21sed00:15:001
19710991715,1cyclictest28172sleep123:21:321
19710991715,1cyclictest0-21swapper/122:55:161
19710991715,1cyclictest0-21swapper/121:20:181
19710991714,2cyclictest8152-21/usr/sbin/munin00:30:111
19710991714,2cyclictest6283-21grep23:30:011
19710991714,2cyclictest5322-21cpuspeed_turbos19:40:151
19710991714,2cyclictest4538-21H212:26:331
19710991714,2cyclictest4530-21H212:26:331
19710991714,2cyclictest4528-21H212:26:331
19710991714,2cyclictest32724-21if_eno100:15:161
19710991714,2cyclictest30939-21fschecks_time23:15:151
19710991714,2cyclictest30939-21fschecks_time23:15:151
19710991714,2cyclictest30864-21df_inode22:20:141
19710991714,2cyclictest27335-21cat21:15:221
19710991714,2cyclictest27268-21sed00:05:171
19710991714,2cyclictest24174-21ntp_kernel_pll_21:10:201
19710991714,2cyclictest21782-21/usr/sbin/munin23:55:171
19710991714,2cyclictest19993-21netstat20:05:181
19710991714,2cyclictest1578-21nfsd420:30:191
19710991714,2cyclictest13465-21cut21:49:591
19710991714,2cyclictest1127-21snapd22:41:131
19710991713,3cyclictest4538-21H212:26:331
19710991713,3cyclictest4538-21H212:26:331
1971099170,2cyclictest6679-21grep21:35:181
1971099170,2cyclictest4523-21H212:26:331
1971099170,2cyclictest4523-21H212:26:331
1971099170,2cyclictest3350-21master23:51:441
1971099170,2cyclictest26900-21chrt22:12:211
1971099170,2cyclictest23903-21expr00:00:121
1971099170,2cyclictest21373-21ps21:05:201
1971099170,2cyclictest21373-21ps21:05:201
1971099170,2cyclictest2049-21systemd-journal00:21:481
1971099170,2cyclictest1355-21lxd23:12:531
1971099170,16cyclictest4593-21H212:26:331
1971099170,16cyclictest4536-21H212:26:331
1971099170,16cyclictest4198-21proxymap21:31:311
1971099170,16cyclictest28937-21smartctl22:15:191
1971099170,16cyclictest2410-21expr19:35:141
1971099170,16cyclictest1-21systemd22:30:011
1971099170,16cyclictest1147-21snapd21:56:131
1971099170,16cyclictest1132-21snapd20:38:431
1971099170,16cyclictest0-21swapper/122:31:181
1971099170,15cyclictest4534-21H212:26:331
19709991714,2cyclictest4581-21H212:26:330
19709991714,2cyclictest4523-21H212:26:330
19709991714,2cyclictest30264-21cat22:20:110
19709991714,2cyclictest27661-21ps00:05:190
19709991714,2cyclictest24572-21cut20:15:140
19709991714,2cyclictest23401-21awk20:10:230
19709991714,2cyclictest23247-21latency_hist23:59:590
19709991714,2cyclictest16059-21egrep20:00:130
19709991714,2cyclictest15711-21python322:50:000
19709991714,2cyclictest14890-21chrt20:55:150
1970999171,2cyclictest18102-21cpuspeed_turbos23:50:120
1970999171,15cyclictest4035-21taskset20:35:170
1970999170,2cyclictest977-21cron22:20:000
1970999170,2cyclictest7315-21if_eno123:30:120
1970999170,2cyclictest29717-21expr00:10:140
1970999170,2cyclictest13996-21cron20:55:010
1970999170,2cyclictest1155-21snapd19:13:430
1970999170,1cyclictest0-21swapper/021:30:360
1970999170,1cyclictest0-21swapper/020:20:590
1970999170,16cyclictest4538-21H212:26:330
1970999170,16cyclictest4536-21H212:26:330
1970999170,16cyclictest4534-21H212:26:330
1970999170,16cyclictest31946-21expr21:25:120
1970999170,16cyclictest23077-21gpg-connect-age19:15:020
1970999170,16cyclictest2042-21sed00:20:010
1970999170,16cyclictest2041-21cut19:35:120
1970999170,16cyclictest1494-21perf19:35:020
1970999170,16cyclictest14865-21munin-run23:45:000
1970999170,16cyclictest14865-21munin-run23:45:000
19711991614,1cyclictest0-21swapper/223:35:122
19711991614,1cyclictest0-21swapper/223:20:142
19711991614,1cyclictest0-21swapper/222:30:142
19711991614,1cyclictest0-21swapper/222:00:052
19711991614,1cyclictest0-21swapper/219:55:202
19711991614,1cyclictest0-21swapper/219:45:162
19711991614,1cyclictest0-21swapper/200:25:112
19711991613,2cyclictest7207-21fschecks_time23:30:122
19711991613,2cyclictest21942-21grep22:05:142
19711991613,2cyclictest11212-21cat22:40:192
1971199160,1cyclictest28299-21ls23:10:152
1971199160,1cyclictest12358-21dpkg23:40:012
1971199160,1cyclictest12358-21dpkg23:40:012
1971199160,1cyclictest0-21swapper/223:45:142
1971199160,1cyclictest0-21swapper/221:40:142
1971199160,1cyclictest0-21swapper/220:40:122
1971199160,1cyclictest0-21swapper/200:00:162
1971199160,15cyclictest0-21swapper/222:25:142
1971199160,15cyclictest0-21swapper/221:55:142
1971199160,15cyclictest0-21swapper/221:45:182
1971199160,15cyclictest0-21swapper/221:35:022
1971199160,15cyclictest0-21swapper/221:20:172
1971199160,15cyclictest0-21swapper/221:05:162
1971199160,15cyclictest0-21swapper/221:05:152
1971199160,15cyclictest0-21swapper/220:15:152
1971199160,15cyclictest0-21swapper/219:30:162
19710991614,1cyclictest14152-21cat21:50:141
19710991614,1cyclictest11435-21ls00:35:151
19710991614,1cyclictest0-21swapper/123:30:181
19710991614,1cyclictest0-21swapper/123:00:181
19710991613,2cyclictest5835-21cat00:25:131
1971099160,2cyclictest30231-21expr20:25:151
1971099160,2cyclictest24760-21cat20:15:151
1971099160,15cyclictest15986-21smartctl23:45:161
1971099160,15cyclictest0-21swapper/120:10:161
19709991614,1cyclictest0-21swapper/023:25:100
19709991614,1cyclictest0-21swapper/022:55:070
19709991614,1cyclictest0-21swapper/022:41:210
19709991614,1cyclictest0-21swapper/022:31:360
19709991614,1cyclictest0-21swapper/022:25:000
19709991614,1cyclictest0-21swapper/021:20:150
19709991614,1cyclictest0-21swapper/019:45:160
19709991613,2cyclictest4523-21H212:26:330
19709991613,2cyclictest2976-21expr00:20:140
19709991613,2cyclictest23258-21grep23:00:170
1970999160,1cyclictest30834-21cstates23:15:140
1970999160,1cyclictest30834-21cstates23:15:140
1970999160,1cyclictest0-21swapper/020:30:140
1970999160,1cyclictest0-21swapper/000:30:130
1970999160,15cyclictest5969-21expr00:25:130
1970999160,15cyclictest17189-21http_loadtime22:50:140
1970999160,15cyclictest13705-21cut00:40:010
1970999160,15cyclictest0-21swapper/023:20:160
1970999160,15cyclictest0-21swapper/019:40:160
1971099150,1cyclictest0-21swapper/121:40:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional