You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-13 - 03:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot0.osadl.org (updated Mon May 12, 2025 12:45:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2620899257,15cyclictest0-21swapper/009:55:530
2621999245,11cyclictest0-21swapper/212:26:102
2621999230,5cyclictest0-21swapper/210:55:132
2621999230,5cyclictest0-21swapper/208:18:182
26219992214,3cyclictest0-21swapper/210:15:162
2621999210,5cyclictest0-21swapper/207:20:212
2621499203,2cyclictest6731-21idleruntime-cro12:00:001
2621999194,1cyclictest0-21swapper/210:25:012
2621999193,9cyclictest29802-21python311:45:002
2621999193,15cyclictest2879-21http_loadtime08:20:182
26219991917,1cyclictest0-21swapper/211:55:152
26214991919,0cyclictest0-21swapper/108:24:141
2621499190,16cyclictest14081-21nfsd409:35:211
2621499190,0cyclictest0-21swapper/112:36:531
26208991916,2cyclictest20466-21nfsd408:50:190
26219991816,1cyclictest0-21swapper/208:55:012
26219991814,3cyclictest4911-21grep07:25:202
26219991814,3cyclictest456-21perf11:50:002
2621999180,17cyclictest21320-21latency_hist11:30:012
2621999180,17cyclictest1979-21cat11:50:142
2621999180,16cyclictest16876-21nvmesmart_nvme012:15:212
2621999180,16cyclictest14461-21nfsd411:15:162
2621499182,1cyclictest0-21swapper/109:14:001
2621499182,10cyclictest23350-21munin-run12:30:011
26214991817,0cyclictest0-21swapper/109:00:231
26214991816,1cyclictest9436-21nfsd408:30:211
26214991814,1cyclictest0-21swapper/111:25:271
2621499181,2cyclictest15184-21vmstat11:15:181
2621499181,2cyclictest14862-21chrt12:12:411
2621499180,16cyclictest29397-21apt-config07:15:091
2620899182,1cyclictest0-21swapper/008:47:070
2620899182,15cyclictest0-21swapper/011:40:010
26208991816,1cyclictest23141-21kworker/0:109:39:000
26208991815,2cyclictest5379-21apache208:25:020
26208991814,3cyclictest0-21swapper/012:27:090
2620899181,16cyclictest24340-21cut12:30:150
2620899180,17cyclictest823-21systemd-network09:27:510
2620899180,17cyclictest0-21swapper/007:30:230
2620899180,17cyclictest0-21swapper/007:30:230
26219991715,1cyclictest0-21swapper/208:05:172
26219991715,1cyclictest0-21swapper/207:40:222
26219991714,2cyclictest893-21systemd-logind09:19:072
26219991714,2cyclictest4632-21/usr/sbin/munin09:20:142
26219991714,2cyclictest3787-21latency10:35:142
26219991714,2cyclictest3787-21latency10:35:142
26219991714,2cyclictest31010-21nfsd407:15:192
26219991714,2cyclictest26929-21munin-plugin-st11:40:002
26219991714,2cyclictest25629-21cut09:55:222
26219991714,2cyclictest24128-21apache_accesses12:30:102
26219991714,2cyclictest21299-21tr09:50:132
26219991714,2cyclictest17575-21expr07:50:162
26219991714,2cyclictest13842-21apache_processe08:40:142
26219991714,2cyclictest11827-21postgres12:05:322
26219991713,3cyclictest17952-21nvmesmart_nvme008:45:202
2621999170,2cyclictest893-21systemd-logind10:31:072
2621999170,2cyclictest25135-21apache_accesses09:00:132
2621999170,2cyclictest24486-21netstat08:00:182
2621999170,2cyclictest19816-21expr08:50:142
2621999170,16cyclictest454-21plymouthd07:50:012
2621999170,16cyclictest30061-21snapd10:48:472
2621999170,16cyclictest29947-21latency08:10:192
2621999170,16cyclictest29453-21dpkg10:15:002
2621999170,16cyclictest28192-21sshd10:09:392
2621999170,16cyclictest22847-21latency_hist08:00:012
2621999170,16cyclictest19917-21pzem_voltage09:45:212
2621999170,16cyclictest14089-21grep09:35:222
2621999170,16cyclictest13959-21nfsd412:10:162
2621999170,16cyclictest0-21swapper/210:45:002
2621999170,16cyclictest0-21swapper/209:05:202
2621999170,16cyclictest0-21swapper/207:10:202
26214991715,1cyclictest21-21ksoftirqd/111:45:011
26214991715,1cyclictest0-21swapper/108:15:211
26214991714,2cyclictest26853-21apt-config11:40:001
26214991714,2cyclictest18263-21chrt11:24:581
26214991714,2cyclictest15423-21sendmail_mailtr08:40:221
2621499171,1cyclictest0-21swapper/107:45:161
2621499170,2cyclictest4593-21H212:26:331
2621499170,2cyclictest3350-21master09:40:121
2621499170,2cyclictest31017-21lxd09:07:021
2621499170,2cyclictest29018-21grep08:10:151
2621499170,2cyclictest2805-21nfsd409:15:191
2621499170,2cyclictest24751-21sendmail-msp09:00:011
2621499170,2cyclictest24132-21apache_volume12:30:111
2621499170,16cyclictest5081-21pzem_voltage07:25:231
2621499170,16cyclictest4538-21H212:26:331
2621499170,16cyclictest30062-21snapd10:13:571
2621499170,16cyclictest30062-21snapd07:23:591
2621499170,16cyclictest27917-21ntp_states07:10:221
2621499170,16cyclictest19393-21seq07:52:261
2621499170,16cyclictest16931-21processes12:15:211
2621499170,16cyclictest1555-21lxd07:35:021
2621499170,16cyclictest1411-21lxd11:05:021
2621499170,16cyclictest1411-21lxd10:53:011
2621499170,16cyclictest1168-21sed11:50:011
2621499170,15cyclictest0-21swapper/107:59:271
26208991715,1cyclictest0-21swapper/008:18:260
26208991715,1cyclictest0-21swapper/007:55:180
26208991714,2cyclictest414-20systemd-journal11:19:560
26208991714,2cyclictest31960-21netstat09:10:190
26208991714,2cyclictest17865-21expr07:50:150
26208991714,2cyclictest16639-21fschecks_time11:20:150
26208991714,2cyclictest11168-21chrt07:38:470
26208991713,3cyclictest6727-21latency_hist12:00:010
2620899171,15cyclictest27817-21nfsd407:10:210
2620899171,15cyclictest268232chrt12:35:060
2620899171,15cyclictest0-21swapper/007:40:190
2620899170,2cyclictest3355-21qmgr07:25:470
2620899170,2cyclictest20535-21munin-run12:25:000
2620899170,2cyclictest11085-21nfsd412:05:220
2620899170,16cyclictest9618-21systemctl10:55:170
2620899170,16cyclictest6194-21cut10:45:010
2620899170,16cyclictest32033-21proc_pri11:45:210
2620899170,16cyclictest3134-21rtkit-daemon09:46:020
2620899170,16cyclictest29274-21apt-config10:15:010
2620899170,16cyclictest27417-21find11:40:120
2620899170,16cyclictest2390-21latency_hist07:25:000
2620899170,16cyclictest23604-21apt-config09:55:010
2620899170,16cyclictest15979-21ntp_states07:45:180
2620899170,16cyclictest1304-21lxd10:35:010
2620899170,16cyclictest1304-21lxd10:35:010
2621999162,14cyclictest0-21swapper/211:30:192
26219991614,1cyclictest16579-21kernelversion09:40:152
26219991614,1cyclictest0-21swapper/212:35:162
26219991614,1cyclictest0-21swapper/212:00:182
26219991614,1cyclictest0-21swapper/210:27:292
26219991614,1cyclictest0-21swapper/209:25:182
26219991614,1cyclictest0-21swapper/209:10:142
26219991614,1cyclictest0-21swapper/208:30:202
26219991613,2cyclictest13269-21cron08:39:002
2621999161,15cyclictest0-21swapper/207:35:192
2621999160,1cyclictest0-21swapper/212:20:182
2621999160,1cyclictest0-21swapper/211:20:202
2621999160,1cyclictest0-21swapper/207:30:232
2621999160,1cyclictest0-21swapper/207:30:222
2621999160,15cyclictest26967-21chrt10:00:352
2621999160,15cyclictest10367-21expr09:30:132
2621999160,15cyclictest0-21swapper/211:05:172
2621999160,15cyclictest0-21swapper/210:55:012
2621999160,15cyclictest0-21swapper/208:25:022
26214991614,1cyclictest27686-21sensors08:05:231
26214991614,1cyclictest26371-21runrttasks09:58:091
26214991614,1cyclictest19862-21fschecks_count08:50:151
26214991614,1cyclictest0-21swapper/110:34:501
26214991614,1cyclictest0-21swapper/109:30:121
26214991614,1cyclictest0-21swapper/108:45:161
26214991614,1cyclictest0-21swapper/108:00:151
26214991614,1cyclictest0-21swapper/107:30:131
26214991614,1cyclictest0-21swapper/107:30:131
26214991613,2cyclictest8285-21tr10:55:111
26214991613,2cyclictest7898-21http_loadtime12:00:161
26214991613,2cyclictest5441-21ls08:25:011
26214991613,2cyclictest4904-21expr09:20:161
26214991613,2cyclictest1845-21systemd-journal11:11:461
2621499160,1cyclictest6975-21cut10:50:001
2621499160,1cyclictest22312-21nfsd409:50:181
2621499160,1cyclictest0-21swapper/111:35:011
2621499160,1cyclictest0-21swapper/110:01:391
2621499160,1cyclictest0-21swapper/107:40:201
2621499160,15cyclictest11333-21ps12:05:241
2621499160,15cyclictest0-21swapper/111:40:161
2621499160,15cyclictest0-21swapper/110:35:151
2621499160,15cyclictest0-21swapper/110:35:141
2621499160,15cyclictest0-21swapper/110:29:051
2621499160,15cyclictest0-21swapper/109:45:151
2621499160,15cyclictest0-21swapper/108:35:151
26208991615,1cyclictest9-21ksoftirqd/008:33:570
26208991615,1cyclictest29341-21kworker/0:210:53:570
26208991614,1cyclictest22210-21appstreamcli08:55:020
26208991614,1cyclictest14143-21ntp_states12:10:170
26208991614,1cyclictest0-21swapper/012:00:080
26208991614,1cyclictest0-21swapper/011:05:010
26208991614,1cyclictest0-21swapper/010:27:090
26208991614,1cyclictest0-21swapper/010:05:550
26208991614,1cyclictest0-21swapper/009:30:150
26208991614,1cyclictest0-21swapper/008:40:230
26208991614,1cyclictest0-21swapper/008:27:290
26208991613,2cyclictest29218-21grep09:05:200
26208991613,2cyclictest1791-21expr09:15:160
26208991613,2cyclictest12066-21latency_hist11:10:010
2620899160,2cyclictest27160-21missed_timers08:05:210
2620899160,2cyclictest24092-21if_enp1s008:00:170
2620899160,2cyclictest13184-21date11:15:010
2620899160,15cyclictest876-21dpkg11:50:010
2620899160,15cyclictest4526-21H212:26:330
2620899160,15cyclictest3441-21gsd-color10:16:050
2620899160,15cyclictest31407-21latency_hist08:15:010
2620899160,15cyclictest30082-21expr07:15:160
2620899160,15cyclictest25821-21fschecks_time09:00:150
2620899160,15cyclictest20764-21cupsd11:30:150
2620899160,15cyclictest12397-21grep08:35:200
2620899160,15cyclictest0-21swapper/012:15:140
2620899160,15cyclictest0-21swapper/010:46:570
2620899160,15cyclictest0-21swapper/009:20:120
2621999150,1cyclictest0-21swapper/211:12:432
2621999150,14cyclictest0-21swapper/211:01:452
2621499150,1cyclictest0-21swapper/110:08:571
2621499150,15cyclictest0-21swapper/109:26:121
2621499150,14cyclictest0-21swapper/112:20:171
2621499150,14cyclictest0-21swapper/111:01:041
26208991513,1cyclictest0-21swapper/011:25:220
2620899150,1cyclictest0-21swapper/010:21:000
2620899150,1cyclictest0-21swapper/010:03:570
26214991412,1cyclictest0-21swapper/110:20:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional