You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 06:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot6.osadl.org (updated Tue Nov 25, 2025 00:44:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5499210627,26sleep10-21swapper/119:06:241
2397821020,7chrt23980-21basename21:30:181
581829020,25sleep00-21swapper/019:09:180
6015998132,43cyclictest12156-21latency_hist00:00:020
6015997734,38cyclictest4799-21python320:35:340
6015997734,37cyclictest24045-21grep23:00:390
6015997614,55cyclictest0-21swapper/000:30:140
6015997527,40cyclictest14219-21apt-get22:35:150
6015997455,13cyclictest0-21swapper/023:25:120
6015997433,35cyclictest8083-21cstates20:45:200
6018997337,26cyclictest26-21ksoftirqd/122:30:141
6015997338,31cyclictest8248-21cron23:50:010
6015997333,35cyclictest3775-21needreboot23:35:300
6015997331,23cyclictest8465-21basename19:15:170
6015997235,31cyclictest9344-21sshd22:20:210
6015997231,36cyclictest32453-21munin-run21:55:010
6015997229,37cyclictest17314-21if_err_enp2s021:10:260
6015997133,10cyclictest14339-21df_inode00:05:210
6015997132,33cyclictest6191-21/usr/sbin/munin20:40:280
6015997129,21cyclictest23605-21taskset21:29:130
6015997124,31cyclictest14-21ksoftirqd/000:26:500
6015997045,14cyclictest0-21swapper/019:30:150
6015997035,29cyclictest21537-21switchtime19:50:360
6015997030,35cyclictest461-21rs:main0
6015997030,34cyclictest5149-21cpu23:40:170
6015996937,25cyclictest11229-21latency_hist20:55:010
6015996935,28cyclictest25941-21df_inode21:35:220
6015996935,28cyclictest18242-21uname22:45:260
6015996933,30cyclictest19503-21/usr/sbin/munin22:50:350
6015996931,32cyclictest553-21runrttasks22:58:460
6015996930,33cyclictest27768-21aten2.4_r3power20:10:160
6015996930,33cyclictest1744-21diskstats23:30:230
6015996927,36cyclictest1670-21seq20:26:100
601899682,11cyclictest5663-21apt-config20:40:011
601599687,49cyclictest8427-21apt-get23:50:140
6015996837,23cyclictest555-21seq21:55:220
6015996835,28cyclictest254-21systemd-journal20:31:330
6015996835,24cyclictest4259-21/usr/sbin/munin22:05:260
6015996831,31cyclictest1956-21munin-node22:00:100
6015996830,34cyclictest31895-21ntp_states20:20:320
6015996829,32cyclictest12596-21ntp_states19:25:310
6015996741,21cyclictest20691-21apache200:00:040
6015996737,25cyclictest1-21systemd20:20:010
6015996735,25cyclictest17388-21ls19:40:200
6015996735,23cyclictest16690-21switchtime00:10:360
6015996734,26cyclictest24519-21uname21:30:280
6015996729,33cyclictest27680-21processes23:10:430
6015996727,34cyclictest21730-21seq21:22:440
6015996638,23cyclictest12310-21turbostat22:30:000
6015996638,18cyclictest25970-21basename20:05:160
6015996637,24cyclictest15344-21taskset19:35:150
6015996636,24cyclictest14960-21apt-key21:05:040
6015996636,22cyclictest11282-21/usr/sbin/munin20:55:130
6015996635,24cyclictest29166-21aten2.4_r3power21:45:160
6015996634,23cyclictest7230-21grep19:10:380
6015996634,23cyclictest25741-21timerwakeupswit23:05:340
6015996630,31cyclictest12838-21fw_packets22:30:220
6015996629,32cyclictest9-1kworker/0:1H00:35:310
6015996629,30cyclictest5529-21sh22:10:160
6015996625,33cyclictest22604-21awk19:55:180
87252650,6sleep1251rcuc/119:15:211
601899652,16cyclictest13317-21awk00:00:371
6015996548,10cyclictest14-21ksoftirqd/021:40:150
6015996539,18cyclictest20404-21grep00:20:390
6015996535,24cyclictest19059-21grep19:45:160
6015996535,22cyclictest7256-21aten2.4_r3power22:15:160
6015996535,21cyclictest19095-21turbostat.cron00:20:010
6015996534,24cyclictest30427-21aten2.4_r3power23:20:160
6015996534,24cyclictest30427-21aten2.4_r3power23:20:150
6015996533,25cyclictest29076-21kernelversion23:15:270
6015996530,29cyclictest14171-21sed21:00:360
6015996438,19cyclictest10960-21uname19:20:320
6015996426,20cyclictest18910-21cstates21:15:190
601899635,30cyclictest0-21swapper/123:56:411
6018996332,18cyclictest9546-21apt-get20:50:161
6018996328,28cyclictest0-21swapper/122:00:131
6018996321,37cyclictest26-21ksoftirqd/120:05:101
6015996337,21cyclictest17054-21unixbench-2d22:40:360
6018996131,14cyclictest3136-21apt-get23:35:151
6018996129,22cyclictest19506-21apt-get22:50:121
6018996126,26cyclictest0-21swapper/100:05:141
6018996035,10cyclictest3776-21cron20:35:001
6018996026,25cyclictest0-21swapper/121:25:131
6018996023,19cyclictest27574-21tail21:40:181
6018995929,18cyclictest13601-21apt-get19:30:151
6018995926,26cyclictest0-21swapper/122:40:131
6018995925,22cyclictest0-21swapper/100:35:131
6018995924,20cyclictest0-21swapper/122:10:141
6018995920,20cyclictest21322-21timerandwakeup21:20:361
6018995834,17cyclictest26-21ksoftirqd/123:25:321
6018995832,15cyclictest29151-21apt-get21:45:151
6018995831,14cyclictest18616-21apt-get21:15:131
6018995828,23cyclictest0-21swapper/120:15:161
6018995821,26cyclictest6105-21apt-get19:10:131
6018995733,15cyclictest17153-21apt-get19:40:141
6018995732,15cyclictest15792-21apt-get00:10:151
6018995732,14cyclictest1398-21apt-get23:30:151
6018995730,14cyclictest10737-21apt-get22:25:141
6018995728,24cyclictest0-21swapper/123:10:251
6018995727,23cyclictest0-21swapper/123:50:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional