You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-25 - 07:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7.osadl.org (updated Sat Jan 25, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1365921240,4chrt1-21systemd19:30:201
5172991014,20cyclictest18324-21fschecks_time21:16:110
5172999849,42cyclictest31956-21idleruntime-cro20:25:180
5172999426,59cyclictest0-21swapper/021:00:220
5172999426,59cyclictest0-21swapper/021:00:220
517299934,15cyclictest17308-21tr22:15:190
5172999233,51cyclictest0-21swapper/021:10:200
517299913,81cyclictest2115-21unixbench_singl21:45:500
517299913,20cyclictest17331-21tune2fs00:15:400
5172999123,10cyclictest21755-21rm00:25:310
5172999123,10cyclictest21755-21rm00:25:310
5195999015,45cyclictest0-21swapper/223:00:322
5195999015,45cyclictest0-21swapper/223:00:322
517299904,17cyclictest9137-21idleruntime-cro23:00:190
517299903,80cyclictest5442-21cut20:45:350
517299903,20cyclictest1642-21cut20:30:430
517299903,20cyclictest1642-21cut20:30:430
517299903,15cyclictest4622-21/usr/sbin/munin23:50:530
5195998960,18cyclictest14403-21idleruntime-cro21:10:192
517299894,21cyclictest17264-21latency_hist21:15:220
517299894,11cyclictest0-21swapper/022:21:430
517299893,20cyclictest27943-21taskset23:35:180
517299893,12cyclictest12316-21awk23:05:460
517299885,32cyclictest7527-21/usr/sbin/munin21:55:490
517299884,24cyclictest12096-21if_eth022:05:370
517299883,21cyclictest30341-21idleruntime-cro20:20:190
517299883,21cyclictest30341-21idleruntime-cro20:20:190
517299883,18cyclictest7133-21fschecks_time20:50:430
517299883,17cyclictest17548-21ssh23:15:330
517299883,17cyclictest17548-21ssh23:15:330
517299875,15cyclictest27057-21cat20:10:210
517299874,15cyclictest1578-21timerandwakeup22:45:480
517299874,15cyclictest1578-21timerandwakeup22:45:480
517299873,76cyclictest11505-21diskmemload00:15:200
517299873,76cyclictest11505-21diskmemload00:15:200
5172998733,46cyclictest8150irq/69-2188000.21:38:340
517299873,17cyclictest6277-21grep19:05:510
517299872,30cyclictest22565-21latency_hist21:25:220
517299872,19cyclictest16475-21unixbench_singl19:35:580
5172998721,8cyclictest0-21swapper/020:00:510
5172998713,17cyclictest17174-21cron23:15:190
5172998712,13cyclictest0-21swapper/021:50:400
517299864,16cyclictest27965-21idleruntime-cro22:35:180
517299864,15cyclictest14076-21latency_hist00:10:220
5172998638,41cyclictest24487-21ssh21:28:080
5172998638,41cyclictest24487-21ssh21:28:080
517299863,26cyclictest11465-21modprobe22:05:190
517299863,22cyclictest10912-21taskset21:00:520
517299863,19cyclictest25129-21latency_hist22:30:210
517299862,33cyclictest22241-21/usr/sbin/munin19:55:490
5172998617,10cyclictest0-21swapper/000:30:530
517299855,16cyclictest28136-21modprobe21:35:180
517299855,16cyclictest28136-21modprobe21:35:180
517299853,31cyclictest30992-21ssh23:40:210
517299853,22cyclictest1613-21grep23:45:500
517299853,20cyclictest15251-21sh19:35:190
517299853,17cyclictest11556-21fschecks_count00:05:350
5172998514,11cyclictest0-21swapper/000:05:210
5172998513,12cyclictest0-21swapper/019:50:210
5172998510,13cyclictest141rcu_preempt23:45:210
5172998510,13cyclictest141rcu_preempt23:45:210
517299845,19cyclictest17619-21sort22:15:330
517299844,20cyclictest22205-21latency_hist23:25:200
517299844,19cyclictest5088-21latency_hist20:45:210
517299844,16cyclictest20921-21fschecks_time19:51:050
517299843,20cyclictest10025-21grep19:15:550
517299837,69cyclictest0-21swapper/022:37:410
517299837,69cyclictest0-21swapper/022:37:410
517299837,16cyclictest27313-21/usr/sbin/munin20:11:140
517299834,23cyclictest0-21swapper/022:50:360
517299833,17cyclictest367-21find20:25:540
5203998265,11cyclictest7553-21unixbench_singl22:55:513
518799822,52cyclictest394-21runrttasks23:48:161
517299826,10cyclictest0-21swapper/021:40:220
517299824,16cyclictest11442-21ssh23:05:210
517299824,16cyclictest11442-21ssh23:05:210
517299823,20cyclictest4403-21latency_hist20:40:200
517299823,19cyclictest527-21latency_hist22:45:210
517299823,19cyclictest24991-21idleruntime-cro23:30:180
517299823,19cyclictest24991-21idleruntime-cro23:30:180
517299822,18cyclictest11329-21mailstats19:20:500
517299814,19cyclictest21349-21cron00:25:180
517299813,20cyclictest6551-21grep23:55:370
517299813,20cyclictest17383-21fschecks_time19:40:400
517299813,20cyclictest17383-21fschecks_time19:40:400
517299813,17cyclictest6988-21fschecks_count19:10:240
517299804,18cyclictest5163-21cyclictest19:05:230
517299803,17cyclictest13208-21grep19:25:580
5195997956,15cyclictest15611-21unixbench_singl23:10:552
5187997841,29cyclictest0-21swapper/121:30:521
5187997841,29cyclictest0-21swapper/121:30:521
48592776,48sleep20-21swapper/219:03:092
518799762,47cyclictest11965-21runrttasks19:24:521
519599758,42cyclictest28722-21apt-get21:35:322
5187997516,27cyclictest141rcu_preempt22:35:181
519599747,48cyclictest12156-21kworker/u8:019:50:452
5187997436,30cyclictest0-21swapper/119:35:581
519599733,56cyclictest6202-21sendmail-msp23:55:192
5187997155,10cyclictest17901-21fschecks_time22:15:441
518799713,60cyclictest15187-21ntpq22:10:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional