You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 00:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot8.osadl.org (updated Thu Nov 27, 2025 12:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2168997760,7rtkit-daemon2167-21rtkit-daemon07:06:440
29087995274,447cyclictest0-21swapper/007:46:510
2908999475434,24cyclictest0-21swapper/107:46:511
2908799465407,49cyclictest0-21swapper/007:10:070
2908999449389,44cyclictest0-21swapper/107:10:071
287102980,4sleep028709-21grep08:35:230
2876829674,16sleep10-21swapper/107:07:091
174972830,3chrt17498-21aten_r1power_en10:20:121
2908799783,8cyclictest47-21kswapd009:15:010
2908799783,10cyclictest17179-21munin-node12:10:240
216899770,4rtkit-daemon2167-21rtkit-daemon11:23:561
29087997623,47cyclictest78950irq/46-eth0-tx-11:20:170
29087997514,41cyclictest18786-21ssh10:20:440
182232750,4sleep018224-21grep09:25:270
29087997424,44cyclictest0-21swapper/010:00:180
2908799742,7cyclictest16804-21ssh09:24:430
2908799742,7cyclictest16804-21ssh09:24:430
2908799735,63cyclictest0-21swapper/010:12:590
2908799734,10cyclictest11177-21ssh09:15:130
2908799733,64cyclictest5465-21sh10:00:000
2908799733,10cyclictest7817-21diskmemload11:00:220
29087997325,31cyclictest78950irq/46-eth0-tx-11:12:070
2908799732,8cyclictest26465-21ssh10:35:150
315122720,3sleep131511-21if_eth007:15:171
2908799729,57cyclictest0-21swapper/011:30:340
2908799726,60cyclictest0-21swapper/011:28:560
2908799724,62cyclictest26529-21df_abs09:40:150
2908799723,8cyclictest20406-21munin-node08:15:210
2908799723,8cyclictest14949-21ssh10:15:180
29087997225,32cyclictest78950irq/46-eth0-tx-12:35:190
29087997224,43cyclictest78950irq/46-eth0-tx-11:55:180
29087997223,43cyclictest78950irq/46-eth0-tx-11:35:240
2908799722,7cyclictest32006-21ssh10:45:010
29087997213,52cyclictest0-21swapper/009:50:140
2908799718,58cyclictest17429-21munin-node11:15:170
2908799715,45cyclictest26086-21df_inode12:25:140
2908799714,46cyclictest23544-21df10:30:130
29087997119,36cyclictest78950irq/46-eth0-tx-12:30:230
29087997112,51cyclictest0-21swapper/012:15:130
2908799706,44cyclictest9232-21memory10:05:210
2908799704,54cyclictest5776-21ssh11:50:130
2908799703,46cyclictest12352-21ntp_kernel_err11:05:210
2908799702,9cyclictest31868-21latency_hist09:50:010
2908799702,7cyclictest16967-21sh12:10:000
29087997013,41cyclictest12023-21memory12:00:170
2908799696,57cyclictest0-21swapper/008:45:260
2908799694,46cyclictest3158-21iostat11:45:180
2908799693,9cyclictest31342-21df_abs07:15:150
2908799687,55cyclictest0-21swapper/007:33:340
2908799683,48cyclictest1590-21ssh10:47:160
2908799682,7cyclictest25567-21ssh12:25:000
2908799675,52cyclictest29425-21munin-node08:40:210
2908799673,7cyclictest5439-21crond10:55:010
29087996711,48cyclictest20385-21aten_r1power_en10:25:100
2908799664,55cyclictest6264-21munin-node10:55:190
2908799664,42cyclictest32518-21irqstats11:40:180
29087996621,37cyclictest20801-21ssh09:30:220
2908799662,9cyclictest26157-21gltestperf08:30:150
2908799662,6cyclictest1945-21Xorg07:40:590
29087996613,48cyclictest0-21swapper/009:35:390
2908799657,38cyclictest0-21swapper/007:20:210
2908799656,40cyclictest0-21swapper/007:25:140
2908799653,8cyclictest6009-21idleruntime-cro09:05:010
2908799653,7cyclictest25096-21unixbench_multi08:25:240
2908799653,20cyclictest3337-21proc_pri08:55:220
2908799652,7cyclictest13017-21crond07:55:000
2908799643,8cyclictest5956-21munin-node07:35:210
134202640,3sleep113419-21ssh10:12:201
2908799634,9cyclictest16794-21munin-node08:05:190
2908799634,9cyclictest16794-21munin-node08:05:190
2908799634,51cyclictest575-21munin-node08:50:230
29089996227,29cyclictest4295-21sh10:51:301
2908799626,50cyclictest0-21swapper/009:05:180
2908799626,50cyclictest0-21swapper/008:00:130
2908799624,10cyclictest1427-21runrttasks08:14:340
2908799622,8cyclictest14852-21taskset08:00:000
2908999615,43cyclictest0-21swapper/108:15:591
2908999613,51cyclictest7817-21diskmemload12:20:141
2908799613,9cyclictest23358-21unixbench_singl08:20:240
216899610,5rtkit-daemon2167-21rtkit-daemon09:53:341
216899610,5rtkit-daemon2167-21rtkit-daemon08:55:131
216899610,3rtkit-daemon16932-21ssh11:14:061
2908999602,49cyclictest17904-21munin-node11:15:171
29089996014,40cyclictest20985-21memory10:25:181
216899600,4rtkit-daemon2167-21rtkit-daemon09:33:491
216899600,4rtkit-daemon2167-21rtkit-daemon09:12:481
2908999593,50cyclictest32762-21munin-node10:45:221
2908999592,51cyclictest32423-21swap12:35:241
216899590,5rtkit-daemon2167-21rtkit-daemon10:39:201
216899590,4rtkit-daemon2167-21rtkit-daemon11:28:361
216899590,4rtkit-daemon2167-21rtkit-daemon11:01:561
2908999583,49cyclictest17757-21memory09:25:201
2908999582,50cyclictest5834-21cpu10:55:131
2908999582,50cyclictest3323-21latency09:55:181
2908999582,50cyclictest14193-21munin-node09:20:141
2908999582,50cyclictest14193-21munin-node09:20:141
2908999582,49cyclictest24546-21yum10:30:281
2908999582,49cyclictest2105-21awk07:24:251
2908999582,49cyclictest16515-21ssh12:08:341
2908999574,46cyclictest28473-21munin-node08:35:211
2908999572,49cyclictest7706-21ssh10:02:531
2908999572,49cyclictest29680-21sh10:40:171
2908999572,49cyclictest16333-21runrttasks10:17:211
2908999572,48cyclictest7947-21sh11:54:041
2908999572,48cyclictest29049-21munin-node11:35:171
2908999572,48cyclictest28685-21aten2.4-expect12:30:121
2908999572,48cyclictest2768-21munin-node07:25:141
2908999572,48cyclictest17571-21munin-node08:05:221
2908999572,48cyclictest17571-21munin-node08:05:221
2908999572,45cyclictest26528-21ssh09:40:151
2908999572,38cyclictest15531-21latency08:00:161
216899570,4rtkit-daemon2167-21rtkit-daemon12:10:321
2908999565,34cyclictest0-21swapper/109:04:591
2908999563,46cyclictest12303-21munin-node12:00:221
2908999562,49cyclictest22208-21munin-node08:20:101
2908999562,48cyclictest7817-21diskmemload09:19:491
2908999562,48cyclictest31187-21latency_hist08:45:021
2908999562,47cyclictest13-21rcu_preempt12:25:271
2908999562,47cyclictest12102-21munin-node07:50:241
216899560,4rtkit-daemon2167-21rtkit-daemon11:43:221
2908999555,44cyclictest0-21swapper/111:34:331
2908999552,47cyclictest8855-21munin-node10:05:161
2908999552,47cyclictest26996-21munin-node08:30:271
2908999552,46cyclictest6474-21munin-node07:35:161
216899550,4rtkit-daemon2167-21rtkit-daemon11:48:171
2908999543,44cyclictest1199-21munin-node08:50:191
2908999542,46cyclictest29903-21munin-node09:45:211
2908999542,45cyclictest24452-21munin-node08:25:151
216899540,4rtkit-daemon2167-21rtkit-daemon09:36:541
2908999532,45cyclictest8606-21aten_r1power_vo11:55:131
2908999532,45cyclictest8277-21munin-node07:40:191
2908999532,45cyclictest31542-21munin-node08:45:181
2908999532,45cyclictest13676-21sh11:08:031
2908999532,44cyclictest4187-21munin-node07:30:121
2908999532,44cyclictest18910-21munin-node08:10:141
2908999532,44cyclictest13597-21munin-node07:55:151
2908999523,43cyclictest20976-21ssh12:15:251
2908999522,43cyclictest6231-21munin-node09:05:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional