You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 05:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Fri Aug 28, 2026 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
250352199183,11sleep10-21swapper/119:09:201
248742199183,12sleep00-21swapper/019:07:140
248452194177,12sleep30-21swapper/319:06:523
247972156139,12sleep20-21swapper/219:06:162
50142440,0sleep20-21swapper/222:06:312
316312410,0sleep10-21swapper/121:15:131
2529799120,1cyclictest10990-21ssh22:10:122
262292100,0sleep00-21swapper/021:45:110
2529799100,7cyclictest29127-21hddtemp_smartct00:30:142
2529799100,7cyclictest28589-21ntp_states19:15:012
2529799100,7cyclictest1899-21cpuspeed00:00:142
2529799100,6cyclictest32538-21ntp_states20:25:172
2529799100,6cyclictest19201-21df20:00:132
2529799100,1cyclictest4228-21sh23:28:212
2529799100,1cyclictest16512-21rm21:23:462
2529799100,0cyclictest0-21swapper/222:33:272
252979991,7cyclictest21428-21ssh21:10:112
252979991,5cyclictest20847-21taskset21:09:152
252979991,5cyclictest10877-21taskset19:43:242
252979991,5cyclictest10877-21taskset19:43:232
252979990,7cyclictest7787-21python20:40:192
252979990,6cyclictest15932-21taskset19:54:532
252979990,1cyclictest8033-21sh22:25:002
252979990,1cyclictest598-21basename22:05:002
252979990,1cyclictest5603-21chrt22:23:362
252979990,1cyclictest28945-21ssh22:19:082
252979990,1cyclictest20927-21diskmemload22:46:032
252979990,1cyclictest20917-21hddtemp_smartct23:20:142
252979990,0cyclictest20927-21diskmemload23:05:402
253069985,0cyclictest40-21ksoftirqd/300:39:593
253069983,0cyclictest40-21ksoftirqd/321:15:143
253069982,2cyclictest40-21ksoftirqd/300:25:003
252979981,6cyclictest0-21swapper/200:20:112
252979980,7cyclictest6047-21sh19:35:012
252979980,7cyclictest16192-21apt-get19:55:102
252979980,6cyclictest8441-21taskset19:39:072
252979980,1cyclictest3575-21perl22:55:132
252979980,1cyclictest3575-21perl22:55:132
252979980,1cyclictest29425-21ssh21:46:032
252979980,1cyclictest28414-21munin-run21:30:002
252979980,1cyclictest2440-21memory19:25:152
252979980,1cyclictest24262-21ssh23:38:352
252979980,1cyclictest205-21systemd-journal21:20:012
252979980,1cyclictest19136-21ssh21:40:492
252979980,1cyclictest15942-21dump-pmu-power20:59:552
252979980,1cyclictest14896-21munin-run00:40:002
252979980,1cyclictest1104-21if_eth423:10:152
252979980,1cyclictest10975-21sh21:36:562
252979980,1cyclictest0-21swapper/220:05:112
252979980,0cyclictest6789-21ssh00:19:172
252979980,0cyclictest28189-21apt-get22:35:142
252979980,0cyclictest20927-21diskmemload22:40:582
252979980,0cyclictest20927-21diskmemload21:30:122
252979980,0cyclictest0-21swapper/223:15:122
253069976,0cyclictest40-21ksoftirqd/322:10:013
253069976,0cyclictest40-21ksoftirqd/320:00:013
253069973,2cyclictest40-21ksoftirqd/323:50:143
253069971,1cyclictest40-21ksoftirqd/322:00:003
252979970,6cyclictest31838-21diskstats19:20:122
252979970,6cyclictest26296-21apt20:15:102
252979970,6cyclictest18173-21ssh00:25:012
252979970,1cyclictest8684-21awk23:30:182
252979970,1cyclictest5215-21perl23:45:132
252979970,1cyclictest3783-21ssh21:50:132
252979970,1cyclictest30329-21awk20:20:202
252979970,1cyclictest27095-21python19:10:202
252979970,1cyclictest26083-21basename20:14:592
252979970,1cyclictest24145-21apt-get23:55:122
252979970,1cyclictest21256-21ssh00:10:122
252979970,1cyclictest14356-21ssh23:50:122
252979970,1cyclictest13683-21/usr/sbin/munin21:55:132
252979970,1cyclictest11786-21diskstats20:50:132
252979970,1cyclictest11393-21aten2_r5power_c00:05:122
252979970,1cyclictest11308-21aten2_r5power_p19:45:112
252979970,1cyclictest10009-21ntp_states20:45:182
252979970,1cyclictest0-21swapper/221:00:102
252979970,0cyclictest20927-21diskmemload23:00:132
252979970,0cyclictest0-21swapper/223:40:092
252979970,0cyclictest0-21swapper/222:50:112
252979970,0cyclictest0-21swapper/220:35:112
252899971,3cyclictest6074-21awk19:35:010
253069964,0cyclictest40-21ksoftirqd/323:25:003
253069964,0cyclictest40-21ksoftirqd/322:55:003
253069964,0cyclictest40-21ksoftirqd/320:10:003
253069963,1cyclictest40-21ksoftirqd/322:45:123
253069963,1cyclictest40-21ksoftirqd/322:40:113
253069962,2cyclictest40-21ksoftirqd/323:40:133
253069962,1cyclictest40-21ksoftirqd/322:10:133
253069960,6cyclictest0-21swapper/322:30:133
253069960,5cyclictest0-21swapper/321:20:093
253069960,5cyclictest0-21swapper/320:10:113
253069960,1cyclictest40-21ksoftirqd/322:55:193
253069960,1cyclictest40-21ksoftirqd/322:55:193
253069960,1cyclictest40-21ksoftirqd/321:40:153
253069960,1cyclictest40-21ksoftirqd/319:50:163
253069960,1cyclictest40-21ksoftirqd/300:30:113
253069960,1cyclictest28909-21apt-get21:30:133
253069960,0cyclictest0-21swapper/323:55:133
253069960,0cyclictest0-21swapper/322:15:173
252979960,5cyclictest1307-21apt20:30:122
252899962,4cyclictest0-21swapper/000:30:000
253069954,1cyclictest40-21ksoftirqd/323:05:013
253069954,1cyclictest40-21ksoftirqd/300:05:183
253069954,0cyclictest40-21ksoftirqd/323:30:193
253069954,0cyclictest40-21ksoftirqd/320:55:003
253069954,0cyclictest40-21ksoftirqd/319:50:013
253069954,0cyclictest40-21ksoftirqd/319:40:183
253069954,0cyclictest40-21ksoftirqd/319:40:183
253069954,0cyclictest40-21ksoftirqd/300:25:123
253069954,0cyclictest40-21ksoftirqd/300:00:133
253069953,0cyclictest40-21ksoftirqd/321:45:143
253069953,0cyclictest40-21ksoftirqd/321:05:153
253069953,0cyclictest40-21ksoftirqd/320:45:123
253069952,3cyclictest40-21ksoftirqd/300:15:103
253069952,2cyclictest40-21ksoftirqd/323:10:113
253069952,1cyclictest40-21ksoftirqd/322:25:163
253069951,1cyclictest81rcu_preempt23:40:003
253069951,0cyclictest81rcu_preempt21:50:183
253069951,0cyclictest81rcu_preempt21:40:013
253069950,5cyclictest0-21swapper/323:25:093
253069950,1cyclictest81rcu_preempt00:10:113
253069950,1cyclictest40-21ksoftirqd/322:00:143
253069950,1cyclictest40-21ksoftirqd/320:25:123
253069950,1cyclictest40-21ksoftirqd/320:00:133
253069950,0cyclictest81rcu_preempt19:20:113
253069950,0cyclictest6271-21apt-get20:40:123
253069950,0cyclictest5243-21fschecks_time23:45:133
253069950,0cyclictest18981-21apt-get21:25:113
252949952,1cyclictest0-21swapper/123:50:121
252949951,2cyclictest0-21swapper/122:40:121
252949951,2cyclictest0-21swapper/122:10:111
252949951,2cyclictest0-21swapper/100:05:111
252949950,5cyclictest0-21swapper/122:34:091
252949950,5cyclictest0-21swapper/121:20:241
252899953,2cyclictest3-21ksoftirqd/022:55:130
252899953,2cyclictest3-21ksoftirqd/022:55:130
252899950,5cyclictest0-21swapper/021:20:190
252899950,2cyclictest22546-21processes22:15:180
252899950,0cyclictest0-21swapper/020:35:120
253069944,0cyclictest40-21ksoftirqd/322:20:143
253069944,0cyclictest40-21ksoftirqd/320:20:123
253069943,0cyclictest40-21ksoftirqd/319:25:153
253069942,2cyclictest40-21ksoftirqd/320:30:173
253069942,1cyclictest40-21ksoftirqd/320:35:133
253069942,0cyclictest40-21ksoftirqd/319:15:123
253069941,2cyclictest40-21ksoftirqd/319:30:113
253069941,0cyclictest81rcu_preempt20:15:143
253069940,4cyclictest0-21swapper/322:35:143
253069940,3cyclictest23181-21ssh23:05:143
253069940,2cyclictest81rcu_preempt20:55:123
253069940,2cyclictest40-21ksoftirqd/323:15:123
253069940,1cyclictest81rcu_preempt19:10:113
253069940,1cyclictest21422-21apt-get21:10:123
253069940,0cyclictest81rcu_preempt19:35:203
252949944,0cyclictest0-21swapper/123:47:121
252949944,0cyclictest0-21swapper/122:38:481
252949944,0cyclictest0-21swapper/122:04:541
252949944,0cyclictest0-21swapper/121:33:381
252949944,0cyclictest0-21swapper/120:30:021
252949943,1cyclictest0-21swapper/100:16:531
252949941,2cyclictest0-21swapper/123:55:121
252949941,2cyclictest0-21swapper/121:45:131
252949941,2cyclictest0-21swapper/121:40:111
252949941,2cyclictest0-21swapper/121:05:141
252949941,2cyclictest0-21swapper/120:50:101
252949941,2cyclictest0-21swapper/120:05:121
252949941,2cyclictest0-21swapper/119:55:101
252949941,2cyclictest0-21swapper/119:15:121
252949941,2cyclictest0-21swapper/100:00:121
252949941,1cyclictest0-21swapper/122:50:121
252949940,4cyclictest0-21swapper/121:56:551
252949940,3cyclictest0-21swapper/119:30:101
252949940,2cyclictest0-21swapper/121:25:121
252949940,0cyclictest0-21swapper/123:31:191
252899944,0cyclictest3-21ksoftirqd/020:15:000
252899944,0cyclictest0-21swapper/021:30:570
252899943,1cyclictest57150irq/125-eth022:20:130
252899942,2cyclictest2167-21ssh21:15:570
252899942,1cyclictest18711-21ssh21:40:330
252899941,0cyclictest0-21swapper/020:25:190
252899940,4cyclictest8963-21sh21:35:390
252899940,4cyclictest29434-21ssh22:02:430
252899940,4cyclictest26912-21sh00:12:390
252899940,4cyclictest25384-21/usr/sbin/munin22:50:140
252899940,4cyclictest10047-21sh00:36:530
252899940,4cyclictest0-21swapper/023:50:270
252899940,4cyclictest0-21swapper/023:35:000
252899940,4cyclictest0-21swapper/022:49:300
252899940,4cyclictest0-21swapper/022:28:160
252899940,4cyclictest0-21swapper/021:57:350
252899940,4cyclictest0-21swapper/020:55:110
252899940,4cyclictest0-21swapper/020:50:270
252899940,4cyclictest0-21swapper/019:35:110
252899940,4cyclictest0-21swapper/000:30:100
252899940,3cyclictest5247-21perl23:45:140
252899940,3cyclictest3536-21sh20:34:590
252899940,3cyclictest31953-21users23:25:200
252899940,3cyclictest28075-21grep20:15:200
252899940,3cyclictest25494-21rm19:10:010
252899940,3cyclictest24583-21sed23:05:210
252899940,3cyclictest17646-21sh00:08:010
252899940,3cyclictest10538-21diskstats23:15:150
252899940,3cyclictest0-21swapper/023:35:110
252899940,3cyclictest0-21swapper/019:15:120
252899940,1cyclictest3-21ksoftirqd/019:55:120
253069930,0cyclictest81rcu_preempt21:00:103
252949933,0cyclictest0-21swapper/122:09:331
252949932,1cyclictest0-21swapper/121:00:111
252949931,2cyclictest0-21swapper/123:15:131
252949931,1cyclictest0-21swapper/123:40:091
252949931,1cyclictest0-21swapper/123:35:111
252949931,1cyclictest0-21swapper/123:20:121
252949931,1cyclictest0-21swapper/123:10:111
252949931,1cyclictest0-21swapper/122:55:121
252949931,1cyclictest0-21swapper/122:55:111
252949931,1cyclictest0-21swapper/122:45:131
252949931,1cyclictest0-21swapper/122:25:161
252949931,1cyclictest0-21swapper/122:15:121
252949931,1cyclictest0-21swapper/121:50:131
252949931,1cyclictest0-21swapper/121:35:121
252949931,1cyclictest0-21swapper/121:10:111
252949931,1cyclictest0-21swapper/120:35:121
252949931,1cyclictest0-21swapper/119:35:111
252949931,1cyclictest0-21swapper/119:25:101
252949931,1cyclictest0-21swapper/119:20:111
252949931,1cyclictest0-21swapper/100:30:101
252949931,1cyclictest0-21swapper/100:20:111
252949930,3cyclictest0-21swapper/119:51:011
252949930,2cyclictest29728-21chrt23:25:041
252949930,2cyclictest21049-21chrt00:10:051
252949930,2cyclictest0-21swapper/123:00:121
252949930,2cyclictest0-21swapper/120:45:111
252949930,2cyclictest0-21swapper/120:25:111
252949930,2cyclictest0-21swapper/120:20:111
252949930,2cyclictest0-21swapper/120:15:101
252949930,2cyclictest0-21swapper/120:10:111
252949930,2cyclictest0-21swapper/100:35:121
252949930,1cyclictest0-21swapper/119:45:111
252949930,0cyclictest0-21swapper/120:03:161
252899932,1cyclictest802-21snmpd00:20:020
252899931,1cyclictest0-21swapper/019:20:110
252899930,3cyclictest9575-21hddtemp_smartct20:45:150
252899930,3cyclictest5561-21sh22:40:100
252899930,3cyclictest4352-21diskstats21:50:130
252899930,3cyclictest32499-21ssh23:10:100
252899930,3cyclictest30748-21ssh00:15:010
252899930,3cyclictest26875-21chrt23:40:040
252899930,3cyclictest19608-21if_eth020:00:150
252899930,3cyclictest13722-21apt-get19:50:110
252899930,3cyclictest12661-21ssh23:00:090
252899930,3cyclictest0-21swapper/023:55:130
252899930,3cyclictest0-21swapper/022:35:130
252899930,3cyclictest0-21swapper/022:30:130
252899930,3cyclictest0-21swapper/022:05:140
252899930,3cyclictest0-21swapper/021:25:110
252899930,3cyclictest0-21swapper/021:10:120
252899930,3cyclictest0-21swapper/021:00:100
252899930,3cyclictest0-21swapper/020:40:120
252899930,3cyclictest0-21swapper/020:20:120
252899930,3cyclictest0-21swapper/020:05:050
252899930,3cyclictest0-21swapper/019:40:120
252899930,3cyclictest0-21swapper/019:40:110
252899930,3cyclictest0-21swapper/019:25:110
252899930,3cyclictest0-21swapper/000:00:060
252899930,2cyclictest0-21swapper/023:20:080
252899930,1cyclictest11247-21/usr/sbin/munin19:45:110
252899930,1cyclictest10758-21ssh22:10:020
252899930,0cyclictest0-21swapper/021:05:140
252949921,1cyclictest0-21swapper/119:10:021
252949920,2cyclictest0-21swapper/120:55:121
252949920,1cyclictest8371-21chrt20:43:261
252949920,1cyclictest0-21swapper/123:05:121
252949920,1cyclictest0-21swapper/122:20:131
252949920,1cyclictest0-21swapper/119:40:121
252949920,1cyclictest0-21swapper/119:40:121
252949920,1cyclictest0-21swapper/100:25:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional