You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 13:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Tue Dec 16, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5945992523,1cyclictest22961-21munin-plugin-st23:05:003
594199250,24cyclictest0-21swapper/019:14:280
5945992321,1cyclictest0-21swapper/320:10:013
594399230,2cyclictest20798-21munin-plugin-st19:40:002
594399230,22cyclictest6849-21awk21:25:002
594399230,22cyclictest15377-21apt-get20:39:292
5942992321,1cyclictest30373-21idleruntime-cro20:00:011
5942992321,1cyclictest0-21swapper/119:30:011
594299230,22cyclictest23181-21perf19:45:001
594299230,22cyclictest10545-21cron23:45:001
5941992320,2cyclictest3295-21awk22:25:010
594199230,22cyclictest15299-21munin-plugin-st22:50:000
5945992222,0cyclictest0-21swapper/321:14:283
5945992220,1cyclictest4428-21idleruntime-cro21:20:003
5945992219,2cyclictest30893-21grep22:15:003
594599220,21cyclictest17234-21sendmail-msp20:40:003
594599220,21cyclictest1-21systemd20:50:013
594599220,21cyclictest0-21swapper/323:59:303
594599220,21cyclictest0-21swapper/300:09:303
594599220,1cyclictest10585-21apt-get20:29:283
594599220,1cyclictest0-21swapper/320:15:013
5943992220,1cyclictest3371-21apt-get20:14:282
5943992220,1cyclictest0-21swapper/223:30:012
594399220,21cyclictest8923-21apt-get19:19:282
594399220,21cyclictest8192-21apt-get20:24:292
594399220,21cyclictest26482-21apt-get00:19:292
594399220,21cyclictest23947-21apt-get23:09:302
594399220,21cyclictest23709-21perf22:00:012
594399220,21cyclictest15351-21munin-run23:55:002
594399220,21cyclictest1-21systemd00:40:002
594399220,21cyclictest0-21swapper/219:44:282
5942992221,1cyclictest3891-21apt-get22:29:291
5942992219,2cyclictest15343-21wc23:55:001
594299221,1cyclictest30546-21sendmail-msp23:20:011
594299220,21cyclictest8694-21apt-get22:39:301
594299220,21cyclictest21287-21apt-get00:09:291
594299220,21cyclictest16503-21dump-pmu-power21:45:011
594299220,0cyclictest0-21swapper/120:24:291
5941992221,1cyclictest0-21swapper/021:04:310
5941992220,1cyclictest605-21avahi-daemon19:45:000
594199220,21cyclictest313-21systemd-journal20:10:010
594199220,21cyclictest14764-21awk20:35:000
594199220,21cyclictest0-21swapper/021:29:290
5945992118,2cyclictest313-21systemd-journal22:05:003
594599210,20cyclictest0-21swapper/321:44:293
594599210,20cyclictest0-21swapper/319:39:283
594599210,20cyclictest0-21swapper/300:34:303
5943992119,1cyclictest935-21grep23:25:012
5943992119,1cyclictest5769-21apt-get20:19:292
594399210,20cyclictest606-21dbus-daemon00:10:012
594399210,20cyclictest0-21swapper/223:19:302
594399210,20cyclictest0-21swapper/222:19:292
594399210,20cyclictest0-21swapper/220:50:022
594399210,1cyclictest13502-21apt-get22:49:302
5942992121,0cyclictest0-21swapper/123:20:021
5942992121,0cyclictest0-21swapper/121:34:301
5942992121,0cyclictest0-21swapper/120:04:291
5942992121,0cyclictest0-21swapper/119:49:291
5942992120,1cyclictest0-21swapper/121:04:311
5942992119,1cyclictest622-21gdbus23:00:001
5942992119,1cyclictest5480-21turbostat.cron00:40:001
594299210,21cyclictest0-21swapper/123:14:291
594299210,21cyclictest0-21swapper/100:15:021
594299210,20cyclictest0-21swapper/123:09:301
594299210,20cyclictest0-21swapper/120:39:281
594299210,20cyclictest0-21swapper/100:14:271
594299210,20cyclictest0-21swapper/100:04:301
594299210,1cyclictest5140-21cron20:15:011
594299210,0cyclictest0-21swapper/122:49:301
594299210,0cyclictest0-21swapper/121:49:291
594299210,0cyclictest0-21swapper/121:29:291
5941992121,0cyclictest32634-21apt-get21:14:290
5941992121,0cyclictest0-21swapper/021:24:300
5941992120,1cyclictest29093-21apt-get22:14:300
5941992120,0cyclictest18501-21apt-get00:04:310
5941992119,1cyclictest22030-21cat20:50:010
5941992119,1cyclictest12362-21sh20:30:000
5941992119,1cyclictest0-21swapper/020:45:010
5941992119,1cyclictest0-21swapper/019:25:020
594199210,21cyclictest0-21swapper/022:39:300
594199210,20cyclictest0-21swapper/021:09:290
594199210,0cyclictest0-21swapper/022:44:290
594199210,0cyclictest0-21swapper/020:19:290
5945992020,0cyclictest31552-21apt-get23:24:303
5945992020,0cyclictest13127-21apt-get19:25:023
5945992020,0cyclictest0-21swapper/322:49:303
5945992020,0cyclictest0-21swapper/322:09:293
5945992020,0cyclictest0-21swapper/319:54:303
5945992019,1cyclictest27844-21apt-get21:04:303
5945992018,1cyclictest0-21swapper/321:50:013
5943992020,0cyclictest0-21swapper/223:39:302
5943992020,0cyclictest0-21swapper/223:14:292
5943992020,0cyclictest0-21swapper/222:55:022
5943992020,0cyclictest0-21swapper/222:24:292
5943992020,0cyclictest0-21swapper/221:54:302
5943992020,0cyclictest0-21swapper/221:19:282
5943992020,0cyclictest0-21swapper/220:49:282
5943992019,1cyclictest7441-21apt-get21:29:282
5943992019,1cyclictest26181-21apt-get19:54:292
5943992019,1cyclictest16583-21apt-get19:34:312
5943992018,1cyclictest8757-21apt-get23:44:322
5943992018,1cyclictest8103-21perf22:35:012
5943992018,1cyclictest313-21systemd-journal21:05:012
5943992018,1cyclictest30371-21sh20:00:012
594399200,0cyclictest9839-21apt-get21:34:292
594399200,0cyclictest0-21swapper/222:04:282
594399200,0cyclictest0-21swapper/221:44:292
594399200,0cyclictest0-21swapper/221:09:302
594399200,0cyclictest0-21swapper/220:09:302
5942992020,0cyclictest23036-21apt-get20:54:301
5942992020,0cyclictest0-21swapper/122:54:281
5942992020,0cyclictest0-21swapper/122:44:291
5942992020,0cyclictest0-21swapper/122:09:281
5942992020,0cyclictest0-21swapper/121:59:291
5942992020,0cyclictest0-21swapper/121:14:291
5942992020,0cyclictest0-21swapper/121:09:291
5942992019,1cyclictest0-21swapper/123:39:301
5942992018,1cyclictest3066-21turbostat00:35:001
594299200,19cyclictest12387-21munin-run20:30:001
594299200,0cyclictest0-21swapper/119:24:281
5941992020,0cyclictest0-21swapper/023:59:300
5941992020,0cyclictest0-21swapper/021:54:300
5941992020,0cyclictest0-21swapper/021:39:300
5941992020,0cyclictest0-21swapper/020:24:290
5941992020,0cyclictest0-21swapper/020:14:290
5941992020,0cyclictest0-21swapper/019:49:290
5941992019,1cyclictest18900-21perf21:50:010
5941992019,1cyclictest0-21swapper/023:34:290
5941992018,1cyclictest637-21sh00:30:000
594199200,20cyclictest0-21swapper/019:34:310
594199200,0cyclictest0-21swapper/019:39:280
5945991919,0cyclictest1483-21apt-get22:24:293
5945991919,0cyclictest0-21swapper/323:54:303
5945991919,0cyclictest0-21swapper/323:49:303
5945991919,0cyclictest0-21swapper/322:59:313
5945991919,0cyclictest0-21swapper/321:29:293
5945991919,0cyclictest0-21swapper/320:24:293
5945991919,0cyclictest0-21swapper/319:34:303
5945991919,0cyclictest0-21swapper/319:14:283
5945991919,0cyclictest0-21swapper/300:14:273
5945991918,0cyclictest1525-21apt-get23:29:293
5945991918,0cyclictest0-21swapper/321:54:303
5945991918,0cyclictest0-21swapper/300:29:303
5945991917,1cyclictest6848-21perf21:25:003
5945991917,1cyclictest0-21swapper/322:39:303
594599190,18cyclictest12232-21apt-get21:39:303
5943991919,0cyclictest0-21swapper/221:39:302
5943991919,0cyclictest0-21swapper/220:29:282
5943991918,0cyclictest0-21swapper/222:54:282
5942991919,0cyclictest0-21swapper/123:34:291
5942991919,0cyclictest0-21swapper/123:04:291
5942991919,0cyclictest0-21swapper/122:34:281
5942991919,0cyclictest0-21swapper/122:14:301
5942991918,1cyclictest12948-21perf23:50:001
594299190,1cyclictest2781-21perf20:10:011
5941991919,0cyclictest14648-21apt-get21:44:290
5941991919,0cyclictest0-21swapper/000:24:300
5941991917,1cyclictest22022-21apt-get20:50:020
5941991917,1cyclictest10561-21munin-run23:45:000
5945991818,0cyclictest0-21swapper/323:34:303
5945991818,0cyclictest0-21swapper/323:19:303
5945991818,0cyclictest0-21swapper/321:34:293
5945991818,0cyclictest0-21swapper/320:54:303
5945991818,0cyclictest0-21swapper/320:44:293
5945991818,0cyclictest0-21swapper/320:34:293
5945991818,0cyclictest0-21swapper/319:49:283
5945991818,0cyclictest0-21swapper/300:19:293
5943991818,0cyclictest0-21swapper/200:29:302
5943991816,1cyclictest3935-21apt-get23:34:302
5943991815,2cyclictest10480-21idleruntime-cro22:40:012
5942991818,0cyclictest12981-21apt-get20:34:281
5942991818,0cyclictest0-21swapper/122:19:291
5942991818,0cyclictest0-21swapper/122:04:291
5942991818,0cyclictest0-21swapper/119:54:301
5942991818,0cyclictest0-21swapper/100:24:301
5941991818,0cyclictest26695-21apt-get22:09:280
5941991818,0cyclictest0-21swapper/023:19:300
5941991818,0cyclictest0-21swapper/021:34:290
5941991817,0cyclictest0-21swapper/000:39:300
5941991816,1cyclictest4430-21cron21:20:000
594599172,14cyclictest7508-21pmu-power23:39:363
5945991717,0cyclictest0-21swapper/323:09:303
5945991717,0cyclictest0-21swapper/300:04:303
5943991717,0cyclictest0-21swapper/223:59:302
5943991717,0cyclictest0-21swapper/220:34:292
5943991717,0cyclictest0-21swapper/220:04:292
594399171,15cyclictest0-21swapper/222:44:292
5942991717,0cyclictest0-21swapper/123:29:291
5942991717,0cyclictest0-21swapper/119:34:301
5942991716,1cyclictest2621-21apt-get21:19:281
5942991714,2cyclictest19632-21sh20:45:011
5941991717,0cyclictest0-21swapper/023:24:300
5941991717,0cyclictest0-21swapper/023:09:300
5941991717,0cyclictest0-21swapper/020:59:310
5941991717,0cyclictest0-21swapper/000:14:270
5941991717,0cyclictest0-21swapper/000:05:020
5941991716,1cyclictest30992-21apt-get20:04:290
5945991616,0cyclictest28574-21apt-get19:59:283
5945991616,0cyclictest0-21swapper/322:44:293
5945991616,0cyclictest0-21swapper/322:34:293
5945991615,1cyclictest23712-21awk22:00:013
5945991615,0cyclictest15896-21apt-get22:54:283
5945991614,1cyclictest7574-21apt20:20:013
594599160,15cyclictest606-21dbus-daemon22:30:013
5943991616,0cyclictest28903-21apt-get00:24:302
5943991616,0cyclictest23681-21apt-get00:14:272
5943991616,0cyclictest0-21swapper/223:04:292
5943991616,0cyclictest0-21swapper/222:14:292
5943991616,0cyclictest0-21swapper/200:04:302
5942991616,0cyclictest0-21swapper/120:49:291
5942991616,0cyclictest0-21swapper/119:19:281
5942991614,1cyclictest15940-21apt-get23:59:301
594299160,12cyclictest0-21swapper/121:24:301
5941991614,1cyclictest28305-21munin-run00:20:010
5941991614,1cyclictest13546-21apt-get23:54:300
5941991614,1cyclictest13127-21apt-get19:25:010
5941991613,2cyclictest22939-21cron23:05:000
594199160,6cyclictest0-21swapper/022:04:290
594199160,15cyclictest2691-21sed00:34:380
594199160,15cyclictest17259-21munin-run20:40:000
594199160,0cyclictest8923-21apt-get19:19:280
5945991515,0cyclictest0-21swapper/323:14:293
5945991515,0cyclictest0-21swapper/300:39:303
5945991515,0cyclictest0-21swapper/300:24:303
594599150,1cyclictest12381-21ntp_states19:24:333
594599150,14cyclictest32041-21wc21:10:013
594299155,10cyclictest30003-21munin-node20:17:561
5942991515,0cyclictest0-21swapper/122:24:281
5942991515,0cyclictest0-21swapper/120:59:311
594199156,9cyclictest563-17auditd23:36:440
5941991515,0cyclictest6298-21apt-get22:34:290
5941991515,0cyclictest0-21swapper/021:59:290
5945991414,0cyclictest0-21swapper/319:40:203
594599140,14cyclictest0-21swapper/319:16:183
594599140,0cyclictest0-21swapper/320:56:183
594599140,0cyclictest0-21swapper/320:00:013
5943991414,0cyclictest0-21swapper/222:25:392
5943991414,0cyclictest0-21swapper/221:10:102
594399140,14cyclictest0-21swapper/223:46:462
594399140,14cyclictest0-21swapper/222:08:222
594399140,14cyclictest0-21swapper/221:45:172
594399140,14cyclictest0-21swapper/220:55:082
594399140,14cyclictest0-21swapper/220:40:082
594399140,14cyclictest0-21swapper/219:45:122
594399140,14cyclictest0-21swapper/219:25:542
594399140,14cyclictest0-21swapper/200:30:592
594399140,0cyclictest0-21swapper/219:10:472
5942991414,0cyclictest0-21swapper/119:36:081
594299140,14cyclictest0-21swapper/119:10:561
594299140,14cyclictest0-21swapper/100:25:021
5941991414,0cyclictest0-21swapper/023:10:320
5941991414,0cyclictest0-21swapper/022:55:260
5941991414,0cyclictest0-21swapper/022:15:220
594199140,14cyclictest0-21swapper/023:45:200
594199140,14cyclictest0-21swapper/023:26:120
594199140,0cyclictest0-21swapper/022:50:550
594199140,0cyclictest0-21swapper/022:25:170
594199140,0cyclictest0-21swapper/019:55:040
594199140,0cyclictest0-21swapper/019:50:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional