You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 09:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Dec 31, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
193199261,1cyclictest0-21swapper/319:30:013
1929992422,1cyclictest0-21swapper/223:10:462
1929992421,2cyclictest11487-21cron19:30:012
1925992422,1cyclictest32488-21munin-run22:25:000
193199230,22cyclictest9121-21perf19:25:013
193199230,22cyclictest32479-21idleruntime-cro22:25:003
193199230,22cyclictest21083-21cron19:50:003
193199230,0cyclictest0-21swapper/300:15:503
192999230,22cyclictest6729-21munin-run19:20:012
192999230,22cyclictest21094-21ls19:50:002
192999230,22cyclictest12085-21munin-run22:50:012
192999230,22cyclictest0-21swapper/223:15:452
192999230,21cyclictest313-21systemd-journal21:45:012
1928992321,1cyclictest4143-21munin-run23:40:011
1928992321,1cyclictest2219-21apt-get19:10:451
1928992320,2cyclictest551-21dump-pmu-power00:40:001
192899230,2cyclictest32424-21turbostat.cron21:20:011
192899230,1cyclictest313-21systemd-journal22:50:011
1925992320,2cyclictest21422-21apt19:50:450
192599230,22cyclictest10751-21apt20:35:010
192599230,1cyclictest11073-21apt-get20:35:470
1931992220,1cyclictest606-21dbus-daemon00:00:003
1931992220,1cyclictest26891-21sendmail23:20:003
1931992220,1cyclictest0-21swapper/322:50:013
193199220,21cyclictest32040-21apt-get23:30:473
193199220,21cyclictest313-21systemd-journal19:55:003
193199220,21cyclictest17591-21apt-get23:00:453
193199220,21cyclictest0-21swapper/321:30:023
193199220,21cyclictest0-21swapper/319:10:453
193199220,1cyclictest13490-21apt-get20:40:473
1929992220,1cyclictest0-21swapper/221:30:022
192999220,21cyclictest13699-21systemctl00:00:002
192999220,21cyclictest0-21swapper/223:25:462
192999220,21cyclictest0-21swapper/200:35:472
1928992222,0cyclictest0-21swapper/122:15:451
1928992221,0cyclictest9242-21apt-get23:50:471
1928992221,0cyclictest21423-21apt-get19:50:441
1928992220,1cyclictest30005-21basename21:15:011
1928992220,1cyclictest28542-21apt-get00:30:491
192899220,21cyclictest17960-21turbostat20:50:001
192899220,21cyclictest10744-21apt-get21:40:471
192899220,21cyclictest0-21swapper/100:00:481
1925992220,1cyclictest28234-21munin-run00:30:010
1925992220,1cyclictest19985-21apt-get23:05:450
1925992219,2cyclictest622-21gdbus22:30:000
192599220,22cyclictest5218-21perf21:30:000
192599220,21cyclictest5980-21munin-plugin-st20:25:010
192599220,21cyclictest13136-21apt-get21:45:460
192599220,21cyclictest0-21swapper/021:35:450
192599220,21cyclictest0-21swapper/020:00:460
192599220,1cyclictest2781-21apt-get22:30:460
192599220,1cyclictest14221-21apt-get19:35:460
1931992121,0cyclictest0-21swapper/323:20:463
1931992120,1cyclictest4876-21munin-run22:35:013
1931992120,0cyclictest0-21swapper/320:10:013
1931992120,0cyclictest0-21swapper/300:35:473
1931992119,2cyclictest0-21swapper/320:30:483
193199210,21cyclictest0-21swapper/323:05:453
193199210,20cyclictest26292-21apt-get20:00:463
193199210,20cyclictest15927-21apt-get21:50:463
193199210,20cyclictest14144-21apt-get00:00:483
193199210,20cyclictest0-21swapper/321:15:473
193199210,20cyclictest0-21swapper/321:05:453
193199210,20cyclictest0-21swapper/320:20:453
193199210,1cyclictest0-21swapper/321:55:483
1929992121,0cyclictest0-21swapper/220:30:482
1929992120,1cyclictest6847-21apt-get23:45:482
1929992120,1cyclictest6530-21dump-pmu-power23:45:012
1929992119,1cyclictest0-21swapper/222:15:002
1929992119,1cyclictest0-21swapper/219:15:002
192999210,21cyclictest0-21swapper/220:15:472
192999210,20cyclictest0-21swapper/223:50:472
192999210,20cyclictest0-21swapper/221:50:462
192999210,0cyclictest0-21swapper/222:15:452
192999210,0cyclictest0-21swapper/220:50:462
192899218,0cyclictest0-21swapper/122:05:451
1928992121,0cyclictest0-21swapper/120:10:021
1928992120,1cyclictest21328-21apt-get00:15:501
1928992119,1cyclictest7261-21cron22:40:011
1928992119,1cyclictest23753-21apt-get00:20:471
1928992119,1cyclictest0-21swapper/121:40:001
192899210,21cyclictest0-21swapper/121:50:011
192899210,20cyclictest0-21swapper/123:45:481
192899210,20cyclictest0-21swapper/121:20:031
192899210,20cyclictest0-21swapper/121:00:451
192899210,1cyclictest0-21swapper/120:25:461
192899210,0cyclictest27248-21apt-get23:20:471
192899210,0cyclictest0-21swapper/120:30:481
192899210,0cyclictest0-21swapper/120:00:461
1925992121,0cyclictest0-21swapper/023:20:470
1925992121,0cyclictest0-21swapper/021:40:470
1925992120,1cyclictest7597-21apt-get22:40:460
1925992120,1cyclictest4612-21apt-get19:15:460
1925992120,1cyclictest25538-21apt-get21:05:450
1925992119,1cyclictest22781-21sendmail-msp21:00:010
1925992119,1cyclictest18729-21perf19:45:010
192599210,0cyclictest0-21swapper/023:45:480
192599210,0cyclictest0-21swapper/022:00:470
192599210,0cyclictest0-21swapper/019:45:450
1931992020,0cyclictest1446-21apt-get20:15:473
1931992020,0cyclictest0-21swapper/323:25:463
1931992020,0cyclictest0-21swapper/323:10:463
1931992020,0cyclictest0-21swapper/322:15:453
1931992020,0cyclictest0-21swapper/320:50:463
1931992020,0cyclictest0-21swapper/320:10:023
1931992019,1cyclictest0-21swapper/322:30:003
1931992018,1cyclictest6527-21apt23:45:013
193199200,20cyclictest0-21swapper/319:30:463
193199200,0cyclictest20673-21apt-get20:55:463
193199200,0cyclictest0-21swapper/321:20:463
1929992020,0cyclictest0-21swapper/222:35:462
1929992020,0cyclictest0-21swapper/220:20:452
1929992020,0cyclictest0-21swapper/220:10:022
1929992020,0cyclictest0-21swapper/219:20:452
1929992020,0cyclictest0-21swapper/200:25:452
1929992020,0cyclictest0-21swapper/200:10:472
1929992019,0cyclictest0-21swapper/221:15:472
1929992018,1cyclictest313-21systemd-journal21:50:012
1929992018,1cyclictest22081-21munin-run23:10:002
1929992018,1cyclictest0-21swapper/223:40:012
192999200,20cyclictest0-21swapper/223:30:472
192999200,20cyclictest0-21swapper/222:05:452
192999200,20cyclictest0-21swapper/221:05:452
192999200,0cyclictest30771-21apt-get20:10:012
192999200,0cyclictest0-21swapper/200:15:502
1928992020,0cyclictest0-21swapper/120:20:451
1928992020,0cyclictest0-21swapper/119:35:461
1928992020,0cyclictest0-21swapper/119:25:011
192899200,19cyclictest0-21swapper/120:15:471
1925992020,0cyclictest5207-21apt-get21:30:020
1925992020,0cyclictest32413-21apt-get21:20:030
1925992020,0cyclictest30934-21apt-get00:35:470
1925992020,0cyclictest16535-21apt-get00:05:470
1925992020,0cyclictest0-21swapper/021:10:460
1925992020,0cyclictest0-21swapper/019:10:450
1925992019,1cyclictest8357-21perf20:30:010
1925992019,1cyclictest29640-21apt-get23:25:460
1931991919,0cyclictest0-21swapper/323:50:473
1931991919,0cyclictest0-21swapper/322:10:463
1931991919,0cyclictest0-21swapper/319:55:453
193199190,16cyclictest8909-21idleruntime-cro23:50:013
1929991919,0cyclictest0-21swapper/223:20:462
1929991919,0cyclictest0-21swapper/222:30:462
1929991919,0cyclictest0-21swapper/222:20:442
1929991919,0cyclictest0-21swapper/200:20:462
1928991919,0cyclictest0-21swapper/123:15:451
1928991919,0cyclictest0-21swapper/123:00:031
1928991919,0cyclictest0-21swapper/121:57:011
1928991919,0cyclictest0-21swapper/121:50:021
1928991919,0cyclictest0-21swapper/120:40:471
1925991919,0cyclictest0-21swapper/023:00:460
1925991919,0cyclictest0-21swapper/021:00:450
1925991919,0cyclictest0-21swapper/000:20:460
1925991918,1cyclictest7032-21apt-get19:20:450
1925991918,0cyclictest0-21swapper/022:05:450
1925991917,1cyclictest13742-40mandb00:00:000
192599190,5cyclictest11329-21awk23:55:000
1931991818,0cyclictest5178-21apt-get22:35:463
1931991818,0cyclictest0-21swapper/322:05:453
1931991818,0cyclictest0-21swapper/319:15:463
1931991818,0cyclictest0-21swapper/300:20:473
1931991818,0cyclictest0-21swapper/300:10:473
1931991817,0cyclictest0-21swapper/300:25:453
1931991816,1cyclictest30629-21perf00:35:013
1929991818,0cyclictest0-21swapper/220:40:472
1929991818,0cyclictest0-21swapper/219:55:452
1929991818,0cyclictest0-21swapper/219:50:452
1929991818,0cyclictest0-21swapper/200:30:492
1929991817,0cyclictest23089-21apt-get21:00:452
192999180,1cyclictest0-21swapper/200:05:482
1928991818,0cyclictest0-21swapper/123:30:471
1928991818,0cyclictest0-21swapper/123:25:461
1928991818,0cyclictest0-21swapper/122:10:461
1928991818,0cyclictest0-21swapper/100:05:481
1928991816,1cyclictest19030-21apt-get19:45:451
192899180,1cyclictest0-21swapper/121:25:451
1925991818,0cyclictest0-21swapper/023:35:460
1925991818,0cyclictest0-21swapper/022:10:460
1925991818,0cyclictest0-21swapper/021:55:490
1925991818,0cyclictest0-21swapper/020:50:450
1931991716,1cyclictest4126-21latency_hist23:40:013
1931991715,1cyclictest10744-21apt-get21:40:463
193199170,16cyclictest0-21swapper/300:05:483
1929991717,0cyclictest0-21swapper/222:25:462
1929991717,0cyclictest0-21swapper/219:40:472
1929991716,0cyclictest8325-21apt-get21:35:452
1928991717,0cyclictest0-21swapper/122:20:441
1928991717,0cyclictest0-21swapper/119:15:451
1928991716,0cyclictest20740-21apt-get22:00:471
1928991716,0cyclictest11824-21apt-get19:30:461
1925991717,0cyclictest0-21swapper/021:15:470
1925991717,0cyclictest0-21swapper/020:45:450
1925991715,2cyclictest11519-21basename19:30:010
1925991715,1cyclictest0-21swapper/022:55:010
192599170,17cyclictest0-21swapper/022:35:460
1931991615,1cyclictest6280-21apt-get20:25:463
1931991615,1cyclictest16638-21apt-get19:40:473
1931991614,1cyclictest15190-21cron21:50:013
1929991616,0cyclictest0-21swapper/223:00:452
1929991616,0cyclictest0-21swapper/221:55:492
1929991616,0cyclictest0-21swapper/220:55:462
1929991616,0cyclictest0-21swapper/219:35:452
1929991616,0cyclictest0-21swapper/200:00:482
1929991615,0cyclictest0-21swapper/220:35:462
1929991614,1cyclictest28380-21munin-run20:05:002
1929991614,1cyclictest0-21swapper/221:10:522
192999160,15cyclictest2820-21perf21:25:002
1928991616,0cyclictest0-21swapper/119:55:451
1928991614,1cyclictest5839-21apt-get21:30:021
192899160,1cyclictest22788-21awk21:00:011
192899160,15cyclictest14462-21sh22:55:011
1925991615,1cyclictest0-21swapper/022:45:460
192599160,15cyclictest30441-21chrt00:33:060
1931991515,0cyclictest0-21swapper/321:00:453
1929991515,0cyclictest0-21swapper/222:40:472
192999150,14cyclictest21784-21ntp_states22:00:522
192999150,14cyclictest0-21swapper/222:50:542
192999150,0cyclictest0-21swapper/220:25:462
1928991515,0cyclictest0-21swapper/122:30:461
1928991515,0cyclictest0-21swapper/119:25:471
1928991514,1cyclictest14778-21apt-get22:55:451
1928991514,1cyclictest0-21swapper/123:10:001
192899150,12cyclictest5871-21munin-node00:26:221
1925991515,0cyclictest30771-21apt-get20:10:020
1925991515,0cyclictest0-21swapper/023:30:470
1925991515,0cyclictest0-21swapper/000:15:490
192599150,14cyclictest0-21swapper/021:50:460
192599150,0cyclictest0-21swapper/023:15:450
193199140,14cyclictest0-21swapper/322:56:183
193199140,14cyclictest0-21swapper/322:50:243
193199140,14cyclictest0-21swapper/321:35:183
193199140,14cyclictest0-21swapper/321:25:203
193199140,14cyclictest0-21swapper/321:10:043
193199140,0cyclictest0-21swapper/322:41:123
193199140,0cyclictest0-21swapper/320:45:043
193199140,0cyclictest0-21swapper/320:38:183
193199140,0cyclictest0-21swapper/319:35:053
192999140,14cyclictest0-21swapper/221:25:042
192999140,0cyclictest0-21swapper/222:55:342
192999140,0cyclictest0-21swapper/220:45:382
192999140,0cyclictest0-21swapper/219:30:332
1928991414,0cyclictest0-21swapper/121:05:451
192899140,14cyclictest0-21swapper/123:55:091
192899140,14cyclictest0-21swapper/123:10:111
192899140,14cyclictest0-21swapper/122:40:371
192899140,14cyclictest0-21swapper/120:50:021
192899140,14cyclictest0-21swapper/120:35:401
192899140,14cyclictest0-21swapper/100:10:101
1925991414,0cyclictest0-21swapper/020:41:320
1925991414,0cyclictest0-21swapper/020:05:130
192599140,14cyclictest0-21swapper/023:40:170
192599140,14cyclictest0-21swapper/022:55:160
192599140,14cyclictest0-21swapper/019:55:060
192599140,14cyclictest0-21swapper/019:32:000
192599140,0cyclictest0-21swapper/023:10:400
192599140,0cyclictest0-21swapper/020:15:090
192599140,0cyclictest0-21swapper/000:10:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional