You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-09 - 13:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jan 09, 2026 00:44:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2083899260,25cyclictest313-21systemd-journal00:40:000
2084399242,21cyclictest6234-21grep23:05:002
2084399240,22cyclictest313-21systemd-journal21:35:012
20845992322,0cyclictest0-21swapper/322:56:313
20845992321,1cyclictest19714-21apt-get21:21:323
2084599231,21cyclictest0-21swapper/319:45:003
2084599230,22cyclictest17923-21turbostat.cron00:35:003
2084399230,22cyclictest5250-21cron19:45:002
2084399230,22cyclictest24879-21dump-pmu-power20:25:002
2084399230,22cyclictest17919-21apt00:35:002
20839992321,1cyclictest0-21swapper/121:36:321
2083899230,22cyclictest605-21avahi-daemon22:40:010
2083899230,22cyclictest25654-21sendmail19:20:010
20845992220,1cyclictest32075-21idleruntime-cro20:40:003
20845992220,1cyclictest0-21swapper/322:11:313
20845992220,1cyclictest0-21swapper/320:45:013
20845992220,1cyclictest0-21swapper/300:25:003
2084599220,21cyclictest26528-21turbostat.cron21:35:013
2084599220,21cyclictest0-21swapper/321:36:323
2084599220,1cyclictest606-21dbus-daemon20:25:003
2084599220,1cyclictest18641-21cut23:30:013
2084599220,1cyclictest0-21swapper/321:11:313
20843992221,1cyclictest0-21swapper/220:56:292
20843992220,1cyclictest32067-21sh20:40:002
20843992219,2cyclictest22472-21grep20:20:012
2084399220,21cyclictest5921-21perf00:10:012
2084399220,21cyclictest18961-21apt-get22:26:312
2084399220,21cyclictest10833-21apt-get19:56:302
2084399220,1cyclictest18634-21perf23:30:012
2084399220,1cyclictest14898-21apt-get21:11:312
20839992221,1cyclictest23824-21apt-get23:41:321
20839992220,1cyclictest14117-21apt-get21:10:031
20839992220,1cyclictest0-21swapper/119:35:001
20839992219,2cyclictest26173-21cron22:40:011
20839992219,2cyclictest16161-21cron22:20:001
20839992218,3cyclictest13392-21munin-run22:15:001
2083999220,21cyclictest24891-21wc20:25:001
2083999220,21cyclictest0-21swapper/123:56:331
2083999220,21cyclictest0-21swapper/122:55:001
2083999220,21cyclictest0-21swapper/122:31:321
2083999220,21cyclictest0-21swapper/121:55:011
2083999220,21cyclictest0-21swapper/121:50:011
2083999220,0cyclictest0-21swapper/121:31:311
20838992222,0cyclictest0-21swapper/022:26:310
2083899220,22cyclictest0-21swapper/022:16:310
2083899220,21cyclictest956-21turbostat22:55:000
2083899220,21cyclictest26573-21apt-get22:41:300
2083899220,21cyclictest2503-21apt-get20:46:300
2083899220,21cyclictest11031-21apt-get23:15:020
2083899220,21cyclictest11031-21apt-get23:15:020
2083899220,21cyclictest0-21swapper/022:11:310
2083899220,21cyclictest0-21swapper/021:26:300
2083899220,21cyclictest0-21swapper/021:00:010
2083899220,21cyclictest0-21swapper/000:01:330
2083899220,0cyclictest0-21swapper/022:01:320
2083899220,0cyclictest0-21swapper/020:06:300
20845992121,0cyclictest0-21swapper/319:31:313
20845992119,1cyclictest23460-21awk23:40:003
20845992119,1cyclictest22475-21cron20:20:013
20845992119,1cyclictest18297-21apt-get00:36:323
20845992119,1cyclictest1320-21latency_hist21:50:013
2084599210,21cyclictest0-21swapper/322:01:323
2084599210,20cyclictest0-21swapper/319:51:303
2084599210,20cyclictest0-21swapper/319:16:293
2084599210,0cyclictest0-21swapper/322:26:313
20843992120,1cyclictest2090-21perf20:45:012
20843992120,1cyclictest0-21swapper/221:01:302
20843992119,1cyclictest23445-21munin-run23:40:002
20843992119,1cyclictest1018-21perf00:00:012
20843992119,1cyclictest0-21swapper/221:50:012
2084399210,20cyclictest0-21swapper/223:51:312
2084399210,20cyclictest0-21swapper/222:01:322
2084399210,20cyclictest0-21swapper/219:26:302
2084399210,1cyclictest0-21swapper/200:05:012
2084399210,0cyclictest4899-21apt-get20:51:312
2084399210,0cyclictest4899-21apt-get20:51:312
2084399210,0cyclictest0-21swapper/219:51:302
20839992121,0cyclictest0-21swapper/120:41:301
20839992120,0cyclictest6570-21apt-get22:01:311
20839992119,1cyclictest0-21swapper/123:50:021
20839992119,1cyclictest0-21swapper/121:05:011
2083999210,1cyclictest23588-21apt-get19:16:291
2083999210,1cyclictest11113-21apt-get00:21:311
2083999210,0cyclictest0-21swapper/123:06:291
2083999210,0cyclictest0-21swapper/100:16:321
20838992120,1cyclictest62550irq/127-eno123:36:310
20838992120,1cyclictest28248-21apt-get23:50:020
20838992119,1cyclictest12881-21basename20:00:010
2083899210,20cyclictest0-21swapper/022:56:310
2083899210,20cyclictest0-21swapper/020:36:300
2083899210,20cyclictest0-21swapper/019:46:280
2083899210,1cyclictest28956-21turbostat21:40:010
2083899210,0cyclictest30801-21apt-get19:31:310
2083899210,0cyclictest27654-21apt-get20:31:310
2083899210,0cyclictest26008-21apt-get19:21:310
2083899210,0cyclictest21195-21apt-get19:11:300
2083899210,0cyclictest0-21swapper/022:31:320
2083899210,0cyclictest0-21swapper/000:11:310
20845992020,0cyclictest17292-21apt-get21:16:313
20845992020,0cyclictest1493-21apt-get00:01:323
20845992020,0cyclictest0-21swapper/322:51:323
20845992020,0cyclictest0-21swapper/322:06:313
20845992020,0cyclictest0-21swapper/321:01:303
20845992020,0cyclictest0-21swapper/320:56:293
20845992019,0cyclictest0-21swapper/300:00:013
20845992018,1cyclictest31049-21idleruntime-cro23:55:003
20845992017,2cyclictest28241-21dump-pmu-power23:50:003
2084599200,20cyclictest0-21swapper/300:10:013
2084599200,0cyclictest19004-21apt-get23:31:313
2084599200,0cyclictest11792-21apt-get23:16:313
2084599200,0cyclictest11792-21apt-get23:16:313
2084599200,0cyclictest0-21swapper/320:51:313
2084599200,0cyclictest0-21swapper/320:51:313
2084599200,0cyclictest0-21swapper/319:56:303
20843992020,0cyclictest8962-21apt-get22:06:312
20843992020,0cyclictest31365-21apt-get22:51:322
20843992020,0cyclictest0-21swapper/222:11:312
20843992020,0cyclictest0-21swapper/221:36:322
20843992020,0cyclictest0-21swapper/221:21:322
20843992019,0cyclictest9005-21apt-get23:11:322
20843992019,0cyclictest0-21swapper/219:11:302
20843992018,1cyclictest762-21apt-get19:36:322
2084399200,20cyclictest0-21swapper/221:16:312
2084399200,0cyclictest0-21swapper/220:46:302
2084399200,0cyclictest0-21swapper/219:16:292
20839992020,0cyclictest25257-21apt-get20:26:311
20839992020,0cyclictest18041-21apt-get20:11:301
20839992020,0cyclictest0-21swapper/123:26:321
20839992020,0cyclictest0-21swapper/123:11:321
20839992020,0cyclictest0-21swapper/122:41:301
20839992020,0cyclictest0-21swapper/121:56:311
20839992020,0cyclictest0-21swapper/120:51:301
20839992020,0cyclictest0-21swapper/120:51:301
20839992020,0cyclictest0-21swapper/119:11:301
20839992019,0cyclictest30051-21apt-get20:36:311
20839992018,1cyclictest23424-21perf23:40:001
20839992018,1cyclictest1741-21apt-get22:56:311
2083999200,20cyclictest0-21swapper/122:26:311
2083999200,0cyclictest0-21swapper/123:01:321
20838992020,0cyclictest13512-21apt-get00:26:350
20838992020,0cyclictest0-21swapper/021:21:320
20838992020,0cyclictest0-21swapper/021:11:310
20838992020,0cyclictest0-21swapper/021:01:300
20838992020,0cyclictest0-21swapper/020:41:300
20838992020,0cyclictest0-21swapper/019:51:300
20838992019,0cyclictest22864-21apt-get20:21:300
2083899200,20cyclictest0-21swapper/023:01:320
2083899200,20cyclictest0-21swapper/021:06:310
2083899200,20cyclictest0-21swapper/019:26:300
2083899200,0cyclictest0-21swapper/021:41:310
2083899200,0cyclictest0-21swapper/021:41:310
2083899200,0cyclictest0-21swapper/020:55:010
2083899200,0cyclictest0-21swapper/020:55:010
20845991919,0cyclictest28969-21apt-get22:46:303
20845991919,0cyclictest0-21swapper/323:11:323
20845991919,0cyclictest0-21swapper/319:11:303
20845991918,1cyclictest22112-21apt-get21:26:293
20843991919,0cyclictest0-21swapper/222:46:302
20843991919,0cyclictest0-21swapper/221:26:292
20843991919,0cyclictest0-21swapper/200:36:322
20843991918,1cyclictest16566-21apt-get22:21:312
20843991918,0cyclictest5286-21apt-get19:45:022
20843991917,1cyclictest28239-21awk23:50:002
2084399190,19cyclictest0-21swapper/219:31:312
2084399190,17cyclictest0-21swapper/223:21:312
20839991919,0cyclictest3256-21apt-get19:41:301
20839991919,0cyclictest0-21swapper/123:21:321
20839991918,1cyclictest8437-21apt-get19:51:301
20838991919,0cyclictest0-21swapper/023:46:310
20838991919,0cyclictest0-21swapper/021:46:310
20838991919,0cyclictest0-21swapper/020:26:310
20838991918,1cyclictest17936-21grep00:35:000
20845991818,0cyclictest0-21swapper/322:21:313
20845991818,0cyclictest0-21swapper/319:45:023
20843991818,0cyclictest0-21swapper/222:15:022
20843991815,2cyclictest313-21systemd-journal23:20:012
20843991815,2cyclictest313-21systemd-journal23:20:012
20839991818,0cyclictest0-21swapper/121:06:311
20839991818,0cyclictest0-21swapper/100:06:301
20839991816,1cyclictest0-21swapper/100:30:001
2083999180,17cyclictest28401-21apt-get19:26:301
2083999180,17cyclictest0-21swapper/123:16:311
2083999180,17cyclictest0-21swapper/123:16:311
20838991818,0cyclictest6608-21apt-get23:06:290
20838991818,0cyclictest0-21swapper/023:31:310
20838991818,0cyclictest0-21swapper/022:46:310
20838991818,0cyclictest0-21swapper/021:56:310
20838991817,1cyclictest8688-21apt-get00:16:320
20845991717,0cyclictest0-21swapper/322:15:023
20845991717,0cyclictest0-21swapper/319:36:323
20843991717,0cyclictest0-21swapper/222:56:312
20843991716,0cyclictest0-21swapper/200:16:322
20843991715,1cyclictest20078-21munin-run20:15:012
20839991717,0cyclictest15646-21apt-get20:06:301
20839991717,0cyclictest13253-21apt-get20:01:321
20839991717,0cyclictest13253-21apt-get20:01:321
20839991717,0cyclictest0-21swapper/119:56:301
20839991717,0cyclictest0-21swapper/100:36:321
20839991716,1cyclictest622-21gdbus21:25:001
2083999170,16cyclictest2841-21sh19:40:001
20838991717,0cyclictest24515-21apt-get21:31:320
20838991717,0cyclictest14213-21apt-get23:21:320
20838991717,0cyclictest0-21swapper/022:21:310
20838991717,0cyclictest0-21swapper/019:41:300
20838991717,0cyclictest0-21swapper/000:21:310
20838991716,1cyclictest16606-21apt-get23:26:320
20845991616,0cyclictest4218-21apt-get23:01:323
20845991616,0cyclictest0-21swapper/322:44:543
20845991616,0cyclictest0-21swapper/321:41:313
20845991616,0cyclictest0-21swapper/321:41:313
20845991616,0cyclictest0-21swapper/320:11:303
20845991616,0cyclictest0-21swapper/300:16:323
20845991615,1cyclictest12105-21apt-get21:06:313
20845991615,0cyclictest0-21swapper/323:41:323
20845991615,0cyclictest0-21swapper/300:26:353
20845991613,2cyclictest17661-21cron20:10:013
20843991616,0cyclictest0-21swapper/221:41:312
20843991616,0cyclictest0-21swapper/221:41:312
20843991615,1cyclictest28-21ksoftirqd/200:15:012
20843991615,1cyclictest0-21swapper/200:26:352
20843991615,0cyclictest26573-21apt-get22:41:302
20843991614,1cyclictest0-21swapper/200:24:232
20839991616,0cyclictest0-21swapper/123:46:311
20839991616,0cyclictest0-21swapper/120:46:301
2083999160,7cyclictest0-21swapper/119:21:311
20838991615,0cyclictest0-21swapper/020:16:310
20838991614,1cyclictest0-21swapper/020:01:310
20838991614,1cyclictest0-21swapper/020:01:310
20845991515,0cyclictest21366-21apt-get22:31:323
20845991514,1cyclictest0-21swapper/322:35:023
20845991513,1cyclictest7155-21perl23:06:313
20845991512,2cyclictest0-21swapper/320:01:403
20845991512,2cyclictest0-21swapper/320:01:403
2084599150,1cyclictest26974-21users20:26:403
20843991515,0cyclictest0-21swapper/222:31:322
20843991515,0cyclictest0-21swapper/221:06:312
20843991514,1cyclictest4153-21apt-get21:56:312
20843991514,0cyclictest0-21swapper/221:51:312
20843991513,1cyclictest17667-21idleruntime-cro20:10:012
2084399150,1cyclictest24465-21hddtemp_smartct23:41:342
20839991515,0cyclictest0-21swapper/122:46:311
20839991515,0cyclictest0-21swapper/121:16:311
2083999150,1cyclictest21622-21head20:16:391
20838991515,0cyclictest0-21swapper/023:41:320
20838991515,0cyclictest0-21swapper/022:06:310
20838991515,0cyclictest0-21swapper/020:11:300
20838991515,0cyclictest0-21swapper/019:36:310
20845991414,0cyclictest0-21swapper/321:50:483
2084599140,14cyclictest0-21swapper/320:45:073
2084599140,14cyclictest0-21swapper/320:30:263
2084599140,0cyclictest0-21swapper/323:20:193
2084599140,0cyclictest0-21swapper/321:55:593
2084599140,0cyclictest0-21swapper/319:26:413
2084599140,0cyclictest0-21swapper/319:20:123
2084599140,0cyclictest0-21swapper/300:10:013
20843991414,0cyclictest0-21swapper/222:35:022
2084399140,14cyclictest0-21swapper/223:31:112
2084399140,14cyclictest0-21swapper/220:30:262
2084399140,14cyclictest0-21swapper/220:25:432
2084399140,0cyclictest0-21swapper/223:05:192
2084399140,0cyclictest0-21swapper/220:00:302
2084399140,0cyclictest0-21swapper/220:00:302
2084399140,0cyclictest0-21swapper/219:20:122
20839991414,0cyclictest0-21swapper/121:25:031
2083999140,14cyclictest0-21swapper/122:05:011
2083999140,14cyclictest0-21swapper/120:30:121
2083999140,14cyclictest0-21swapper/119:45:151
2083999140,14cyclictest0-21swapper/100:10:411
20838991414,0cyclictest0-21swapper/023:55:100
20838991414,0cyclictest0-21swapper/021:15:390
20838991414,0cyclictest0-21swapper/000:05:170
2083899140,14cyclictest0-21swapper/023:10:470
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional