You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-16 - 06:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Thu Jul 16, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
458871994541,3cyclictest702534-21kworker/u8:0+events_unbound23:34:460
458876994335,5cyclictest557579-21latency_hist20:45:002
458879994034,4cyclictest797305-21latency_hist00:35:013
458879994034,4cyclictest797305-21latency_hist00:35:013
458871994037,2cyclictest589163-21kworker/u8:2+events_unbound21:13:280
458871994036,3cyclictest761315-21/usr/sbin/munin00:00:140
458873993935,3cyclictest335557-21systemd-journal21:18:441
458876993831,5cyclictest594532-21latency_hist21:20:022
458871993733,3cyclictest702534-21kworker/u8:0+events_unbound23:17:470
458871993733,3cyclictest589163-21kworker/u8:2+events_unbound22:49:460
458871993733,3cyclictest484324-21kworker/u8:0+events_unbound20:11:440
458871993633,2cyclictest589163-21kworker/u8:2+events_unbound21:50:230
458871993633,2cyclictest484324-21kworker/u8:0+events_unbound20:25:560
458871993532,2cyclictest484324-21kworker/u8:0+events_unbound20:05:180
458871993531,3cyclictest702534-21kworker/u8:0+events_unbound23:06:320
458871993531,3cyclictest687684-21kworker/u8:3+events_unbound23:01:290
458879993428,4cyclictest630696-21latency_hist21:55:003
458871993431,2cyclictest75-21kswapd019:40:030
458871993431,2cyclictest687684-21kworker/u8:3+events_unbound23:10:150
458871993431,2cyclictest625159-21kworker/u8:3+events_unbound21:49:440
458871993430,3cyclictest589163-21kworker/u8:2+events_unbound22:07:460
458873993328,3cyclictest599702-21latency_hist21:25:001
458871993330,2cyclictest725058-21kworker/u8:3+events_unbound23:35:230
458871993330,2cyclictest640685-21kworker/u8:0+events_unbound22:03:450
458871993330,2cyclictest484324-21kworker/u8:0+events_unbound21:06:440
458871993329,3cyclictest438665-21kworker/u8:4+events_unbound19:18:430
458879993229,2cyclictest719025-21kworker/u8:1+flush-259:000:10:003
458873993228,3cyclictest469429-21apt-get19:20:111
458873993228,3cyclictest335557-21systemd-journal23:55:451
458873993226,4cyclictest718834-21latency_hist23:20:011
458871993229,2cyclictest750377-21kworker/u8:0+events_unbound00:22:560
458871993229,2cyclictest589163-21kworker/u8:2+events_unbound22:55:240
458871993229,2cyclictest589163-21kworker/u8:2+events_unbound22:11:190
458871993229,2cyclictest589163-21kworker/u8:2+events_unbound22:11:190
458871993228,3cyclictest734761-21kworker/u8:2+events_unbound23:45:450
458871993128,2cyclictest725058-21kworker/u8:3+events_unbound23:52:210
458871993128,2cyclictest505814-21kworker/u8:1+events_unbound20:35:190
458871993128,2cyclictest505814-21kworker/u8:1+events_unbound20:15:240
458871993128,2cyclictest416426-21kworker/u8:2+events_unbound19:45:230
458871993127,3cyclictest589163-21kworker/u8:2+events_unbound22:53:460
458871993124,5cyclictest723499-21ntpq23:20:210
458879993024,4cyclictest656451-21latency_hist22:20:003
458871993027,3cyclictest438665-21kworker/u8:4+events_unbound19:10:450
458871993027,2cyclictest505814-21kworker/u8:1+events_unbound20:55:130
458871993027,2cyclictest484324-21kworker/u8:0+events_unbound20:52:450
458871993027,2cyclictest484324-21kworker/u8:0+events_unbound20:40:200
458871993026,3cyclictest766234-21kworker/u8:2+events_unbound00:32:140
458871993026,3cyclictest766234-21kworker/u8:2+events_unbound00:32:140
458871992927,2cyclictest750377-21kworker/u8:0+events_unbound00:15:240
458871992926,2cyclictest505814-21kworker/u8:1+events_unbound21:00:120
458871992926,2cyclictest505814-21kworker/u8:1+events_unbound20:30:150
458871992925,3cyclictest589163-21kworker/u8:2+events_unbound21:31:110
458876992823,3cyclictest725058-21kworker/u8:3+flush-259:023:50:152
458873992822,4cyclictest708502-21latency_hist23:10:001
458871992825,3cyclictest640685-21kworker/u8:0+events_unbound22:30:160
458871992824,3cyclictest750377-21kworker/u8:0+events_unbound00:05:270
458871992824,3cyclictest615451-21apt-get21:40:130
458879992721,4cyclictest335557-21systemd-journal19:47:443
458876992722,3cyclictest589163-21kworker/u8:2+flush-259:022:25:012
458876992720,5cyclictest335557-21systemd-journal21:30:002
458873992724,2cyclictest573971-21base6421:00:021
458871992725,1cyclictest1-21systemd19:24:430
458871992724,2cyclictest484324-21kworker/u8:0+events_unbound20:20:560
458871992724,2cyclictest484324-21kworker/u8:0+events_unbound20:00:540
458871992724,2cyclictest484324-21kworker/u8:0+events_unbound20:00:530
458871992723,3cyclictest640685-21kworker/u8:0+events_unbound22:35:200
458871992723,3cyclictest505814-21kworker/u8:1+events_unbound21:37:450
458876992620,4cyclictest557601-21kworker/u8:2+flush-259:020:50:152
458873992622,3cyclictest739941-21gpgv23:40:011
458871992522,2cyclictest416426-21kworker/u8:2+events_unbound19:30:220
458871992519,4cyclictest594793-21apt-get21:20:120
458879992420,3cyclictest416426-21kworker/u8:2+flush-259:019:30:003
458879992419,3cyclictest479806-21apt-get19:30:123
458876992420,3cyclictest438665-21kworker/u8:4+flush-259:019:50:012
458871992422,2cyclictest589163-21kworker/u8:2+events_unbound22:40:250
458871992421,2cyclictest416426-21kworker/u8:2+events_unbound19:26:450
458879992319,3cyclictest335557-21systemd-journal00:30:003
458876992319,3cyclictest687684-21kworker/u8:3+flush-259:022:50:232
458876992319,3cyclictest589163-21kworker/u8:2+flush-259:022:40:202
458876992317,4cyclictest734761-21kworker/u8:2+events_unbound23:45:202
458873992319,3cyclictest745773-21apt-get23:45:101
458873992319,3cyclictest605145-21apt-get21:30:111
458873992319,3cyclictest335557-21systemd-journal19:45:011
458873992318,4cyclictest724617-21/usr/sbin/munin23:25:201
458873992318,4cyclictest661820-21/usr/sbin/munin22:25:131
458873992316,5cyclictest792115-21latency_hist00:30:001
458871992321,2cyclictest640685-21kworker/u8:0+events_unbound22:15:110
458871992316,6cyclictest660670-21ntpq22:20:190
458879992217,4cyclictest687684-21kworker/u8:3+flush-259:022:55:153
458876992219,2cyclictest438665-21kworker/u8:4+events_unbound19:15:182
458876992219,2cyclictest335557-21systemd-journal23:10:002
458876992218,3cyclictest640685-21kworker/u8:0+flush-259:022:15:152
458876992215,5cyclictest766234-21kworker/u8:2+flush-259:000:20:182
458873992217,4cyclictest589163-21kworker/u8:2+flush-259:022:30:251
458871992219,2cyclictest750377-21kworker/u8:0+events_unbound00:29:550
458871992219,2cyclictest505814-21kworker/u8:1+events_unbound21:25:280
458871992219,2cyclictest484324-21kworker/u8:0+events_unbound20:47:460
458871992217,4cyclictest335557-21systemd-journal00:00:000
458879992116,3cyclictest573458-21apt-get21:00:003
458876992118,2cyclictest750377-21kworker/u8:0+flush-259:000:15:232
458876992118,2cyclictest438665-21kworker/u8:4+flush-259:019:25:152
458876992116,4cyclictest740114-21gpgv23:40:012
458876992115,4cyclictest335557-21systemd-journal23:43:462
458876992114,5cyclictest620338-21latency_hist21:45:012
458873992115,5cyclictest770462-21ntpq00:05:211
458873992115,4cyclictest464024-21latency_hist19:15:001
45887399211,18cyclictest509-21rs:main1
458871992119,2cyclictest484324-21kworker/u8:0+events_unbound19:35:260
458871992118,3cyclictest625159-21kworker/u8:3+events_unbound21:56:460
458879992015,3cyclictest802487-21latency_hist00:40:013
458879992014,4cyclictest734732-21latency_hist23:35:013
458879992014,4cyclictest651321-21latency_hist22:15:013
458879992014,4cyclictest651321-21latency_hist22:15:013
458876992017,2cyclictest713667-21cron23:15:012
458876992016,3cyclictest640685-21kworker/u8:0+flush-259:022:30:162
458873992017,2cyclictest698436-21apt-get23:00:101
458873992016,3cyclictest505814-21kworker/u8:1+flush-259:020:25:011
458873992016,3cyclictest484324-21kworker/u8:0+flush-259:020:55:161
458871992017,2cyclictest766234-21kworker/u8:2+events_unbound00:38:390
458871992017,2cyclictest725058-21kworker/u8:3+events_unbound00:10:280
458879991913,4cyclictest510934-21latency_hist20:00:003
45887999190,17cyclictest1-21systemd21:32:453
458876991915,3cyclictest750377-21kworker/u8:0+flush-259:000:05:172
458876991913,4cyclictest756076-21/usr/sbin/munin23:55:122
458873991915,3cyclictest335557-21systemd-journal20:15:441
458873991914,3cyclictest547512-21apt-get20:35:111
458873991913,4cyclictest698177-21latency_hist23:00:011
458876991815,2cyclictest730240-21irqcore23:30:162
458876991814,3cyclictest702534-21kworker/u8:0+events_unbound23:25:182
458876991814,3cyclictest625159-21kworker/u8:3+flush-259:022:00:172
458876991814,3cyclictest484324-21kworker/u8:0+flush-259:021:10:252
458876991813,3cyclictest694282-21kthreadcore22:55:172
458876991813,3cyclictest509-21rs:main2
458876991812,5cyclictest335557-21systemd-journal20:50:012
458876991812,4cyclictest506042-21apt-get19:55:122
458873991814,3cyclictest509-21rs:main1
458873991814,3cyclictest509-21rs:main1
458873991814,3cyclictest505814-21kworker/u8:1+flush-259:021:25:151
458873991812,5cyclictest468314-21ntpq19:15:201
458871991815,2cyclictest725058-21kworker/u8:3+events_unbound23:41:200
458871991815,2cyclictest416426-21kworker/u8:2+events_unbound19:51:320
458871991814,3cyclictest589163-21kworker/u8:2+events_unbound21:17:010
458879991714,2cyclictest615191-21latency_hist21:39:593
458879991714,2cyclictest589163-21kworker/u8:2+events_unbound22:20:183
458879991714,1cyclictest490241-21apt-key19:40:003
458879991713,3cyclictest687684-21kworker/u8:3+flush-259:022:50:173
458879991713,3cyclictest484324-21kworker/u8:0+flush-259:019:41:063
458873991715,1cyclictest777290-21irqcore00:15:151
458873991713,3cyclictest537081-21/usr/sbin/munin20:25:131
458873991712,4cyclictest335557-21systemd-journal23:23:451
45887399171,14cyclictest1-21systemd19:55:001
458871991713,2cyclictest702534-21kworker/u8:0+events_unbound23:26:170
458879991613,2cyclictest746795-21kthreadcore23:45:163
458879991613,2cyclictest547657-21cpuspeed_turbos20:35:143
458879991613,2cyclictest505774-21sh19:54:593
458879991612,3cyclictest771631-21/usr/sbin/munin00:10:253
458879991612,3cyclictest604009-21ntp_kernel_pll_21:25:213
458879991612,3cyclictest505814-21kworker/u8:1+flush-259:020:30:243
45887699169,5cyclictest801592-21ntpq00:35:222
458876991613,2cyclictest505814-21kworker/u8:1+events_unbound21:45:192
458876991612,3cyclictest416426-21kworker/u8:2+flush-259:020:00:252
458876991612,3cyclictest416426-21kworker/u8:2+flush-259:020:00:242
458876991612,2cyclictest0-21swapper/200:05:002
458876991610,4cyclictest579011-21latency_hist21:05:012
458876991610,4cyclictest490364-21base6419:40:002
458873991612,3cyclictest552687-21apt-get20:40:101
458871991613,2cyclictest416426-21kworker/u8:2+events_unbound19:56:210
458879991512,2cyclictest666958-21gpgv22:30:013
458879991511,3cyclictest484324-21kworker/u8:0+flush-259:020:05:103
458879991511,2cyclictest473973-21sshd19:20:443
458876991511,3cyclictest572966-21unixbench_multi20:55:242
458873991511,3cyclictest625159-21kworker/u8:3+flush-259:022:00:181
458873991511,3cyclictest625159-21kworker/u8:3+flush-259:021:55:191
458873991510,4cyclictest650481-21ntpq22:10:231
458873991510,4cyclictest650481-21ntpq22:10:221
458879991411,2cyclictest702534-21kworker/u8:0+flush-259:023:25:223
458879991411,2cyclictest584866-21irqcore21:10:163
45887699149,3cyclictest489869-21http19:40:002
45887699148,4cyclictest724378-21latency_hist23:25:002
458876991411,2cyclictest776122-21unixbench_multi00:10:272
45887399148,4cyclictest625521-21latency_hist21:50:001
45887999139,3cyclictest750377-21kworker/u8:0+flush-259:000:00:243
45887999138,4cyclictest416426-21kworker/u8:2+flush-259:020:00:263
45887999138,4cyclictest416426-21kworker/u8:2+flush-259:020:00:253
458879991311,1cyclictest2971-21cron21:50:003
458879991311,1cyclictest0-21swapper/323:20:173
458879991310,2cyclictest698857-21irqcore23:00:153
458879991310,2cyclictest464425-21cpuspeed_turbos19:15:113
458879991310,2cyclictest416426-21kworker/u8:2+flush-259:020:20:003
45887699139,2cyclictest698578-21tr23:00:112
45887699138,3cyclictest625159-21kworker/u8:3+flush-259:021:55:242
45887399138,4cyclictest335557-21systemd-journal22:17:001
45887399137,4cyclictest782028-21apt-get00:20:121
458873991310,2cyclictest615181-21sh21:40:001
458873991310,2cyclictest0-21swapper/100:40:001
458871991311,1cyclictest60350irq/132-enp0s29f1:rx-022:25:460
45887999129,2cyclictest776935-21cpuspeed_turbos00:15:123
45887999129,2cyclictest703658-21cpuspeed_turbos23:05:133
45887999129,2cyclictest594970-21uniq21:20:153
45887999128,3cyclictest687684-21kworker/u8:3+flush-259:023:10:153
45887999128,3cyclictest335557-21systemd-journal22:40:003
45887999127,3cyclictest513-21gdbus20:45:003
45887999126,4cyclictest594514-21cron21:20:013
458879991212,0cyclictest2605873-21kworker/3:1+events_power_efficient19:13:363
458879991210,1cyclictest718823-21cron23:20:013
458879991210,1cyclictest0-21swapper/320:30:013
45887699129,2cyclictest787292-21cpuspeed_turbos00:25:132
45887699129,2cyclictest714010-21cpuspeed_turbos23:15:132
45887699129,2cyclictest537173-21cpuspeed_turbos20:25:122
45887699129,2cyclictest503698-21kthreadcore19:50:192
45887699128,3cyclictest625781-21apt-get21:50:122
45887699128,2cyclictest0-21swapper/219:20:162
45887699125,5cyclictest525595-21ntpq20:10:182
45887699125,5cyclictest335557-21systemd-journal22:40:002
45887399128,3cyclictest687684-21kworker/u8:3+flush-259:023:10:111
458873991210,1cyclictest490074-21apt-key19:40:001
45887999119,1cyclictest0-21swapper/323:50:143
45887999119,1cyclictest0-21swapper/321:55:153
45887999118,2cyclictest667510-21cpuspeed_turbos22:30:123
45887999118,2cyclictest0-21swapper/323:40:013
45887699118,2cyclictest595214-21sed21:20:162
45887699118,2cyclictest531993-21cpuspeed_turbos20:20:132
45887699116,4cyclictest507-21in:imuxsock22:10:002
45887399119,1cyclictest0-21swapper/122:40:161
45887399118,2cyclictest563082-21cpuspeed_turbos20:50:131
45887399118,2cyclictest526039-21unixbench_multi20:10:221
45887399117,3cyclictest335557-21systemd-journal21:07:441
45887399116,4cyclictest335557-21systemd-journal21:13:451
45887399116,3cyclictest646167-21latency_hist22:10:011
45887399111,9cyclictest766209-21awk00:05:001
45887999108,1cyclictest0-21swapper/322:50:003
45887699108,1cyclictest0-21swapper/220:15:132
45887699107,2cyclictest683030-21cpuspeed_turbos22:45:122
45887699106,2cyclictest0-21swapper/220:30:122
45887699100,8cyclictest797305-21latency_hist00:35:002
45887699100,8cyclictest797305-21latency_hist00:35:002
45887399108,1cyclictest0-21swapper/122:50:111
45887399100,6cyclictest510941-21munin-run20:00:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional