You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 06:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Thu Apr 02, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4065651995144,5cyclictest23086-21diskstats21:35:130
4065651994336,5cyclictest105896-21diskstats22:55:140
4065656994237,3cyclictest199843-21latency_hist00:25:012
4065661994037,2cyclictest184610-21kworker/u8:3+events_unbound00:30:193
4065661994037,2cyclictest184610-21kworker/u8:3+events_unbound00:30:193
4065661993833,4cyclictest173517-21latency_hist00:00:013
4065651993833,4cyclictest4185535-21apt-get21:05:120
4065656993726,9cyclictest4179934-21kworker/u8:0+flush-259:022:20:002
4065651993733,3cyclictest4138372-21apt-get20:20:120
4065661993630,5cyclictest7050-21apt-get21:20:113
4065653993630,3cyclictest252-21systemd-journal21:50:261
4065653993429,3cyclictest153063-21apt-get23:40:111
4065653993329,3cyclictest4117490-21kworker/u8:3+flush-259:022:05:221
4065651993228,3cyclictest43476-21apt-get21:55:110
4065651993227,3cyclictest4055625-21kworker/u8:1+flush-259:019:35:100
4065656993126,3cyclictest252-21systemd-journal19:56:252
4065653993126,4cyclictest22924-21apt-get21:35:121
406565399311,14cyclictest210152-21munin-plugin-st00:35:001
406565399311,14cyclictest210152-21munin-plugin-st00:34:591
4065651993127,3cyclictest68736-21kworker/u8:3+events_unbound22:35:000
4065656993024,4cyclictest205002-21latency_hist00:30:012
4065653993025,4cyclictest4117490-21kworker/u8:3+flush-259:021:30:171
4065653993024,4cyclictest69622-21cp22:20:011
4065651993025,4cyclictest4164119-21apt-get20:45:100
4065651993025,3cyclictest4055625-21kworker/u8:1+events_unbound19:40:170
4065651993025,3cyclictest4055625-21kworker/u8:1+events_unbound19:40:170
4065661992926,2cyclictest4117491-21kworker/u8:4+events_unbound20:00:193
4065661992925,3cyclictest4117490-21kworker/u8:3+flush-259:021:00:243
4065651992923,4cyclictest210377-21/usr/sbin/munin00:35:130
4065661992823,4cyclictest252-21systemd-journal22:15:003
4065653992822,4cyclictest100570-21/usr/sbin/munin22:50:141
4065653992821,5cyclictest16152-21ntpq21:25:201
4065653992820,6cyclictest252-21systemd-journal00:14:591
4065651992825,2cyclictest174244-21kworker/u8:1+flush-259:000:10:210
4065651992824,3cyclictest4179934-21kworker/u8:0+flush-259:022:15:170
4065651992824,3cyclictest126175-21kworker/u8:0+flush-259:023:25:000
4065651992822,4cyclictest147644-21latency_hist23:35:010
4065661992724,2cyclictest4117491-21kworker/u8:4+flush-259:020:50:203
4065656992721,4cyclictest126678-21base6423:15:022
4065653992722,4cyclictest157963-21kworker/u8:2+flush-259:000:00:151
4065651992724,2cyclictest126175-21kworker/u8:0+events_unbound23:25:110
4065653992621,4cyclictest68698-21apt-get22:17:001
4065653992621,4cyclictest4055625-21kworker/u8:1+flush-259:019:50:261
4065653992618,5cyclictest184386-21latency_hist00:10:011
4065651992622,3cyclictest58322-21kworker/u8:1+events_unbound23:15:150
4065651992622,3cyclictest4055625-21kworker/u8:1+flush-259:019:25:170
4065651992621,4cyclictest85137-21apt-get22:35:110
4065651992620,4cyclictest38336-21/usr/sbin/munin21:50:230
4065661992518,5cyclictest4091313-21apt-get19:35:013
4065653992521,3cyclictest68736-21kworker/u8:3+flush-259:023:00:171
4065653992520,4cyclictest4117490-21kworker/u8:3+flush-259:020:15:241
4065653992520,3cyclictest184610-21kworker/u8:3+flush-259:000:25:141
4065651992522,2cyclictest4117491-21kworker/u8:4+events_unbound20:50:200
4065651992522,2cyclictest4117490-21kworker/u8:3+flush-259:021:00:210
4065651992522,2cyclictest184610-21kworker/u8:3+events_unbound00:15:180
4065651992521,2cyclictest4070995-21kworker/u8:2+flush-259:019:20:150
4065651992518,4cyclictest509-21rs:main0
4065661992421,2cyclictest58322-21kworker/u8:1+flush-259:023:25:113
4065661992421,2cyclictest4179934-21kworker/u8:0+flush-259:021:25:173
4065661992420,3cyclictest4117490-21kworker/u8:3+flush-259:021:10:173
4065651992420,3cyclictest58322-21kworker/u8:1+events_unbound23:10:200
4065651992420,3cyclictest173541-21gpgv23:59:590
4065651992417,5cyclictest17050-21latency_hist21:30:000
4065661992319,3cyclictest58322-21kworker/u8:1+flush-259:023:15:183
4065661992319,3cyclictest4117491-21kworker/u8:4+flush-259:020:20:143
4065653992319,3cyclictest4174162-21idleruntime-cro20:55:001
4065653992318,4cyclictest33199-21/usr/sbin/munin21:45:141
4065653992316,5cyclictest32957-21latency_hist21:45:001
4065651992319,3cyclictest4091331-21kworker/u8:0+flush-259:019:45:250
4065651992319,3cyclictest4065597-21kworker/u8:0+events_unbound19:15:210
4065651992316,5cyclictest157942-21latency_hist23:45:010
4065656992218,3cyclictest126169-21gpgv23:15:002
4065656992216,4cyclictest252-21systemd-journal22:05:312
4065653992218,3cyclictest68736-21kworker/u8:3+flush-259:022:40:171
4065653992217,3cyclictest126830-21apt-get23:15:121
4065653992215,5cyclictest252-21systemd-journal19:48:241
4065651992218,3cyclictest4117490-21kworker/u8:3+events_unbound21:10:120
4065651992218,3cyclictest4117490-21kworker/u8:3+events_unbound20:30:230
4065651992218,3cyclictest174244-21kworker/u8:1+flush-259:000:04:420
4065651992217,3cyclictest4117490-21kworker/u8:3+events_unbound21:30:190
4065651992215,5cyclictest114913-21ntpq23:00:190
4065661992117,3cyclictest4065597-21kworker/u8:0+flush-259:019:15:243
4065661992116,4cyclictest4179909-21gpgv21:00:013
4065656992117,3cyclictest74813-21apt-get22:25:112
4065656992114,5cyclictest252-21systemd-journal21:20:002
4065653992115,4cyclictest116080-21/usr/sbin/munin23:05:151
4065651992118,2cyclictest4117490-21kworker/u8:3+flush-259:020:40:210
4065651992118,2cyclictest4117490-21kworker/u8:3+flush-259:020:05:200
4065651992114,5cyclictest4174662-21cat20:55:010
4065661992014,5cyclictest52640-21ntpq22:00:213
4065656992016,3cyclictest147870-21kworker/u8:4+flush-259:023:50:162
4065656992015,3cyclictest252-21systemd-journal19:42:242
4065656992015,3cyclictest252-21systemd-journal19:42:242
4065653992016,3cyclictest58322-21kworker/u8:1+flush-259:022:45:221
4065653992015,3cyclictest147903-21apt-get23:35:111
4065653992014,4cyclictest4117490-21kworker/u8:3+flush-259:021:00:161
4065653992014,4cyclictest252-21systemd-journal22:10:311
4065651992016,3cyclictest4179934-21kworker/u8:0+events_unbound22:05:010
4065651992016,3cyclictest4117490-21kworker/u8:3+flush-259:021:15:200
4065651992016,3cyclictest4117490-21kworker/u8:3+flush-259:020:35:210
4065661991916,2cyclictest68736-21kworker/u8:3+events_unbound22:25:173
4065661991914,3cyclictest4153822-21/usr/sbin/munin20:35:153
4065661991914,3cyclictest252-21systemd-journal20:16:263
4065656991913,4cyclictest4107177-21latency_hist19:50:012
4065653991915,3cyclictest507-21in:imuxsock20:55:011
4065653991914,4cyclictest4122953-21apt-get20:05:121
4065653991914,4cyclictest4086442-21/usr/sbin/munin19:30:131
4065653991913,4cyclictest4069848-21ntpq19:10:211
4065653991913,4cyclictest157961-21kworker/u8:0+flush-259:000:35:151
4065651991916,2cyclictest4117491-21kworker/u8:4+events_unbound20:00:030
4065651991915,3cyclictest68736-21kworker/u8:3+events_unbound22:40:130
4065651991915,3cyclictest68736-21kworker/u8:3+events_unbound22:25:360
4065651991915,3cyclictest4117490-21kworker/u8:3+flush-259:021:45:000
4065651991915,3cyclictest4117490-21kworker/u8:3+events_unbound20:15:180
4065651991914,4cyclictest4179934-21kworker/u8:0+flush-259:022:20:170
4065651991913,4cyclictest183539-21ntpq00:05:210
4065651991912,5cyclictest252-21systemd-journal22:50:260
4065661991815,2cyclictest4179934-21kworker/u8:0+flush-259:022:10:003
4065656991815,2cyclictest68736-21kworker/u8:3+flush-259:023:00:002
4065656991813,4cyclictest193819-21ntpq00:15:212
4065656991813,3cyclictest4168960-21latency_hist20:50:012
4065656991813,3cyclictest4112334-21latency_hist19:55:012
4065653991813,4cyclictest4190653-21/usr/sbin/munin21:10:151
4065651991814,3cyclictest4179934-21kworker/u8:0+flush-259:021:23:020
4065651991814,3cyclictest4091331-21kworker/u8:0+flush-259:019:51:290
4065651991814,3cyclictest4070995-21kworker/u8:2+events_unbound19:30:120
4065651991813,3cyclictest157961-21kworker/u8:0+flush-259:000:20:240
4065651991812,4cyclictest204116-21ntpq00:25:180
4065661991714,2cyclictest4117490-21kworker/u8:3+flush-259:021:35:163
4065661991713,3cyclictest4179934-21kworker/u8:0+flush-259:021:55:333
4065656991713,3cyclictest4117490-21kworker/u8:3+flush-259:021:21:312
4065656991712,4cyclictest137390-21cat23:25:022
4065653991714,1cyclictest0-21swapper/100:00:001
4065653991712,3cyclictest4055625-21kworker/u8:1+flush-259:019:40:161
4065653991712,3cyclictest4055625-21kworker/u8:1+flush-259:019:40:161
4065653991711,4cyclictest4128065-21apt-get20:10:101
4065651991714,2cyclictest60350irq/132-enp0s29f1:rx-019:58:580
4065651991714,2cyclictest60350irq/132-enp0s29f1:rx-000:30:230
4065651991714,2cyclictest60350irq/132-enp0s29f1:rx-000:30:230
4065656991613,2cyclictest0-21swapper/200:15:002
4065656991612,3cyclictest252-21systemd-journal19:26:242
4065656991612,3cyclictest252-21systemd-journal00:00:002
4065653991612,3cyclictest58322-21kworker/u8:1+flush-259:022:55:211
4065651991612,3cyclictest60350irq/132-enp0s29f1:rx-022:10:120
4065651991612,3cyclictest4117490-21kworker/u8:3+flush-259:020:13:000
4065651991612,3cyclictest4117490-21kworker/u8:3+events_unbound20:29:570
406566199159,5cyclictest136867-21latency_hist23:25:013
406566199159,4cyclictest252-21systemd-journal00:09:373
4065661991512,2cyclictest68736-21kworker/u8:3+flush-259:023:05:013
4065661991512,2cyclictest58322-21kworker/u8:1+flush-259:022:45:213
4065661991511,3cyclictest252-21systemd-journal00:10:383
4065661991510,3cyclictest509-21rs:main3
4065656991513,1cyclictest0-21swapper/223:10:002
4065656991512,2cyclictest68736-21kworker/u8:3+flush-259:022:33:562
4065656991512,2cyclictest59299-21irqcore22:10:162
4065656991512,2cyclictest0-21swapper/223:25:012
4065656991511,3cyclictest4179934-21kworker/u8:0+flush-259:021:04:572
4065656991511,3cyclictest4055625-21kworker/u8:1+flush-259:019:36:292
4065656991511,3cyclictest2971-21cron21:10:002
4065653991511,3cyclictest4117491-21kworker/u8:4+flush-259:020:45:191
4065653991511,3cyclictest4055625-21kworker/u8:1+flush-259:019:25:231
4065653991510,4cyclictest4112581-21/usr/sbin/munin19:55:201
4065653991510,4cyclictest126175-21kworker/u8:0+flush-259:023:20:231
4065651991513,1cyclictest60350irq/132-enp0s29f1:rx-023:50:200
4065651991513,1cyclictest60350irq/132-enp0s29f1:rx-023:45:150
4065651991512,2cyclictest60350irq/132-enp0s29f1:rx-023:35:510
4065651991512,2cyclictest4117490-21kworker/u8:3+flush-259:021:45:170
406566199149,3cyclictest4091313-21apt-get19:35:003
4065661991412,1cyclictest110649-21idleruntime-cro23:00:003
4065661991411,2cyclictest147754-21runrttasks23:35:023
406565399148,5cyclictest4075927-21latency_hist19:20:011
4065653991411,2cyclictest4179934-21kworker/u8:0+flush-259:021:05:231
4065653991410,3cyclictest4117491-21kworker/u8:4+flush-259:020:35:171
4065651991412,1cyclictest60350irq/132-enp0s29f1:rx-022:45:310
406566199139,3cyclictest4117490-21kworker/u8:3+flush-259:021:05:163
406566199139,3cyclictest4117490-21kworker/u8:3+flush-259:020:05:223
4065661991311,1cyclictest6784-21sh21:19:593
4065661991310,2cyclictest68736-21kworker/u8:3+flush-259:022:50:233
4065661991310,2cyclictest4117491-21kworker/u8:4+flush-259:020:10:123
4065661991310,2cyclictest4076605-21irqcore19:20:153
406565699139,3cyclictest4065597-21kworker/u8:0+flush-259:019:15:162
406565699137,4cyclictest27830-21latency_hist21:40:002
4065656991310,2cyclictest99443-21ntp_kernel_pll_22:45:212
4065656991310,2cyclictest43881-21irqcore21:55:162
4065656991310,2cyclictest0-21swapper/223:35:012
4065656991310,2cyclictest0-21swapper/220:20:252
406565399139,3cyclictest4117490-21kworker/u8:3+flush-259:021:15:261
406565399139,3cyclictest126175-21kworker/u8:0+flush-259:023:30:111
406565399137,4cyclictest252-21systemd-journal22:30:001
4065653991310,2cyclictest4142805-21unixbench_multi20:20:251
406566199129,2cyclictest4179934-21kworker/u8:0+flush-259:022:15:253
406566199129,2cyclictest4179934-21kworker/u8:0+flush-259:021:40:253
406566199128,3cyclictest4117491-21kworker/u8:4+flush-259:020:25:163
406566199128,2cyclictest120525-21unixbench_multi23:05:253
4065661991210,1cyclictest0-21swapper/319:10:193
406565699129,2cyclictest4179934-21kworker/u8:0+flush-259:021:50:202
406565699129,2cyclictest105480-21idleruntime-cro22:55:002
406565699128,3cyclictest4179934-21kworker/u8:0+flush-259:021:40:252
406565699128,3cyclictest4012886-21kworker/u8:3+flush-259:019:14:552
406565699128,3cyclictest174342-21cpuspeed_turbos00:00:122
406565699127,4cyclictest252-21systemd-journal21:30:222
4065656991210,1cyclictest0-21swapper/221:00:012
406565399129,2cyclictest168355-21idleruntime-cro23:54:591
406565399129,1cyclictest0-21swapper/123:49:591
406565399128,3cyclictest500-21systemd-logind20:35:001
406565399128,3cyclictest4117490-21kworker/u8:3+flush-259:020:40:241
406565699118,2cyclictest4169292-21cpuspeed_turbos20:50:122
406565699118,2cyclictest0-21swapper/223:00:252
406565699118,2cyclictest0-21swapper/222:00:192
406565699118,1cyclictest0-21swapper/219:35:002
406565699115,4cyclictest68992-21apt-get22:20:022
406565399119,1cyclictest0-21swapper/122:35:161
406565399119,1cyclictest0-21swapper/100:20:121
406565399118,2cyclictest4147978-21unixbench_singl20:25:241
406565399118,2cyclictest4118168-21irqcore20:00:171
406566199107,2cyclictest4112699-21cpuspeed_turbos19:55:133
406565699108,1cyclictest4123052-21cpuspeed_turbos20:05:142
406565699107,2cyclictest0-21swapper/200:30:142
406565699107,2cyclictest0-21swapper/200:30:132
406565399106,3cyclictest4070995-21kworker/u8:2+events_unbound19:24:591
406565399101,1cyclictest849482grep22:35:011
406565399100,2cyclictest126137-21latency_hist23:15:021
40656619997,1cyclictest0-21swapper/319:29:593
40656569995,3cyclictest148145-21tune2fs23:35:142
40656539994,3cyclictest252-21systemd-journal21:55:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional