You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 23:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sun Aug 02, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4106934994642,3cyclictest58204-21kworker/u8:4+flush-259:009:55:003
4106934994238,3cyclictest4142956-21kworker/u8:2+events_unbound08:18:333
4106934994238,3cyclictest219724-21kworker/u8:0+flush-259:012:30:263
4106934994238,3cyclictest219724-21kworker/u8:0+flush-259:012:30:253
4106924994236,4cyclictest335557-21systemd-journal09:58:340
4106934994037,2cyclictest4168913-21kworker/u8:0+events_unbound08:55:233
4106934994037,2cyclictest4142956-21kworker/u8:2+events_unbound08:35:263
4106928994037,2cyclictest4168913-21kworker/u8:0+flush-259:009:10:011
4106934993936,2cyclictest173297-21kworker/u8:3+flush-259:011:39:363
4106934993734,2cyclictest4091225-21kworker/u8:2+events_unbound07:25:003
4106934993733,3cyclictest84028-21kworker/u8:2+events_unbound10:12:363
4106924993731,5cyclictest214450-21gpgv12:00:000
4106932993630,4cyclictest4143089-21latency_hist07:45:012
4106928993631,3cyclictest4168913-21kworker/u8:0+flush-259:008:20:181
4106924993629,5cyclictest173330-21apt-get11:20:110
4106934993532,2cyclictest53025-21kworker/u8:1+flush-259:010:15:253
4106934993530,4cyclictest199096-21kworker/u8:1+events_unbound11:57:353
4106928993528,5cyclictest335557-21systemd-journal12:28:351
4106934993431,2cyclictest94205-21kworker/u8:0+events_unbound10:20:253
4106934993431,2cyclictest94205-21kworker/u8:0+events_unbound10:20:253
4106934993431,2cyclictest4091225-21kworker/u8:2+events_unbound07:16:343
4106934993430,3cyclictest84028-21kworker/u8:2+events_unbound10:39:043
4106934993430,3cyclictest4137658-21kworker/u8:3+events_unbound08:09:353
4106934993430,3cyclictest219724-21kworker/u8:0+events_unbound12:14:133
4106934993428,4cyclictest4174069-21latency_hist08:15:013
4106934993427,2cyclictest4137658-21kworker/u8:3+events_unbound07:50:233
4106928993428,4cyclictest203227-21ntpq11:45:231
4106934993329,3cyclictest4142956-21kworker/u8:2+events_unbound08:04:353
4106934993328,4cyclictest4168913-21kworker/u8:0+events_unbound08:21:353
4106934993229,2cyclictest68511-21kworker/u8:0+events_unbound09:44:343
4106934993228,3cyclictest53025-21kworker/u8:1+events_unbound10:28:363
4106934993228,3cyclictest53025-21kworker/u8:1+events_unbound10:28:353
4106934993228,3cyclictest32304-21kworker/u8:3+events_unbound09:35:243
4106924993225,5cyclictest142062-21diskstats10:50:150
4106934993127,3cyclictest199096-21kworker/u8:1+events_unbound11:49:343
4106934993125,4cyclictest11166-21latency_hist08:45:013
4106932993125,4cyclictest95188-21diskstats10:05:132
4106928993127,3cyclictest4137658-21kworker/u8:3+flush-259:008:43:381
4106924993125,4cyclictest94334-21latency_hist10:05:000
4106934993027,2cyclictest84028-21kworker/u8:2+flush-259:011:10:253
4106934993027,2cyclictest84028-21kworker/u8:2+events_unbound10:40:233
4106934993026,3cyclictest84028-21kworker/u8:2+events_unbound10:32:353
4106928993025,3cyclictest214942-21base6412:00:011
4106934992926,2cyclictest53025-21kworker/u8:1+events_unbound09:55:213
4106934992925,3cyclictest53025-21kworker/u8:1+events_unbound10:03:353
4106934992925,3cyclictest4142956-21kworker/u8:2+events_unbound07:48:313
4106934992925,3cyclictest4091225-21kworker/u8:2+events_unbound07:13:423
4106934992925,3cyclictest32304-21kworker/u8:3+events_unbound09:20:253
4106928992924,4cyclictest219724-21kworker/u8:0+flush-259:012:10:001
4106928992924,3cyclictest225421-21/usr/sbin/munin12:10:161
4106928992923,4cyclictest4117505-21apt-get07:20:131
4106934992825,2cyclictest58204-21kworker/u8:4+events_unbound09:33:353
4106934992825,2cyclictest42874-21kworker/u8:2+events_unbound09:15:203
4106934992825,2cyclictest4063532-21kworker/u8:0+events_unbound07:35:203
4106934992820,6cyclictest157231-21cp11:05:003
4106928992824,3cyclictest4137658-21kworker/u8:3+flush-259:008:00:291
4106928992824,3cyclictest209533-21apt-get11:55:121
4106934992724,2cyclictest4168913-21kworker/u8:0+events_unbound08:30:223
4106934992724,2cyclictest4137658-21kworker/u8:3+events_unbound07:58:323
4106932992724,2cyclictest173297-21kworker/u8:3+flush-259:012:35:012
4106932992724,2cyclictest173297-21kworker/u8:3+flush-259:012:35:002
4106928992723,3cyclictest4137658-21kworker/u8:3+flush-259:008:05:301
4106928992721,4cyclictest4158582-21latency_hist08:00:011
4106924992714,11cyclictest157477-21latency_hist11:05:020
4106934992623,2cyclictest53025-21kworker/u8:1+events_unbound09:45:193
4106934992622,3cyclictest199096-21kworker/u8:1+events_unbound12:00:153
4106932992622,3cyclictest53025-21kworker/u8:1+flush-259:010:00:002
4106932992622,3cyclictest53025-21kworker/u8:1+events_unbound10:27:352
4106932992622,3cyclictest53025-21kworker/u8:1+events_unbound10:27:352
4106928992619,5cyclictest4152598-21ntpq07:50:241
4106928992619,5cyclictest335557-21systemd-journal10:15:001
4106928992618,6cyclictest335557-21systemd-journal07:45:001
4106934992522,2cyclictest219724-21kworker/u8:0+events_unbound12:05:223
4106934992522,2cyclictest173297-21kworker/u8:3+events_unbound11:25:203
4106934992521,3cyclictest240933-21/usr/sbin/munin12:25:243
4106932992521,3cyclictest4137658-21kworker/u8:3+events_unbound07:55:002
4106932992521,3cyclictest4137658-21kworker/u8:3+events_unbound07:47:352
4106928992520,4cyclictest168147-21/usr/sbin/munin11:15:161
4106924992519,4cyclictest94973-21cp10:05:010
410692499251,22cyclictest1-21systemd10:36:340
4106934992421,2cyclictest4127617-21kworker/u8:1+events_unbound07:40:113
4106934992420,3cyclictest11191-21kworker/u8:1+events_unbound08:49:333
4106932992421,2cyclictest11191-21kworker/u8:1+flush-259:009:00:252
4106932992420,3cyclictest219724-21kworker/u8:0+flush-259:012:05:342
4106932992420,3cyclictest162771-21kworker/u8:0+events_unbound11:43:352
4106928992419,4cyclictest162995-21apt-get11:10:121
4106928992418,4cyclictest4142956-21kworker/u8:2+flush-259:008:25:171
4106928992418,4cyclictest335557-21systemd-journal09:00:341
4106928992418,4cyclictest335557-21systemd-journal08:58:341
4106924992418,4cyclictest4158845-21apt-get08:00:140
4106924992418,4cyclictest335557-21systemd-journal08:39:330
410692499240,23cyclictest1-21systemd09:15:010
4106934992320,2cyclictest94205-21kworker/u8:0+events_unbound10:05:183
4106934992320,2cyclictest173297-21kworker/u8:3+events_unbound12:38:353
4106934992319,3cyclictest53025-21kworker/u8:1+events_unbound10:45:133
4106932992319,3cyclictest4168913-21kworker/u8:0+events_unbound08:20:352
4106932992319,3cyclictest4091225-21kworker/u8:2+events_unbound07:21:342
4106932992319,3cyclictest199096-21kworker/u8:1+events_unbound11:54:342
4106932992319,2cyclictest68511-21kworker/u8:0+flush-259:009:40:172
4106932992318,3cyclictest4168913-21kworker/u8:0+events_unbound08:50:192
4106928992319,3cyclictest32304-21kworker/u8:3+events_unbound09:25:011
4106924992317,4cyclictest335557-21systemd-journal08:08:440
4106924992316,5cyclictest335557-21systemd-journal10:10:340
4106934992219,2cyclictest204298-21kworker/u8:4+events_unbound12:15:163
4106932992219,3cyclictest173297-21kworker/u8:3+events_unbound11:25:342
4106932992218,3cyclictest68511-21kworker/u8:0+events_unbound09:40:002
4106932992218,3cyclictest4063532-21kworker/u8:0+flush-259:007:35:162
4106932992218,3cyclictest136525-21latency_hist10:45:012
4106932992217,4cyclictest42874-21kworker/u8:2+flush-259:009:25:352
4106932992216,5cyclictest4128000-21diskstats07:30:142
4106932992215,5cyclictest256157-21latency_hist12:40:002
4106932992215,5cyclictest105097-21apt-get10:15:012
4106928992217,4cyclictest73954-21/usr/sbin/munin09:45:151
410692499220,21cyclictest43315-21grep09:15:150
410692499220,21cyclictest1-21systemd11:54:590
410692499220,20cyclictest1-21systemd12:12:340
4106934992118,2cyclictest53025-21kworker/u8:1+flush-259:011:05:193
4106934992117,3cyclictest53025-21kworker/u8:1+events_unbound10:50:173
4106932992117,3cyclictest53025-21kworker/u8:1+events_unbound11:13:352
4106932992117,3cyclictest53025-21kworker/u8:1+events_unbound10:45:232
4106932992114,5cyclictest125358-21ntpq10:30:222
4106928992118,2cyclictest193766-21munin-plugin-st11:40:001
4106928992117,3cyclictest204298-21kworker/u8:4+flush-259:012:15:251
4106928992116,3cyclictest4189803-21/usr/sbin/munin08:30:251
410692899210,19cyclictest1-21systemd12:25:001
4106924992117,3cyclictest335557-21systemd-journal07:23:290
4106924992116,4cyclictest335557-21systemd-journal11:16:350
4106924992116,4cyclictest110948-21apt-get10:20:130
4106924992116,4cyclictest110948-21apt-get10:20:130
4106934992017,2cyclictest53025-21kworker/u8:1+events_unbound11:15:273
4106934992017,2cyclictest4091225-21kworker/u8:2+flush-259:007:28:343
4106932992017,2cyclictest173297-21kworker/u8:3+events_unbound11:55:242
4106932992016,3cyclictest4137658-21kworker/u8:3+events_unbound08:10:342
4106932992016,3cyclictest173297-21kworker/u8:3+events_unbound11:45:242
4106932992015,4cyclictest4168913-21kworker/u8:0+events_unbound09:17:362
4106928992013,5cyclictest162731-21latency_hist11:10:011
410692499201,5cyclictest4107569-21grep07:10:180
410692499201,4cyclictest335557-21systemd-journal08:14:590
4106924992014,4cyclictest4193849-21ntpq08:30:220
4106924992014,4cyclictest178486-21apt-get11:25:110
410692499201,18cyclictest1-21systemd11:30:340
410692499200,5cyclictest83999-21awk09:55:000
410692499200,2cyclictest158987-21grep11:05:180
4106934991916,2cyclictest4063532-21kworker/u8:0+events_unbound07:30:273
4106932991916,2cyclictest53025-21kworker/u8:1+events_unbound10:54:082
4106932991915,3cyclictest84028-21kworker/u8:2+events_unbound11:05:242
4106932991915,3cyclictest4137658-21kworker/u8:3+events_unbound07:55:232
4106932991915,3cyclictest4091225-21kworker/u8:2+flush-259:007:25:202
410692499196,1cyclictest0-21swapper/008:40:140
410692499191,4cyclictest16544-21latency_hist08:50:010
410692499191,4cyclictest151937-21idleruntime-cro11:00:000
410692499191,3cyclictest73719-21turbostat.cron09:45:000
410692499191,3cyclictest335557-21systemd-journal08:30:000
4106924991912,5cyclictest335557-21systemd-journal12:25:000
410692499190,6cyclictest219115-21ntpq12:00:230
410692499190,5cyclictest1-21systemd07:42:330
410692499190,2cyclictest138064-21grep10:45:170
4106934991815,2cyclictest32304-21kworker/u8:3+events_unbound09:28:353
4106932991816,2cyclictest235563-21kworker/u8:1+events_unbound12:27:362
4106932991816,1cyclictest162771-21kworker/u8:0+events_unbound11:30:222
4106932991814,3cyclictest219724-21kworker/u8:0+events_unbound12:24:182
4106932991814,2cyclictest94205-21kworker/u8:0+flush-259:010:10:182
4106932991812,4cyclictest234629-21ntpq12:15:232
4106928991815,2cyclictest4174076-21idleruntime-cro08:14:591
4106928991812,4cyclictest63389-21latency_hist09:35:011
4106928991811,5cyclictest335557-21systemd-journal10:30:011
4106928991811,5cyclictest335557-21systemd-journal10:30:001
410692499184,3cyclictest73978-21apt09:45:140
410692499184,3cyclictest28994-21tr09:00:180
410692499181,6cyclictest235074-21grep12:15:260
410692499181,5cyclictest125320-21ntpq10:30:210
410692499181,4cyclictest136002-21/usr/sbin/munin10:40:240
410692499181,3cyclictest68519-21cron09:40:000
410692499181,3cyclictest4158563-21cron07:59:590
4106924991813,4cyclictest60350irq/132-enp0s29f1:rx-011:44:000
4106924991812,4cyclictest57253-21ntpq09:25:200
410692499180,5cyclictest4148953-21irqcore07:50:180
410692499180,5cyclictest109768-21ntpq10:15:210
410692499180,4cyclictest4184384-21cron08:25:000
410692499180,4cyclictest21450-21grep08:50:250
410692499180,4cyclictest193760-21turbostat.cron11:40:000
4106934991714,2cyclictest4168913-21kworker/u8:0+events_unbound08:50:173
4106934991714,2cyclictest4106919-21cyclictest09:10:263
4106934991713,3cyclictest4142956-21kworker/u8:2+events_unbound08:26:033
4106932991714,2cyclictest126893-21irqcore10:35:172
4106932991714,2cyclictest11853-21irqcore08:45:152
4106932991713,3cyclictest58204-21kworker/u8:4+events_unbound09:31:362
4106932991713,3cyclictest4168913-21kworker/u8:0+events_unbound08:25:352
4106932991713,3cyclictest4091225-21kworker/u8:2+events_unbound07:12:342
4106932991712,4cyclictest58204-21kworker/u8:4+events_unbound09:52:362
4106928991714,2cyclictest58204-21kworker/u8:4+events_unbound09:50:211
4106928991714,2cyclictest246522-21irqcore12:30:161
4106928991714,2cyclictest246522-21irqcore12:30:161
410692499175,1cyclictest0-21swapper/007:15:150
410692499173,3cyclictest33524-21cut09:05:170
4106924991714,2cyclictest60350irq/132-enp0s29f1:rx-012:26:360
4106924991712,4cyclictest60350irq/132-enp0s29f1:rx-011:45:210
410692499170,6cyclictest4126685-21ntpq07:25:220
410692499170,5cyclictest4178363-21ld08:15:220
410692499170,4cyclictest4148258-21awk07:49:590
4106934991613,3cyclictest53025-21kworker/u8:1+events_unbound10:56:403
410693299161,8cyclictest4168896-21idleruntime-cro08:10:002
4106932991613,2cyclictest4168913-21kworker/u8:0+events_unbound08:55:182
4106932991612,3cyclictest58204-21kworker/u8:4+flush-259:010:00:352
4106932991611,4cyclictest42874-21kworker/u8:2+events_unbound09:24:352
4106928991612,3cyclictest94205-21kworker/u8:0+flush-259:010:21:061
4106928991612,3cyclictest94205-21kworker/u8:0+flush-259:010:21:061
4106928991612,3cyclictest94205-21kworker/u8:0+events_unbound10:05:001
4106928991612,3cyclictest4063532-21kworker/u8:0+flush-259:007:30:241
4106928991612,3cyclictest1524-21cut08:35:181
4106928991612,2cyclictest0-21swapper/112:40:011
410692499160,2cyclictest4132533-21sshd07:32:330
4106934991512,2cyclictest11191-21kworker/u8:1+events_unbound09:05:303
4106932991511,3cyclictest4168913-21kworker/u8:0+events_unbound08:32:342
4106932991511,3cyclictest4137658-21kworker/u8:3+events_unbound08:35:152
4106932991511,2cyclictest4142956-21kworker/u8:2+flush-259:008:00:182
4106932991510,4cyclictest94205-21kworker/u8:0+events_unbound10:20:232
4106932991510,4cyclictest94205-21kworker/u8:0+events_unbound10:20:232
4106932991510,4cyclictest219724-21kworker/u8:0+events_unbound12:11:342
4106932991510,3cyclictest32548-21apt-get09:05:132
4106928991512,2cyclictest40032-21kthreadcore09:10:191
4106928991511,3cyclictest152209-21apt-get11:00:121
4106928991511,3cyclictest11191-21kworker/u8:1+flush-259:008:46:391
410692499158,5cyclictest246275-21diskstats12:30:140
410692499158,5cyclictest246275-21diskstats12:30:140
4106924991513,1cyclictest60350irq/132-enp0s29f1:rx-012:05:140
4106924991513,1cyclictest60350irq/132-enp0s29f1:rx-007:35:160
4106924991512,2cyclictest60350irq/132-enp0s29f1:rx-012:37:520
410693499148,4cyclictest509-21rs:main3
4106934991412,1cyclictest185971-21kthreadcore11:30:173
410693299149,4cyclictest11191-21kworker/u8:1+events_unbound09:13:362
4106932991411,2cyclictest4137658-21kworker/u8:3+flush-259:008:40:252
4106932991411,2cyclictest173297-21kworker/u8:3+events_unbound11:35:252
4106932991410,3cyclictest53025-21kworker/u8:1+events_unbound11:18:352
410692899149,4cyclictest4063532-21kworker/u8:0+flush-259:007:35:241
410692899148,4cyclictest141638-21latency_hist10:50:011
4106928991412,1cyclictest4123070-21irqcore07:25:171
4106928991411,2cyclictest43316-21irqcore09:15:151
410692499142,2cyclictest162995-21apt-get11:10:130
4106924991411,2cyclictest60350irq/132-enp0s29f1:rx-009:30:210
4106924991411,2cyclictest60350irq/132-enp0s29f1:rx-008:55:230
410693499137,4cyclictest335557-21systemd-journal12:20:343
4106934991310,2cyclictest199096-21kworker/u8:1+events_unbound11:50:193
4106934991310,2cyclictest162771-21kworker/u8:0+flush-259:011:40:273
410693299139,3cyclictest84028-21kworker/u8:2+flush-259:011:00:252
4106932991310,2cyclictest53025-21kworker/u8:1+events_unbound09:45:152
4106932991310,2cyclictest4174555-21fschecks_time08:15:142
410692899139,3cyclictest84028-21kworker/u8:2+events_unbound10:35:191
410692899138,4cyclictest16949-21cat08:50:011
4106928991312,0cyclictest0-21swapper/111:45:001
4106928991310,2cyclictest2971-21cron10:45:001
4106928991310,2cyclictest0-21swapper/110:50:181
410692899130,6cyclictest89193-21cron10:00:001
4106924991310,2cyclictest60350irq/132-enp0s29f1:rx-009:20:130
410693499128,3cyclictest4168913-21kworker/u8:0+events_unbound09:02:323
410693299128,3cyclictest173297-21kworker/u8:3+events_unbound11:20:182
410692899129,2cyclictest73278-21unixbench_singl09:40:251
410692899129,2cyclictest0-21swapper/107:15:011
410692899120,3cyclictest4148272-21awk07:49:591
410692899118,2cyclictest123610-21kthreadcore10:30:181
410693299104,4cyclictest335557-21systemd-journal07:15:332
410692899107,2cyclictest0-21swapper/109:30:011
410692899104,4cyclictest95025-21apt-get10:05:111
41069289995,3cyclictest4112344-21/usr/sbin/munin07:15:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional