You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-10 - 21:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Aug 10, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3976660995148,2cyclictest75-21kswapd009:51:383
3976653994941,5cyclictest4080365-21latency_hist08:50:012
3976648994741,4cyclictest4173759-21latency_hist10:20:001
3976646994542,2cyclictest21205-21kworker/u8:2+flush-259:011:25:010
3976648994337,4cyclictest4095853-21latency_hist09:05:011
3976646994037,2cyclictest4189245-21kworker/u8:0+events_unbound10:50:150
3976646994037,2cyclictest4189245-21kworker/u8:0+events_unbound10:50:150
3976646994035,4cyclictest4137427-21apt-get09:45:120
3976646993936,2cyclictest4152282-21kworker/u8:0+flush-259:010:05:000
3976646993936,2cyclictest4013068-21kworker/u8:1+events_unbound08:00:160
3976660993833,3cyclictest4080615-21/usr/sbin/munin08:50:163
3976648993831,5cyclictest335557-21systemd-journal10:55:001
3976648993831,5cyclictest335557-21systemd-journal10:55:001
3976646993734,2cyclictest3976587-21kworker/u8:2+flush-259:009:55:160
3976660993632,3cyclictest72406-21kworker/u8:0+flush-259:012:10:213
3976646993633,2cyclictest3982038-21kworker/u8:0+events_unbound07:15:230
3976660993529,4cyclictest335557-21systemd-journal08:25:003
3976648993530,3cyclictest4038890-21kworker/u8:0+flush-259:008:35:171
3976660993431,2cyclictest4189245-21kworker/u8:0+events_unbound10:53:213
3976660993431,2cyclictest4189245-21kworker/u8:0+events_unbound10:53:203
3976646993430,3cyclictest4007588-21kworker/u8:0+events_unbound07:50:120
3976660993330,2cyclictest3976587-21kworker/u8:2+flush-259:009:40:233
3976646993327,4cyclictest31468-21latency_hist11:10:010
3976660993229,2cyclictest31275-21kworker/u8:1+flush-259:011:15:003
3976648993227,3cyclictest42046-21apt-get11:20:131
3976646993230,1cyclictest211rcuc/008:29:560
3976646993230,1cyclictest211rcuc/008:29:560
3976646993229,2cyclictest41804-21kworker/u8:3+flush-259:011:30:000
3976646993228,3cyclictest41804-21kworker/u8:3+flush-259:011:30:150
3976648993126,4cyclictest3976587-21kworker/u8:2+flush-259:008:10:171
3976646993129,2cyclictest4158322-21kworker/u8:3+events_unbound10:35:010
3976646993128,2cyclictest41804-21kworker/u8:3+events_unbound12:05:210
3976646993127,3cyclictest4168601-21kworker/u8:2+flush-259:010:20:050
3976646993127,3cyclictest4111362-21kworker/u8:1+flush-259:009:20:210
3976653993026,3cyclictest4158322-21kworker/u8:3+flush-259:010:35:152
3976648993024,4cyclictest5889-21apt-get10:45:131
3976646993027,2cyclictest3992254-21kworker/u8:1+flush-259:007:35:160
3976646993025,4cyclictest4132245-21/usr/sbin/munin09:40:130
3976660992926,2cyclictest72406-21kworker/u8:0+flush-259:012:05:003
3976653992924,4cyclictest4013068-21kworker/u8:1+events_unbound08:00:122
397665399290,27cyclictest1-21systemd07:30:002
3976648992925,3cyclictest67836-21apt-get11:45:111
3976648992924,3cyclictest335557-21systemd-journal11:36:361
3976646992925,3cyclictest4033427-21kworker/u8:3+events_unbound08:15:240
3976660992824,3cyclictest3922853-21kworker/u8:1+events_unbound07:14:353
3976648992821,4cyclictest3981806-21latency_hist07:15:011
3976646992825,2cyclictest77908-21kworker/u8:1+events_unbound12:30:190
3976646992825,2cyclictest4013068-21kworker/u8:1+events_unbound07:55:140
3976646992824,3cyclictest77908-21kworker/u8:1+events_unbound12:24:420
3976646992823,4cyclictest335557-21systemd-journal08:40:350
3976646992822,4cyclictest4011931-21ntpq07:40:200
3976660992724,2cyclictest3976587-21kworker/u8:2+flush-259:009:27:053
3976660992723,3cyclictest41804-21kworker/u8:3+flush-259:011:35:003
3976660992723,3cyclictest4111362-21kworker/u8:1+events_unbound09:20:363
3976660992721,4cyclictest93804-21latency_hist12:10:023
3976653992724,2cyclictest4007588-21kworker/u8:0+flush-259:007:50:162
3976653992723,3cyclictest4189245-21kworker/u8:0+events_unbound11:04:362
3976646992724,2cyclictest31275-21kworker/u8:1+events_unbound11:15:170
3976653992622,3cyclictest3976587-21kworker/u8:2+flush-259:009:00:002
3976646992623,2cyclictest4070249-21kworker/u8:3+events_unbound09:20:000
3976646992623,2cyclictest3976587-21kworker/u8:2+events_unbound07:45:010
3976646992623,2cyclictest211rcuc/011:15:000
3976646992622,3cyclictest41804-21kworker/u8:3+events_unbound11:45:130
3976646992622,3cyclictest4158322-21kworker/u8:3+flush-259:010:45:220
3976646992622,3cyclictest4095873-21kworker/u8:0+flush-259:009:05:210
3976646992622,3cyclictest3976587-21kworker/u8:2+events_unbound08:53:360
3976660992522,2cyclictest4168601-21kworker/u8:2+flush-259:010:25:253
3976660992521,3cyclictest21205-21kworker/u8:2+events_unbound11:19:363
3976660992520,4cyclictest335557-21systemd-journal08:38:353
3976653992521,3cyclictest4070249-21kworker/u8:3+events_unbound08:45:002
3976648992519,4cyclictest335557-21systemd-journal11:30:011
3976648992518,4cyclictest3991298-21ntpq07:20:211
3976648992516,6cyclictest118696-21ntpq12:30:231
3976646992522,2cyclictest4152282-21kworker/u8:0+flush-259:010:00:150
3976660992421,2cyclictest4007588-21kworker/u8:0+events_unbound07:45:113
3976660992421,2cyclictest335557-21systemd-journal08:49:533
3976660992420,3cyclictest41804-21kworker/u8:3+events_unbound12:22:443
3976660992418,4cyclictest335557-21systemd-journal11:22:353
3976653992421,2cyclictest21205-21kworker/u8:2+events_unbound11:30:012
3976653992420,3cyclictest4038890-21kworker/u8:0+events_unbound08:35:172
3976653992418,4cyclictest88217-21latency_hist12:05:012
3976648992419,4cyclictest4095873-21kworker/u8:0+flush-259:009:05:241
3976648992419,4cyclictest4069811-21kworker/u8:1+flush-259:008:45:211
3976646992421,2cyclictest21205-21kworker/u8:2+events_unbound11:40:210
3976646992420,3cyclictest3992254-21kworker/u8:1+flush-259:007:30:180
3976646992420,3cyclictest3976587-21kworker/u8:2+events_unbound08:10:170
3976646992419,3cyclictest4163720-21apt-get10:10:120
3976646992419,3cyclictest21205-21kworker/u8:2+events_unbound11:54:360
3976660992320,2cyclictest3976587-21kworker/u8:2+flush-259:007:24:393
3976660992319,3cyclictest41804-21kworker/u8:3+events_unbound11:38:363
3976660992319,3cyclictest4142358-21kworker/u8:1+events_unbound10:04:353
3976660992319,3cyclictest3976587-21kworker/u8:2+events_unbound09:30:183
3976653992319,3cyclictest4111362-21kworker/u8:1+flush-259:009:25:002
3976653992319,3cyclictest4033427-21kworker/u8:3+events_unbound08:28:322
3976653992319,3cyclictest4033427-21kworker/u8:3+events_unbound08:28:322
3976653992319,3cyclictest4033427-21kworker/u8:3+events_unbound08:05:332
3976648992318,3cyclictest83303-21/usr/sbin/munin12:00:161
3976648992317,4cyclictest62682-21apt-get11:40:121
3976648992317,4cyclictest4158570-21apt-get10:05:131
3976646992319,2cyclictest77908-21kworker/u8:1+events_unbound12:15:160
3976646992318,4cyclictest41804-21kworker/u8:3+events_unbound12:00:270
3976653992218,3cyclictest4158322-21kworker/u8:3+events_unbound10:26:362
3976653992218,3cyclictest4095873-21kworker/u8:0+events_unbound09:07:362
3976653992218,3cyclictest3976587-21kworker/u8:2+events_unbound09:17:372
3976653992218,3cyclictest3976587-21kworker/u8:2+events_unbound09:14:362
3976648992219,2cyclictest4013068-21kworker/u8:1+flush-259:008:00:251
3976648992217,3cyclictest72970-21apt-get11:50:121
3976648992217,3cyclictest3976587-21kworker/u8:2+flush-259:009:20:161
3976648992217,3cyclictest335557-21systemd-journal08:09:311
3976646992219,2cyclictest77908-21kworker/u8:1+events_unbound12:27:410
3976646992219,2cyclictest4189245-21kworker/u8:0+flush-259:010:55:240
3976646992219,2cyclictest41804-21kworker/u8:3+events_unbound11:35:250
3976646992219,2cyclictest3976587-21kworker/u8:2+events_unbound09:10:190
3976660992119,2cyclictest77908-21kworker/u8:1+flush-259:012:30:263
3976660992117,3cyclictest41804-21kworker/u8:3+flush-259:011:47:073
3976660992117,3cyclictest4095873-21kworker/u8:0+events_unbound09:09:353
3976660992117,3cyclictest3976587-21kworker/u8:2+events_unbound08:55:313
3976660992117,3cyclictest3976587-21kworker/u8:2+events_unbound08:04:553
3976660992117,3cyclictest335557-21systemd-journal07:34:413
3976653992117,3cyclictest4158322-21kworker/u8:3+events_unbound10:45:192
3976653992117,3cyclictest4131641-21kworker/u8:3+flush-259:009:50:202
3976653992117,3cyclictest3976587-21kworker/u8:2+events_unbound07:40:152
3976653992116,4cyclictest41804-21kworker/u8:3+events_unbound11:45:152
3976648992117,3cyclictest4158322-21kworker/u8:3+events_unbound10:40:181
3976648992117,3cyclictest3976587-21kworker/u8:2+events_unbound08:30:001
3976648992117,3cyclictest3976587-21kworker/u8:2+events_unbound08:30:001
3976646992117,3cyclictest72406-21kworker/u8:0+events_unbound11:55:280
3976646992117,3cyclictest4158322-21kworker/u8:3+events_unbound10:15:380
3976646992117,3cyclictest3976588-21kworker/u8:4+events_unbound07:21:100
3976646992117,3cyclictest3976587-21kworker/u8:2+events_unbound09:51:400
3976646992117,3cyclictest3976587-21kworker/u8:2+events_unbound08:09:550
3976646992117,3cyclictest109308-21kworker/u8:0+events_unbound12:39:410
3976646992116,4cyclictest2971-21cron09:35:000
3976646992115,4cyclictest4091126-21diskstats09:00:150
3976660992017,2cyclictest41804-21kworker/u8:3+events_unbound11:25:193
3976660992017,2cyclictest4158322-21kworker/u8:3+flush-259:010:45:253
3976660992017,2cyclictest4158322-21kworker/u8:3+events_unbound10:32:373
3976660992017,2cyclictest4070249-21kworker/u8:3+events_unbound09:00:033
3976660992017,2cyclictest3992254-21kworker/u8:1+events_unbound07:35:233
3976660992016,3cyclictest4070249-21kworker/u8:3+flush-259:009:18:453
3976660992016,3cyclictest109308-21kworker/u8:0+events_unbound12:35:423
3976653992017,2cyclictest72406-21kworker/u8:0+flush-259:012:10:012
3976653992017,2cyclictest41804-21kworker/u8:3+events_unbound11:30:242
3976653992017,2cyclictest3976587-21kworker/u8:2+flush-259:008:10:242
3976653992017,2cyclictest109308-21kworker/u8:0+flush-259:012:35:252
3976653992016,3cyclictest77908-21kworker/u8:1+flush-259:012:30:252
3976653992016,3cyclictest4142358-21kworker/u8:1+events_unbound10:17:352
3976653992016,3cyclictest3976587-21kworker/u8:2+flush-259:009:30:162
3976653992015,4cyclictest4189245-21kworker/u8:0+flush-259:011:05:152
3976648992015,3cyclictest4059543-21apt-get08:30:121
3976648992013,5cyclictest335557-21systemd-journal10:10:081
3976646992017,2cyclictest4059509-21kworker/u8:4+events_unbound08:33:360
3976646992016,3cyclictest72406-21kworker/u8:0+events_unbound12:10:230
3976646992016,3cyclictest4038890-21kworker/u8:0+flush-259:008:35:230
3976646992016,3cyclictest3976588-21kworker/u8:4+events_unbound07:12:120
3976660991917,1cyclictest0-21swapper/310:00:013
3976660991916,2cyclictest4158322-21kworker/u8:3+flush-259:010:57:053
3976660991916,2cyclictest4033427-21kworker/u8:3+flush-259:008:25:153
3976660991916,2cyclictest4033427-21kworker/u8:3+flush-259:008:25:153
3976660991915,3cyclictest4158322-21kworker/u8:3+flush-259:010:15:183
3976660991915,3cyclictest4158322-21kworker/u8:3+events_unbound10:22:363
3976660991914,4cyclictest4106185-21latency_hist09:15:013
397666099190,17cyclictest77886-21unin-run11:55:003
3976653991916,2cyclictest77908-21kworker/u8:1+events_unbound12:17:422
3976653991916,2cyclictest4070249-21kworker/u8:3+events_unbound09:03:372
3976653991915,3cyclictest4189245-21kworker/u8:0+events_unbound10:55:192
3976653991915,3cyclictest4158322-21kworker/u8:3+events_unbound10:10:162
3976653991915,3cyclictest4152282-21kworker/u8:0+events_unbound10:00:152
3976653991915,3cyclictest4070249-21kworker/u8:3+events_unbound08:50:022
3976653991915,3cyclictest3976587-21kworker/u8:2+events_unbound09:45:182
3976653991914,4cyclictest4189245-21kworker/u8:0+events_unbound10:51:372
3976653991914,4cyclictest4189245-21kworker/u8:0+events_unbound10:51:362
3976653991914,4cyclictest4158322-21kworker/u8:3+events_unbound10:31:362
3976648991914,3cyclictest3976587-21kworker/u8:2+flush-259:009:45:061
3976648991912,5cyclictest401-21latency_hist10:40:001
3976660991814,3cyclictest4152282-21kworker/u8:0+events_unbound10:05:143
3976660991814,3cyclictest4033427-21kworker/u8:3+flush-259:008:15:253
3976660991814,3cyclictest3976588-21kworker/u8:4+events_unbound07:25:303
3976653991814,3cyclictest72406-21kworker/u8:0+flush-259:011:55:262
3976653991814,3cyclictest3992254-21kworker/u8:1+events_unbound07:39:122
3976653991814,3cyclictest3976587-21kworker/u8:2+events_unbound07:22:102
3976653991814,3cyclictest31275-21kworker/u8:1+events_unbound11:10:132
3976646991815,2cyclictest4168601-21kworker/u8:2+events_unbound10:38:030
3976646991812,4cyclictest4158322-21kworker/u8:3+flush-259:010:27:050
3976660991713,3cyclictest3976587-21kworker/u8:2+flush-259:009:45:263
3976660991711,5cyclictest335557-21systemd-journal07:20:013
3976653991715,1cyclictest3976587-21kworker/u8:2+events_unbound09:35:192
3976653991713,3cyclictest3976587-21kworker/u8:2+flush-259:009:25:242
3976648991714,2cyclictest106702-21kthreadcore12:20:191
3976648991713,3cyclictest72406-21kworker/u8:0+flush-259:012:06:131
3976648991713,2cyclictest3976587-21kworker/u8:2+flush-259:009:15:191
3976646991713,3cyclictest5429-21kworker/u8:4+events_unbound10:44:200
3976646991713,3cyclictest3992254-21kworker/u8:1+events_unbound07:28:110
3976660991613,2cyclictest41804-21kworker/u8:3+flush-259:012:15:103
3976660991612,3cyclictest4131641-21kworker/u8:3+events_unbound09:37:373
3976660991611,4cyclictest4069590-21apt-get08:40:013
3976653991612,3cyclictest4152282-21kworker/u8:0+flush-259:010:05:222
3976653991612,3cyclictest4013068-21kworker/u8:1+events_unbound07:55:122
3976653991612,3cyclictest4007588-21kworker/u8:0+events_unbound07:45:242
3976653991612,3cyclictest3976587-21kworker/u8:2+flush-259:009:40:322
3976653991612,3cyclictest31275-21kworker/u8:1+events_unbound11:17:362
3976648991613,2cyclictest96369-21kthreadcore12:10:181
3976648991610,4cyclictest4152839-21base6410:00:001
3976648991610,4cyclictest4049235-21apt-get08:20:121
3976646991613,2cyclictest60350irq/132-enp0s29f1:rx-008:20:200
3976646991613,2cyclictest3976587-21kworker/u8:2+events_unbound09:29:370
3976660991512,2cyclictest3976587-21kworker/u8:2+events_unbound08:10:133
3976660991511,3cyclictest4189245-21kworker/u8:0+events_unbound11:02:363
3976660991511,3cyclictest4059509-21kworker/u8:4+events_unbound08:34:573
3976653991513,2cyclictest4158322-21kworker/u8:3+events_unbound10:40:222
3976653991512,2cyclictest4158322-21kworker/u8:3+flush-259:010:20:362
3976653991512,2cyclictest3982038-21kworker/u8:0+flush-259:007:15:192
3976653991512,2cyclictest21205-21kworker/u8:2+flush-259:011:25:002
3976653991511,3cyclictest4033427-21kworker/u8:3+events_unbound08:20:202
3976648991510,3cyclictest3992254-21kworker/u8:1+flush-259:007:35:251
3976660991411,2cyclictest5429-21kworker/u8:4+events_unbound10:44:363
3976660991411,2cyclictest4142358-21kworker/u8:1+events_unbound10:14:353
3976660991410,3cyclictest4158322-21kworker/u8:3+events_unbound10:35:173
3976653991411,2cyclictest3976588-21kworker/u8:4+flush-259:007:10:262
3976653991410,3cyclictest4148027-21fschecks_time09:55:152
397665399140,6cyclictest114439-21apt12:29:592
397664899149,3cyclictest4069811-21kworker/u8:1+flush-259:008:50:261
397664899149,3cyclictest335557-21systemd-journal10:33:361
3976646991410,3cyclictest4070249-21kworker/u8:3+events_unbound08:46:080
397666099139,3cyclictest72406-21kworker/u8:0+flush-259:011:55:323
397666099139,3cyclictest4013068-21kworker/u8:1+flush-259:007:54:513
3976660991310,2cyclictest4038235-21unixbench_singl08:05:263
3976660991310,2cyclictest21205-21kworker/u8:2+flush-259:011:40:573
397665399139,3cyclictest4059509-21kworker/u8:4+events_unbound08:30:232
397665399139,3cyclictest21205-21kworker/u8:2+events_unbound11:37:352
3976653991310,2cyclictest3976588-21kworker/u8:4+events_unbound07:34:362
3976653991310,2cyclictest108860-21unixbench_singl12:20:262
397664899139,3cyclictest4189245-21kworker/u8:0+flush-259:011:00:241
397664899139,2cyclictest4120776-21ntp_kernel_pll_09:25:211
397664899136,5cyclictest4044053-21/usr/sbin/munin08:15:231
3976648991311,1cyclictest0-21swapper/111:15:151
3976648991310,2cyclictest4027367-21cut07:55:181
397666099129,2cyclictest4189245-21kworker/u8:0+flush-259:011:05:243
397666099128,3cyclictest4007588-21kworker/u8:0+events_unbound07:44:453
397666099127,4cyclictest41804-21kworker/u8:3+events_unbound12:25:193
397665399128,3cyclictest21205-21kworker/u8:2+flush-259:011:43:062
397664899129,2cyclictest4069811-21kworker/u8:1+flush-259:008:55:211
397664899127,3cyclictest4179161-21apt-get10:25:121
397664899126,4cyclictest120267-21tr12:35:161
3976648991210,1cyclictest0-21swapper/109:45:001
397666099117,3cyclictest4013068-21kworker/u8:1+flush-259:007:55:163
397665399118,2cyclictest77908-21kworker/u8:1+flush-259:012:12:112
397664899118,2cyclictest0-21swapper/109:50:161
397664899116,3cyclictest335557-21systemd-journal07:40:111
397664899115,4cyclictest490-21dbus-daemon08:45:001
397664899111,8cyclictest3987010-21latency_hist07:20:001
397665399106,3cyclictest3976587-21kworker/u8:2+events_unbound08:17:332
397664899106,3cyclictest3976587-21kworker/u8:2+flush-259:009:30:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional