You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-26 - 18:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Fri Jun 26, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3169170994845,2cyclictest3503320-21kworker/u8:0+events_unbound12:32:331
3169170994643,2cyclictest3314330-21kworker/u8:0+events_unbound11:08:231
3169170994542,2cyclictest3366342-21kworker/u8:1+events_unbound10:51:231
3169178994431,11cyclictest3330183-21latency_hist09:45:003
3169170994439,4cyclictest3424572-21latency_hist11:15:011
3169173994339,3cyclictest3503320-21kworker/u8:0+events_unbound12:33:342
3169173994339,3cyclictest3314330-21kworker/u8:0+flush-259:010:05:202
3169170994341,2cyclictest3314330-21kworker/u8:0+events_unbound11:44:141
3169173994239,2cyclictest3366342-21kworker/u8:1+flush-259:010:55:002
3169173994237,3cyclictest3482549-21base6412:10:002
3169170994239,2cyclictest3314330-21kworker/u8:0+events_unbound11:01:231
3169170994037,2cyclictest3314330-21kworker/u8:0+events_unbound12:09:181
3169170994037,2cyclictest3236617-21kworker/u8:3+events_unbound08:25:011
3169168994036,3cyclictest3262209-21kworker/u8:2+flush-259:008:55:210
3169178993931,6cyclictest3335502-21gpgv09:50:003
3169170993936,2cyclictest3314330-21kworker/u8:0+events_unbound11:54:261
3169168993935,3cyclictest3314330-21kworker/u8:0+flush-259:010:05:000
3169173993835,2cyclictest3293710-21kworker/u8:2+flush-259:009:25:212
3169168993831,5cyclictest3360706-21ntpq10:10:200
3169173993733,3cyclictest3451068-21kworker/u8:4+flush-259:012:00:212
3169178993630,4cyclictest3236626-21/usr/sbin/munin08:15:143
3169170993631,3cyclictest3445454-21/usr/sbin/munin11:35:141
3169178993528,5cyclictest3231245-21latency_hist08:10:003
3169173993532,2cyclictest3350339-21kworker/u8:2+events_unbound11:15:142
3169170993533,2cyclictest3262446-21kworker/u8:4+events_unbound09:39:221
3169170993531,3cyclictest3314330-21kworker/u8:0+flush-259:012:10:161
3169168993533,1cyclictest3189906-21kworker/0:0+pm08:02:220
3169178993428,4cyclictest3340044-21ntpq09:50:203
3169173993431,2cyclictest3350339-21kworker/u8:2+flush-259:010:15:202
3169173993330,2cyclictest3262209-21kworker/u8:2+events_unbound08:55:222
3169170993330,2cyclictest3190055-21kworker/u8:4+events_unbound07:38:371
3169168993329,3cyclictest3314330-21kworker/u8:0+flush-259:010:40:230
3169173993228,3cyclictest3356662-21kworker/u8:4+flush-259:011:00:222
3169173993227,4cyclictest3200190-21latency_hist07:40:002
3169168993226,4cyclictest3476923-21dpkg12:02:190
3169173993128,2cyclictest3356662-21kworker/u8:4+events_unbound11:12:232
3169173993128,2cyclictest3314330-21kworker/u8:0+flush-259:011:25:162
3169173993128,2cyclictest3246765-21kworker/u8:0+events_unbound08:45:232
3169173993128,2cyclictest3171706-21kworker/u8:3+flush-259:007:20:242
3169173993127,3cyclictest3314330-21kworker/u8:0+flush-259:011:50:002
3169168993127,3cyclictest3493352-21kworker/u8:2+flush-259:012:35:160
3169168993125,4cyclictest335557-21systemd-journal07:45:000
3169168993124,5cyclictest335557-21systemd-journal09:25:010
3169178993025,4cyclictest3467045-21kworker/u8:3+flush-259:012:17:333
3169170993028,2cyclictest3293710-21kworker/u8:2+events_unbound09:26:341
3169170993027,2cyclictest3451068-21kworker/u8:4+events_unbound11:49:061
3169170993027,2cyclictest3230292-21kworker/u8:2+events_unbound08:34:101
3169168993027,2cyclictest3356662-21kworker/u8:4+flush-259:011:10:000
3169168993025,3cyclictest3336001-21base6409:50:010
3169173992926,2cyclictest3299609-21kworker/u8:1+flush-259:009:15:212
3169173992926,2cyclictest3221522-21kworker/u8:0+flush-259:008:04:592
3169173992922,3cyclictest3184665-21kworker/u8:1+events_unbound07:25:212
3169170992927,2cyclictest3299609-21kworker/u8:1+events_unbound09:43:301
3169170992926,2cyclictest3299609-21kworker/u8:1+events_unbound09:16:111
3169170992926,2cyclictest3210223-21kworker/u8:1+events_unbound08:09:221
3169170992925,3cyclictest3171706-21kworker/u8:3+events_unbound07:10:401
3169170992923,4cyclictest3204465-21ntpq07:40:211
3169173992824,3cyclictest3493352-21kworker/u8:2+events_unbound12:24:292
3169170992821,5cyclictest3277741-21latency_hist08:55:001
3169168992825,2cyclictest3230292-21kworker/u8:2+events_unbound08:25:170
3169168992825,2cyclictest211rcuc/007:50:000
3169173992724,2cyclictest3493352-21kworker/u8:2+flush-259:012:35:202
3169173992724,2cyclictest3299609-21kworker/u8:1+flush-259:009:35:112
3169173992723,3cyclictest3350339-21kworker/u8:2+events_unbound11:20:182
3169173992723,3cyclictest3314330-21kworker/u8:0+events_unbound09:54:242
3169173992723,3cyclictest3171706-21kworker/u8:3+events_unbound07:11:222
3169170992724,2cyclictest3503320-21kworker/u8:0+events_unbound12:29:551
3169170992724,2cyclictest3440097-21kworker/u8:1+events_unbound11:56:331
3169170992724,2cyclictest3314330-21kworker/u8:0+events_unbound11:21:241
3169170992724,2cyclictest3314330-21kworker/u8:0+events_unbound10:03:421
3169170992724,2cyclictest3277778-21kworker/u8:1+events_unbound09:03:231
3169168992724,2cyclictest3262446-21kworker/u8:4+flush-259:008:40:160
3169168992721,4cyclictest3430020-21apt-get11:20:110
3169168992721,4cyclictest3299078-21/usr/sbin/munin09:15:130
3169178992622,3cyclictest3205585-21/usr/sbin/munin07:45:163
3169173992623,2cyclictest3314330-21kworker/u8:0+events_unbound12:10:202
3169173992623,2cyclictest3262446-21kworker/u8:4+flush-259:009:05:152
3169173992623,2cyclictest3236406-21systemd-run08:15:002
3169173992623,2cyclictest3236406-21systemd-run08:14:592
3169173992623,2cyclictest3230292-21kworker/u8:2+flush-259:008:25:232
3169173992622,3cyclictest3467045-21kworker/u8:3+flush-259:012:20:002
3169170992623,2cyclictest3366342-21kworker/u8:1+events_unbound10:31:231
3169170992623,2cyclictest3314330-21kworker/u8:0+events_unbound11:34:231
3169170992620,5cyclictest3231473-21/usr/sbin/munin08:10:141
3169170992620,5cyclictest3231473-21/usr/sbin/munin08:10:141
3169168992624,1cyclictest3451068-21kworker/u8:4+events_unbound11:49:150
3169168992622,3cyclictest3293710-21kworker/u8:2+flush-259:009:30:010
3169168992621,4cyclictest3356662-21kworker/u8:4+events_unbound10:49:240
3169178992518,5cyclictest335557-21systemd-journal10:50:003
3169173992522,2cyclictest3314330-21kworker/u8:0+events_unbound10:10:232
3169173992522,2cyclictest3230292-21kworker/u8:2+events_unbound08:33:452
3169173992521,3cyclictest3314330-21kworker/u8:0+flush-259:010:24:242
3169173992521,3cyclictest3314330-21kworker/u8:0+events_unbound11:09:092
3169173992521,3cyclictest3262446-21kworker/u8:4+flush-259:008:40:232
3169173992518,2cyclictest3190055-21kworker/u8:4+events_unbound07:55:272
3169173992517,3cyclictest3210223-21kworker/u8:1+events_unbound08:05:222
3169170992523,2cyclictest3262446-21kworker/u8:4+events_unbound09:12:221
3169170992522,2cyclictest3314330-21kworker/u8:0+events_unbound12:16:341
3169170992522,2cyclictest3277778-21kworker/u8:1+events_unbound09:08:341
3169168992522,2cyclictest3341227-21apt-get09:55:110
3169168992520,4cyclictest3314330-21kworker/u8:0+events_unbound10:39:050
3169168992519,4cyclictest3210223-21kworker/u8:1+flush-259:008:24:590
3169178992421,2cyclictest3314330-21kworker/u8:0+flush-259:012:05:003
3169178992419,3cyclictest3236617-21kworker/u8:3+events_unbound08:30:183
3169178992418,4cyclictest3450586-21store11:40:013
3169178992417,5cyclictest3178619-21ntpq07:15:263
3169173992421,2cyclictest3299609-21kworker/u8:1+events_unbound09:40:212
3169173992421,2cyclictest3236617-21kworker/u8:3+events_unbound08:18:182
3169173992421,2cyclictest3190048-21kworker/u8:2+events_unbound07:30:232
3169173992420,3cyclictest3262209-21kworker/u8:2+events_unbound08:51:062
3169170992421,2cyclictest3314330-21kworker/u8:0+events_unbound10:18:231
3169170992421,2cyclictest3190055-21kworker/u8:4+events_unbound07:59:551
3169170992420,3cyclictest3356662-21kworker/u8:4+events_unbound11:15:281
3169170992420,3cyclictest3314330-21kworker/u8:0+events_unbound12:04:281
3169168992421,2cyclictest3246765-21kworker/u8:0+flush-259:008:45:160
3169168992420,3cyclictest3350339-21kworker/u8:2+events_unbound11:39:250
3169168992420,3cyclictest3350339-21kworker/u8:2+events_unbound11:15:200
3169168992420,3cyclictest3246765-21kworker/u8:0+events_unbound08:37:230
3169168992420,3cyclictest3210223-21kworker/u8:1+flush-259:008:18:520
3169168992419,4cyclictest3350339-21kworker/u8:2+events_unbound10:58:240
3169178992316,5cyclictest335557-21systemd-journal09:10:013
3169178992316,5cyclictest3169096-21latency_hist07:10:013
3169173992319,3cyclictest3466312-21latency_hist11:55:012
3169173992319,3cyclictest3262446-21kworker/u8:4+flush-259:009:10:212
3169173992319,2cyclictest3350339-21kworker/u8:2+flush-259:010:30:162
3169170992320,2cyclictest3314330-21kworker/u8:0+events_unbound10:21:451
3169170992320,2cyclictest3236617-21kworker/u8:3+events_unbound08:17:481
3169170992320,2cyclictest3171706-21kworker/u8:3+events_unbound07:25:051
3169170992316,5cyclictest3318570-21ntpq09:30:191
3169168992319,3cyclictest3366342-21kworker/u8:1+events_unbound10:50:210
3169168992319,3cyclictest3366342-21kworker/u8:1+events_unbound10:19:230
3169178992218,2cyclictest3451068-21kworker/u8:4+flush-259:012:05:173
3169178992218,2cyclictest0-21swapper/311:10:003
3169178992217,4cyclictest3383402-21/usr/sbin/munin10:35:203
3169173992219,2cyclictest3277778-21kworker/u8:1+events_unbound09:00:182
3169173992219,2cyclictest3171706-21kworker/u8:3+flush-259:007:15:232
3169173992218,3cyclictest3498569-21apt-get12:25:112
3169173992218,3cyclictest3314330-21kworker/u8:0+events_unbound10:35:212
3169170992219,2cyclictest3366342-21kworker/u8:1+events_unbound10:57:131
3169170992219,2cyclictest3356662-21kworker/u8:4+events_unbound10:45:041
3169170992219,2cyclictest3314330-21kworker/u8:0+events_unbound10:28:181
3169170992219,2cyclictest3314330-21kworker/u8:0+events_unbound10:10:271
3169170992219,2cyclictest3314330-21kworker/u8:0+events_unbound09:59:561
3169170992219,2cyclictest3314330-21kworker/u8:0+events_unbound09:48:591
3169170992219,2cyclictest3262446-21kworker/u8:4+events_unbound08:42:171
3169170992219,2cyclictest3221522-21kworker/u8:0+events_unbound08:04:201
3169170992217,2cyclictest3299609-21kworker/u8:1+events_unbound09:50:101
3169168992219,2cyclictest3262446-21kworker/u8:4+flush-259:009:30:210
3169168992218,3cyclictest3435177-21/usr/sbin/munin11:25:180
3169168992218,3cyclictest3324669-21kworker/u8:2+events_unbound09:40:130
3169168992218,3cyclictest3171706-21kworker/u8:3+events_unbound07:24:220
3169168992216,5cyclictest3470993-21ntpq11:55:180
3169168992216,4cyclictest3277744-21apt-get08:55:010
3169178992117,2cyclictest3283342-21latency_hist09:00:003
3169173992118,2cyclictest3356662-21kworker/u8:4+flush-259:010:45:152
3169173992118,2cyclictest3299609-21kworker/u8:1+flush-259:009:20:162
3169173992118,2cyclictest3299609-21kworker/u8:1+events_unbound09:30:142
3169173992117,3cyclictest3350339-21kworker/u8:2+events_unbound10:55:232
3169173992116,3cyclictest3210223-21kworker/u8:1+events_unbound07:50:192
3169170992118,2cyclictest3277778-21kworker/u8:1+events_unbound08:57:371
3169170992118,2cyclictest3210223-21kworker/u8:1+events_unbound08:21:231
3169168992118,2cyclictest3356662-21kworker/u8:4+events_unbound11:00:130
3169168992118,2cyclictest3171706-21kworker/u8:3+flush-259:007:20:000
3169168992117,3cyclictest3351533-21apt-get10:05:100
3169168992116,4cyclictest3461363-21/usr/sbin/munin11:50:210
3169168992114,5cyclictest335557-21systemd-journal08:15:000
3169168992114,5cyclictest335557-21systemd-journal08:14:590
3169178992016,2cyclictest0-21swapper/310:20:003
3169178992014,4cyclictest3388563-21/usr/sbin/munin10:40:143
3169178992013,5cyclictest3179889-21diskstats07:20:133
3169173992017,2cyclictest3236617-21kworker/u8:3+events_unbound08:35:222
3169173992017,2cyclictest3190055-21kworker/u8:4+flush-259:007:40:192
3169173992016,3cyclictest3314330-21kworker/u8:0+events_unbound10:27:112
3169170992018,2cyclictest3205039-21kworker/u8:0+events_unbound07:51:311
3169170992017,2cyclictest3493352-21kworker/u8:2+events_unbound12:37:051
3169170992017,2cyclictest3246765-21kworker/u8:0+events_unbound08:37:281
3169170992017,2cyclictest3210223-21kworker/u8:1+events_unbound07:48:231
3169170992017,2cyclictest3171706-21kworker/u8:3+events_unbound07:19:191
3169168992017,2cyclictest509-21rs:main0
3169168992017,2cyclictest3356662-21kworker/u8:4+flush-259:011:10:160
3169168992015,4cyclictest3314330-21kworker/u8:0+events_unbound10:25:240
3169178991915,3cyclictest0-21swapper/308:55:013
3169178991914,3cyclictest3456201-21/usr/sbin/munin11:45:143
3169178991914,3cyclictest3319739-21apt-get09:35:093
3169170991916,2cyclictest3350339-21kworker/u8:2+events_unbound11:25:091
3169170991916,2cyclictest3299609-21kworker/u8:1+events_unbound09:21:421
3169170991916,2cyclictest3171706-21kworker/u8:3+events_unbound07:30:081
3169170991916,2cyclictest3158072-21kworker/u8:0+events_unbound07:21:101
3169168991915,3cyclictest3210223-21kworker/u8:1+events_unbound08:06:220
3169178991814,2cyclictest3293929-21apt-get09:10:113
3169178991814,2cyclictest0-21swapper/311:05:003
316917899180,17cyclictest1-21systemd08:44:593
3169173991815,3cyclictest3440097-21kworker/u8:1+events_unbound11:55:172
3169173991814,3cyclictest3314330-21kworker/u8:0+events_unbound09:55:202
3169173991814,3cyclictest3314330-21kworker/u8:0+events_unbound09:49:552
3169173991812,4cyclictest3440317-21/usr/sbin/munin11:30:202
3169170991815,2cyclictest3493352-21kworker/u8:2+events_unbound12:21:291
3169170991815,2cyclictest3366342-21kworker/u8:1+events_unbound10:37:561
3169168991815,2cyclictest3467045-21kworker/u8:3+flush-259:012:15:230
3169168991813,3cyclictest3220909-21sh07:59:590
3169178991712,4cyclictest3205039-21kworker/u8:0+flush-259:007:50:233
3169173991715,1cyclictest0-21swapper/210:45:002
3169173991714,2cyclictest3350339-21kworker/u8:2+events_unbound11:35:222
3169173991714,2cyclictest3190055-21kworker/u8:4+events_unbound07:45:022
3169170991714,2cyclictest3314330-21kworker/u8:0+events_unbound10:44:451
3169168991714,2cyclictest60350irq/132-enp0s29f1:rx-011:30:220
3169168991714,2cyclictest3314330-21kworker/u8:0+events_unbound11:40:200
3169168991712,4cyclictest3503320-21kworker/u8:0+flush-259:012:29:340
3169168991712,4cyclictest3371881-21ntpq10:20:200
3169168991711,5cyclictest3487985-21latency_hist12:15:010
3169178991613,2cyclictest3439157-21ntp_kernel_err11:25:193
3169178991612,3cyclictest3246765-21kworker/u8:0+flush-259:008:35:273
3169178991611,4cyclictest3493386-21apt-get12:20:113
3169178991611,3cyclictest3314330-21kworker/u8:0+flush-259:011:20:273
3169173991612,3cyclictest3350339-21kworker/u8:2+events_unbound11:40:022
3169170991613,2cyclictest3299609-21kworker/u8:1+events_unbound10:05:431
3169168991613,2cyclictest60350irq/132-enp0s29f1:rx-012:05:290
3169168991613,2cyclictest60350irq/132-enp0s29f1:rx-007:27:470
3169168991613,2cyclictest3350339-21kworker/u8:2+events_unbound10:30:190
3169168991612,3cyclictest3330879-21kworker/u8:3+events_unbound09:45:190
3169168991612,3cyclictest3293710-21kworker/u8:2+events_unbound09:10:230
3169168991612,3cyclictest3262446-21kworker/u8:4+events_unbound09:39:180
3169168991612,3cyclictest3190055-21kworker/u8:4+flush-259:007:35:190
316917899159,4cyclictest3482386-21apt-get12:10:013
316917899159,4cyclictest3246765-21kworker/u8:0+flush-259:008:45:173
316917899158,5cyclictest3314304-21latency_hist09:30:013
3169178991512,2cyclictest3509231-21irqcore12:35:163
3169178991512,2cyclictest3382232-21ntp_kernel_err10:30:183
3169178991512,2cyclictest3185325-21irqcore07:25:153
3169178991512,2cyclictest0-21swapper/307:15:003
3169178991511,2cyclictest0-21swapper/309:20:013
316917899150,2cyclictest3288500-21idleruntime-cro09:05:003
3169173991513,2cyclictest3210223-21kworker/u8:1+events_unbound08:22:082
3169173991512,2cyclictest3330879-21kworker/u8:3+flush-259:010:00:192
3169168991513,2cyclictest3277778-21kworker/u8:1+events_unbound09:02:230
316917899146,6cyclictest3403907-21latency_hist10:55:013
316917899142,10cyclictest335557-21systemd-journal11:15:013
3169178991411,2cyclictest3225604-21unixbench_multi08:00:253
3169168991412,2cyclictest60350irq/132-enp0s29f1:rx-008:30:120
3169168991412,1cyclictest60350irq/132-enp0s29f1:rx-007:10:390
3169168991411,2cyclictest60350irq/132-enp0s29f1:rx-009:05:160
3169168991411,2cyclictest60350irq/132-enp0s29f1:rx-007:50:170
3169168991411,2cyclictest3493352-21kworker/u8:2+events_unbound12:20:210
316917899139,2cyclictest0-21swapper/308:15:003
316917899139,2cyclictest0-21swapper/308:15:003
3169168991310,2cyclictest60350irq/132-enp0s29f1:rx-007:30:120
316917899129,2cyclictest3466766-21latency_hist11:55:023
316917899129,2cyclictest3352553-21kthreadcore10:05:163
316917899129,2cyclictest0-21swapper/310:10:163
316917899129,2cyclictest0-21swapper/310:00:003
316917899128,3cyclictest3493352-21kworker/u8:2+flush-259:012:25:163
316917899128,3cyclictest3190048-21kworker/u8:2+flush-259:007:34:523
316917899128,2cyclictest0-21swapper/308:00:013
316917899127,4cyclictest3230292-21kworker/u8:2+flush-259:008:25:163
316917899126,4cyclictest3466967-21/usr/sbin/munin11:55:183
316917899119,1cyclictest3408329-21sensors10:55:233
316917899118,2cyclictest3304387-21cpuspeed_turbos09:20:113
316917899117,2cyclictest0-21swapper/309:30:193
316917899116,4cyclictest3450379-21apt-get11:40:013
316917899106,2cyclictest3445203-21cron11:35:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional