You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 16:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Tue Aug 11, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2960067994339,3cyclictest3110382-21kworker/u8:3+events_unbound09:43:552
2960067994339,3cyclictest3058833-21kworker/u8:1+events_unbound08:52:352
2960067994238,3cyclictest3224736-21kworker/u8:1+events_unbound11:43:462
2960067994238,3cyclictest2959977-21kworker/u8:2+events_unbound07:58:312
2960067994236,4cyclictest3136152-21apt-get10:00:022
2960070994134,5cyclictest3099986-21latency_hist09:25:003
2960067994138,2cyclictest2949190-21kworker/u8:0+events_unbound07:10:322
2960067994138,2cyclictest2943732-21kworker/u8:3+events_unbound08:11:352
2960067994138,2cyclictest2943732-21kworker/u8:3+events_unbound07:45:252
2960067994137,3cyclictest3125888-21kworker/u8:1+events_unbound10:07:462
2960067994037,2cyclictest3272187-21kworker/u8:1+events_unbound12:22:462
2960067994037,2cyclictest3224736-21kworker/u8:1+events_unbound11:34:152
2960067994037,2cyclictest3173049-21kworker/u8:0+events_unbound10:55:242
2960067994037,2cyclictest2959977-21kworker/u8:2+events_unbound08:45:012
2960067994037,2cyclictest2959977-21kworker/u8:2+events_unbound07:25:232
2960067993937,2cyclictest3272187-21kworker/u8:1+events_unbound12:08:472
2960067993936,2cyclictest3224736-21kworker/u8:1+events_unbound11:35:152
2960067993936,2cyclictest3219358-21kworker/u8:2+events_unbound12:18:482
2960067993935,3cyclictest3272187-21kworker/u8:1+events_unbound12:31:482
2960067993935,3cyclictest2943732-21kworker/u8:3+events_unbound07:36:332
2960067993835,2cyclictest3209006-21kworker/u8:3+events_unbound12:10:232
2960067993835,2cyclictest3136804-21kworker/u8:2+events_unbound10:14:032
2960067993835,2cyclictest2986503-21kworker/u8:0+events_unbound08:02:332
2960067993834,3cyclictest3095036-21kworker/u8:2+events_unbound09:22:362
2960067993834,3cyclictest2959977-21kworker/u8:2+events_unbound07:53:332
2960067993834,3cyclictest2943732-21kworker/u8:3+events_unbound07:43:342
2960067993734,2cyclictest3074129-21kworker/u8:0+events_unbound09:14:362
2960067993734,2cyclictest3074129-21kworker/u8:0+events_unbound09:14:352
2960067993733,3cyclictest2959977-21kworker/u8:2+events_unbound08:44:352
2960067993733,3cyclictest2943732-21kworker/u8:3+events_unbound07:34:342
2960067993731,4cyclictest3156410-21ntpq10:15:232
2960064993731,4cyclictest335557-21systemd-journal09:48:341
2960067993634,2cyclictest3125888-21kworker/u8:1+events_unbound10:40:172
2960067993633,2cyclictest3173049-21kworker/u8:0+events_unbound11:17:462
2960067993532,2cyclictest3173049-21kworker/u8:0+events_unbound11:10:152
2960064993528,5cyclictest3270642-21ntpq12:00:241
2960060993532,2cyclictest3209006-21kworker/u8:3+events_unbound11:47:170
2960070993430,3cyclictest2943732-21kworker/u8:3+flush-259:007:40:003
2960067993431,2cyclictest3074129-21kworker/u8:0+events_unbound09:19:362
2960060993430,3cyclictest2943732-21kworker/u8:3+flush-259:007:45:160
2960070993330,2cyclictest3209006-21kworker/u8:3+flush-259:011:40:223
2960067993330,2cyclictest3272187-21kworker/u8:1+events_unbound12:29:232
2960067993330,2cyclictest3110382-21kworker/u8:3+events_unbound09:55:292
2960064993327,4cyclictest3012325-21/usr/sbin/munin08:00:151
2960067993229,2cyclictest3058833-21kworker/u8:1+flush-259:009:08:442
2960067993229,2cyclictest3058833-21kworker/u8:1+flush-259:009:08:442
2960060993229,2cyclictest2986503-21kworker/u8:0+flush-259:008:40:000
2960070993128,2cyclictest3302866-21kworker/u8:0+flush-259:012:40:013
2960067993128,2cyclictest2959977-21kworker/u8:2+events_unbound08:35:282
2960067993127,3cyclictest3198878-21kworker/u8:1+events_unbound11:04:112
2960070993027,2cyclictest3058833-21kworker/u8:1+events_unbound08:50:253
2960070993024,4cyclictest2975518-21latency_hist07:25:013
2960067993026,3cyclictest3255705-21kworker/u8:4+events_unbound11:50:082
2960067993024,4cyclictest3266586-21apt-get12:00:132
2960064993025,3cyclictest335557-21systemd-journal09:27:341
2960060993026,3cyclictest3125888-21kworker/u8:1+events_unbound10:45:220
2960070992925,3cyclictest3229937-21apt-get11:30:113
2960067992926,2cyclictest2943732-21kworker/u8:3+events_unbound07:23:252
2960067992925,3cyclictest3136804-21kworker/u8:2+events_unbound10:20:262
2960060992926,2cyclictest3110382-21kworker/u8:3+events_unbound09:40:100
2960060992926,2cyclictest2986503-21kworker/u8:0+events_unbound08:20:110
2960060992925,3cyclictest3198878-21kworker/u8:1+events_unbound11:00:480
2960060992925,3cyclictest3074129-21kworker/u8:0+events_unbound09:01:350
2960060992923,4cyclictest3110606-21apt-get09:35:140
2960060992923,4cyclictest3021491-21ntpq08:05:210
2960070992825,2cyclictest3209006-21kworker/u8:3+events_unbound12:13:463
2960070992825,2cyclictest3110382-21kworker/u8:3+events_unbound09:50:233
2960070992825,2cyclictest2959977-21kworker/u8:2+events_unbound09:00:243
2960070992823,3cyclictest3115518-21latency_hist09:40:013
2960067992825,2cyclictest3074129-21kworker/u8:0+events_unbound09:00:172
2960067992825,2cyclictest2949190-21kworker/u8:0+events_unbound07:16:332
2960067992824,3cyclictest75-21kswapd011:47:282
2960067992824,3cyclictest3173049-21kworker/u8:0+events_unbound10:47:452
2960064992823,3cyclictest335557-21systemd-journal08:45:351
2960064992823,3cyclictest3261411-21apt-get11:55:131
2960060992825,2cyclictest3255705-21kworker/u8:4+events_unbound11:54:150
2960060992825,2cyclictest3037474-21kworker/u8:4+flush-259:008:40:200
2960060992824,3cyclictest3224736-21kworker/u8:1+flush-259:011:35:010
2960060992824,3cyclictest3136804-21kworker/u8:2+events_unbound10:20:000
2960070992724,2cyclictest2949190-21kworker/u8:0+flush-259:007:10:213
2960070992723,3cyclictest2959977-21kworker/u8:2+events_unbound07:28:333
2960067992724,2cyclictest3224736-21kworker/u8:1+events_unbound11:27:462
2960067992723,3cyclictest3125888-21kworker/u8:1+events_unbound09:53:422
2960064992724,2cyclictest75-21kswapd011:47:281
2960064992723,3cyclictest335557-21systemd-journal10:39:591
2960060992724,2cyclictest3219358-21kworker/u8:2+flush-259:012:25:250
2960060992723,3cyclictest2943732-21kworker/u8:3+flush-259:008:15:220
2960060992722,3cyclictest335557-21systemd-journal11:59:160
2960060992721,4cyclictest3012092-21latency_hist08:00:010
2960070992624,1cyclictest3136804-21kworker/u8:2+events_unbound10:00:143
2960070992623,2cyclictest3136804-21kworker/u8:2+events_unbound10:14:463
2960070992622,3cyclictest3209006-21kworker/u8:3+events_unbound12:04:473
2960067992623,2cyclictest3250050-21kworker/u8:0+events_unbound11:58:472
2960067992623,2cyclictest3136804-21kworker/u8:2+events_unbound10:25:272
2960067992623,2cyclictest3074129-21kworker/u8:0+events_unbound09:30:172
2960067992623,2cyclictest2959977-21kworker/u8:2+events_unbound08:55:142
2960060992623,2cyclictest3125888-21kworker/u8:1+events_unbound10:31:460
2960060992623,2cyclictest3058833-21kworker/u8:1+events_unbound09:08:470
2960060992623,2cyclictest3058833-21kworker/u8:1+events_unbound09:08:460
2960070992522,2cyclictest2943732-21kworker/u8:3+events_unbound07:17:343
2960067992523,2cyclictest3173049-21kworker/u8:0+events_unbound10:50:292
2960067992521,3cyclictest3074129-21kworker/u8:0+flush-259:009:25:162
2960067992519,4cyclictest3167880-21/usr/sbin/munin10:30:152
2960060992522,2cyclictest3136804-21kworker/u8:2+events_unbound10:25:260
2960060992522,2cyclictest3125888-21kworker/u8:1+events_unbound09:56:360
2960060992522,2cyclictest3095036-21kworker/u8:2+events_unbound09:23:520
2960060992522,2cyclictest2986503-21kworker/u8:0+flush-259:007:50:250
2960060992521,3cyclictest3272187-21kworker/u8:1+events_unbound12:30:240
2960060992521,3cyclictest3173049-21kworker/u8:0+flush-259:011:15:000
2960060992521,3cyclictest2986503-21kworker/u8:0+flush-259:008:00:320
2960060992521,3cyclictest2986503-21kworker/u8:0+events_unbound07:38:280
2960070992422,1cyclictest2959977-21kworker/u8:2+events_unbound08:30:203
2960070992421,2cyclictest2986503-21kworker/u8:0+events_unbound08:05:143
2960070992421,2cyclictest2959977-21kworker/u8:2+flush-259:007:55:233
2960067992420,3cyclictest2959977-21kworker/u8:2+events_unbound08:28:352
296006499249,8cyclictest2991006-21munin-run07:40:001
2960064992420,3cyclictest3173049-21kworker/u8:0+flush-259:010:50:221
2960064992419,3cyclictest335557-21systemd-journal07:19:321
2960060992422,2cyclictest3136811-21kworker/u8:4+events_unbound10:04:450
2960070992320,2cyclictest3136804-21kworker/u8:2+flush-259:010:05:213
2960070992320,2cyclictest3125888-21kworker/u8:1+events_unbound10:21:453
2960067992320,2cyclictest3037474-21kworker/u8:4+events_unbound08:33:382
2960067992319,3cyclictest2959977-21kworker/u8:2+events_unbound08:23:362
2960060992321,2cyclictest3209006-21kworker/u8:3+events_unbound12:05:200
2960060992319,3cyclictest3302866-21kworker/u8:0+events_unbound12:35:170
2960060992318,4cyclictest3064065-21apt-get08:50:110
2960070992220,2cyclictest2943732-21kworker/u8:3+events_unbound07:45:133
2960070992219,2cyclictest3173049-21kworker/u8:0+flush-259:010:55:163
2960070992219,2cyclictest3125888-21kworker/u8:1+flush-259:010:35:213
2960070992218,3cyclictest2959977-21kworker/u8:2+events_unbound08:55:223
2960070992218,3cyclictest2959977-21kworker/u8:2+events_unbound08:27:353
2960070992218,3cyclictest2943732-21kworker/u8:3+events_unbound07:32:333
2960070992217,4cyclictest3109428-21ntpq09:30:213
2960067992219,2cyclictest3209006-21kworker/u8:3+events_unbound11:23:472
2960064992218,3cyclictest3235091-21apt-get11:35:121
2960064992218,3cyclictest3074129-21kworker/u8:0+events_unbound09:30:201
2960064992217,4cyclictest3110767-21diskstats09:35:171
2960070992119,2cyclictest2943732-21kworker/u8:3+flush-259:007:40:323
2960070992118,2cyclictest3209006-21kworker/u8:3+events_unbound11:15:163
2960070992118,2cyclictest3037474-21kworker/u8:4+events_unbound08:24:333
2960067992118,2cyclictest3110382-21kworker/u8:3+events_unbound09:46:132
2960064992116,4cyclictest3287430-21latency_hist12:20:011
2960060992118,2cyclictest3209006-21kworker/u8:3+events_unbound11:40:210
2960060992118,2cyclictest3074129-21kworker/u8:0+events_unbound09:25:180
2960060992118,2cyclictest2959977-21kworker/u8:2+flush-259:008:55:260
2960060992118,2cyclictest2959977-21kworker/u8:2+events_unbound08:45:130
2960060992117,3cyclictest3219358-21kworker/u8:2+flush-259:011:25:160
2960070992017,2cyclictest3167907-21apt-get10:30:133
2960070992016,3cyclictest3219358-21kworker/u8:2+events_unbound11:28:483
2960070992016,3cyclictest3198878-21kworker/u8:1+flush-259:011:00:153
2960070992016,3cyclictest3110382-21kworker/u8:3+flush-259:009:41:363
2960070992016,3cyclictest2959977-21kworker/u8:2+flush-259:007:55:003
2960070992015,4cyclictest3250192-21frontend11:47:253
2960067992017,2cyclictest2943732-21kworker/u8:3+events_unbound08:15:032
2960067992016,3cyclictest3303197-21apt-get12:35:112
2960064992018,1cyclictest3006514-21apt-get07:55:011
2960064992016,3cyclictest3298044-21apt-get12:30:131
2960064992016,3cyclictest2943732-21kworker/u8:3+flush-259:007:30:191
2960064992015,4cyclictest3204095-21apt-get11:05:131
2960060992017,2cyclictest3173049-21kworker/u8:0+events_unbound10:55:190
2960060992017,2cyclictest2943732-21kworker/u8:3+flush-259:007:14:390
2960070991916,3cyclictest3219358-21kworker/u8:2+events_unbound12:20:223
2960070991916,2cyclictest3255705-21kworker/u8:4+flush-259:011:50:263
2960070991916,2cyclictest3224736-21kworker/u8:1+events_unbound11:36:483
2960070991916,2cyclictest3084406-21kworker/u8:3+events_unbound09:13:373
2960070991916,2cyclictest3084406-21kworker/u8:3+events_unbound09:13:373
2960070991916,2cyclictest2986503-21kworker/u8:0+events_unbound08:01:353
2960067991916,2cyclictest2943732-21kworker/u8:3+events_unbound08:07:222
296006499195,4cyclictest3065606-21kthreadcore08:50:171
296006499193,5cyclictest3179481-21grep10:40:181
2960064991915,3cyclictest509-21rs:main1
2960064991915,3cyclictest3277360-21apt-get12:10:131
2960064991915,3cyclictest3198878-21kworker/u8:1+flush-259:011:00:171
2960064991915,2cyclictest1-21systemd08:56:341
2960064991912,5cyclictest3233967-21ntpq11:30:221
2960060991916,2cyclictest3272187-21kworker/u8:1+flush-259:012:15:160
2960060991915,3cyclictest3219358-21kworker/u8:2+flush-259:012:20:220
2960060991913,4cyclictest3214565-21diskstats11:15:150
2960070991816,1cyclictest2959977-21kworker/u8:2+flush-259:008:35:203
2960070991815,2cyclictest3272187-21kworker/u8:1+events_unbound12:28:533
2960070991815,2cyclictest3219358-21kworker/u8:2+events_unbound12:19:203
2960070991815,2cyclictest3209006-21kworker/u8:3+events_unbound12:09:173
2960070991815,2cyclictest3198878-21kworker/u8:1+events_unbound11:05:143
2960070991815,2cyclictest3095036-21kworker/u8:2+events_unbound09:45:163
2960070991815,2cyclictest3058833-21kworker/u8:1+events_unbound08:45:173
2960070991814,3cyclictest3219358-21kworker/u8:2+events_unbound12:34:213
2960070991814,3cyclictest3074129-21kworker/u8:0+flush-259:009:25:243
2960067991814,3cyclictest3173049-21kworker/u8:0+events_unbound11:09:042
2960064991816,1cyclictest3219330-21cut11:19:591
2960064991811,5cyclictest3260250-21ntpq11:50:201
2960060991815,2cyclictest2959977-21kworker/u8:2+events_unbound07:25:210
2960060991814,3cyclictest3209006-21kworker/u8:3+flush-259:011:38:230
2960060991813,3cyclictest335557-21systemd-journal10:54:460
2960070991716,1cyclictest3074129-21kworker/u8:0+flush-259:009:05:213
2960070991716,1cyclictest3074129-21kworker/u8:0+flush-259:009:05:203
2960070991714,2cyclictest3173049-21kworker/u8:0+flush-259:011:20:213
2960070991714,2cyclictest3037474-21kworker/u8:4+flush-259:008:40:243
2960070991712,3cyclictest509-21rs:main3
2960067991714,2cyclictest3095036-21kworker/u8:2+events_unbound09:38:102
296006499175,6cyclictest3141802-21munin-run10:05:001
296006499174,7cyclictest3093933-21ntpq09:15:211
296006499172,5cyclictest3289603-21cut12:20:171
296006499172,5cyclictest3245120-21modprobe11:44:451
2960064991715,1cyclictest3021407-21needreboot08:05:191
2960064991714,2cyclictest2960663-21irqcore07:10:161
2960064991713,3cyclictest2991263-21apt-get07:40:091
2960064991713,3cyclictest2959977-21kworker/u8:2+flush-259:008:30:211
2960064991712,3cyclictest3152114-21cron10:15:011
2960064991710,5cyclictest335557-21systemd-journal12:06:451
2960060991714,2cyclictest3136804-21kworker/u8:2+events_unbound10:05:170
2960060991714,2cyclictest2986503-21kworker/u8:0+events_unbound08:13:340
2960060991714,2cyclictest2970099-21kworker/u8:1+events_unbound07:30:320
2960060991713,3cyclictest3209006-21kworker/u8:3+flush-259:011:22:530
2960060991713,3cyclictest3198878-21kworker/u8:1+flush-259:011:08:230
2960060991713,3cyclictest3136804-21kworker/u8:2+flush-259:010:14:220
2960070991613,2cyclictest3173049-21kworker/u8:0+events_unbound10:50:253
2960070991613,2cyclictest3074129-21kworker/u8:0+events_unbound09:15:223
2960070991610,5cyclictest3136152-21apt-get10:00:003
296006499164,2cyclictest2979797-21ntpq07:25:221
296006499163,4cyclictest3088714-21ntpq09:10:221
296006499163,4cyclictest3088714-21ntpq09:10:221
2960064991612,2cyclictest3132264-21kthreadcore09:55:191
2960064991611,4cyclictest2970596-21/usr/sbin/munin07:20:141
2960064991610,4cyclictest335557-21systemd-journal08:29:591
2960060991613,2cyclictest60350irq/132-enp0s29f1:rx-009:30:210
2960060991613,2cyclictest3136804-21kworker/u8:2+events_unbound10:20:450
2960060991613,2cyclictest3125888-21kworker/u8:1+events_unbound10:41:450
2960060991612,3cyclictest2959977-21kworker/u8:2+events_unbound08:28:370
2960070991512,2cyclictest3173049-21kworker/u8:0+events_unbound11:10:133
2960070991512,2cyclictest2943732-21kworker/u8:3+events_unbound08:16:363
2960070991511,3cyclictest3187889-21unixbench_singl10:45:263
296006499154,9cyclictest2959943-21latency_hist07:10:011
296006499154,3cyclictest3187428-21ntpq10:45:221
296006499153,2cyclictest3197713-21ntpq10:55:221
296006499152,4cyclictest3224165-21taskset11:21:091
2960064991512,2cyclictest3054657-21kthreadcore08:40:161
2960064991511,3cyclictest2943732-21kworker/u8:3+flush-259:008:10:211
296006499151,12cyclictest3053397-21unin-run08:40:001
2960060991513,2cyclictest3209006-21kworker/u8:3+events_unbound12:10:280
2960060991513,1cyclictest60350irq/132-enp0s29f1:rx-010:35:130
2960060991513,1cyclictest60350irq/132-enp0s29f1:rx-009:15:160
2960060991513,1cyclictest60350irq/132-enp0s29f1:rx-007:20:140
2960060991513,1cyclictest60350irq/132-enp0s29f1:rx-007:15:140
2960060991512,2cyclictest60350irq/132-enp0s29f1:rx-008:30:140
2960060991511,3cyclictest3125888-21kworker/u8:1+events_unbound09:54:340
296006499149,4cyclictest3032923-21apt-get08:20:111
296006499143,6cyclictest3007488-21fw_forwarded_lo07:55:171
2960060991412,1cyclictest60350irq/132-enp0s29f1:rx-012:00:200
2960060991411,2cyclictest60350irq/132-enp0s29f1:rx-009:45:140
296007099139,3cyclictest3209006-21kworker/u8:3+events_unbound11:55:273
2960070991310,2cyclictest3136804-21kworker/u8:2+flush-259:010:15:213
296006499133,3cyclictest3099986-21latency_hist09:25:001
2960064991310,2cyclictest3142235-21fschecks_count10:05:111
296006499130,12cyclictest3130988-21idleruntime-cro09:55:001
2960060991311,1cyclictest60350irq/132-enp0s29f1:rx-007:40:130
296006499127,3cyclictest3225779-21kthreadcore11:25:191
296006499126,4cyclictest3000572-21smartctl07:45:241
296006499123,5cyclictest0-21swapper/110:25:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional