You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 15:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Mon May 11, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3090251994843,3cyclictest3126269-21kworker/u8:3+flush-259:019:50:013
3090241994745,2cyclictest3322585-21kworker/u8:3+events_unbound22:55:000
3090244994439,3cyclictest3312327-21kworker/u8:2+flush-259:023:25:001
3090244994439,3cyclictest3312327-21kworker/u8:2+flush-259:023:25:001
3090244994339,3cyclictest3146826-21kworker/u8:4+flush-259:020:35:001
3090241994239,2cyclictest3193145-21kworker/u8:1+events_unbound22:06:560
3090241994238,3cyclictest3391207-21kworker/u8:4+events_unbound00:31:390
3090241994033,5cyclictest3411657-21latency_hist00:20:010
3090241993936,2cyclictest3090224-21kworker/u8:1+events_unbound20:08:280
3090241993935,3cyclictest3292460-21apt-get22:25:110
3090241993734,3cyclictest3312327-21kworker/u8:2+events_unbound23:57:280
3090241993734,2cyclictest3322585-21kworker/u8:3+events_unbound23:00:020
3090241993733,3cyclictest3266716-21apt-get22:00:120
3090241993733,3cyclictest3146826-21kworker/u8:4+events_unbound20:30:280
3090247993632,3cyclictest3266493-21kworker/u8:2+flush-259:022:00:232
3090247993632,2cyclictest3354866-21kworker/u8:1+events_unbound23:45:182
3090251993329,3cyclictest3193145-21kworker/u8:1+flush-259:021:10:003
3090251993329,3cyclictest3193145-21kworker/u8:1+flush-259:021:10:003
3090247993228,3cyclictest3292238-21kworker/u8:0+flush-259:022:47:062
3090244993226,4cyclictest3416816-21latency_hist00:25:011
3090251993128,2cyclictest3312327-21kworker/u8:2+flush-259:023:30:223
3090247993128,2cyclictest3312327-21kworker/u8:2+flush-259:000:25:232
3090247993127,3cyclictest13711-21kworker/u8:2+events_unbound19:24:272
3090247993125,4cyclictest3224855-21latency_hist21:20:012
3090244993128,2cyclictest3042148-21kworker/u8:0+flush-259:019:20:231
3090241993125,4cyclictest3301680-21ntpq22:30:230
3090251993023,5cyclictest252-21systemd-journal20:23:263
3090247993027,2cyclictest3146826-21kworker/u8:4+flush-259:020:50:202
3090247993026,3cyclictest3292238-21kworker/u8:0+events_unbound22:25:202
3090247993026,3cyclictest3245472-21kworker/u8:0+events_unbound21:51:532
3090251992923,4cyclictest3234316-21ntpq21:25:203
3090247992926,2cyclictest3266493-21kworker/u8:2+flush-259:022:20:262
3090247992924,3cyclictest3339239-21gpgv23:10:002
3090247992922,5cyclictest3245425-21latency_hist21:40:012
3090244992925,3cyclictest3090224-21kworker/u8:1+flush-259:020:20:201
3090241992922,5cyclictest3265600-21ntpq21:55:220
3090241992921,6cyclictest3121133-21latency_hist19:40:010
3090247992824,3cyclictest3141703-21kworker/u8:2+flush-259:020:10:212
3090247992824,2cyclictest3312327-21kworker/u8:2+events_unbound23:52:102
3090251992723,3cyclictest3354866-21kworker/u8:1+flush-259:023:45:183
3090251992722,3cyclictest3334020-21cat23:05:013
3090247992723,3cyclictest3391207-21kworker/u8:4+flush-259:000:30:212
3090247992723,3cyclictest3312327-21kworker/u8:2+events_unbound00:35:212
3090247992723,3cyclictest3230052-21kworker/u8:2+events_unbound21:41:282
3090247992722,4cyclictest3126269-21kworker/u8:3+events_unbound19:45:122
3090241992724,2cyclictest3292238-21kworker/u8:0+events_unbound23:05:270
3090241992720,5cyclictest3219469-21cat21:15:000
3090241992719,5cyclictest3421983-21latency_hist00:30:010
3090247992623,2cyclictest3042148-21kworker/u8:0+events_unbound19:11:262
3090247992622,3cyclictest3312327-21kworker/u8:2+events_unbound22:45:002
3090247992622,3cyclictest3193145-21kworker/u8:1+flush-259:021:10:202
3090247992622,3cyclictest3193145-21kworker/u8:1+events_unbound21:25:282
3090247992622,3cyclictest13711-21kworker/u8:2+events_unbound19:31:342
3090244992619,5cyclictest3187166-21ntpq20:40:221
3090251992522,2cyclictest3391207-21kworker/u8:4+flush-259:000:15:263
3090251992521,3cyclictest3422022-21kworker/u8:0+flush-259:000:38:393
3090247992522,2cyclictest3042148-21kworker/u8:0+events_unbound19:35:242
3090247992521,3cyclictest3322585-21kworker/u8:3+events_unbound23:01:282
3090247992520,4cyclictest3391207-21kworker/u8:4+events_unbound00:24:382
3090247992519,4cyclictest3396161-21latency_hist00:05:002
3090247992519,4cyclictest3105930-21/usr/sbin/munin19:25:162
3090247992518,5cyclictest252-21systemd-journal22:16:262
3090244992522,2cyclictest252-21systemd-journal23:41:271
3090241992522,2cyclictest3266493-21kworker/u8:2+events_unbound22:17:270
3090241992522,2cyclictest3177711-21kworker/u8:0+events_unbound20:41:270
3090241992521,2cyclictest3230052-21kworker/u8:2+flush-259:021:40:170
3090251992421,2cyclictest13711-21kworker/u8:2+flush-259:019:45:013
3090251992420,3cyclictest3245472-21kworker/u8:0+flush-259:021:55:233
3090251992420,3cyclictest3219311-21latency_hist21:15:003
3090251992419,3cyclictest252-21systemd-journal22:28:273
3090247992420,3cyclictest3391207-21kworker/u8:4+flush-259:000:05:222
3090247992420,3cyclictest3230052-21kworker/u8:2+events_unbound21:31:512
3090247992420,3cyclictest3193145-21kworker/u8:1+events_unbound22:05:172
3090247992420,3cyclictest13711-21kworker/u8:2+flush-259:019:15:162
3090247992419,4cyclictest3292238-21kworker/u8:0+events_unbound22:59:272
3090244992421,2cyclictest3042148-21kworker/u8:0+flush-259:019:35:191
3090241992421,2cyclictest3177711-21kworker/u8:0+events_unbound21:15:030
3090241992421,2cyclictest3146826-21kworker/u8:4+events_unbound20:25:200
3090241992421,2cyclictest3141703-21kworker/u8:2+events_unbound20:16:410
3090247992319,3cyclictest3312327-21kworker/u8:2+events_unbound23:11:262
3090247992318,4cyclictest3203432-21latency_hist21:00:002
3090241992320,2cyclictest3349365-21kworker/u8:3+events_unbound23:28:260
3090241992320,2cyclictest3312327-21kworker/u8:2+events_unbound22:43:270
3090241992320,2cyclictest3266493-21kworker/u8:2+events_unbound22:22:010
3090241992319,3cyclictest3177711-21kworker/u8:0+flush-259:021:09:560
3090241992319,3cyclictest3177711-21kworker/u8:0+flush-259:021:09:560
3090251992219,2cyclictest3380695-21kworker/u8:0+flush-259:000:05:003
3090251992219,2cyclictest3312327-21kworker/u8:2+flush-259:023:20:003
3090251992218,3cyclictest3312327-21kworker/u8:2+flush-259:023:55:223
3090251992217,4cyclictest3385843-21latency_hist23:55:003
3090247992219,2cyclictest3292238-21kworker/u8:0+events_unbound23:15:232
3090247992218,3cyclictest3193145-21kworker/u8:1+events_unbound21:21:502
3090244992219,2cyclictest3042148-21kworker/u8:0+flush-259:019:40:181
3090244992218,3cyclictest3312327-21kworker/u8:2+flush-259:000:25:261
3090244992218,3cyclictest3188253-21apt-get20:45:121
3090244992218,3cyclictest3152224-21/usr/sbin/munin20:10:191
3090241992220,2cyclictest3193145-21kworker/u8:1+events_unbound21:37:280
3090241992220,2cyclictest13711-21kworker/u8:2+events_unbound19:41:350
3090241992217,3cyclictest252-21systemd-journal20:56:440
3090247992117,3cyclictest3177711-21kworker/u8:0+events_unbound21:00:042
3090247992117,3cyclictest3090224-21kworker/u8:1+events_unbound20:21:282
3090241992119,2cyclictest3090224-21kworker/u8:1+events_unbound20:01:380
3090241992118,2cyclictest3391207-21kworker/u8:4+events_unbound00:08:120
3090241992118,2cyclictest3193145-21kworker/u8:1+events_unbound22:14:270
3090241992118,2cyclictest3141703-21kworker/u8:2+events_unbound20:21:440
3090241992118,2cyclictest3141703-21kworker/u8:2+events_unbound20:11:410
3090241992115,4cyclictest3281956-21kworker/u8:3+flush-259:022:35:170
3090251992016,3cyclictest3391207-21kworker/u8:4+flush-259:000:10:223
3090247992017,2cyclictest3245472-21kworker/u8:0+events_unbound21:45:132
3090247992016,3cyclictest3281956-21kworker/u8:3+events_unbound22:35:212
3090244992017,2cyclictest3177711-21kworker/u8:0+events_unbound21:20:221
3090244992016,3cyclictest3136762-21/usr/sbin/munin19:55:151
3090244992016,3cyclictest252-21systemd-journal19:30:011
3090241992018,2cyclictest3193145-21kworker/u8:1+events_unbound21:20:260
3090241992016,2cyclictest3255717-21cron21:50:000
3090251991916,2cyclictest3151995-21munin-run20:10:013
3090251991916,2cyclictest13711-21kworker/u8:2+events_unbound19:25:253
3090251991916,2cyclictest0-21swapper/322:10:003
3090251991914,4cyclictest3230052-21kworker/u8:2+flush-259:021:30:253
3090247991917,1cyclictest3281956-21kworker/u8:3+events_unbound22:30:232
3090247991916,2cyclictest3312327-21kworker/u8:2+flush-259:023:30:162
3090247991915,3cyclictest3349365-21kworker/u8:3+events_unbound23:25:202
3090247991915,3cyclictest3312327-21kworker/u8:2+events_unbound23:24:262
3090247991915,3cyclictest3312327-21kworker/u8:2+events_unbound23:24:262
3090247991915,3cyclictest3245472-21kworker/u8:0+events_unbound21:55:242
3090247991915,3cyclictest3193145-21kworker/u8:1+events_unbound22:10:152
3090247991915,3cyclictest3141703-21kworker/u8:2+flush-259:020:05:252
3090247991914,3cyclictest3042148-21kworker/u8:0+flush-259:019:40:152
3090244991916,2cyclictest3307701-21systemd-run22:40:011
3090244991916,2cyclictest3245472-21kworker/u8:0+flush-259:021:45:211
3090241991916,2cyclictest3391207-21kworker/u8:4+events_unbound00:11:590
3090241991916,2cyclictest3322585-21kworker/u8:3+events_unbound22:53:140
3090241991916,2cyclictest3312327-21kworker/u8:2+events_unbound23:41:200
3090241991916,2cyclictest3245472-21kworker/u8:0+events_unbound21:50:480
3090241991916,2cyclictest3146826-21kworker/u8:4+events_unbound20:39:560
3090241991916,2cyclictest3126269-21kworker/u8:3+events_unbound19:46:210
3090241991916,2cyclictest13711-21kworker/u8:2+events_unbound19:14:270
3090241991915,3cyclictest13711-21kworker/u8:2+events_unbound19:19:200
3090251991815,2cyclictest3230052-21kworker/u8:2+flush-259:021:40:003
3090251991815,2cyclictest3141703-21kworker/u8:2+events_unbound20:10:193
3090251991815,2cyclictest13711-21kworker/u8:2+flush-259:019:30:203
3090251991814,3cyclictest3401300-21kworker/u8:1+flush-259:000:25:003
3090251991814,3cyclictest3312327-21kworker/u8:2+flush-259:000:25:263
3090251991812,4cyclictest3287087-21latency_hist22:20:013
3090247991815,2cyclictest3391207-21kworker/u8:4+flush-259:000:15:212
3090247991815,2cyclictest3177711-21kworker/u8:0+events_unbound21:05:292
3090247991815,2cyclictest3177711-21kworker/u8:0+events_unbound21:05:292
3090244991814,3cyclictest3312327-21kworker/u8:2+events_unbound23:10:221
3090244991814,3cyclictest3219971-21/usr/sbin/munin21:15:161
3090244991814,3cyclictest3203964-21base6421:00:011
3090244991814,3cyclictest3131362-21latency_hist19:50:011
3090241991816,2cyclictest3312327-21kworker/u8:2+events_unbound23:49:590
3090241991816,2cyclictest3193145-21kworker/u8:1+events_unbound21:01:270
3090241991815,2cyclictest3354866-21kworker/u8:1+events_unbound23:53:390
3090241991815,2cyclictest3230052-21kworker/u8:2+events_unbound21:30:220
3090241991815,2cyclictest13711-21kworker/u8:2+events_unbound19:31:280
3090251991714,2cyclictest3278036-21kthreadcore22:10:183
3090247991713,3cyclictest3090224-21kworker/u8:1+events_unbound19:55:132
3090244991714,2cyclictest3219337-21gpgv21:15:001
3090244991713,3cyclictest3042148-21kworker/u8:0+flush-259:019:10:261
3090244991712,4cyclictest3391207-21kworker/u8:4+flush-259:000:15:221
309024499171,15cyclictest500-21systemd-logind19:20:011
3090241991715,2cyclictest13711-21kworker/u8:2+events_unbound19:20:470
3090241991715,1cyclictest0-21swapper/019:55:000
3090241991714,2cyclictest3312327-21kworker/u8:2+events_unbound00:22:570
3090241991714,2cyclictest3177711-21kworker/u8:0+events_unbound20:53:210
3090241991714,2cyclictest3090236-21cyclictest22:45:250
3090241991714,2cyclictest13711-21kworker/u8:2+events_unbound19:26:280
3090241991712,4cyclictest3364357-21ntpq23:30:210
3090251991613,2cyclictest3325651-21grep22:55:173
3090251991613,2cyclictest3281956-21kworker/u8:3+flush-259:022:30:263
3090251991611,4cyclictest3250570-21latency_hist21:45:013
3090247991613,2cyclictest3375510-21sh23:45:012
3090247991613,2cyclictest3146826-21kworker/u8:4+flush-259:020:15:212
3090244991612,3cyclictest3292238-21kworker/u8:0+flush-259:022:25:161
3090244991612,3cyclictest3292238-21kworker/u8:0+events_unbound22:40:011
3090244991612,3cyclictest3177711-21kworker/u8:0+events_unbound20:35:221
309024199163,3cyclictest3431381-21ntpq00:35:200
309024199163,3cyclictest16-21ksoftirqd/023:35:230
3090241991614,2cyclictest3126269-21kworker/u8:3+events_unbound19:56:560
3090241991613,2cyclictest60350irq/132-enp0s29f1:rx-021:25:180
3090241991613,2cyclictest3292238-21kworker/u8:0+events_unbound23:13:530
3090241991613,2cyclictest3146826-21kworker/u8:4+events_unbound20:46:160
3090251991512,2cyclictest3333727-21latency_hist23:05:003
3090251991511,3cyclictest3292238-21kworker/u8:0+flush-259:022:45:253
3090251991511,3cyclictest3255846-21gpgv21:50:003
3090251991511,3cyclictest3090224-21kworker/u8:1+flush-259:020:00:013
3090247991512,2cyclictest3354866-21kworker/u8:1+flush-259:023:35:222
3090247991511,3cyclictest3390998-21kworker/u8:3+flush-259:000:00:012
3090247991511,3cyclictest3146826-21kworker/u8:4+events_unbound20:46:482
3090247991511,3cyclictest3090224-21kworker/u8:1+events_unbound20:00:142
309024499157,1cyclictest0-21swapper/121:35:001
3090244991512,2cyclictest3197339-21ntp_kernel_err20:50:201
3090241991513,1cyclictest60350irq/132-enp0s29f1:rx-023:21:380
3090241991513,1cyclictest60350irq/132-enp0s29f1:rx-023:21:370
3090241991513,1cyclictest60350irq/132-enp0s29f1:rx-023:15:190
3090241991512,2cyclictest3380695-21kworker/u8:0+events_unbound00:04:170
3090251991411,2cyclictest3304450-21kthreadcore22:35:183
3090251991411,2cyclictest0-21swapper/321:55:003
3090247991412,1cyclictest3292238-21kworker/u8:0+events_unbound22:50:172
3090247991411,2cyclictest3182839-21idleruntime-cro20:39:592
3090247991411,2cyclictest3146826-21kworker/u8:4+flush-259:020:40:242
309024499149,4cyclictest3235197-21latency_hist21:30:011
309024499141,2cyclictest33283111latency_hist23:00:001
3090244991412,1cyclictest0-21swapper/123:10:001
3090244991412,1cyclictest0-21swapper/122:10:011
3090244991411,2cyclictest3193145-21kworker/u8:1+flush-259:022:00:001
3090244991411,2cyclictest0-21swapper/123:35:191
3090244991410,3cyclictest3401540-21apt-get00:10:111
309025199139,3cyclictest3203429-21apt-get21:00:023
3090251991310,2cyclictest3375083-21unixbench_singl23:40:263
3090251991310,2cyclictest3095380-21idleruntime-cro19:15:003
309024799139,2cyclictest3042148-21kworker/u8:0+events_unbound19:50:132
3090247991310,2cyclictest3391207-21kworker/u8:4+events_unbound00:10:132
309024499138,4cyclictest3256418-21apt-get21:50:121
3090244991311,1cyclictest0-21swapper/121:00:001
3090244991310,2cyclictest3106367-21irqcore19:25:171
309024499129,2cyclictest3375847-21cpuspeed_turbos23:45:141
309024499129,2cyclictest3240717-21cpuspeed_turbos21:35:131
309025199119,1cyclictest3119207-21kthreadcore19:35:193
309025199119,1cyclictest0-21swapper/319:20:203
309025199118,2cyclictest3266974-21fschecks_time22:00:153
309025199118,2cyclictest3220062-21cpuspeed_turbos21:15:153
309025199118,2cyclictest3188320-21cpuspeed_turbos20:45:143
309025199118,2cyclictest3132638-21kthreadcore19:50:163
309025199117,3cyclictest3370343-21awk23:40:003
309025199117,3cyclictest3146826-21kworker/u8:4+flush-259:020:15:173
309024799117,3cyclictest3141703-21kworker/u8:2+events_unbound20:30:202
309024499119,1cyclictest0-21swapper/122:30:141
309024499118,2cyclictest3347396-21kthreadcore23:15:201
309024499117,3cyclictest3167927-21perl20:25:151
309024499115,4cyclictest3145912-21ntpq20:00:221
309024199111,3cyclictest16-21ksoftirqd/019:10:010
309025199108,1cyclictest0-21swapper/323:30:003
309025199108,1cyclictest0-21swapper/320:30:213
309025199107,2cyclictest0-21swapper/320:35:133
309025199105,3cyclictest3318513-21fw_forwarded_lo22:50:153
309024499108,1cyclictest0-21swapper/123:55:161
309024499107,2cyclictest3360359-21cpuspeed_turbos23:30:131
30902449995,3cyclictest3287572-21uniq22:20:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional