You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 19:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Mon Aug 03, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3066715995853,3cyclictest3145178-21kworker/u8:3+flush-259:008:55:010
3066725994845,2cyclictest3093162-21kworker/u8:1+events_unbound08:05:013
3066715994638,5cyclictest3098110-21latency_hist07:40:010
3066719994236,4cyclictest509-21rs:main1
3066723994138,2cyclictest3218451-21kworker/u8:0+events_unbound10:30:182
3066725993933,4cyclictest3374625-21gpgv12:05:013
3066719993932,5cyclictest3176498-21latency_hist08:55:011
3066725993633,2cyclictest3093162-21kworker/u8:1+flush-259:008:40:013
3066723993531,3cyclictest3197702-21kworker/u8:2+flush-259:010:15:212
3066715993531,3cyclictest3369544-21kworker/u8:4+events_unbound12:05:180
3066719993329,3cyclictest3092535-21gpgv07:35:001
3066719993328,3cyclictest335557-21systemd-journal11:20:001
3066719993328,3cyclictest3119441-21apt-get08:00:121
3066719993327,4cyclictest335557-21systemd-journal10:45:211
3066725993229,2cyclictest3244572-21kworker/u8:4+events_unbound10:55:233
3066723993228,3cyclictest3296146-21kworker/u8:0+flush-259:011:10:252
3066719993228,3cyclictest3093162-21kworker/u8:1+flush-259:008:50:011
3066715993225,5cyclictest3363201-21ntpq11:50:200
3066723993124,5cyclictest335557-21systemd-journal09:00:002
3066719993127,3cyclictest3234008-21kworker/u8:3+flush-259:010:00:001
3066719993127,3cyclictest3093162-21kworker/u8:1+flush-259:008:10:001
3066719993126,3cyclictest3072119-21apt-get07:15:131
3066719993126,3cyclictest3072119-21apt-get07:15:131
3066719993125,4cyclictest335557-21systemd-journal12:35:371
3066719993124,5cyclictest3368380-21ntpq11:55:201
3066715993128,2cyclictest3244572-21kworker/u8:4+events_unbound10:32:590
3066715993126,3cyclictest3391145-21apt-get12:20:110
3066725993027,3cyclictest3218451-21kworker/u8:0+events_unbound10:29:593
3066725993027,2cyclictest3244572-21kworker/u8:4+flush-259:010:00:593
3066723993023,5cyclictest3317407-21cp11:10:012
3066719993024,4cyclictest3113151-21ntpq07:50:231
3066725992926,3cyclictest3061480-21kworker/u8:2+events_unbound07:16:563
3066725992926,3cyclictest3061480-21kworker/u8:2+events_unbound07:16:563
3066725992925,3cyclictest3197702-21kworker/u8:2+events_unbound09:53:003
3066725992925,3cyclictest3150581-21kworker/u8:0+flush-259:008:45:013
3066725992924,3cyclictest3139821-21latency_hist08:20:013
3066723992925,3cyclictest3061480-21kworker/u8:2+events_unbound07:49:432
3066723992923,4cyclictest3233075-21ntpq09:45:202
3066719992921,6cyclictest335557-21systemd-journal11:34:591
3066723992825,2cyclictest3244572-21kworker/u8:4+events_unbound10:05:192
3066719992823,3cyclictest3375072-21gpgv12:05:011
3066719992823,3cyclictest3124378-21kworker/u8:2+flush-259:008:14:551
3066719992821,5cyclictest3202897-21latency_hist09:20:001
3066725992723,3cyclictest3379874-21kworker/u8:1+flush-259:012:09:593
3066719992721,4cyclictest3217538-21ntpq09:30:211
3066715992724,2cyclictest3312250-21kworker/u8:1+events_unbound11:30:000
3066715992723,3cyclictest3312250-21kworker/u8:1+events_unbound11:10:000
3066715992720,5cyclictest335557-21systemd-journal10:53:590
3066725992622,3cyclictest3197702-21kworker/u8:2+events_unbound09:59:593
3066723992623,2cyclictest3124378-21kworker/u8:2+flush-259:008:19:562
3066723992622,3cyclictest3208096-21kworker/u8:5+events_unbound09:45:002
3066723992622,3cyclictest3092511-21apt-get07:35:012
3066725992523,2cyclictest3187319-21kworker/u8:1+events_unbound09:19:003
3066725992522,2cyclictest3124378-21kworker/u8:2+events_unbound08:13:553
3066725992521,3cyclictest3312250-21kworker/u8:1+events_unbound11:49:003
3066725992521,3cyclictest3061480-21kworker/u8:2+flush-259:007:30:563
3066719992520,3cyclictest3280888-21apt-get10:35:141
3066719992519,4cyclictest3071852-21latency_hist07:15:011
3066715992521,3cyclictest3093162-21kworker/u8:1+events_unbound08:21:550
3066725992422,2cyclictest3322816-21kworker/u8:2+events_unbound11:19:023
3066725992421,2cyclictest3312250-21kworker/u8:1+events_unbound11:33:003
3066725992421,2cyclictest3208096-21kworker/u8:5+flush-259:009:50:003
3066725992420,3cyclictest3389861-21kworker/u8:3+events_unbound12:25:273
3066725992420,3cyclictest3285837-21kworker/u8:1+events_unbound10:45:593
3066719992418,3cyclictest3385498-21base6412:15:011
3066725992320,2cyclictest3061480-21kworker/u8:2+events_unbound07:13:543
3066725992319,3cyclictest507-21in:imuxsock11:10:003
3066725992319,3cyclictest3197702-21kworker/u8:2+flush-259:010:35:183
3066723992320,2cyclictest3322816-21kworker/u8:2+events_unbound11:17:012
3066723992320,2cyclictest3150581-21kworker/u8:0+events_unbound08:42:592
3066723992320,2cyclictest3124378-21kworker/u8:2+events_unbound08:25:242
3066723992319,3cyclictest3312250-21kworker/u8:1+events_unbound11:20:132
3066723992319,3cyclictest3244572-21kworker/u8:4+events_unbound10:50:232
3066723992319,3cyclictest3050809-21kworker/u8:0+events_unbound07:55:202
3066723992318,4cyclictest3338726-21diskstats11:30:132
3066719992318,3cyclictest3374514-21apt-get12:04:591
3066719992317,4cyclictest3389861-21kworker/u8:3+flush-259:012:35:001
3066719992317,4cyclictest3311600-21apt-get11:05:011
3066715992316,5cyclictest335557-21systemd-journal09:38:580
3066725992220,2cyclictest3348632-21kworker/u8:2+events_unbound12:31:593
3066725992220,2cyclictest3296146-21kworker/u8:0+events_unbound11:22:003
3066725992220,2cyclictest3124378-21kworker/u8:2+events_unbound08:30:243
3066725992219,2cyclictest3171481-21kworker/u8:4+flush-259:008:50:163
3066725992219,2cyclictest3093162-21kworker/u8:1+events_unbound07:45:213
3066725992217,4cyclictest335557-21systemd-journal08:25:013
3066723992219,2cyclictest3389861-21kworker/u8:3+flush-259:012:35:252
3066723992218,3cyclictest3197702-21kworker/u8:2+events_unbound09:58:002
3066723992218,3cyclictest3061480-21kworker/u8:2+flush-259:007:10:212
3066719992219,2cyclictest3171481-21kworker/u8:4+events_unbound09:35:181
3066719992217,3cyclictest3358951-21latency_hist11:50:001
3066719992216,4cyclictest3312209-21cat11:05:011
3066719992215,5cyclictest3139927-21cp08:20:011
3066715992219,2cyclictest3244572-21kworker/u8:4+events_unbound11:00:240
3066715992217,3cyclictest335557-21systemd-journal10:50:000
3066725992117,3cyclictest3150581-21kworker/u8:0+events_unbound09:09:593
3066723992118,2cyclictest3171481-21kworker/u8:4+events_unbound09:35:222
3066723992117,3cyclictest3187319-21kworker/u8:1+flush-259:009:10:252
3066723992116,4cyclictest3076997-21latency_hist07:20:012
3066723992116,4cyclictest3076997-21latency_hist07:20:012
3066719992115,4cyclictest3114216-21/usr/sbin/munin07:55:251
3066715992118,2cyclictest3187319-21kworker/u8:1+flush-259:009:25:000
3066715992117,3cyclictest3244572-21kworker/u8:4+flush-259:010:10:200
3066715992117,3cyclictest3093162-21kworker/u8:1+flush-259:008:00:260
3066725992017,2cyclictest3050809-21kworker/u8:0+flush-259:007:55:213
3066725992016,3cyclictest3312250-21kworker/u8:1+flush-259:011:35:203
3066725992014,4cyclictest3385323-21latency_hist12:15:013
3066723992017,2cyclictest3328210-21kworker/u8:3+events_unbound11:44:002
3066723992016,3cyclictest3389861-21kworker/u8:3+events_unbound12:15:212
3066723992016,3cyclictest3328210-21kworker/u8:3+events_unbound11:47:012
3066723992016,3cyclictest3093162-21kworker/u8:1+flush-259:007:44:552
3066723992016,3cyclictest3061480-21kworker/u8:2+flush-259:007:30:262
3066719992014,4cyclictest335557-21systemd-journal12:16:581
3066715992016,3cyclictest3050809-21kworker/u8:0+flush-259:007:14:550
3066725991917,2cyclictest3171481-21kworker/u8:4+events_unbound09:25:133
3066725991916,2cyclictest3348632-21kworker/u8:2+events_unbound12:38:003
3066725991916,2cyclictest3171481-21kworker/u8:4+events_unbound09:20:223
3066725991915,3cyclictest3061480-21kworker/u8:2+events_unbound07:20:563
3066723991915,3cyclictest3208096-21kworker/u8:5+events_unbound09:29:592
3066723991915,3cyclictest3150581-21kworker/u8:0+events_unbound08:50:022
3066723991915,3cyclictest3061480-21kworker/u8:2+events_unbound07:26:552
3066723991914,3cyclictest3171481-21kworker/u8:4+flush-259:009:30:242
3066719991913,4cyclictest3082487-21apt-get07:25:131
3066715991912,5cyclictest3301548-21/usr/sbin/munin10:55:170
3066725991816,2cyclictest3244572-21kworker/u8:4+events_unbound10:10:143
3066725991814,3cyclictest3296146-21kworker/u8:0+flush-259:011:00:183
3066723991815,2cyclictest509-21rs:main2
3066723991815,2cyclictest3374963-21latency_hist12:05:002
3066723991814,3cyclictest3358966-21kworker/u8:0+flush-259:012:10:212
3066723991814,3cyclictest3328210-21kworker/u8:3+flush-259:011:50:202
3066723991814,3cyclictest3197702-21kworker/u8:2+flush-259:010:25:012
3066723991814,3cyclictest3197702-21kworker/u8:2+events_unbound10:25:212
3066719991816,1cyclictest0-21swapper/111:00:001
3066719991815,2cyclictest3270248-21idleruntime-cro10:25:001
3066719991813,3cyclictest3223895-21apt-get09:40:111
3066719991813,3cyclictest3208313-21/usr/sbin/munin09:25:141
306671999181,15cyclictest3145434-21unin-run08:25:011
306671999181,15cyclictest1-21systemd11:40:311
3066715991815,2cyclictest3348632-21kworker/u8:2+flush-259:012:15:250
3066715991814,3cyclictest3124378-21kworker/u8:2+events_unbound08:29:590
3066715991813,4cyclictest509-21rs:main0
3066715991813,3cyclictest509-21rs:main0
3066725991714,2cyclictest3171481-21kworker/u8:4+flush-259:009:45:013
3066725991713,3cyclictest3124378-21kworker/u8:2+flush-259:008:25:173
3066725991712,4cyclictest3280615-21latency_hist10:35:013
3066723991714,2cyclictest3249527-21cron10:05:002
3066723991713,3cyclictest3389861-21kworker/u8:3+flush-259:012:25:262
3066723991713,3cyclictest3389861-21kworker/u8:3+events_unbound12:23:592
3066723991713,3cyclictest3348632-21kworker/u8:2+events_unbound12:31:012
3066723991713,2cyclictest0-21swapper/209:25:002
3066723991710,5cyclictest3182225-21cat09:00:002
3066719991711,4cyclictest3249811-21apt-get10:05:111
3066715991714,2cyclictest3285837-21kworker/u8:1+flush-259:010:40:250
3066715991713,3cyclictest3312250-21kworker/u8:1+events_unbound11:35:220
3066715991713,3cyclictest3244572-21kworker/u8:4+flush-259:010:35:270
3066715991713,3cyclictest3197702-21kworker/u8:2+flush-259:009:45:110
3066725991613,2cyclictest3364364-21kworker/u8:1+events_unbound11:55:163
3066725991613,2cyclictest3150581-21kworker/u8:0+events_unbound08:58:583
3066725991613,2cyclictest3050809-21kworker/u8:0+events_unbound07:10:013
3066725991612,3cyclictest3093162-21kworker/u8:1+events_unbound07:40:153
3066725991612,3cyclictest3061480-21kworker/u8:2+events_unbound07:36:553
3066725991612,2cyclictest3359636-21irqcore11:50:153
3066723991612,3cyclictest3296146-21kworker/u8:0+events_unbound11:01:012
3066723991612,3cyclictest3145178-21kworker/u8:3+events_unbound09:05:192
3066723991612,3cyclictest3050809-21kworker/u8:0+events_unbound07:53:552
3066723991612,3cyclictest1607760-21fwupd09:17:582
3066719991612,2cyclictest0-21swapper/107:10:011
3066719991610,4cyclictest3160027-21ntpq08:35:191
3066715991614,1cyclictest60350irq/132-enp0s29f1:rx-011:25:210
3066715991614,1cyclictest60350irq/132-enp0s29f1:rx-009:30:140
3066715991614,1cyclictest0-21swapper/008:45:010
3066715991613,2cyclictest60350irq/132-enp0s29f1:rx-007:16:220
3066715991613,2cyclictest60350irq/132-enp0s29f1:rx-007:16:210
3066725991512,2cyclictest3197702-21kworker/u8:2+flush-259:010:05:153
3066725991512,2cyclictest3187319-21kworker/u8:1+events_unbound09:11:583
3066725991511,3cyclictest3312250-21kworker/u8:1+events_unbound11:25:303
3066725991511,3cyclictest3244572-21kworker/u8:4+events_unbound11:13:003
3066725991511,3cyclictest3171481-21kworker/u8:4+events_unbound09:40:003
3066723991512,3cyclictest3358966-21kworker/u8:0+events_unbound11:55:332
3066723991512,2cyclictest3296146-21kworker/u8:0+events_unbound11:25:142
3066723991512,2cyclictest3166137-21kworker/u8:2+events_unbound08:45:582
3066723991511,3cyclictest3379874-21kworker/u8:1+events_unbound12:09:002
3066723991511,3cyclictest3093162-21kworker/u8:1+events_unbound08:39:572
3066723991510,4cyclictest509-21rs:main2
3066723991510,4cyclictest507-21in:imuxsock08:15:002
3066719991512,2cyclictest3166077-21idleruntime-cro08:45:001
3066719991510,3cyclictest3244610-21apt-get10:00:111
3066719991510,3cyclictest3093162-21kworker/u8:1+flush-259:007:40:101
3066715991513,1cyclictest61150irq/133-enp0s29f1:tx-007:50:170
3066715991513,1cyclictest60350irq/132-enp0s29f1:rx-010:25:160
3066715991513,1cyclictest60350irq/132-enp0s29f1:rx-009:15:150
3066715991513,1cyclictest60350irq/132-enp0s29f1:rx-009:10:250
3066715991513,1cyclictest60350irq/132-enp0s29f1:rx-008:35:180
3066715991513,1cyclictest60350irq/132-enp0s29f1:rx-008:30:120
3066715991513,1cyclictest60350irq/132-enp0s29f1:rx-008:07:070
3066715991512,2cyclictest60350irq/132-enp0s29f1:rx-012:35:180
3066715991512,2cyclictest60350irq/132-enp0s29f1:rx-012:00:210
3066715991512,2cyclictest60350irq/132-enp0s29f1:rx-010:20:270
3066715991512,2cyclictest60350irq/132-enp0s29f1:rx-010:16:480
3066715991512,2cyclictest60350irq/132-enp0s29f1:rx-009:40:150
3066715991512,2cyclictest60350irq/132-enp0s29f1:rx-008:15:240
3066715991512,2cyclictest60350irq/132-enp0s29f1:rx-008:00:010
3066715991512,2cyclictest60350irq/132-enp0s29f1:rx-007:25:230
3066715991512,2cyclictest3244572-21kworker/u8:4+flush-259:010:05:230
3066715991512,1cyclictest1-21systemd10:01:580
3066715991511,3cyclictest3389861-21kworker/u8:3+events_unbound12:30:140
3066725991411,2cyclictest3171481-21kworker/u8:4+flush-259:009:30:173
3066725991410,3cyclictest3197702-21kworker/u8:2+events_unbound10:15:593
3066723991410,3cyclictest3124378-21kworker/u8:2+flush-259:008:24:572
306671999149,4cyclictest3197702-21kworker/u8:2+flush-259:010:25:101
306671999149,4cyclictest3197702-21kworker/u8:2+flush-259:009:20:151
306671999148,4cyclictest3192500-21latency_hist09:10:001
306671999147,5cyclictest3154861-21ntpq08:30:221
306671999140,8cyclictest3364136-21munin-run11:54:591
3066715991412,1cyclictest60350irq/132-enp0s29f1:rx-011:45:250
3066715991412,1cyclictest60350irq/132-enp0s29f1:rx-011:40:180
3066715991411,2cyclictest60350irq/132-enp0s29f1:rx-011:20:130
3066715991411,2cyclictest60350irq/132-enp0s29f1:rx-009:58:010
3066715991411,2cyclictest60350irq/132-enp0s29f1:rx-008:11:270
3066715991411,2cyclictest60350irq/132-enp0s29f1:rx-007:30:220
3066715991411,2cyclictest3192502-21turbostat09:10:000
306672599139,2cyclictest3290518-21unixbench_multi10:40:253
3066725991311,2cyclictest3197702-21kworker/u8:2+events_unbound10:20:163
3066725991310,2cyclictest3166137-21kworker/u8:2+events_unbound08:47:593
306672399139,3cyclictest3244572-21kworker/u8:4+events_unbound10:12:592
306672399139,3cyclictest3197702-21kworker/u8:2+flush-259:010:45:192
3066723991310,2cyclictest3244572-21kworker/u8:4+events_unbound10:57:002
3066723991310,2cyclictest3197702-21kworker/u8:2+events_unbound09:51:592
3066723991310,2cyclictest3050809-21kworker/u8:0+events_unbound08:05:152
306671999139,3cyclictest3317218-21apt-get11:10:021
306671999138,4cyclictest3103550-21apt-get07:45:121
306671999130,12cyclictest0-21swapper/112:30:001
3066715991312,1cyclictest60350irq/132-enp0s29f1:rx-012:14:170
3066715991312,1cyclictest60350irq/132-enp0s29f1:rx-007:40:470
3066715991311,2cyclictest60350irq/132-enp0s29f1:rx-008:45:130
3066715991311,1cyclictest60350irq/132-enp0s29f1:rx-012:25:160
3066715991311,1cyclictest60350irq/132-enp0s29f1:rx-008:55:280
3066715991311,1cyclictest60350irq/132-enp0s29f1:rx-007:46:380
3066715991310,2cyclictest60350irq/132-enp0s29f1:rx-011:55:190
3066715991310,2cyclictest500-21systemd-logind09:55:000
306672599129,2cyclictest3312250-21kworker/u8:1+flush-259:011:41:013
306672599128,3cyclictest3109106-21apt-get07:50:123
306672399129,2cyclictest3093162-21kworker/u8:1+events_unbound08:34:592
306672399128,3cyclictest3076805-21kworker/u8:3+events_unbound07:24:392
306672399127,4cyclictest3123435-21ntpq08:00:232
306671999129,2cyclictest3290505-21unixbench_multi10:40:251
306671999129,2cyclictest3193195-21irqcore09:10:161
306671999128,3cyclictest3275703-21apt-get10:30:131
306671999128,3cyclictest3076805-21kworker/u8:3+flush-259:007:24:431
306672599117,3cyclictest491ktimers/312:20:113
306672599116,4cyclictest335557-21systemd-journal08:10:003
306672599111,8cyclictest3187294-21latency_hist09:05:003
306672399119,1cyclictest0-21swapper/210:40:142
306671999119,1cyclictest0-21swapper/109:00:261
306671999117,3cyclictest3093162-21kworker/u8:1+flush-259:007:35:211
306671999114,5cyclictest3145646-21/usr/sbin/munin08:25:151
306671599118,2cyclictest60350irq/132-enp0s29f1:rx-009:00:130
306672599108,1cyclictest0-21swapper/312:15:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional