You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 23:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Tue Apr 28, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3007153994744,2cyclictest3323176-21kworker/u8:2+events_unbound12:25:003
3007153994643,2cyclictest3007118-21kworker/u8:1+events_unbound07:30:223
3007145994340,2cyclictest3162760-21kworker/u8:2+flush-259:009:49:591
3007145994236,4cyclictest3126609-21latency_hist09:05:021
3007153993936,2cyclictest3240975-21kworker/u8:2+flush-259:010:55:253
3007148993934,4cyclictest3282147-21apt-get11:35:142
3007148993934,4cyclictest3100490-21kworker/u8:1+flush-259:008:50:192
3007141993934,4cyclictest3100027-21ntpq08:35:220
3007141993933,4cyclictest252-21systemd-journal07:12:470
3007153993835,2cyclictest3168593-21kworker/u8:3+flush-259:009:45:223
3007153993734,2cyclictest3225321-21kworker/u8:1+flush-259:011:10:003
3007153993733,3cyclictest3100490-21kworker/u8:1+flush-259:009:00:243
3007145993733,3cyclictest3334291-21kworker/u8:3+flush-259:012:30:001
3007153993633,2cyclictest3214986-21kworker/u8:0+flush-259:011:50:213
3007148993631,3cyclictest252-21systemd-journal11:50:002
3007145993632,3cyclictest3225539-21apt-get10:40:111
3007145993632,3cyclictest252-21systemd-journal10:36:481
3007145993531,3cyclictest3162760-21kworker/u8:2+flush-259:010:20:221
3007141993529,4cyclictest3047602-21ntpq07:45:220
3007148993427,4cyclictest252-21systemd-journal08:57:472
3007145993427,5cyclictest3204674-21latency_hist10:20:001
3007141993431,2cyclictest3162760-21kworker/u8:2+flush-259:010:05:230
3007153993327,4cyclictest3307620-21ntpq11:55:213
3007141993329,3cyclictest3100490-21kworker/u8:1+flush-259:008:50:230
3007153993230,2cyclictest3100490-21kworker/u8:1+events_unbound09:05:263
3007153993229,2cyclictest3058744-21kworker/u8:3+flush-259:008:35:243
3007148993228,3cyclictest252-21systemd-journal10:26:472
3007145993228,3cyclictest3214986-21kworker/u8:0+flush-259:010:30:011
3007145993227,4cyclictest3142319-21kworker/u8:3+flush-259:009:20:241
3007153993128,2cyclictest3100490-21kworker/u8:1+events_unbound09:15:213
3007153993127,3cyclictest3058744-21kworker/u8:3+events_unbound08:30:013
3007153993126,4cyclictest3106034-21latency_hist08:45:013
3007148993127,2cyclictest3292298-21gpgv11:45:012
3007145993126,3cyclictest3090122-21kworker/u8:2+events_unbound08:55:141
3007141993127,3cyclictest3303948-21kworker/u8:1+flush-259:012:00:270
3007141993126,4cyclictest3348816-21ntpq12:35:210
3007141993124,5cyclictest3260449-21ntpq11:10:210
3007153993027,2cyclictest3323176-21kworker/u8:2+events_unbound12:25:183
3007153993027,2cyclictest3168593-21kworker/u8:3+events_unbound10:45:013
3007153993027,2cyclictest2964107-21kworker/u8:0+events_unbound08:30:123
3007148993024,4cyclictest252-21systemd-journal09:20:012
3007141993023,5cyclictest3094407-21ntpq08:30:200
3007141993022,5cyclictest3177946-21ntpq09:50:200
3007153992927,2cyclictest3214986-21kworker/u8:0+flush-259:012:30:183
3007153992925,3cyclictest3168593-21kworker/u8:3+events_unbound10:10:163
3007153992924,3cyclictest3292841-21/usr/sbin/munin11:45:183
3007148992925,3cyclictest3199805-21apt-get10:15:102
3007148992922,5cyclictest3021820-21ntpq07:20:222
3007145992925,3cyclictest3303948-21kworker/u8:1+flush-259:012:15:111
3007141992926,2cyclictest3100490-21kworker/u8:1+flush-259:009:25:160
3007141992925,3cyclictest3168593-21kworker/u8:3+flush-259:009:45:150
3007141992925,3cyclictest3168593-21kworker/u8:3+events_unbound10:10:140
3007141992925,3cyclictest2964107-21kworker/u8:0+events_unbound09:10:010
3007153992825,2cyclictest3214986-21kworker/u8:0+flush-259:012:15:003
3007153992825,2cyclictest3090122-21kworker/u8:2+events_unbound08:55:223
3007153992823,4cyclictest3043267-21latency_hist07:45:003
3007153992823,4cyclictest3027479-21apt-get07:26:203
3007148992825,2cyclictest3058744-21kworker/u8:3+flush-259:008:20:182
3007148992823,4cyclictest3266731-21apt-get11:20:132
3007145992822,4cyclictest3085202-21apt-get08:25:121
3007153992725,2cyclictest3225321-21kworker/u8:1+events_unbound11:00:183
3007153992724,2cyclictest3022684-21kworker/u8:3+flush-259:007:45:183
3007145992723,3cyclictest3214986-21kworker/u8:0+flush-259:011:30:161
3007145992722,4cyclictest3064600-21apt-get08:05:121
3007145992721,5cyclictest3275843-21ntpq11:25:191
3007153992623,2cyclictest3214986-21kworker/u8:0+events_unbound12:05:193
3007153992623,2cyclictest3058744-21kworker/u8:3+flush-259:008:20:013
3007153992623,2cyclictest3058744-21kworker/u8:3+flush-259:008:20:003
3007153992623,2cyclictest3053368-21kworker/u8:2+flush-259:007:55:133
3007153992623,2cyclictest2964107-21kworker/u8:0+flush-259:009:10:223
3007153992621,3cyclictest509-21rs:main3
3007148992622,3cyclictest2964107-21kworker/u8:0+events_unbound08:15:242
3007148992622,3cyclictest2964107-21kworker/u8:0+events_unbound08:15:232
3007148992621,4cyclictest2964107-21kworker/u8:0+flush-259:008:00:212
3007145992622,3cyclictest3214986-21kworker/u8:0+flush-259:011:50:171
3007145992622,3cyclictest3022684-21kworker/u8:3+flush-259:007:26:201
3007141992623,2cyclictest3303948-21kworker/u8:1+events_unbound12:14:350
3007141992623,2cyclictest3214986-21kworker/u8:0+flush-259:011:45:110
3007141992622,3cyclictest3147646-21kworker/u8:0+events_unbound09:40:200
3007148992522,2cyclictest3168593-21kworker/u8:3+events_unbound10:45:242
3007145992521,3cyclictest3100490-21kworker/u8:1+events_unbound09:25:221
3007145992519,4cyclictest3157042-21ntpq09:30:231
3007145992519,4cyclictest3069760-21apt-get08:10:111
3007145992518,5cyclictest3017489-21latency_hist07:20:011
3007141992522,2cyclictest3225321-21kworker/u8:1+flush-259:010:55:200
3007141992522,2cyclictest3214986-21kworker/u8:0+flush-259:010:30:130
3007141992522,2cyclictest3214986-21kworker/u8:0+events_unbound11:50:210
3007141992521,3cyclictest3323176-21kworker/u8:2+events_unbound12:21:480
3007141992521,3cyclictest3179136-21apt-get09:55:110
3007141992521,3cyclictest3090122-21kworker/u8:2+flush-259:008:55:250
3007141992520,4cyclictest3142319-21kworker/u8:3+events_unbound09:35:130
3007153992421,2cyclictest2964107-21kworker/u8:0+flush-259:007:10:223
3007153992420,3cyclictest3162760-21kworker/u8:2+events_unbound09:55:123
3007148992420,3cyclictest2964107-21kworker/u8:0+flush-259:007:10:282
3007148992419,3cyclictest509-21rs:main2
3007145992420,3cyclictest3214986-21kworker/u8:0+flush-259:011:55:161
3007145992418,4cyclictest3319094-21/usr/sbin/munin12:10:131
3007141992421,2cyclictest3281903-21kworker/u8:3+flush-259:011:40:010
3007141992421,2cyclictest3022684-21kworker/u8:3+flush-259:007:40:200
3007141992420,3cyclictest3162760-21kworker/u8:2+flush-259:010:00:140
3007141992417,5cyclictest252-21systemd-journal10:29:590
300714199241,21cyclictest1-21systemd11:03:470
300714199240,22cyclictest1-21systemd11:05:470
3007153992320,2cyclictest3162760-21kworker/u8:2+flush-259:009:50:203
3007153992320,2cyclictest3162760-21kworker/u8:2+events_unbound10:05:473
3007148992319,3cyclictest3240975-21kworker/u8:2+flush-259:010:55:172
3007148992317,4cyclictest252-21systemd-journal10:55:002
3007148992316,5cyclictest3349707-21latency_hist12:40:012
3007145992320,3cyclictest3168593-21kworker/u8:3+flush-259:010:50:251
3007145992319,3cyclictest3214986-21kworker/u8:0+events_unbound11:45:181
3007145992318,4cyclictest3100490-21kworker/u8:1+events_unbound08:45:231
3007145992317,4cyclictest3261542-21/usr/sbin/munin11:15:151
3007145992317,4cyclictest3184324-21apt-get10:00:121
3007141992319,3cyclictest3100490-21kworker/u8:1+events_unbound09:30:150
3007141992319,3cyclictest3058744-21kworker/u8:3+events_unbound08:25:180
3007141992319,3cyclictest3058744-21kworker/u8:3+events_unbound08:18:490
3007141992319,3cyclictest3058744-21kworker/u8:3+events_unbound08:18:490
3007141992318,4cyclictest3053852-21apt-get07:55:120
3007153992220,2cyclictest3214986-21kworker/u8:0+events_unbound10:53:483
3007153992219,2cyclictest3214986-21kworker/u8:0+flush-259:011:40:183
3007153992219,2cyclictest3168593-21kworker/u8:3+flush-259:010:00:263
3007153992219,2cyclictest3058744-21kworker/u8:3+flush-259:008:10:133
3007153992218,3cyclictest3214986-21kworker/u8:0+flush-259:011:35:193
3007153992218,3cyclictest3022684-21kworker/u8:3+events_unbound07:38:493
3007148992219,2cyclictest3214986-21kworker/u8:0+flush-259:010:30:232
3007148992218,3cyclictest3022684-21kworker/u8:3+flush-259:007:50:262
3007148992217,4cyclictest3276980-21/usr/sbin/munin11:30:132
3007148992217,3cyclictest3225321-21kworker/u8:1+flush-259:011:00:232
3007145992218,3cyclictest3214986-21kworker/u8:0+events_unbound11:40:141
3007145992216,4cyclictest3287049-21latency_hist11:40:011
3007141992218,3cyclictest3100490-21kworker/u8:1+events_unbound09:00:230
3007141992217,3cyclictest3100490-21kworker/u8:1+flush-259:009:15:260
3007153992119,2cyclictest3303948-21kworker/u8:1+events_unbound12:15:193
3007153992118,2cyclictest3162760-21kworker/u8:2+flush-259:010:25:003
300715399211,18cyclictest1-21systemd11:15:013
3007148992118,2cyclictest3168593-21kworker/u8:3+flush-259:010:35:262
3007148992117,3cyclictest3142319-21kworker/u8:3+flush-259:009:20:262
3007148992117,3cyclictest3100490-21kworker/u8:1+flush-259:009:25:182
3007148992117,3cyclictest3100490-21kworker/u8:1+flush-259:009:05:272
3007145992117,3cyclictest3058744-21kworker/u8:3+events_unbound08:35:211
3007145992117,3cyclictest3022684-21kworker/u8:3+flush-259:007:50:201
3007145992116,4cyclictest2964107-21kworker/u8:0+flush-259:007:20:251
3007141992118,2cyclictest3168593-21kworker/u8:3+flush-259:010:45:150
3007141992118,2cyclictest2964107-21kworker/u8:0+flush-259:007:16:520
3007141992117,3cyclictest3214986-21kworker/u8:0+events_unbound11:30:140
3007141992117,2cyclictest3168593-21kworker/u8:3+events_unbound10:15:200
3007153992017,2cyclictest2964107-21kworker/u8:0+flush-259:008:00:153
3007153992016,3cyclictest3214986-21kworker/u8:0+events_unbound11:20:133
3007153992016,3cyclictest3142319-21kworker/u8:3+events_unbound09:34:163
3007148992017,2cyclictest3334291-21kworker/u8:3+flush-259:012:30:232
3007148992017,2cyclictest2964107-21kworker/u8:0+flush-259:009:10:202
3007148992017,2cyclictest2964107-21kworker/u8:0+flush-259:008:40:222
3007148992016,3cyclictest2964107-21kworker/u8:0+flush-259:007:40:152
3007148992015,4cyclictest3053368-21kworker/u8:2+flush-259:007:55:232
3007145992016,3cyclictest3058744-21kworker/u8:3+events_unbound08:20:221
3007145992015,4cyclictest3007118-21kworker/u8:1+flush-259:007:30:181
3007141992017,2cyclictest3323176-21kworker/u8:2+events_unbound12:25:140
3007141992017,2cyclictest3214986-21kworker/u8:0+events_unbound11:40:220
3007141992017,2cyclictest3100490-21kworker/u8:1+events_unbound09:20:120
3007153991917,1cyclictest3100490-21kworker/u8:1+events_unbound09:25:123
3007153991916,2cyclictest3142319-21kworker/u8:3+flush-259:009:35:183
3007153991916,2cyclictest3142319-21kworker/u8:3+events_unbound09:24:073
3007153991915,3cyclictest3303948-21kworker/u8:1+flush-259:012:00:033
3007148991915,3cyclictest3168593-21kworker/u8:3+events_unbound10:10:232
3007145991916,2cyclictest3303948-21kworker/u8:1+events_unbound12:05:231
3007145991914,3cyclictest252-21systemd-journal07:39:471
3007145991913,4cyclictest509-21rs:main1
3007145991913,4cyclictest252-21systemd-journal08:15:471
3007145991913,4cyclictest252-21systemd-journal08:15:471
3007141991916,2cyclictest3053368-21kworker/u8:2+flush-259:008:14:030
3007141991915,3cyclictest3100490-21kworker/u8:1+flush-259:008:45:160
3007141991915,3cyclictest3100490-21kworker/u8:1+flush-259:008:40:160
3007141991913,4cyclictest3131958-21gpgv09:10:000
3007153991816,2cyclictest3168593-21kworker/u8:3+events_unbound10:45:173
3007153991815,2cyclictest3065620-21kthreadcore08:05:173
3007153991814,3cyclictest3100490-21kworker/u8:1+flush-259:008:45:253
3007153991814,3cyclictest2964107-21kworker/u8:0+flush-259:007:20:193
3007148991815,2cyclictest3045830-21kthreadcore07:45:182
3007145991815,2cyclictest2964107-21kworker/u8:0+events_unbound08:30:141
3007145991814,3cyclictest3100490-21kworker/u8:1+events_unbound08:40:211
3007145991813,3cyclictest3100490-21kworker/u8:1+events_unbound09:05:191
3007145991813,3cyclictest3007356-21apt-get07:10:141
3007141991815,2cyclictest3214986-21kworker/u8:0+events_unbound11:55:200
3007141991815,2cyclictest3053368-21kworker/u8:2+events_unbound08:09:480
3007141991814,3cyclictest3214986-21kworker/u8:0+flush-259:012:31:520
3007141991814,3cyclictest3022684-21kworker/u8:3+flush-259:007:26:580
3007141991813,3cyclictest3168593-21kworker/u8:3+events_unbound10:50:170
3007153991714,2cyclictest3214986-21kworker/u8:0+flush-259:011:30:203
3007153991713,3cyclictest3214986-21kworker/u8:0+flush-259:010:30:193
3007153991713,3cyclictest2964107-21kworker/u8:0+events_unbound07:53:473
3007153991710,5cyclictest3115457-21ntpq08:50:233
3007148991714,2cyclictest3028503-21irqcore07:30:172
3007148991713,3cyclictest3063911-21apt-get08:05:022
3007145991714,2cyclictest3225321-21kworker/u8:1+flush-259:011:00:201
3007145991713,3cyclictest3168593-21kworker/u8:3+events_unbound10:08:471
3007145991713,3cyclictest3053368-21kworker/u8:2+events_unbound07:55:201
3007141991713,3cyclictest3007118-21kworker/u8:1+events_unbound07:30:200
300714199170,15cyclictest3084948-21basename08:25:010
3007153991612,3cyclictest3214986-21kworker/u8:0+events_unbound10:38:213
3007153991610,4cyclictest3214986-21kworker/u8:0+flush-259:012:40:003
3007148991612,3cyclictest3303948-21kworker/u8:1+events_unbound12:05:012
3007148991612,3cyclictest3168593-21kworker/u8:3+flush-259:010:00:272
3007148991610,4cyclictest3100868-21latency_hist08:40:002
300714899160,15cyclictest1-21systemd09:44:472
3007145991613,2cyclictest3162760-21kworker/u8:2+flush-259:009:55:211
3007141991613,3cyclictest3214986-21kworker/u8:0+events_unbound11:19:330
3007141991613,2cyclictest3162760-21kworker/u8:2+events_unbound10:20:470
3007141991612,3cyclictest3214986-21kworker/u8:0+events_unbound12:10:000
3007153991512,2cyclictest3147646-21kworker/u8:0+events_unbound09:44:033
300714599159,4cyclictest252-21systemd-journal08:51:481
3007145991513,1cyclictest0-21swapper/107:45:001
3007145991512,2cyclictest3168593-21kworker/u8:3+events_unbound09:50:201
3007145991511,3cyclictest3251232-21kworker/u8:3+events_unbound11:05:151
3007145991511,3cyclictest3214986-21kworker/u8:0+events_unbound11:20:201
3007145991511,3cyclictest3168593-21kworker/u8:3+flush-259:010:45:201
3007141991513,2cyclictest60350irq/132-enp0s29f1:rx-010:40:030
3007141991513,2cyclictest60350irq/132-enp0s29f1:rx-010:39:190
3007141991513,1cyclictest60350irq/132-enp0s29f1:rx-011:25:230
300714899149,4cyclictest509-21rs:main2
300714899148,4cyclictest252-21systemd-journal11:55:012
3007145991411,2cyclictest3334291-21kworker/u8:3+flush-259:012:30:261
3007145991410,3cyclictest3168593-21kworker/u8:3+events_unbound10:10:191
3007141991412,2cyclictest60350irq/132-enp0s29f1:rx-007:22:050
3007141991411,2cyclictest61150irq/133-enp0s29f1:tx-007:35:180
300714899139,3cyclictest3251232-21kworker/u8:3+flush-259:011:05:312
300714899130,12cyclictest1-21systemd09:38:472
300714599139,3cyclictest3323176-21kworker/u8:2+flush-259:012:35:181
300714899129,2cyclictest3208810-21needreboot10:20:172
300714899128,3cyclictest3100490-21kworker/u8:1+flush-259:009:30:332
300714899128,2cyclictest0-21swapper/208:15:002
300714899127,4cyclictest252-21systemd-journal07:26:192
300714599129,2cyclictest3168144-21unixbench_multi09:40:271
300714599128,2cyclictest0-21swapper/112:20:161
300714899118,2cyclictest3261327-21kworker/u8:2+flush-259:011:25:242
300714899118,2cyclictest3214986-21kworker/u8:0+flush-259:011:55:152
300714899117,2cyclictest0-21swapper/208:30:152
300714899111,2cyclictest3126609-21latency_hist09:05:002
300714899108,1cyclictest0-21swapper/212:15:112
300714899108,1cyclictest0-21swapper/209:50:002
300714899107,2cyclictest3314184-21fschecks_time12:05:152
300714899107,1cyclictest0-21swapper/212:20:242
300714899106,3cyclictest3100490-21kworker/u8:1+events_unbound08:45:212
300714899104,4cyclictest252-21systemd-journal08:26:482
30071489996,1cyclictest3017489-21latency_hist07:20:012
30071489995,3cyclictest3214986-21kworker/u8:0+events_unbound10:40:232
30071489994,4cyclictest3323942-21sh12:14:592
30071489990,2cyclictest3184059-21latency_hist10:00:002
30071489984,3cyclictest3175637-21tr09:50:172
30071489980,1cyclictest0-21swapper/210:05:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional