You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 22:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Tue Mar 17, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2718860994340,2cyclictest2983573-21kworker/u8:1+events_unbound12:15:192
2718855993936,2cyclictest2890354-21kworker/u8:4+events_unbound10:35:220
2718860993835,2cyclictest3031593-21kworker/u8:2+events_unbound12:35:142
2718864993733,3cyclictest2973273-21kworker/u8:2+flush-259:011:19:043
2718864993733,3cyclictest2973273-21kworker/u8:2+flush-259:011:19:033
2718855993734,2cyclictest2729343-21kworker/u8:1+events_unbound07:30:140
2718864993632,3cyclictest2890354-21kworker/u8:4+flush-259:010:30:153
2718860993633,2cyclictest2890354-21kworker/u8:4+flush-259:010:10:142
2718860993633,2cyclictest2890354-21kworker/u8:4+events_unbound10:55:132
2718860993632,3cyclictest2900933-21kworker/u8:0+flush-259:010:15:242
2718855993633,2cyclictest2739435-21kworker/u8:0+flush-259:009:35:270
2718855993630,2cyclictest2983573-21kworker/u8:1+events_unbound12:25:150
2718860993531,3cyclictest2879844-21kworker/u8:1+events_unbound09:50:222
2718857993532,2cyclictest2786033-21kworker/u8:1+flush-259:009:30:001
2718857993430,3cyclictest2786033-21kworker/u8:1+events_unbound08:20:131
2718855993432,2cyclictest2953150-21kworker/u8:3+events_unbound10:55:250
2718855993431,2cyclictest2760412-21kworker/u8:2+flush-259:008:10:170
2718855993431,2cyclictest2739435-21kworker/u8:0+flush-259:007:50:270
2718860993229,2cyclictest3031593-21kworker/u8:2+events_unbound12:30:162
2718857993228,3cyclictest2675938-21kworker/u8:5+flush-259:007:45:211
2718855993230,2cyclictest2675938-21kworker/u8:5+flush-259:007:25:280
2718855993229,2cyclictest2983573-21kworker/u8:1+flush-259:011:35:230
2718860993126,2cyclictest2874451-21kworker/u8:3+events_unbound09:40:202
2718857993128,2cyclictest2890354-21kworker/u8:4+flush-259:010:40:201
2718855993129,2cyclictest2994377-21kworker/u8:0+events_unbound11:40:170
2718855993128,2cyclictest2931575-21kworker/u8:2+flush-259:011:05:250
2718855993128,2cyclictest2926009-21kworker/u8:0+events_unbound11:19:080
2718855993128,2cyclictest2926009-21kworker/u8:0+events_unbound11:19:070
2718864993025,3cyclictest2926009-21kworker/u8:0+flush-259:010:55:173
2718860993027,2cyclictest2973273-21kworker/u8:2+events_unbound11:45:232
2718860993027,2cyclictest2953150-21kworker/u8:3+events_unbound11:15:202
2718860993027,2cyclictest2953150-21kworker/u8:3+events_unbound11:15:192
2718860993027,2cyclictest2739435-21kworker/u8:0+events_unbound07:55:202
2718860993024,4cyclictest2989260-21cp11:30:002
2718857993026,3cyclictest2953150-21kworker/u8:3+events_unbound11:00:131
2718855993028,2cyclictest3031593-21kworker/u8:2+events_unbound12:10:130
2718855993025,4cyclictest2951694-21ntpq10:50:200
271885599301,27cyclictest2754876-21munin-run07:45:010
2718864992923,4cyclictest252-21systemd-journal09:31:333
2718860992926,2cyclictest2983573-21kworker/u8:1+events_unbound12:20:192
2718860992926,2cyclictest2973273-21kworker/u8:2+events_unbound11:25:232
2718860992926,2cyclictest2786033-21kworker/u8:1+events_unbound08:20:162
2718860992926,2cyclictest2739435-21kworker/u8:0+events_unbound07:45:232
2718860992924,4cyclictest252-21systemd-journal09:20:002
2718857992926,2cyclictest2953150-21kworker/u8:3+flush-259:011:10:201
2718857992924,3cyclictest2978640-21/usr/sbin/munin11:20:141
2718857992923,4cyclictest3062349-21latency_hist12:40:011
2718855992926,2cyclictest2874451-21kworker/u8:3+flush-259:010:00:220
2718855992926,2cyclictest2786033-21kworker/u8:1+flush-259:008:45:260
2718860992826,1cyclictest2739435-21kworker/u8:0+events_unbound07:40:142
2718860992825,2cyclictest2994377-21kworker/u8:0+flush-259:011:40:202
2718857992825,2cyclictest3031593-21kworker/u8:2+flush-259:012:10:141
2718857992823,3cyclictest2796671-21/usr/sbin/munin08:25:241
2718855992826,2cyclictest2983573-21kworker/u8:1+flush-259:012:15:240
2718855992826,2cyclictest2983573-21kworker/u8:1+events_unbound12:20:120
2718855992825,2cyclictest2760412-21kworker/u8:2+flush-259:008:10:000
2718864992721,4cyclictest2755672-21diskstats07:45:133
2718860992724,2cyclictest2843548-21kworker/u8:2+events_unbound09:30:172
2718860992723,3cyclictest2926009-21kworker/u8:0+events_unbound11:05:132
2718857992723,3cyclictest2675938-21kworker/u8:5+events_unbound07:15:151
2718855992724,2cyclictest2953150-21kworker/u8:3+flush-259:011:00:160
2718855992724,2cyclictest2739435-21kworker/u8:0+flush-259:008:30:290
2718864992619,5cyclictest2723953-21latency_hist07:15:013
2718860992624,2cyclictest2890354-21kworker/u8:4+flush-259:009:55:252
2718860992623,2cyclictest2900933-21kworker/u8:0+events_unbound10:05:152
2718860992623,2cyclictest2874451-21kworker/u8:3+events_unbound09:45:162
2718860992623,2cyclictest2675938-21kworker/u8:5+flush-259:008:05:162
2718860992622,3cyclictest2890354-21kworker/u8:4+events_unbound10:45:202
2718860992622,3cyclictest2786033-21kworker/u8:1+events_unbound08:25:222
2718860992619,5cyclictest2817617-21cp08:45:002
2718857992623,2cyclictest2994377-21kworker/u8:0+events_unbound12:00:151
2718855992623,2cyclictest2994377-21kworker/u8:0+events_unbound11:55:200
2718855992623,2cyclictest2983573-21kworker/u8:1+events_unbound11:50:210
2718855992623,2cyclictest2675938-21kworker/u8:5+events_unbound07:35:240
2718855992621,4cyclictest252-21systemd-journal08:45:000
2718864992520,3cyclictest2786033-21kworker/u8:1+flush-259:008:45:173
2718860992523,2cyclictest2890354-21kworker/u8:4+events_unbound10:40:142
2718860992522,2cyclictest2786033-21kworker/u8:1+events_unbound08:40:242
2718860992522,2cyclictest2675938-21kworker/u8:5+flush-259:007:50:232
2718857992522,2cyclictest2739435-21kworker/u8:0+events_unbound09:00:141
2718857992522,2cyclictest2739435-21kworker/u8:0+events_unbound09:00:131
2718857992522,2cyclictest2729343-21kworker/u8:1+events_unbound07:20:161
2718857992520,4cyclictest2823229-21apt-get08:50:091
2718855992522,2cyclictest2926009-21kworker/u8:0+events_unbound11:20:180
2718855992522,2cyclictest2786033-21kworker/u8:1+events_unbound08:50:120
2718864992420,3cyclictest2994377-21kworker/u8:0+flush-259:011:55:163
2718860992422,1cyclictest2760412-21kworker/u8:2+flush-259:008:10:252
2718860992421,2cyclictest2786033-21kworker/u8:1+events_unbound09:25:242
2718860992421,2cyclictest2729343-21kworker/u8:1+flush-259:007:30:282
2718857992419,4cyclictest2811843-21latency_hist08:40:001
2718855992421,2cyclictest2843548-21kworker/u8:2+events_unbound09:30:130
2718860992321,1cyclictest2874451-21kworker/u8:3+events_unbound10:00:132
2718860992320,2cyclictest3010099-21kworker/u8:3+events_unbound12:00:162
2718860992320,2cyclictest2994377-21kworker/u8:0+flush-259:012:05:262
2718860992320,2cyclictest2983573-21kworker/u8:1+events_unbound11:50:232
2718860992320,2cyclictest2973273-21kworker/u8:2+flush-259:011:35:172
2718857992320,2cyclictest2983573-21kworker/u8:1+flush-259:012:25:151
2718857992320,2cyclictest2953150-21kworker/u8:3+events_unbound10:55:221
2718857992319,3cyclictest2953150-21kworker/u8:3+events_unbound11:15:181
2718857992319,3cyclictest2953150-21kworker/u8:3+events_unbound11:15:171
2718857992319,3cyclictest2786033-21kworker/u8:1+flush-259:008:55:201
2718857992319,3cyclictest2786033-21kworker/u8:1+flush-259:008:40:201
2718857992317,4cyclictest2885457-21apt-get09:50:121
2718857992317,4cyclictest252-21systemd-journal10:15:001
2718855992321,2cyclictest3031593-21kworker/u8:2+flush-259:012:35:220
2718855992321,2cyclictest2890354-21kworker/u8:4+events_unbound10:10:220
2718855992320,2cyclictest2786033-21kworker/u8:1+flush-259:008:15:210
2718855992318,4cyclictest2718778-21latency_hist07:10:010
2718864992219,2cyclictest2983573-21kworker/u8:1+flush-259:011:35:013
2718864992216,4cyclictest2724185-21/usr/sbin/munin07:15:143
2718860992220,2cyclictest2739435-21kworker/u8:0+flush-259:008:35:212
2718860992219,2cyclictest2890353-21kworker/u8:2+events_unbound10:20:202
2718860992219,2cyclictest2675938-21kworker/u8:5+flush-259:007:25:232
2718857992219,2cyclictest2890354-21kworker/u8:4+flush-259:009:55:211
2718857992219,2cyclictest2843548-21kworker/u8:2+flush-259:009:20:241
2718857992217,4cyclictest2890354-21kworker/u8:4+events_unbound10:35:161
2718855992219,2cyclictest2874451-21kworker/u8:3+flush-259:009:40:190
271885599221,20cyclictest1-21systemd10:25:330
2718864992115,4cyclictest2801785-21/usr/sbin/munin08:30:143
2718860992118,2cyclictest2953150-21kworker/u8:3+flush-259:011:00:212
2718860992118,2cyclictest2890354-21kworker/u8:4+events_unbound10:30:142
2718860992118,2cyclictest2786033-21kworker/u8:1+events_unbound08:55:232
2718857992118,3cyclictest2890354-21kworker/u8:4+events_unbound10:30:271
2718857992118,2cyclictest3031593-21kworker/u8:2+flush-259:012:30:161
2718857992117,3cyclictest2983573-21kworker/u8:1+events_unbound12:20:111
2718857992117,3cyclictest2843548-21kworker/u8:2+events_unbound09:10:151
2718857992117,3cyclictest2675938-21kworker/u8:5+events_unbound07:10:251
2718857992116,3cyclictest2884824-21gpgv09:50:001
2718855992118,2cyclictest2786033-21kworker/u8:1+flush-259:008:55:210
2718864992016,3cyclictest2983573-21kworker/u8:1+events_unbound11:35:143
2718857992017,2cyclictest2890354-21kworker/u8:4+flush-259:010:45:161
2718857992017,2cyclictest2786033-21kworker/u8:1+flush-259:008:30:251
2718857992015,4cyclictest252-21systemd-journal10:05:001
2718855992017,2cyclictest2786033-21kworker/u8:1+events_unbound09:20:230
2718855992017,2cyclictest2739435-21kworker/u8:0+events_unbound07:55:220
2718855992017,2cyclictest2675938-21kworker/u8:5+events_unbound07:10:230
2718855992015,4cyclictest2921279-21latency_hist10:25:010
2718855992014,5cyclictest2915190-21ntpq10:15:210
2718855992014,4cyclictest3030475-21ntpq12:05:220
2718864991915,3cyclictest2953150-21kworker/u8:3+events_unbound11:00:143
2718860991917,1cyclictest2675938-21kworker/u8:5+flush-259:007:15:192
2718860991916,2cyclictest2786033-21kworker/u8:1+flush-259:008:15:192
2718860991915,3cyclictest2786033-21kworker/u8:1+flush-259:008:50:092
2718860991914,4cyclictest2774906-21ntpq08:00:202
2718857991916,2cyclictest2874451-21kworker/u8:3+events_unbound09:40:141
2718857991916,2cyclictest2786033-21kworker/u8:1+flush-259:009:05:241
2718857991916,2cyclictest2675938-21kworker/u8:5+events_unbound08:09:321
2718857991915,3cyclictest2739435-21kworker/u8:0+events_unbound07:53:291
2718855991916,2cyclictest2890354-21kworker/u8:4+events_unbound10:41:330
2718855991916,2cyclictest2739435-21kworker/u8:0+flush-259:009:05:330
2718855991916,2cyclictest2675938-21kworker/u8:5+events_unbound07:15:250
2718855991913,5cyclictest2760384-21latency_hist07:50:010
2718864991815,2cyclictest3005138-21latency_hist11:45:013
2718864991813,3cyclictest2973245-21latency_hist11:15:003
2718864991813,3cyclictest2812084-21/usr/sbin/munin08:40:143
2718860991816,2cyclictest2942511-21kworker/u8:1+flush-259:010:50:152
2718860991815,2cyclictest3031593-21kworker/u8:2+events_unbound12:10:182
2718860991815,2cyclictest2890354-21kworker/u8:4+events_unbound10:35:152
2718860991815,2cyclictest2729343-21kworker/u8:1+events_unbound07:20:262
2718860991814,3cyclictest2786033-21kworker/u8:1+events_unbound08:31:312
2718860991813,4cyclictest2749737-21latency_hist07:40:012
2718857991815,2cyclictest2739435-21kworker/u8:0+events_unbound08:04:311
2718857991815,2cyclictest2739435-21kworker/u8:0+events_unbound07:55:161
2718857991815,2cyclictest2729343-21kworker/u8:1+flush-259:007:25:161
2718857991814,3cyclictest2760412-21kworker/u8:2+events_unbound08:10:151
2718857991812,4cyclictest3015543-21cp11:55:011
2718855991815,2cyclictest2973273-21kworker/u8:2+events_unbound11:27:330
2718855991815,2cyclictest2926009-21kworker/u8:0+events_unbound10:33:580
2718855991815,2cyclictest2874451-21kworker/u8:3+events_unbound09:45:270
2718855991815,2cyclictest2675938-21kworker/u8:5+events_unbound07:24:130
2718855991815,2cyclictest252-21systemd-journal09:55:000
2718855991814,3cyclictest2926009-21kworker/u8:0+events_unbound11:10:160
2718855991814,3cyclictest2890353-21kworker/u8:2+flush-259:010:05:340
2718864991713,3cyclictest2786033-21kworker/u8:1+events_unbound08:15:183
2718864991711,4cyclictest2739435-21kworker/u8:0+events_unbound09:35:203
2718864991710,5cyclictest2988716-21latency_hist11:30:013
2718860991714,2cyclictest2983541-21cron11:24:592
2718860991711,5cyclictest3020159-21ntpq11:55:222
2718857991714,3cyclictest2931575-21kworker/u8:2+events_unbound11:05:181
2718857991714,2cyclictest2942511-21kworker/u8:1+events_unbound10:50:131
2718857991714,2cyclictest2890353-21kworker/u8:2+events_unbound10:25:251
2718857991714,2cyclictest2729343-21kworker/u8:1+flush-259:007:30:161
2718857991713,3cyclictest3010099-21kworker/u8:3+events_unbound12:19:161
2718857991713,3cyclictest2983573-21kworker/u8:1+flush-259:011:30:101
2718857991713,3cyclictest2816771-21kworker/u8:3+events_unbound08:45:171
2718857991713,3cyclictest2786033-21kworker/u8:1+events_unbound08:17:331
2718855991715,1cyclictest211rcuc/012:00:230
2718855991714,2cyclictest60350irq/132-enp0s29f1:rx-011:31:190
2718855991714,2cyclictest2874451-21kworker/u8:3+events_unbound09:57:340
2718855991714,2cyclictest2739435-21kworker/u8:0+events_unbound08:00:170
2718864991613,2cyclictest2854501-21irqcore09:20:163
2718864991613,1cyclictest0-21swapper/312:30:013
2718864991612,3cyclictest2739435-21kworker/u8:0+flush-259:008:20:233
2718864991610,4cyclictest2843527-21latency_hist09:10:003
2718864991610,4cyclictest2838382-21latency_hist09:05:013
2718864991610,4cyclictest2838382-21latency_hist09:05:003
2718860991613,2cyclictest509-21rs:main2
2718857991613,2cyclictest2675938-21kworker/u8:5+events_unbound07:43:271
2718857991612,3cyclictest2973273-21kworker/u8:2+flush-259:011:25:211
2718857991612,3cyclictest2900933-21kworker/u8:0+events_unbound10:05:131
2718855991613,2cyclictest60350irq/132-enp0s29f1:rx-010:45:110
2718855991613,2cyclictest2809248-21sed08:35:170
2718855991613,2cyclictest2739435-21kworker/u8:0+events_unbound09:02:340
2718855991613,2cyclictest2739435-21kworker/u8:0+events_unbound09:02:340
2718855991613,2cyclictest2739435-21kworker/u8:0+events_unbound08:22:050
2718864991513,1cyclictest0-21swapper/307:45:013
2718864991512,2cyclictest2890353-21kworker/u8:2+flush-259:010:25:223
2718864991511,3cyclictest2900933-21kworker/u8:0+events_unbound10:05:203
2718864991511,3cyclictest2874451-21kworker/u8:3+flush-259:010:00:193
2718864991511,3cyclictest2786033-21kworker/u8:1+flush-259:008:35:153
2718864991511,3cyclictest2675938-21kworker/u8:5+events_unbound07:50:223
2718860991512,2cyclictest2739435-21kworker/u8:0+flush-259:009:00:202
2718860991512,2cyclictest2739435-21kworker/u8:0+flush-259:009:00:202
2718857991512,2cyclictest2994377-21kworker/u8:0+flush-259:012:05:261
2718857991512,2cyclictest2994377-21kworker/u8:0+events_unbound11:55:241
2718857991512,2cyclictest2739435-21kworker/u8:0+events_unbound09:33:351
2718857991510,3cyclictest2744834-21/usr/sbin/munin07:35:141
2718855991512,2cyclictest60350irq/132-enp0s29f1:rx-011:45:130
271886499149,4cyclictest2675938-21kworker/u8:5+flush-259:008:00:023
2718864991411,2cyclictest2900933-21kworker/u8:0+events_unbound10:15:213
2718864991411,2cyclictest2786033-21kworker/u8:1+flush-259:009:00:003
271886099149,3cyclictest252-21systemd-journal11:15:002
2718860991412,2cyclictest2890353-21kworker/u8:2+events_unbound10:25:232
2718860991412,2cyclictest2703497-21kworker/u8:0+events_unbound07:11:392
2718860991411,2cyclictest3046930-21kworker/u8:0+events_unbound12:29:342
2718860991411,2cyclictest2739435-21kworker/u8:0+events_unbound09:38:512
2718857991411,2cyclictest2994377-21kworker/u8:0+events_unbound11:45:031
2718855991413,1cyclictest60350irq/132-enp0s29f1:rx-009:14:420
2718855991412,1cyclictest60350irq/132-enp0s29f1:rx-012:30:160
271886499138,4cyclictest2926009-21kworker/u8:0+events_unbound11:20:213
271886499138,3cyclictest2739651-21/usr/sbin/munin07:30:153
271886499137,4cyclictest2884771-21apt-get09:50:003
271886499137,4cyclictest2786133-21turbostat08:15:013
2718864991311,1cyclictest0-21swapper/312:20:213
2718864991310,2cyclictest2849970-21kthreadcore09:15:163
2718864991310,2cyclictest0-21swapper/311:55:003
271886099139,3cyclictest2786033-21kworker/u8:1+flush-259:009:09:562
271885799139,3cyclictest2890353-21kworker/u8:2+events_unbound10:15:031
2718857991310,2cyclictest2916555-21fschecks_count10:20:121
2718855991311,1cyclictest60350irq/132-enp0s29f1:rx-009:25:230
2718855991311,1cyclictest60350irq/132-enp0s29f1:rx-009:15:160
271886499129,2cyclictest3021367-21cpuspeed_turbos12:00:123
271886499129,2cyclictest2967617-21unixbench_multi11:05:253
271886499129,2cyclictest2675938-21kworker/u8:5+events_unbound07:35:253
271886499127,4cyclictest2952588-21cron10:55:003
271886499126,4cyclictest2739435-21kworker/u8:0+events_unbound07:55:123
271886499125,5cyclictest252-21systemd-journal10:49:333
271885799129,2cyclictest2999863-21cpuspeed_turbos11:40:151
271885799129,2cyclictest2869677-21fschecks_count09:35:141
271885799128,3cyclictest2973273-21kworker/u8:2+events_unbound11:39:351
271885799128,3cyclictest2843548-21kworker/u8:2+events_unbound09:19:561
271886499118,2cyclictest3052725-21sed12:30:163
271886499118,2cyclictest2920847-21unixbench_singl10:20:233
271886499117,3cyclictest2983573-21kworker/u8:1+flush-259:012:15:173
271886499117,3cyclictest2729343-21kworker/u8:1+events_unbound07:20:243
271886499105,4cyclictest3030220-21tr12:05:203
27188649997,1cyclictest0-21swapper/312:35:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional