You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 08:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Sep 18, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3219546995552,2cyclictest3354279-21kworker/u8:3+flush-259:021:35:241
3219546995451,2cyclictest3495483-21gpgv23:35:011
3219544995448,4cyclictest3495285-21latency_hist23:35:010
3219544994642,3cyclictest3230044-21apt-get19:20:120
3219546994439,4cyclictest3276595-21apt-get20:05:121
3219544994439,4cyclictest3235221-21apt-get19:25:120
3219554994338,3cyclictest3417720-21apt-get22:20:113
3219549994339,3cyclictest3219728-21apt-get19:10:112
3219544994337,4cyclictest3297634-21cp20:25:010
3219544994137,3cyclictest3484777-21store23:25:000
3219554994036,3cyclictest3422679-21kworker/u8:1+flush-259:022:30:273
3219549994034,5cyclictest3547374-21latency_hist00:25:002
3219549993935,3cyclictest3276224-21kworker/u8:1+flush-259:020:05:242
3219544993935,3cyclictest3276224-21kworker/u8:1+flush-259:020:40:250
3219549993733,3cyclictest3276224-21kworker/u8:1+flush-259:020:45:252
3219544993732,4cyclictest3412562-21apt-get22:15:110
3219546993633,2cyclictest3422679-21kworker/u8:1+events_unbound22:30:211
3219546993632,3cyclictest3239762-21kworker/u8:0+events_unbound21:15:241
3219544993631,3cyclictest3422679-21kworker/u8:1+flush-259:022:30:230
3219544993531,3cyclictest3469099-21kworker/u8:1+flush-259:023:40:170
3219544993429,3cyclictest3402227-21apt-get22:05:120
3219544993429,3cyclictest3402227-21apt-get22:05:110
3219544993429,3cyclictest3239762-21kworker/u8:0+flush-259:021:05:250
3219554993326,5cyclictest3447544-21ntpq22:45:213
3219549993329,3cyclictest3239762-21kworker/u8:0+flush-259:019:30:242
3219549993327,4cyclictest3562952-21latency_hist00:40:012
3219549993327,4cyclictest3562952-21latency_hist00:40:012
3219549993228,3cyclictest3286731-21kworker/u8:2+flush-259:021:20:192
3219546993227,4cyclictest3359842-21gpgv21:25:001
3219544993228,3cyclictest3239762-21kworker/u8:0+flush-259:021:00:170
3219554993128,2cyclictest3165031-21kworker/u8:4+flush-259:019:25:253
3219549993127,3cyclictest3422896-21apt-get22:25:102
3219546993128,2cyclictest3276224-21kworker/u8:1+events_unbound20:15:111
3219546993127,3cyclictest3354279-21kworker/u8:3+flush-259:021:30:101
3219544993128,2cyclictest3443086-21kworker/u8:0+events_unbound23:10:230
3219544993125,4cyclictest3364475-21ntpq21:25:190
3219554993025,4cyclictest3296991-21apt-get20:25:013
3219546993027,2cyclictest3443086-21kworker/u8:0+flush-259:023:00:181
3219546992925,3cyclictest3296997-21latency_hist20:25:011
3219546992925,3cyclictest3239762-21kworker/u8:0+events_unbound19:50:211
3219546992925,3cyclictest3204093-21kworker/u8:1+events_unbound19:10:231
3219544992925,3cyclictest3276224-21kworker/u8:1+flush-259:020:10:240
3219544992925,3cyclictest3250733-21apt-get19:40:110
3219544992924,3cyclictest3276570-21/usr/sbin/munin20:05:200
3219554992825,2cyclictest3521354-21kworker/u8:0+flush-259:000:10:303
3219549992824,3cyclictest3396500-21kworker/u8:3+flush-259:023:05:242
3219544992824,3cyclictest3521354-21kworker/u8:0+events_unbound00:07:530
3219544992824,3cyclictest3422679-21kworker/u8:1+events_unbound22:37:460
3219544992821,5cyclictest3489266-21ntpq23:25:220
3219554992724,2cyclictest3443086-21kworker/u8:0+events_unbound23:10:163
3219554992724,2cyclictest3396500-21kworker/u8:3+flush-259:023:30:003
3219554992723,3cyclictest3239762-21kworker/u8:0+flush-259:019:50:233
3219554992721,4cyclictest3322318-21ntpq20:45:233
3219549992724,2cyclictest3469099-21kworker/u8:1+events_unbound00:15:242
3219549992722,3cyclictest3396500-21kworker/u8:3+events_unbound23:15:182
3219546992724,2cyclictest3422679-21kworker/u8:1+flush-259:022:40:251
3219546992723,3cyclictest3521354-21kworker/u8:0+events_unbound00:24:511
3219546992723,3cyclictest3359848-21kworker/u8:0+flush-259:021:45:241
3219546992722,4cyclictest3307949-21/usr/sbin/munin20:35:201
3219544992723,3cyclictest3521354-21kworker/u8:0+flush-259:000:04:590
3219544992723,3cyclictest3469099-21kworker/u8:1+flush-259:000:25:200
3219544992723,3cyclictest3204093-21kworker/u8:1+events_unbound19:10:100
3219549992622,3cyclictest3521354-21kworker/u8:0+flush-259:000:10:282
3219546992623,2cyclictest3386084-21kworker/u8:2+events_unbound21:58:491
3219546992623,2cyclictest3386084-21kworker/u8:2+events_unbound21:58:481
3219546992623,2cyclictest3286731-21kworker/u8:2+events_unbound20:32:501
3219546992622,3cyclictest3396500-21kworker/u8:3+events_unbound23:25:231
3219546992622,3cyclictest3239762-21kworker/u8:0+events_unbound21:12:511
3219544992622,3cyclictest3396500-21kworker/u8:3+events_unbound22:25:490
3219544992620,4cyclictest3515486-21ntpq23:50:220
3219544992618,6cyclictest3536153-21ntpq00:10:240
3219554992520,4cyclictest3495287-21apt-get23:35:023
3219549992522,2cyclictest3276224-21kworker/u8:1+flush-259:020:15:152
3219549992521,3cyclictest3297026-21gpgv20:25:002
3219546992522,2cyclictest3510921-21kworker/u8:3+flush-259:023:55:161
3219546992522,2cyclictest3443086-21kworker/u8:0+flush-259:023:05:161
3219546992522,2cyclictest3443086-21kworker/u8:0+events_unbound22:56:501
3219546992522,2cyclictest3386084-21kworker/u8:2+events_unbound22:02:501
3219546992521,3cyclictest3495095-21kworker/u8:2+events_unbound23:44:501
3219544992522,2cyclictest3386084-21kworker/u8:2+events_unbound21:55:160
3219544992522,2cyclictest3386084-21kworker/u8:2+events_unbound21:55:150
3219544992521,3cyclictest3396500-21kworker/u8:3+flush-259:023:05:180
3219544992519,4cyclictest3516827-21diskstats23:55:140
3219554992421,2cyclictest3245358-21kworker/u8:2+flush-259:019:45:243
3219554992421,2cyclictest3239762-21kworker/u8:0+flush-259:021:05:213
3219549992420,3cyclictest3354279-21kworker/u8:3+events_unbound21:18:492
3219549992420,3cyclictest3286731-21kworker/u8:2+events_unbound20:25:142
3219549992420,3cyclictest3239762-21kworker/u8:0+events_unbound21:00:192
3219549992418,4cyclictest3234957-21latency_hist19:25:002
3219546992421,2cyclictest3510921-21kworker/u8:3+events_unbound23:49:501
3219546992421,2cyclictest3396500-21kworker/u8:3+events_unbound23:20:231
3219546992421,2cyclictest3396500-21kworker/u8:3+events_unbound22:15:201
3219546992421,2cyclictest3396500-21kworker/u8:3+events_unbound22:07:421
3219546992421,2cyclictest3396500-21kworker/u8:3+events_unbound22:07:411
3219546992420,3cyclictest3521354-21kworker/u8:0+flush-259:000:05:151
3219546992420,3cyclictest3245358-21kworker/u8:2+events_unbound20:02:191
3219546992420,3cyclictest3204093-21kworker/u8:1+flush-259:019:40:241
3219544992421,2cyclictest3359848-21kworker/u8:0+flush-259:021:45:200
3219544992420,3cyclictest3396500-21kworker/u8:3+flush-259:022:45:000
3219544992420,3cyclictest3239762-21kworker/u8:0+events_unbound21:15:140
3219544992420,3cyclictest3214340-21kworker/u8:2+events_unbound19:15:190
3219544992419,4cyclictest3240352-21/usr/sbin/munin19:30:140
3219554992320,2cyclictest3276224-21kworker/u8:1+events_unbound20:05:233
3219554992319,3cyclictest509-21rs:main3
3219549992319,3cyclictest3422679-21kworker/u8:1+flush-259:022:30:252
3219549992318,3cyclictest3370836-21apt-get21:35:112
3219549992317,4cyclictest3344317-21latency_hist21:10:012
3219546992320,2cyclictest3443086-21kworker/u8:0+flush-259:022:45:161
3219546992319,3cyclictest3443086-21kworker/u8:0+events_unbound22:52:511
3219546992319,3cyclictest3239762-21kworker/u8:0+events_unbound19:30:031
3219546992319,3cyclictest3214340-21kworker/u8:2+events_unbound19:20:231
3219544992320,2cyclictest3469099-21kworker/u8:1+flush-259:000:20:260
3219544992320,2cyclictest3469099-21kworker/u8:1+events_unbound00:15:250
3219544992320,2cyclictest3276224-21kworker/u8:1+flush-259:020:20:230
3219544992319,3cyclictest3553265-21kworker/u8:2+events_unbound00:35:500
3219544992319,3cyclictest3553265-21kworker/u8:2+events_unbound00:35:500
3219544992319,3cyclictest3396500-21kworker/u8:3+flush-259:022:10:200
3219544992319,3cyclictest3386324-21apt-get21:50:100
3219554992219,2cyclictest3469099-21kworker/u8:1+events_unbound23:46:513
3219549992219,2cyclictest3386084-21kworker/u8:2+events_unbound22:00:162
3219549992218,3cyclictest3521354-21kworker/u8:0+flush-259:000:05:142
3219546992220,2cyclictest3521354-21kworker/u8:0+events_unbound00:15:301
3219546992220,2cyclictest3443086-21kworker/u8:0+flush-259:023:10:181
3219546992219,2cyclictest3386084-21kworker/u8:2+events_unbound21:50:231
3219546992218,3cyclictest3510921-21kworker/u8:3+events_unbound23:54:491
3219546992218,3cyclictest3328188-21kworker/u8:3+events_unbound20:55:511
3219544992219,2cyclictest3396500-21kworker/u8:3+events_unbound22:50:230
3219544992216,4cyclictest3510313-21ntpq23:45:200
3219554992118,2cyclictest3276224-21kworker/u8:1+flush-259:020:15:223
3219554992117,3cyclictest3396500-21kworker/u8:3+events_unbound23:20:223
3219549992118,2cyclictest3328667-21apt-get20:55:122
3219549992117,3cyclictest3422679-21kworker/u8:1+events_unbound22:40:012
3219549992117,3cyclictest3422638-21latency_hist22:25:012
3219549992117,3cyclictest3334215-21kworker/u8:1+events_unbound21:10:242
3219546992118,2cyclictest3286731-21kworker/u8:2+events_unbound20:25:231
3219546992118,2cyclictest3276224-21kworker/u8:1+events_unbound20:45:141
3219546992117,3cyclictest3214340-21kworker/u8:2+flush-259:019:25:181
3219546992116,4cyclictest3255878-21/usr/sbin/munin19:45:231
3219546992115,4cyclictest3249589-21ntpq19:35:211
3219544992118,2cyclictest3276224-21kworker/u8:1+flush-259:020:45:140
3219544992118,2cyclictest3260885-21kworker/u8:3+events_unbound20:00:240
3219544992117,3cyclictest3359848-21kworker/u8:0+events_unbound22:20:200
3219544992117,3cyclictest3276224-21kworker/u8:1+events_unbound20:35:270
3219544992117,3cyclictest3276224-21kworker/u8:1+events_unbound20:15:210
3219554992017,2cyclictest3443086-21kworker/u8:0+flush-259:023:00:273
3219554992017,2cyclictest3386084-21kworker/u8:2+flush-259:022:05:153
3219554992017,2cyclictest3386084-21kworker/u8:2+flush-259:022:05:153
3219554992017,2cyclictest3286731-21kworker/u8:2+flush-259:021:00:253
3219554992016,3cyclictest3521354-21kworker/u8:0+events_unbound00:30:133
3219554992016,3cyclictest3469099-21kworker/u8:1+flush-259:023:50:223
3219554992015,4cyclictest335557-21systemd-journal20:35:013
3219549992017,2cyclictest3245358-21kworker/u8:2+flush-259:019:40:202
3219549992017,2cyclictest3239762-21kworker/u8:0+events_unbound19:50:192
3219549992016,3cyclictest3396500-21kworker/u8:3+flush-259:023:30:262
3219549992016,3cyclictest3354279-21kworker/u8:3+flush-259:021:30:232
3219546992017,2cyclictest3469099-21kworker/u8:1+events_unbound00:35:161
3219546992017,2cyclictest3469099-21kworker/u8:1+events_unbound00:35:161
3219546992016,3cyclictest3396500-21kworker/u8:3+flush-259:022:10:151
3219544992017,2cyclictest3443086-21kworker/u8:0+events_unbound23:00:510
3219544992017,2cyclictest3245358-21kworker/u8:2+events_unbound19:45:150
3219544992017,2cyclictest3239762-21kworker/u8:0+flush-259:019:50:120
3219544992016,3cyclictest3359848-21kworker/u8:0+flush-259:021:37:490
3219544992013,6cyclictest3354279-21kworker/u8:3+events_unbound21:30:110
3219554991916,2cyclictest3521354-21kworker/u8:0+events_unbound00:20:153
3219554991916,2cyclictest3239762-21kworker/u8:0+events_unbound21:15:223
3219549991915,3cyclictest3510921-21kworker/u8:3+flush-259:023:54:592
3219549991915,3cyclictest3443086-21kworker/u8:0+events_unbound22:50:182
3219549991915,3cyclictest3386084-21kworker/u8:2+flush-259:021:55:012
3219549991913,4cyclictest335557-21systemd-journal23:44:592
3219546991915,3cyclictest3239762-21kworker/u8:0+flush-259:020:12:211
3219544991915,3cyclictest3495095-21kworker/u8:2+events_unbound23:40:000
3219544991915,3cyclictest3359848-21kworker/u8:0+events_unbound21:40:180
3219544991915,3cyclictest3245358-21kworker/u8:2+flush-259:019:58:260
3219544991915,3cyclictest3204093-21kworker/u8:1+flush-259:019:35:200
3219554991816,1cyclictest0-21swapper/323:35:003
3219554991815,2cyclictest3359848-21kworker/u8:0+flush-259:021:40:263
3219554991815,2cyclictest0-21swapper/320:25:003
3219549991816,2cyclictest3286731-21kworker/u8:2+events_unbound20:30:222
3219549991815,2cyclictest3510921-21kworker/u8:3+flush-259:023:55:212
3219549991815,2cyclictest3495095-21kworker/u8:2+flush-259:023:35:222
3219549991815,2cyclictest3276224-21kworker/u8:1+flush-259:020:50:232
3219549991814,3cyclictest3469099-21kworker/u8:1+flush-259:000:30:172
3219549991814,3cyclictest3276224-21kworker/u8:1+flush-259:020:05:012
3219546991815,2cyclictest3422679-21kworker/u8:1+events_unbound22:35:211
3219546991814,3cyclictest3469099-21kworker/u8:1+events_unbound00:00:351
3219554991714,2cyclictest3386084-21kworker/u8:2+events_unbound21:50:143
3219554991714,2cyclictest3359848-21kworker/u8:0+flush-259:021:45:253
3219554991714,2cyclictest3204093-21kworker/u8:1+flush-259:019:35:203
3219554991714,1cyclictest0-21swapper/322:05:003
3219554991713,3cyclictest3286731-21kworker/u8:2+flush-259:020:50:163
3219549991714,2cyclictest3396500-21kworker/u8:3+flush-259:023:20:202
3219549991713,3cyclictest3443086-21kworker/u8:0+flush-259:023:00:252
3219546991715,2cyclictest3286731-21kworker/u8:2+events_unbound21:00:231
3219546991715,2cyclictest3239762-21kworker/u8:0+events_unbound21:05:221
3219546991714,2cyclictest3521354-21kworker/u8:0+events_unbound00:10:181
3219544991714,2cyclictest3276224-21kworker/u8:1+events_unbound20:31:490
3219544991713,3cyclictest3386084-21kworker/u8:2+events_unbound22:00:010
3219554991613,2cyclictest3521354-21kworker/u8:0+events_unbound00:25:253
3219554991613,2cyclictest3469099-21kworker/u8:1+flush-259:000:00:313
3219554991613,2cyclictest3214340-21kworker/u8:2+events_unbound19:15:133
3219554991612,3cyclictest3469099-21kworker/u8:1+events_unbound00:35:243
3219554991612,3cyclictest3469099-21kworker/u8:1+events_unbound00:35:233
3219554991612,3cyclictest3354279-21kworker/u8:3+events_unbound21:35:173
3219554991612,3cyclictest3260885-21kworker/u8:3+events_unbound20:00:223
3219554991612,3cyclictest3165031-21kworker/u8:4+events_unbound19:20:193
3219549991613,2cyclictest3422679-21kworker/u8:1+events_unbound22:40:242
3219549991613,2cyclictest3359848-21kworker/u8:0+flush-259:021:30:012
3219549991613,2cyclictest0-21swapper/220:45:002
3219549991612,3cyclictest3165031-21kworker/u8:4+flush-259:019:15:242
3219546991614,2cyclictest3495095-21kworker/u8:2+events_unbound23:35:201
3219546991613,3cyclictest3396500-21kworker/u8:3+events_unbound22:23:511
3219546991613,2cyclictest3359848-21kworker/u8:0+events_unbound22:25:131
3219546991612,3cyclictest3469099-21kworker/u8:1+events_unbound00:30:181
3219546991612,3cyclictest3396500-21kworker/u8:3+events_unbound23:17:511
3219546991612,3cyclictest3359848-21kworker/u8:0+flush-259:021:40:201
3219546991612,3cyclictest3266282-21/usr/sbin/munin19:55:141
3219544991613,2cyclictest60350irq/132-enp0s29f1:rx-021:21:200
3219544991612,2cyclictest0-21swapper/020:55:010
3219544991611,4cyclictest3552832-21/usr/sbin/munin00:30:180
3219554991512,3cyclictest3495095-21kworker/u8:2+events_unbound23:40:163
3219554991512,2cyclictest3510921-21kworker/u8:3+events_unbound23:55:183
3219554991512,2cyclictest3354279-21kworker/u8:3+flush-259:021:30:233
3219554991512,2cyclictest3204093-21kworker/u8:1+flush-259:019:10:203
3219554991511,3cyclictest3396500-21kworker/u8:3+flush-259:022:51:203
3219549991514,1cyclictest3386084-21kworker/u8:2+events_unbound21:55:252
3219549991514,1cyclictest3386084-21kworker/u8:2+events_unbound21:55:252
3219549991512,2cyclictest3521354-21kworker/u8:0+flush-259:000:00:172
3219546991512,2cyclictest3276224-21kworker/u8:1+events_unbound20:50:261
3219546991512,2cyclictest3165031-21kworker/u8:4+flush-259:019:17:201
3219544991513,1cyclictest60350irq/132-enp0s29f1:rx-022:46:150
3219544991513,1cyclictest60350irq/132-enp0s29f1:rx-020:55:220
3219554991411,2cyclictest3432934-21kworker/u8:2+flush-259:022:35:203
3219554991411,2cyclictest3396500-21kworker/u8:3+flush-259:022:15:153
3219554991411,2cyclictest3204093-21kworker/u8:1+flush-259:019:40:143
3219554991410,3cyclictest3396500-21kworker/u8:3+events_unbound23:15:233
321955499140,13cyclictest1-21systemd21:55:493
321955499140,13cyclictest1-21systemd21:55:483
3219549991411,2cyclictest3240100-21cron19:30:002
3219549991410,3cyclictest3276224-21kworker/u8:1+flush-259:020:10:192
321954699149,4cyclictest3521354-21kworker/u8:0+flush-259:000:26:551
3219546991411,2cyclictest3276224-21kworker/u8:1+events_unbound20:40:221
3219544991413,1cyclictest60350irq/132-enp0s29f1:rx-023:15:040
3219544991410,3cyclictest335557-21systemd-journal21:13:490
3219554991310,2cyclictest3464409-21fschecks_time23:05:143
3219554991310,2cyclictest3276224-21kworker/u8:1+events_unbound20:35:233
3219554991310,2cyclictest3239762-21kworker/u8:0+events_unbound19:30:203
321954999138,3cyclictest3443086-21kworker/u8:0+flush-259:023:10:152
3219546991311,1cyclictest3359848-21kworker/u8:0+events_unbound21:25:211
321955499129,2cyclictest3531477-21unixbench_singl00:05:273
321954499129,2cyclictest3456149-21kthreadcore22:55:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional