You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 04:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sun Jul 05, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3046584994946,2cyclictest3082434-21kworker/u8:0+events_unbound20:45:233
3046580994841,5cyclictest3348390-21latency_hist00:00:022
3046580994839,6cyclictest3093289-21cat19:55:002
3046584994741,3cyclictest3203574-21kworker/u8:2+events_unbound22:00:163
3046577994638,5cyclictest3244736-21latency_hist22:20:001
3046584994340,2cyclictest3244773-21kworker/u8:0+events_unbound22:25:153
3046584994138,2cyclictest3192882-21kworker/u8:1+events_unbound23:00:153
3046584994138,2cyclictest3146185-21kworker/u8:2+events_unbound20:50:223
3046584994031,2cyclictest3093168-21kworker/u8:4+events_unbound20:10:233
3046584994031,2cyclictest3093168-21kworker/u8:4+events_unbound20:10:223
3046577993932,5cyclictest3343204-21latency_hist23:55:011
3046572993936,2cyclictest3082434-21kworker/u8:0+flush-259:021:30:210
3046572993935,3cyclictest2987377-21kworker/u8:1+flush-259:019:35:160
3046572993933,4cyclictest3388897-21ntpq00:35:220
3046584993835,2cyclictest3156274-21kworker/u8:1+events_unbound20:55:223
3046584993835,2cyclictest3051906-21kworker/u8:3+flush-259:019:40:243
3046580993834,3cyclictest3082434-21kworker/u8:0+flush-259:020:25:162
3046577993826,10cyclictest3233535-21ntpq22:05:201
3046577993825,11cyclictest3214095-21/usr/sbin/munin21:50:131
3046584993734,2cyclictest3343226-21kworker/u8:3+flush-259:000:15:133
3046584993734,2cyclictest3332645-21kworker/u8:0+events_unbound00:10:213
3046584993734,2cyclictest3322806-21kworker/u8:4+flush-259:023:40:243
3046584993733,3cyclictest3192882-21kworker/u8:1+events_unbound22:20:163
3046584993733,3cyclictest3087983-21kworker/u8:3+events_unbound19:55:223
3046580993733,3cyclictest3265332-21kworker/u8:4+flush-259:023:15:002
3046572993733,3cyclictest3082434-21kworker/u8:0+events_unbound20:35:230
3046584993633,2cyclictest3146185-21kworker/u8:2+events_unbound21:05:153
3046584993633,2cyclictest2987377-21kworker/u8:1+events_unbound19:30:243
3046572993630,5cyclictest3358722-21latency_hist00:10:020
3046584993533,2cyclictest3082434-21kworker/u8:0+events_unbound21:15:173
3046584993532,2cyclictest3093168-21kworker/u8:4+flush-259:020:15:243
3046577993528,4cyclictest3213860-21latency_hist21:50:011
3046577993527,5cyclictest3192997-21cat21:30:011
3046584993431,2cyclictest3082434-21kworker/u8:0+flush-259:019:45:243
3046584993428,2cyclictest3332645-21kworker/u8:0+events_unbound00:38:083
3046584993427,2cyclictest3203574-21kworker/u8:2+events_unbound21:40:273
3046580993427,5cyclictest3071595-21ntpq19:30:212
3046584993330,2cyclictest3322806-21kworker/u8:4+events_unbound23:35:263
3046584993330,2cyclictest3192882-21kworker/u8:1+events_unbound22:10:243
3046584993329,3cyclictest3013522-21kworker/u8:2+events_unbound19:23:443
3046572993329,3cyclictest3051906-21kworker/u8:3+flush-259:019:25:150
3046572993328,4cyclictest3243889-21ntpq22:15:220
3046584993229,2cyclictest3082434-21kworker/u8:0+flush-259:021:30:263
3046584993229,2cyclictest3082434-21kworker/u8:0+flush-259:020:35:183
3046580993229,2cyclictest3343226-21kworker/u8:3+flush-259:000:05:212
3046580993229,2cyclictest3203574-21kworker/u8:2+flush-259:022:15:242
3046580993225,5cyclictest3120587-21diskstats20:20:142
3046572993228,2cyclictest3338269-21kworker/u8:1+flush-259:000:05:000
3046584993128,2cyclictest3082434-21kworker/u8:0+flush-259:020:42:153
3046580993127,3cyclictest3093168-21kworker/u8:4+flush-259:020:05:002
3046577993124,4cyclictest3057302-21/usr/sbin/munin19:20:151
3046572993128,2cyclictest3296429-21kworker/u8:2+flush-259:023:50:220
3046572993128,2cyclictest3260221-21kworker/u8:2+events_unbound22:45:000
3046584993027,2cyclictest3306429-21kworker/u8:1+events_unbound23:18:453
3046584993026,3cyclictest3275698-21kworker/u8:0+flush-259:023:25:163
3046584993026,3cyclictest3275698-21kworker/u8:0+events_unbound23:07:483
3046572993027,2cyclictest3244773-21kworker/u8:0+flush-259:022:25:150
3046572993024,5cyclictest335557-21systemd-journal22:35:450
3046584992926,2cyclictest3332645-21kworker/u8:0+events_unbound00:23:073
3046584992926,2cyclictest3082434-21kworker/u8:0+flush-259:021:35:193
3046584992926,2cyclictest3051906-21kworker/u8:3+events_unbound19:29:453
3046584992926,2cyclictest2987377-21kworker/u8:1+events_unbound19:35:203
3046584992925,3cyclictest3260221-21kworker/u8:2+events_unbound22:47:453
3046584992925,3cyclictest3260221-21kworker/u8:2+events_unbound22:47:453
3046584992925,3cyclictest3120182-21kworker/u8:1+events_unbound20:20:213
3046580992926,2cyclictest3275698-21kworker/u8:0+events_unbound23:00:192
3046580992925,3cyclictest3306429-21kworker/u8:1+flush-259:023:40:002
3046572992924,4cyclictest3046308-21latency_hist19:10:010
3046572992922,5cyclictest335557-21systemd-journal21:47:440
3046584992826,2cyclictest3296429-21kworker/u8:2+events_unbound23:55:193
3046584992826,2cyclictest3265332-21kworker/u8:4+events_unbound23:10:103
3046584992825,2cyclictest3343226-21kworker/u8:3+events_unbound00:28:083
3046584992825,2cyclictest3322806-21kworker/u8:4+events_unbound23:48:453
3046584992825,2cyclictest3082434-21kworker/u8:0+events_unbound20:25:203
3046584992825,2cyclictest3082434-21kworker/u8:0+events_unbound20:00:233
3046584992825,2cyclictest3013522-21kworker/u8:2+flush-259:019:10:183
3046577992821,5cyclictest3166576-21latency_hist21:05:011
3046572992824,3cyclictest3275698-21kworker/u8:0+events_unbound23:06:440
3046584992724,2cyclictest3203574-21kworker/u8:2+events_unbound21:55:123
3046584992722,2cyclictest3296429-21kworker/u8:2+events_unbound00:00:173
3046584992721,4cyclictest3322337-21cat23:35:013
3046584992721,2cyclictest3093168-21kworker/u8:4+events_unbound20:05:223
3046580992724,2cyclictest3051906-21kworker/u8:3+flush-259:019:40:252
3046580992720,5cyclictest335557-21systemd-journal00:25:002
3046577992721,4cyclictest3291482-21/usr/sbin/munin23:05:251
3046572992724,2cyclictest3192882-21kworker/u8:1+flush-259:022:20:210
3046584992623,2cyclictest3192882-21kworker/u8:1+events_unbound22:40:223
3046584992623,2cyclictest3087983-21kworker/u8:3+events_unbound21:10:153
3046584992622,3cyclictest3087983-21kworker/u8:3+events_unbound20:32:133
3046580992619,5cyclictest335557-21systemd-journal21:14:442
3046572992622,3cyclictest3333184-21apt-get23:45:110
3046572992622,3cyclictest3306429-21kworker/u8:1+events_unbound23:17:460
3046572992622,3cyclictest3156274-21kworker/u8:1+events_unbound20:55:200
3046572992622,3cyclictest3087983-21kworker/u8:3+flush-259:020:10:150
3046572992622,3cyclictest3087983-21kworker/u8:3+flush-259:020:10:150
3046572992622,3cyclictest3051906-21kworker/u8:3+flush-259:019:40:200
3046584992522,2cyclictest2987377-21kworker/u8:1+events_unbound19:50:253
3046584992521,3cyclictest3244773-21kworker/u8:0+events_unbound22:37:413
3046580992522,2cyclictest3087983-21kworker/u8:3+events_unbound20:40:232
3046572992521,3cyclictest3203574-21kworker/u8:2+flush-259:021:45:000
3046584992421,2cyclictest3203574-21kworker/u8:2+events_unbound21:50:203
3046584992421,2cyclictest3192882-21kworker/u8:1+events_unbound22:17:373
3046584992421,2cyclictest3192882-21kworker/u8:1+events_unbound22:05:193
3046584992421,2cyclictest3177586-21kworker/u8:4+events_unbound21:29:523
3046584992420,3cyclictest3306429-21kworker/u8:1+events_unbound23:22:483
3046577992421,2cyclictest3192882-21kworker/u8:1+flush-259:022:30:191
3046577992418,4cyclictest3193532-21apt-get21:30:111
3046580992320,2cyclictest3332645-21kworker/u8:0+flush-259:000:15:242
3046580992320,2cyclictest3203574-21kworker/u8:2+flush-259:021:55:152
3046580992319,3cyclictest3332645-21kworker/u8:0+events_unbound23:45:152
3046580992319,3cyclictest3192882-21kworker/u8:1+flush-259:022:40:162
3046580992319,3cyclictest3051906-21kworker/u8:3+flush-259:019:25:192
3046580992317,4cyclictest3306946-21/usr/sbin/munin23:20:132
3046577992318,3cyclictest3192882-21kworker/u8:1+events_unbound22:10:191
3046577992317,4cyclictest3087983-21kworker/u8:3+flush-259:021:10:181
3046577992316,4cyclictest3322816-21/usr/sbin/munin23:35:161
3046572992319,3cyclictest3203574-21kworker/u8:2+events_unbound21:50:140
3046572992319,3cyclictest3082434-21kworker/u8:0+events_unbound21:35:250
3046580992219,2cyclictest3338269-21kworker/u8:1+events_unbound00:35:152
3046580992219,2cyclictest3192882-21kworker/u8:1+events_unbound22:30:192
3046580992219,2cyclictest2987377-21kworker/u8:1+events_unbound19:36:452
3046580992218,3cyclictest335557-21systemd-journal22:07:342
3046580992218,3cyclictest3332645-21kworker/u8:0+flush-259:000:10:162
3046577992218,3cyclictest3114646-21gpgv20:15:001
3046577992218,3cyclictest3114646-21gpgv20:14:591
3046577992218,3cyclictest3099447-21apt-get20:00:111
3046572992219,2cyclictest3332645-21kworker/u8:0+flush-259:000:10:230
3046572992219,2cyclictest3087983-21kworker/u8:3+events_unbound20:30:230
3046572992218,3cyclictest3192882-21kworker/u8:1+events_unbound23:02:440
3046572992218,3cyclictest3146185-21kworker/u8:2+events_unbound20:52:170
3046572992218,3cyclictest2987377-21kworker/u8:1+events_unbound19:30:080
3046584992117,3cyclictest3192882-21kworker/u8:1+events_unbound22:33:493
3046580992118,2cyclictest3192882-21kworker/u8:1+flush-259:022:55:162
3046580992118,2cyclictest3177586-21kworker/u8:4+events_unbound21:35:022
3046580992117,3cyclictest3244773-21kworker/u8:0+events_unbound22:25:202
3046580992117,3cyclictest3203574-21kworker/u8:2+flush-259:021:50:212
3046580992117,3cyclictest3082434-21kworker/u8:0+flush-259:021:05:102
3046577992117,3cyclictest3146185-21kworker/u8:2+flush-259:020:47:151
3046577992116,3cyclictest3260221-21kworker/u8:2+flush-259:022:40:051
3046577992115,4cyclictest3051906-21kworker/u8:3+flush-259:019:35:061
3046577992114,5cyclictest3264409-21ntpq22:35:191
3046572992118,2cyclictest3275698-21kworker/u8:0+events_unbound23:25:240
3046572992118,2cyclictest3082434-21kworker/u8:0+flush-259:021:05:180
3046572992117,3cyclictest3306429-21kworker/u8:1+flush-259:023:20:260
3046572992117,3cyclictest3161681-21apt-get21:00:110
3046572992117,3cyclictest3087983-21kworker/u8:3+flush-259:020:10:000
3046572992116,2cyclictest3013522-21kworker/u8:2+events_unbound19:20:210
3046572992114,5cyclictest335557-21systemd-journal00:35:000
3046584992017,2cyclictest3192882-21kworker/u8:1+flush-259:021:48:453
3046584992017,2cyclictest3146185-21kworker/u8:2+flush-259:021:00:453
3046584992017,2cyclictest3146185-21kworker/u8:2+events_unbound21:22:453
3046580992016,3cyclictest3332645-21kworker/u8:0+events_unbound00:34:482
3046580992016,3cyclictest3260221-21kworker/u8:2+events_unbound22:45:362
3046580992016,3cyclictest3260221-21kworker/u8:2+events_unbound22:45:362
3046580992016,3cyclictest3192882-21kworker/u8:1+flush-259:022:04:592
3046580992016,3cyclictest3146185-21kworker/u8:2+events_unbound21:20:222
3046580992016,3cyclictest3082434-21kworker/u8:0+events_unbound19:45:162
3046580992014,4cyclictest3198854-21diskstats21:35:132
3046577992016,3cyclictest2987377-21kworker/u8:1+events_unbound19:30:191
3046577992015,3cyclictest3306429-21kworker/u8:1+flush-259:023:30:011
3046572992017,2cyclictest3306429-21kworker/u8:1+events_unbound23:35:440
3046572992014,4cyclictest3191916-21ntpq21:25:200
3046572992014,3cyclictest3013522-21kworker/u8:2+flush-259:019:10:260
3046580991915,3cyclictest3203574-21kworker/u8:2+events_unbound22:13:452
3046580991915,3cyclictest3082434-21kworker/u8:0+events_unbound20:35:122
3046580991914,4cyclictest3082434-21kworker/u8:0+flush-259:021:15:172
3046577991915,3cyclictest3332645-21kworker/u8:0+flush-259:023:45:241
3046577991913,4cyclictest3156261-21latency_hist20:55:011
3046572991917,2cyclictest3192882-21kworker/u8:1+events_unbound22:05:210
3046572991916,2cyclictest3332645-21kworker/u8:0+events_unbound00:15:190
3046572991915,3cyclictest3332645-21kworker/u8:0+events_unbound00:25:480
3046572991915,2cyclictest3192882-21kworker/u8:1+events_unbound22:55:190
3046572991912,5cyclictest3321279-21ntpq23:30:210
3046584991815,2cyclictest3343226-21kworker/u8:3+events_unbound00:08:033
3046584991815,2cyclictest3296429-21kworker/u8:2+events_unbound23:50:253
3046584991815,2cyclictest3192882-21kworker/u8:1+events_unbound22:53:453
3046584991815,2cyclictest3013522-21kworker/u8:2+events_unbound19:16:533
3046580991815,2cyclictest3317697-21irqcore23:30:172
3046580991814,3cyclictest3369113-21kworker/u8:2+events_unbound00:25:022
3046580991814,3cyclictest3146185-21kworker/u8:2+flush-259:021:00:262
3046580991814,3cyclictest3146185-21kworker/u8:2+events_unbound20:50:182
3046580991814,3cyclictest3093168-21kworker/u8:4+events_unbound20:19:452
3046580991814,3cyclictest3082434-21kworker/u8:0+events_unbound19:55:012
3046580991813,4cyclictest3275698-21kworker/u8:0+flush-259:023:05:192
3046577991814,3cyclictest3379469-21munin-plugin-st00:29:591
3046572991816,2cyclictest3120182-21kworker/u8:1+events_unbound20:22:450
3046572991814,3cyclictest3332645-21kworker/u8:0+events_unbound23:44:210
3046572991814,3cyclictest3296429-21kworker/u8:2+events_unbound23:55:070
3046572991813,4cyclictest3296666-21apt-get23:10:100
3046572991812,4cyclictest3151114-21latency_hist20:50:010
3046584991714,2cyclictest3192882-21kworker/u8:1+events_unbound22:59:273
3046580991714,2cyclictest3296429-21kworker/u8:2+events_unbound23:16:462
3046580991714,2cyclictest3192882-21kworker/u8:1+flush-259:022:35:052
3046580991714,2cyclictest3146185-21kworker/u8:2+flush-259:021:25:242
3046580991713,3cyclictest3332645-21kworker/u8:0+events_unbound23:42:582
3046580991713,3cyclictest3296429-21kworker/u8:2+events_unbound23:54:452
3046580991713,3cyclictest3244773-21kworker/u8:0+flush-259:022:22:202
3046580991713,3cyclictest3156274-21kworker/u8:1+flush-259:020:55:162
3046580991713,3cyclictest3082434-21kworker/u8:0+events_unbound20:46:462
3046580991713,3cyclictest3013522-21kworker/u8:2+events_unbound19:10:122
3046577991711,4cyclictest3125560-21/usr/sbin/munin20:25:131
3046577991710,4cyclictest3301571-21latency_hist23:15:001
3046577991710,4cyclictest3167099-21cat21:05:011
3046572991714,2cyclictest3275698-21kworker/u8:0+events_unbound22:50:230
3046572991714,2cyclictest3146185-21kworker/u8:2+flush-259:021:20:190
3046572991714,2cyclictest3087983-21kworker/u8:3+events_unbound20:40:210
3046572991713,3cyclictest3087983-21kworker/u8:3+events_unbound21:11:440
3046572991711,4cyclictest3093824-21apt-get19:55:110
3046580991612,3cyclictest3275698-21kworker/u8:0+events_unbound22:50:172
3046580991612,3cyclictest3192882-21kworker/u8:1+events_unbound21:42:442
3046580991612,3cyclictest3093168-21kworker/u8:4+flush-259:020:09:552
3046580991612,3cyclictest3013522-21kworker/u8:2+events_unbound19:20:132
3046577991613,2cyclictest490-21dbus-daemon19:55:001
3046577991612,2cyclictest3187719-21idleruntime-cro21:25:001
3046577991611,4cyclictest3338269-21kworker/u8:1+flush-259:023:55:241
3046577991610,4cyclictest335557-21systemd-journal19:56:451
3046572991613,2cyclictest3203574-21kworker/u8:2+flush-259:022:00:250
3046572991613,2cyclictest3203574-21kworker/u8:2+flush-259:021:55:160
3046572991612,3cyclictest3082434-21kworker/u8:0+events_unbound21:16:320
3046580991512,2cyclictest3306429-21kworker/u8:1+events_unbound23:28:452
3046580991511,3cyclictest3296429-21kworker/u8:2+events_unbound00:01:482
3046580991511,3cyclictest3013522-21kworker/u8:2+events_unbound19:15:152
304657799159,4cyclictest3082434-21kworker/u8:0+flush-259:019:45:161
304657799158,5cyclictest3332024-21ntpq23:40:211
304657799158,4cyclictest3280890-21latency_hist22:55:001
304657799151,6cyclictest3161427-21munin-run21:00:001
3046577991511,3cyclictest3087983-21kworker/u8:3+flush-259:020:30:251
3046572991513,1cyclictest60350irq/132-enp0s29f1:rx-019:50:240
3046572991511,3cyclictest3115303-21apt-get20:15:110
304657799148,4cyclictest335557-21systemd-journal20:10:001
304657799141,11cyclictest490-21dbus-daemon20:40:001
3046577991410,3cyclictest3354041-21fschecks_time00:05:151
3046577991410,2cyclictest0-21swapper/119:15:011
304657799140,13cyclictest2971-21cron21:20:001
3046572991412,1cyclictest60350irq/132-enp0s29f1:rx-020:25:140
3046572991411,2cyclictest60350irq/132-enp0s29f1:rx-022:45:400
3046572991411,2cyclictest60350irq/132-enp0s29f1:rx-022:45:390
3046572991411,2cyclictest3013522-21kworker/u8:2+events_unbound19:15:010
304658099139,3cyclictest3177586-21kworker/u8:4+events_unbound21:45:442
3046580991310,2cyclictest3087983-21kworker/u8:3+events_unbound20:10:152
3046580991310,2cyclictest3087983-21kworker/u8:3+events_unbound20:10:152
304657799136,5cyclictest3255037-21latency_hist22:30:001
3046577991310,2cyclictest3286568-21fschecks_count23:00:161
3046577991310,2cyclictest3245062-21cpuspeed_turbos22:20:121
3046577991310,2cyclictest3056615-21unixbench_singl19:15:241
304657799130,1cyclictest0-21swapper/119:40:221
3046572991310,2cyclictest60350irq/132-enp0s29f1:rx-022:10:180
304658099128,2cyclictest0-21swapper/220:35:002
304657799129,2cyclictest3384645-21idleruntime-cro00:34:591
304657799129,1cyclictest0-21swapper/100:00:141
304657799128,2cyclictest0-21swapper/119:25:161
304657799127,4cyclictest3260221-21kworker/u8:2+flush-259:022:47:161
304657799127,4cyclictest3260221-21kworker/u8:2+flush-259:022:47:151
304657799126,4cyclictest3125329-21latency_hist20:25:011
304657799119,1cyclictest0-21swapper/123:20:001
304657799118,2cyclictest3285660-21unixbench_singl22:55:261
304657799118,1cyclictest0-21swapper/123:20:141
304657799117,2cyclictest3223256-21ntpq21:55:201
304657799115,4cyclictest3114604-21cron20:15:011
304657799107,1cyclictest0-21swapper/122:00:201
304657799106,2cyclictest0-21swapper/100:35:161
30465779997,1cyclictest0-21swapper/120:40:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional