You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 10:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sat Jul 18, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2677243994437,5cyclictest2733930-21latency_hist20:05:000
2677243993833,4cyclictest335557-21systemd-journal19:30:000
2677245993733,3cyclictest2972921-21kworker/u8:1+flush-259:000:05:241
2677243993731,4cyclictest2801679-21apt-get21:10:120
2677245993632,2cyclictest2832412-21kworker/u8:3+flush-259:022:00:251
2677248993428,4cyclictest2708115-21latency_hist19:40:012
2677245993226,4cyclictest335557-21systemd-journal23:08:301
2677253993124,5cyclictest335557-21systemd-journal20:10:003
2677245993127,2cyclictest2863634-21kworker/u8:2+flush-259:022:55:261
2677253993027,2cyclictest2764912-21kworker/u8:0+flush-259:020:40:003
2677248993026,3cyclictest335557-21systemd-journal21:15:302
2677245993026,3cyclictest2972921-21kworker/u8:1+events_unbound00:20:161
2677253992925,3cyclictest2915442-21kworker/u8:1+events_unbound23:30:243
2677248992926,2cyclictest2667006-21kworker/u8:1+flush-259:019:20:232
2677248992925,3cyclictest335557-21systemd-journal00:10:002
2677245992926,2cyclictest2951812-21kworker/u8:2+flush-259:023:55:211
2677245992926,2cyclictest2951812-21kworker/u8:2+flush-259:000:00:291
2677245992925,3cyclictest2827166-21kworker/u8:2+events_unbound21:40:221
2677245992924,4cyclictest2703209-21apt-get19:35:111
2677253992825,2cyclictest2780774-21kworker/u8:2+events_unbound21:05:183
2677253992824,3cyclictest2837805-21apt-get21:45:123
2677245992823,3cyclictest2718457-21kworker/u8:1+events_unbound21:20:221
2677245992724,2cyclictest2733551-21kworker/u8:0+flush-259:020:10:091
2677245992723,3cyclictest2796211-21kworker/u8:0+events_unbound22:08:311
2677245992720,5cyclictest2748560-21ntpq20:15:221
2677243992721,4cyclictest2992713-21ntpq00:10:200
2677253992623,2cyclictest3014151-21kworker/u8:3+flush-259:000:35:163
2677253992623,2cyclictest2832412-21kworker/u8:3+flush-259:022:15:013
2677253992622,2cyclictest2951812-21kworker/u8:2+events_unbound23:40:003
2677248992623,2cyclictest2951812-21kworker/u8:2+flush-259:023:45:312
2677245992623,2cyclictest2676949-21kworker/u8:2+events_unbound19:55:171
2677245992623,2cyclictest2676949-21kworker/u8:2+events_unbound19:40:121
2677245992622,3cyclictest2926155-21kworker/u8:0+flush-259:023:15:221
2677245992621,3cyclictest2692681-21kworker/u8:3+flush-259:019:25:111
2677243992622,3cyclictest2848135-21apt-get21:55:120
2677248992523,2cyclictest2983105-21kworker/u8:0+flush-259:000:05:002
2677248992522,2cyclictest2972921-21kworker/u8:1+flush-259:000:15:262
2677248992521,3cyclictest335557-21systemd-journal19:50:312
2677245992521,3cyclictest2894694-21kworker/u8:0+flush-259:022:50:111
2677245992521,3cyclictest2667006-21kworker/u8:1+events_unbound19:20:211
2677245992520,4cyclictest335557-21systemd-journal23:40:001
2677245992517,5cyclictest2967274-21latency_hist23:50:021
2677243992519,4cyclictest2749433-21latency_hist20:20:010
2677243992518,5cyclictest2945767-21ntpq23:25:230
2677248992420,3cyclictest2806592-21kworker/u8:3+flush-259:021:30:202
2677245992422,1cyclictest2692681-21kworker/u8:3+events_unbound19:51:301
2677245992420,3cyclictest3014151-21kworker/u8:3+events_unbound00:36:311
2677245992420,3cyclictest2796211-21kworker/u8:0+flush-259:022:11:561
2677245992420,3cyclictest2759693-21kworker/u8:2+events_unbound20:32:321
2677245992420,3cyclictest2733551-21kworker/u8:0+flush-259:020:20:271
2677245992420,3cyclictest2733551-21kworker/u8:0+events_unbound20:26:311
2677245992420,3cyclictest2676949-21kworker/u8:2+flush-259:019:30:111
2677245992417,5cyclictest335557-21systemd-journal23:30:301
2677243992421,2cyclictest2936510-21kworker/u8:4+flush-259:023:35:210
2677243992420,3cyclictest2972921-21kworker/u8:1+flush-259:000:30:240
2677248992319,3cyclictest2915442-21kworker/u8:1+events_unbound23:35:252
2677248992319,3cyclictest2863634-21kworker/u8:2+flush-259:022:20:182
2677248992319,3cyclictest2692681-21kworker/u8:3+events_unbound19:26:262
2677245992319,3cyclictest2832412-21kworker/u8:3+events_unbound21:56:311
2677245992318,4cyclictest2993896-21apt-get00:15:131
2677243992318,4cyclictest335557-21systemd-journal22:14:300
2677253992217,3cyclictest2682363-21latency_hist19:15:013
2677248992216,4cyclictest2930199-21ntpq23:10:212
2677248992216,4cyclictest2909513-21ntpq22:50:202
2677248992215,5cyclictest2888444-21ntpq22:30:202
2677248992212,9cyclictest2692681-21kworker/u8:3+flush-259:019:35:002
2677245992219,2cyclictest2920771-21kworker/u8:2+events_unbound23:10:221
2677245992219,2cyclictest2832412-21kworker/u8:3+flush-259:022:25:221
2677245992219,2cyclictest2718457-21kworker/u8:1+events_unbound20:45:221
2677245992219,2cyclictest2718457-21kworker/u8:1+events_unbound20:45:211
2677245992218,3cyclictest2863634-21kworker/u8:2+events_unbound22:21:311
2677245992217,3cyclictest2676949-21kworker/u8:2+flush-259:019:10:211
2677253992118,2cyclictest2920771-21kworker/u8:2+flush-259:023:05:163
2677253992118,2cyclictest2879183-21kworker/u8:1+flush-259:022:37:013
2677248992118,2cyclictest2915442-21kworker/u8:1+flush-259:023:40:202
2677248992118,2cyclictest2780774-21kworker/u8:2+flush-259:020:57:302
2677248992117,3cyclictest2993636-21latency_hist00:15:012
2677248992117,3cyclictest2967251-21kworker/u8:3+flush-259:023:53:002
2677248992117,3cyclictest2796211-21kworker/u8:0+flush-259:021:55:222
2677245992118,2cyclictest2775618-21cron20:45:001
2677245992117,3cyclictest2936510-21kworker/u8:4+flush-259:023:20:211
2677245992117,3cyclictest2915442-21kworker/u8:1+events_unbound23:02:051
2677245992117,3cyclictest2791348-21apt-get21:00:111
2677245992116,4cyclictest2967964-21apt-get23:50:121
2677245992115,4cyclictest2900350-21apt-get22:45:111
2677253992017,2cyclictest2832412-21kworker/u8:3+flush-259:022:05:153
2677253992015,3cyclictest2899864-21gpgv22:45:013
2677248992017,2cyclictest2920771-21kworker/u8:2+events_unbound23:09:332
2677248992017,2cyclictest2718457-21kworker/u8:1+events_unbound21:12:332
2677248992017,2cyclictest2676949-21kworker/u8:2+events_unbound19:55:222
2677248992016,3cyclictest335557-21systemd-journal23:27:072
2677248992016,3cyclictest2894694-21kworker/u8:0+flush-259:022:45:242
2677248992016,3cyclictest2780774-21kworker/u8:2+flush-259:021:05:172
2677248992016,3cyclictest2718457-21kworker/u8:1+events_unbound20:29:592
2677248992013,5cyclictest3013480-21ntpq00:30:212
2677245992016,3cyclictest2972921-21kworker/u8:1+events_unbound00:30:141
2677245992016,3cyclictest2951812-21kworker/u8:2+events_unbound23:42:281
2677245992016,3cyclictest2879183-21kworker/u8:1+events_unbound22:35:141
2677245992016,3cyclictest2718457-21kworker/u8:1+events_unbound20:36:371
2677245992016,3cyclictest2676949-21kworker/u8:2+flush-259:020:00:161
2677245992015,3cyclictest2692681-21kworker/u8:3+flush-259:019:45:221
2677243992016,3cyclictest2692681-21kworker/u8:3+flush-259:019:50:240
2677243992016,3cyclictest2676949-21kworker/u8:2+flush-259:019:10:420
2677243992014,4cyclictest2915442-21kworker/u8:1+flush-259:023:45:160
2677253991916,2cyclictest2832412-21kworker/u8:3+events_unbound22:30:173
2677253991916,2cyclictest2796211-21kworker/u8:0+events_unbound21:36:283
2677253991916,2cyclictest2796211-21kworker/u8:0+events_unbound21:15:223
2677253991916,2cyclictest2733551-21kworker/u8:0+flush-259:020:20:173
2677253991916,2cyclictest2676949-21kworker/u8:2+flush-259:020:00:143
2677253991915,3cyclictest2863634-21kworker/u8:2+events_unbound22:20:213
2677253991915,3cyclictest2806592-21kworker/u8:3+flush-259:021:31:463
2677253991915,3cyclictest2780774-21kworker/u8:2+flush-259:021:00:213
2677248991916,2cyclictest2832412-21kworker/u8:3+events_unbound21:50:252
2677248991913,4cyclictest2872911-21ntpq22:15:202
2677245991916,2cyclictest2667006-21kworker/u8:1+events_unbound19:15:221
2677245991915,3cyclictest2718457-21kworker/u8:1+events_unbound20:59:301
2677245991915,2cyclictest2894694-21kworker/u8:0+flush-259:022:40:161
2677243991916,2cyclictest2759693-21kworker/u8:2+flush-259:020:35:170
2677243991916,2cyclictest0-21swapper/022:30:000
2677243991914,4cyclictest2822319-21apt-get21:30:120
2677243991914,3cyclictest2796211-21kworker/u8:0+flush-259:022:15:160
2677243991913,4cyclictest2821138-21ntpq21:25:200
2677253991814,3cyclictest2796211-21kworker/u8:0+events_unbound21:11:443
2677248991815,2cyclictest2847895-21kworker/u8:1+flush-259:022:10:212
2677248991815,2cyclictest2733551-21kworker/u8:0+flush-259:020:05:242
2677248991815,2cyclictest2733551-21kworker/u8:0+events_unbound20:11:312
2677248991814,3cyclictest2936510-21kworker/u8:4+events_unbound23:32:092
2677248991814,3cyclictest2915442-21kworker/u8:1+events_unbound22:59:312
2677248991814,3cyclictest2832412-21kworker/u8:3+events_unbound22:05:162
2677248991812,4cyclictest2898775-21ntpq22:40:212
2677245991813,3cyclictest2832412-21kworker/u8:3+flush-259:021:50:161
2677243991815,2cyclictest2971-21cron00:10:000
2677243991814,3cyclictest2832412-21kworker/u8:3+flush-259:021:50:270
2677243991810,7cyclictest2941465-21turbostat23:25:000
2677253991714,2cyclictest2894694-21kworker/u8:0+events_unbound22:55:233
2677253991714,2cyclictest2832412-21kworker/u8:3+flush-259:021:50:183
2677253991714,2cyclictest2764912-21kworker/u8:0+flush-259:020:40:243
2677253991713,3cyclictest335557-21systemd-journal20:31:353
2677253991713,3cyclictest2667006-21kworker/u8:1+events_unbound19:15:313
2677253991710,5cyclictest2883217-21ntpq22:25:203
267725399170,16cyclictest1-21systemd21:30:003
2677248991714,2cyclictest2983105-21kworker/u8:0+flush-259:000:35:242
2677248991713,3cyclictest2832412-21kworker/u8:3+events_unbound21:46:492
2677248991713,3cyclictest2718457-21kworker/u8:1+events_unbound20:50:222
2677248991713,3cyclictest2692681-21kworker/u8:3+events_unbound19:42:322
2677245991714,2cyclictest2806592-21kworker/u8:3+events_unbound21:30:231
2677245991714,2cyclictest2796211-21kworker/u8:0+events_unbound22:15:121
2677245991714,2cyclictest2764912-21kworker/u8:0+flush-259:020:50:261
2677245991713,3cyclictest2879183-21kworker/u8:1+events_unbound22:30:111
2677245991711,4cyclictest2946637-21latency_hist23:30:001
2677243991714,2cyclictest2842718-21sh21:50:000
2677243991713,3cyclictest60350irq/132-enp0s29f1:rx-022:50:170
2677243991713,3cyclictest2718457-21kworker/u8:1+events_unbound20:55:000
2677243991713,2cyclictest3014151-21kworker/u8:3+flush-259:000:35:180
2677243991712,3cyclictest2858484-21apt-get22:05:100
2677253991614,1cyclictest0-21swapper/322:20:003
2677253991613,2cyclictest3014355-21apt00:34:593
2677253991613,2cyclictest2718457-21kworker/u8:1+flush-259:021:00:003
2677253991612,3cyclictest335557-21systemd-journal19:57:313
2677253991612,3cyclictest2837566-21kworker/u8:4+flush-259:022:00:163
2677253991612,3cyclictest2676949-21kworker/u8:2+events_unbound19:40:153
2677253991610,4cyclictest2702938-21awk19:35:013
2677248991613,2cyclictest2983105-21kworker/u8:0+flush-259:000:25:142
2677245991612,3cyclictest2718457-21kworker/u8:1+flush-259:021:10:271
2677245991611,3cyclictest2718457-21kworker/u8:1+events_unbound21:16:451
2677243991614,1cyclictest60350irq/132-enp0s29f1:rx-023:40:130
2677243991614,1cyclictest60350irq/132-enp0s29f1:rx-022:35:220
2677243991614,1cyclictest60350irq/132-enp0s29f1:rx-019:34:160
2677243991613,2cyclictest60350irq/132-enp0s29f1:rx-023:50:250
2677243991613,2cyclictest60350irq/132-enp0s29f1:rx-022:30:360
2677243991613,2cyclictest60350irq/132-enp0s29f1:rx-020:10:120
2677243991613,2cyclictest2827166-21kworker/u8:2+flush-259:021:40:160
2677243991613,2cyclictest2754572-21idleruntime-cro20:24:590
2677243991612,3cyclictest60350irq/132-enp0s29f1:rx-022:00:120
2677243991612,3cyclictest60350irq/132-enp0s29f1:rx-020:40:150
2677243991612,3cyclictest2863634-21kworker/u8:2+flush-259:022:55:260
2677253991512,2cyclictest2744960-21irqcore20:15:173
2677253991510,3cyclictest2931128-21latency_hist23:15:003
2677248991513,1cyclictest0-21swapper/222:30:002
2677248991511,3cyclictest2926155-21kworker/u8:0+events_unbound23:17:082
2677248991511,3cyclictest2796211-21kworker/u8:0+events_unbound21:25:232
267724899150,13cyclictest2682381-21unin-run19:15:012
2677245991512,2cyclictest2806592-21kworker/u8:3+events_unbound21:29:311
2677245991512,2cyclictest2733551-21kworker/u8:0+flush-259:020:05:111
2677245991511,3cyclictest2796525-21apt-get21:05:121
2677245991510,3cyclictest2837566-21kworker/u8:4+flush-259:021:50:011
2677243991513,2cyclictest60350irq/132-enp0s29f1:rx-022:22:140
2677243991513,1cyclictest60350irq/132-enp0s29f1:rx-023:55:430
2677243991513,1cyclictest60350irq/132-enp0s29f1:rx-023:18:550
2677243991513,1cyclictest60350irq/132-enp0s29f1:rx-020:55:280
2677243991513,1cyclictest60350irq/132-enp0s29f1:rx-020:30:270
2677243991513,1cyclictest60350irq/132-enp0s29f1:rx-019:55:540
2677243991513,1cyclictest60350irq/132-enp0s29f1:rx-019:41:280
2677243991512,2cyclictest60350irq/132-enp0s29f1:rx-023:30:200
2677243991512,2cyclictest2915442-21kworker/u8:1+flush-259:023:05:000
2677243991512,2cyclictest2796211-21kworker/u8:0+flush-259:021:35:240
267725399149,4cyclictest2696911-21ntpq19:25:203
2677253991411,2cyclictest2997803-21needreboot00:15:203
2677253991411,2cyclictest2836558-21needreboot21:40:193
2677253991410,3cyclictest2733551-21kworker/u8:0+events_unbound20:10:213
2677253991410,2cyclictest2910428-21idleruntime-cro22:55:003
267724899147,5cyclictest3004006-21awk00:25:002
2677248991411,2cyclictest2936510-21kworker/u8:4+flush-259:023:20:202
2677248991411,2cyclictest2718457-21kworker/u8:1+events_unbound21:21:312
2677248991410,3cyclictest2832351-21cron21:40:002
2677243991412,2cyclictest60350irq/132-enp0s29f1:rx-000:24:040
2677243991412,1cyclictest60350irq/132-enp0s29f1:rx-021:15:120
2677243991412,1cyclictest60350irq/132-enp0s29f1:rx-021:00:240
2677243991412,1cyclictest60350irq/132-enp0s29f1:rx-019:35:230
2677243991412,1cyclictest60350irq/132-enp0s29f1:rx-019:18:300
2677243991412,1cyclictest2796211-21kworker/u8:0+flush-259:021:25:010
2677243991411,2cyclictest60350irq/132-enp0s29f1:rx-023:10:260
2677243991411,2cyclictest60350irq/132-enp0s29f1:rx-022:46:310
2677243991411,2cyclictest60350irq/132-enp0s29f1:rx-021:05:210
2677243991411,2cyclictest2738169-21ntp_kernel_err20:05:200
267725399139,3cyclictest2957647-21irqcore23:40:163
267725399139,1cyclictest27567292cat20:25:183
267725399137,4cyclictest335557-21systemd-journal23:20:003
2677253991310,2cyclictest2983105-21kworker/u8:0+events_unbound00:10:153
2677253991310,2cyclictest2951812-21kworker/u8:2+events_unbound23:45:193
2677253991310,2cyclictest2781082-21cpuspeed_turbos20:50:133
267724899139,3cyclictest2915442-21kworker/u8:1+events_unbound23:01:302
267724899139,3cyclictest2718457-21kworker/u8:1+events_unbound21:00:312
267724899139,3cyclictest2718457-21kworker/u8:1+events_unbound20:30:172
267724899138,4cyclictest2978111-21gzip00:00:002
267724899134,6cyclictest2780759-21awk20:50:002
267724899134,6cyclictest2780759-21awk20:50:002
2677248991311,1cyclictest0-21swapper/220:00:152
2677248991310,2cyclictest2770044-21gpgv20:40:002
2677248991310,2cyclictest2754150-21unixbench_singl20:20:252
2677248991310,2cyclictest2733551-21kworker/u8:0+flush-259:020:17:012
267724599139,3cyclictest2972921-21kworker/u8:1+flush-259:000:14:351
267724599139,2cyclictest0-21swapper/121:40:001
267724599139,2cyclictest0-21swapper/100:27:301
267724399138,4cyclictest2920771-21kworker/u8:2+events_unbound23:05:180
2677243991311,1cyclictest60350irq/132-enp0s29f1:rx-000:15:150
2677243991311,1cyclictest60350irq/132-enp0s29f1:rx-000:03:050
2677243991310,2cyclictest2780318-21unixbench_singl20:45:260
2677243991310,2cyclictest2780318-21unixbench_singl20:45:260
267725399129,2cyclictest2973582-21grep23:55:163
267725399129,2cyclictest2936610-21cpuspeed_turbos23:20:133
267725399129,2cyclictest0-21swapper/321:55:183
267725399129,2cyclictest0-21swapper/320:50:003
267725399129,2cyclictest0-21swapper/320:50:003
267725399128,3cyclictest2951812-21kworker/u8:2+flush-259:000:00:153
267725399121,2cyclictest2816888-21awk21:25:003
267724899127,4cyclictest2676949-21kworker/u8:2+events_unbound19:45:022
267724399129,2cyclictest60350irq/132-enp0s29f1:rx-019:46:440
2677243991210,1cyclictest60350irq/132-enp0s29f1:rx-000:27:370
267725399118,2cyclictest2692681-21kworker/u8:3+flush-259:019:35:283
267724899119,1cyclictest2770815-21tr20:40:132
267724399108,1cyclictest60350irq/132-enp0s29f1:rx-019:20:140
26772489997,1cyclictest0-21swapper/222:00:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional