You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 12:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sun May 03, 2026 00:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2614082994945,3cyclictest2781080-21kworker/u8:1+events_unbound21:51:071
2614088994338,3cyclictest2807408-21kworker/u8:1+flush-259:022:40:153
2614088994238,3cyclictest2603588-21kworker/u8:4+flush-259:020:10:203
2614076994235,5cyclictest2713880-21diskstats20:45:150
2614088994138,2cyclictest2671884-21kworker/u8:2+flush-259:020:25:213
2614088994138,2cyclictest2625263-21kworker/u8:2+events_unbound19:30:163
2614076994138,2cyclictest2666541-21kworker/u8:1+events_unbound20:00:240
2614076993936,2cyclictest2765941-21kworker/u8:0+flush-259:021:40:200
2614088993832,4cyclictest2760708-21cat21:30:013
2614082993834,2cyclictest2666541-21kworker/u8:1+events_unbound20:05:221
2614082993833,3cyclictest2724442-21apt-get20:55:111
2614076993835,2cyclictest2603588-21kworker/u8:4+flush-259:019:15:210
2614082993629,5cyclictest2889023-21ntpq23:30:191
2614088993533,1cyclictest2817511-21kworker/u8:2+events_unbound22:35:243
2614088993532,2cyclictest2905880-21kworker/u8:0+events_unbound00:23:053
2614088993532,2cyclictest2802021-21kworker/u8:2+events_unbound22:10:163
2614088993532,2cyclictest2765941-21kworker/u8:0+events_unbound22:15:163
2614082993529,5cyclictest2651549-21apt-get19:45:131
2614076993529,4cyclictest2771103-21latency_hist21:40:010
2614088993430,3cyclictest2581160-21kworker/u8:3+flush-259:019:10:213
2614082993431,2cyclictest2729356-21kworker/u8:3+flush-259:021:55:211
2614082993430,3cyclictest2625263-21kworker/u8:2+flush-259:019:25:211
2614076993430,3cyclictest2853750-21kworker/u8:0+flush-259:023:05:150
2614088993330,2cyclictest2853750-21kworker/u8:0+events_unbound23:15:233
2614088993330,2cyclictest2749936-21kworker/u8:4+flush-259:021:35:163
2614088993329,3cyclictest2895528-21kworker/u8:2+events_unbound00:10:003
2614088993328,3cyclictest2864307-21/usr/sbin/munin23:10:163
2614082993330,2cyclictest2807408-21kworker/u8:1+flush-259:022:25:001
2614076993330,2cyclictest2895741-21kworker/u8:4+flush-259:000:25:170
2614076993329,3cyclictest2671884-21kworker/u8:2+flush-259:020:25:050
2614082993229,2cyclictest2666541-21kworker/u8:1+flush-259:020:00:211
2614076993229,2cyclictest2650902-21kworker/u8:0+events_unbound19:50:010
2614076993226,4cyclictest2618566-21ntpq19:10:210
2614088993128,2cyclictest2729356-21kworker/u8:3+flush-259:021:45:213
2614088993127,3cyclictest2603588-21kworker/u8:4+events_unbound20:40:183
2614088993126,3cyclictest2620065-21base6419:15:013
2614085993124,5cyclictest2713449-21latency_hist20:45:012
2614082993128,3cyclictest2895741-21kworker/u8:4+events_unbound23:56:061
2614082993127,3cyclictest2729356-21kworker/u8:3+flush-259:021:30:171
2614082993126,4cyclictest2629417-21ntpq19:20:221
2614076993127,3cyclictest2682182-21kworker/u8:0+flush-259:020:30:160
2614088993024,4cyclictest2666706-21latency_hist20:00:013
2614085993025,3cyclictest2817511-21kworker/u8:2+flush-259:022:25:162
2614082993026,3cyclictest2603588-21kworker/u8:4+events_unbound20:20:191
2614082993026,3cyclictest2603588-21kworker/u8:4+events_unbound19:20:001
2614076993027,2cyclictest2905880-21kworker/u8:0+flush-259:000:10:250
2614076993027,2cyclictest2603588-21kworker/u8:4+flush-259:020:55:170
2614076993027,2cyclictest2603588-21kworker/u8:4+events_unbound20:50:140
2614076993026,3cyclictest2765941-21kworker/u8:0+flush-259:022:05:240
2614076993026,3cyclictest2729356-21kworker/u8:3+events_unbound21:10:230
2614088992926,2cyclictest2853750-21kworker/u8:0+flush-259:023:30:003
2614088992926,2cyclictest2603588-21kworker/u8:4+events_unbound19:40:233
2614088992925,3cyclictest2905880-21kworker/u8:0+flush-259:000:17:063
2614088992925,3cyclictest2729356-21kworker/u8:3+flush-259:021:20:203
2614088992924,4cyclictest2687324-21latency_hist20:20:003
2614082992926,2cyclictest2895528-21kworker/u8:2+flush-259:023:45:231
2614082992925,3cyclictest2729356-21kworker/u8:3+events_unbound21:14:071
2614082992925,3cyclictest2581160-21kworker/u8:3+events_unbound19:42:041
2614082992924,2cyclictest2895741-21kworker/u8:4+events_unbound00:30:141
2614076992926,2cyclictest2802021-21kworker/u8:2+flush-259:022:10:210
2614076992926,2cyclictest2729356-21kworker/u8:3+flush-259:021:50:160
2614085992823,3cyclictest2698021-21kworker/u8:1+flush-259:020:30:052
2614082992825,2cyclictest2853750-21kworker/u8:0+flush-259:023:05:241
2614082992825,2cyclictest2682182-21kworker/u8:0+events_unbound20:30:141
2614076992824,3cyclictest2895741-21kworker/u8:4+events_unbound00:23:090
2614076992822,5cyclictest252-21systemd-journal00:05:000
2614088992723,3cyclictest2879620-21kworker/u8:3+flush-259:023:30:053
2614088992723,3cyclictest2729356-21kworker/u8:3+events_unbound21:10:213
2614088992723,3cyclictest2555344-21kworker/u8:0+flush-259:019:25:003
2614088992721,4cyclictest2879602-21latency_hist23:25:003
2614085992723,3cyclictest2666541-21kworker/u8:1+flush-259:020:00:252
2614082992724,2cyclictest2671884-21kworker/u8:2+events_unbound20:10:131
2614082992724,2cyclictest2581160-21kworker/u8:3+flush-259:019:10:211
2614082992723,3cyclictest2640833-21apt-get19:35:121
2614082992722,3cyclictest2581160-21kworker/u8:3+flush-259:019:35:001
2614076992724,2cyclictest2625263-21kworker/u8:2+events_unbound19:35:240
2614076992724,2cyclictest2603588-21kworker/u8:4+events_unbound20:35:230
2614076992723,3cyclictest252-21systemd-journal21:50:010
2614076992719,6cyclictest2904977-21ntpq23:45:200
2614088992623,2cyclictest2895741-21kworker/u8:4+flush-259:000:25:253
2614088992623,2cyclictest2843419-21kworker/u8:3+events_unbound23:03:053
2614088992623,2cyclictest2625263-21kworker/u8:2+events_unbound19:37:133
2614088992623,2cyclictest2603588-21kworker/u8:4+events_unbound20:20:143
2614088992622,3cyclictest2682182-21kworker/u8:0+events_unbound20:30:223
2614085992621,3cyclictest2671884-21kworker/u8:2+flush-259:020:10:152
2614085992619,5cyclictest252-21systemd-journal21:35:052
2614082992622,3cyclictest2603588-21kworker/u8:4+events_unbound20:50:241
2614082992622,3cyclictest2603588-21kworker/u8:4+events_unbound20:44:071
2614076992623,2cyclictest2853750-21kworker/u8:0+events_unbound23:12:050
2614076992623,2cyclictest2625263-21kworker/u8:2+events_unbound19:30:220
2614076992621,4cyclictest252-21systemd-journal21:30:000
2614088992522,2cyclictest2765941-21kworker/u8:0+events_unbound22:05:233
2614088992522,2cyclictest2765941-21kworker/u8:0+events_unbound21:40:243
2614085992520,4cyclictest2817511-21kworker/u8:2+flush-259:022:55:172
2614082992522,2cyclictest2895741-21kworker/u8:4+flush-259:000:20:211
2614082992519,4cyclictest2878686-21ntpq23:20:201
2614076992522,2cyclictest2853750-21kworker/u8:0+events_unbound23:19:060
2614076992521,3cyclictest2625263-21kworker/u8:2+events_unbound19:27:050
2614088992422,1cyclictest2729356-21kworker/u8:3+flush-259:021:55:193
2614088992421,2cyclictest2807408-21kworker/u8:1+flush-259:022:20:163
2614088992421,2cyclictest2719274-21kworker/u8:2+events_unbound21:00:193
2614088992420,3cyclictest2719301-21apt-get20:50:123
2614085992420,3cyclictest2739899-21kworker/u8:0+flush-259:021:20:002
2614082992421,2cyclictest2817511-21kworker/u8:2+flush-259:022:50:201
2614082992421,2cyclictest2807409-21kworker/u8:3+events_unbound22:15:241
2614082992421,2cyclictest2729356-21kworker/u8:3+events_unbound21:02:051
2614082992420,3cyclictest2895528-21kworker/u8:2+events_unbound00:07:071
2614082992420,3cyclictest2843419-21kworker/u8:3+flush-259:023:00:221
2614076992422,2cyclictest2905880-21kworker/u8:0+events_unbound23:55:240
2614076992421,2cyclictest2807409-21kworker/u8:3+events_unbound22:25:150
2614076992421,2cyclictest2807408-21kworker/u8:1+events_unbound22:40:220
2614076992420,3cyclictest2603588-21kworker/u8:4+flush-259:019:52:160
2614076992418,4cyclictest2900704-21latency_hist23:45:010
2614076992418,4cyclictest2738846-21ntpq21:05:230
2614088992320,2cyclictest2817511-21kworker/u8:2+flush-259:022:50:233
2614085992319,3cyclictest2581160-21kworker/u8:3+events_unbound19:20:212
2614085992318,3cyclictest2853750-21kworker/u8:0+flush-259:023:15:202
2614085992317,4cyclictest2791952-21/usr/sbin/munin22:00:232
2614082992319,3cyclictest2895528-21kworker/u8:2+flush-259:000:15:251
2614082992319,3cyclictest2802021-21kworker/u8:2+events_unbound22:13:051
2614082992318,4cyclictest2930794-21ntpq00:10:211
2614082992317,4cyclictest2697107-21ntpq20:25:181
261408299230,21cyclictest2755235-21unin-run21:25:001
2614076992320,2cyclictest2905880-21kworker/u8:0+flush-259:000:05:210
2614076992320,2cyclictest2719274-21kworker/u8:2+events_unbound21:00:160
2614076992319,3cyclictest2672107-21apt-get20:05:110
2614088992220,1cyclictest2895741-21kworker/u8:4+flush-259:000:30:243
2614088992219,2cyclictest2817511-21kworker/u8:2+flush-259:022:45:153
2614085992216,4cyclictest2739910-21/usr/sbin/munin21:10:142
2614085992216,4cyclictest2724175-21latency_hist20:55:002
2614085992215,5cyclictest2691592-21ntpq20:20:202
2614082992219,2cyclictest2843419-21kworker/u8:3+flush-259:023:15:001
2614082992219,2cyclictest2749936-21kworker/u8:4+flush-259:021:35:251
2614082992219,2cyclictest2603588-21kworker/u8:4+flush-259:019:55:231
2614082992218,3cyclictest2853750-21kworker/u8:0+events_unbound23:15:061
2614082992218,3cyclictest2765941-21kworker/u8:0+events_unbound22:05:151
2614076992220,1cyclictest0-21swapper/023:30:000
2614076992219,2cyclictest2843419-21kworker/u8:3+events_unbound23:00:250
2614076992219,2cyclictest2603588-21kworker/u8:4+flush-259:020:40:150
2614076992219,2cyclictest2603588-21kworker/u8:4+flush-259:019:40:170
2614076992218,3cyclictest2895741-21kworker/u8:4+flush-259:000:30:060
2614076992218,3cyclictest2781080-21kworker/u8:1+events_unbound22:00:150
2614088992118,2cyclictest2905880-21kworker/u8:0+events_unbound23:55:223
2614088992118,2cyclictest2895528-21kworker/u8:2+events_unbound23:50:283
2614088992118,2cyclictest2729356-21kworker/u8:3+flush-259:021:50:263
2614088992118,2cyclictest2729355-21kworker/u8:1+flush-259:021:05:153
2614088992118,2cyclictest2698021-21kworker/u8:1+flush-259:020:47:263
2614088992118,2cyclictest2603588-21kworker/u8:4+flush-259:020:35:153
2614088992115,2cyclictest2895528-21kworker/u8:2+events_unbound23:40:223
2614082992118,2cyclictest2941997-21kworker/u8:1+flush-259:000:35:211
2614082992118,2cyclictest2879620-21kworker/u8:3+events_unbound23:43:041
2614082992117,3cyclictest2895528-21kworker/u8:2+events_unbound23:53:041
2614082992117,2cyclictest2603588-21kworker/u8:4+events_unbound20:15:171
2614082992115,4cyclictest252-21systemd-journal22:32:501
2614076992118,2cyclictest2603588-21kworker/u8:4+flush-259:020:10:240
2614088992018,2cyclictest2781080-21kworker/u8:1+flush-259:022:00:063
2614088992017,2cyclictest500-21systemd-logind21:00:003
2614088992016,3cyclictest2666541-21kworker/u8:1+events_unbound20:05:123
2614082992018,2cyclictest2895528-21kworker/u8:2+events_unbound00:00:151
2614082992017,2cyclictest2853750-21kworker/u8:0+flush-259:023:25:201
2614076992017,2cyclictest2941997-21kworker/u8:1+flush-259:000:35:240
2614076992017,2cyclictest2603588-21kworker/u8:4+flush-259:020:20:200
2614076992017,2cyclictest2603588-21kworker/u8:4+flush-259:020:15:210
2614088991916,2cyclictest2853750-21kworker/u8:0+flush-259:023:05:203
2614088991916,2cyclictest2603588-21kworker/u8:4+events_unbound19:26:063
2614085991916,2cyclictest2952608-21latency_hist00:35:012
2614085991915,3cyclictest2941997-21kworker/u8:1+events_unbound00:35:202
2614085991915,2cyclictest2625263-21kworker/u8:2+events_unbound19:45:182
2614082991915,3cyclictest2833288-21apt-get22:40:101
2614076991916,2cyclictest2931946-21apt-get00:15:110
2614076991916,2cyclictest2853750-21kworker/u8:0+flush-259:023:35:260
2614076991916,2cyclictest2853750-21kworker/u8:0+events_unbound23:20:210
2614076991915,3cyclictest2817511-21kworker/u8:2+flush-259:022:45:210
2614088991815,2cyclictest2905880-21kworker/u8:0+events_unbound00:10:133
2614088991815,2cyclictest2650902-21kworker/u8:0+flush-259:019:50:163
2614082991815,2cyclictest2817511-21kworker/u8:2+flush-259:022:55:181
2614082991815,2cyclictest2650902-21kworker/u8:0+events_unbound19:50:151
2614076991815,2cyclictest2765941-21kworker/u8:0+flush-259:022:00:010
2614076991815,2cyclictest2729356-21kworker/u8:3+events_unbound21:30:150
2614088991714,2cyclictest2941997-21kworker/u8:1+events_unbound00:35:223
2614088991714,2cyclictest2892924-21sort23:35:183
2614088991714,2cyclictest2729356-21kworker/u8:3+events_unbound21:30:213
2614088991714,2cyclictest2666541-21kworker/u8:1+events_unbound20:00:133
2614088991711,4cyclictest2750021-21latency_hist21:20:013
261408599172,9cyclictest2921383-21munin-run00:05:012
261408599172,5cyclictest2905874-21munin-run23:50:002
2614085991714,2cyclictest2725463-21kthreadcore20:55:162
2614085991713,3cyclictest2603588-21kworker/u8:4+flush-259:019:40:162
2614085991711,4cyclictest2842542-21ntpq22:45:212
2614085991711,4cyclictest252-21systemd-journal00:10:002
2614082991714,2cyclictest2807408-21kworker/u8:1+events_unbound22:47:071
2614082991713,3cyclictest2879620-21kworker/u8:3+events_unbound23:35:181
2614082991713,2cyclictest2603588-21kworker/u8:4+flush-259:020:35:191
2614076991714,2cyclictest2807408-21kworker/u8:1+events_unbound22:20:160
2614085991613,2cyclictest2698009-21turbostat.cron20:30:002
2614085991612,3cyclictest2765941-21kworker/u8:0+flush-259:022:35:162
2614085991612,3cyclictest2765941-21kworker/u8:0+flush-259:022:15:172
2614085991611,3cyclictest509-21rs:main2
2614085991611,3cyclictest2603588-21kworker/u8:4+flush-259:019:35:172
2614085991611,3cyclictest252-21systemd-journal23:51:072
2614082991613,2cyclictest2895741-21kworker/u8:4+events_unbound00:25:291
2614082991612,3cyclictest2781080-21kworker/u8:1+flush-259:022:00:211
2614082991612,3cyclictest2729356-21kworker/u8:3+events_unbound21:41:061
261408599159,4cyclictest2894639-21ntpq23:35:222
261408599159,4cyclictest2603588-21kworker/u8:4+flush-259:019:30:012
2614085991512,2cyclictest2896190-21irqcore23:40:152
2614082991512,2cyclictest2765941-21kworker/u8:0+flush-259:022:35:051
2614082991512,2cyclictest2729356-21kworker/u8:3+flush-259:021:15:191
2614082991511,3cyclictest2817511-21kworker/u8:2+events_unbound22:25:191
2614076991513,2cyclictest2807408-21kworker/u8:1+events_unbound22:19:060
2614076991512,2cyclictest60350irq/132-enp0s29f1:rx-022:56:000
2614076991512,2cyclictest2650902-21kworker/u8:0+events_unbound19:58:070
2614076991511,3cyclictest2822886-21/usr/sbin/munin22:30:140
2614088991411,2cyclictest0-21swapper/300:00:173
2614085991411,2cyclictest2947177-21latency_hist00:30:002
2614085991411,2cyclictest2885441-21irqcore23:30:152
2614085991411,2cyclictest2833043-21kworker/u8:4+flush-259:022:50:112
2614085991410,2cyclictest0-21swapper/220:50:002
2614082991411,2cyclictest2749936-21kworker/u8:4+flush-259:021:25:061
2614076991412,1cyclictest60350irq/132-enp0s29f1:rx-021:20:230
2614076991412,1cyclictest60350irq/132-enp0s29f1:rx-021:15:210
2614076991411,1cyclictest0-21swapper/019:20:190
261408899139,3cyclictest2603588-21kworker/u8:4+events_unbound19:45:323
2614088991310,2cyclictest2817511-21kworker/u8:2+events_unbound22:25:273
2614088991310,2cyclictest2807409-21kworker/u8:3+flush-259:022:30:203
261408599139,3cyclictest2895528-21kworker/u8:2+flush-259:000:10:052
2614085991311,1cyclictest2813175-21irqcore22:20:172
2614085991310,2cyclictest2730648-21kthreadcore21:00:182
2614076991311,1cyclictest60350irq/132-enp0s29f1:rx-023:53:490
261408599129,2cyclictest2776238-21sh21:45:002
261408599129,2cyclictest2682655-21fschecks_time20:15:132
261408599128,3cyclictest2729356-21kworker/u8:3+flush-259:021:25:172
261408599128,3cyclictest2729355-21kworker/u8:1+events_unbound21:05:242
261408599128,2cyclictest2755214-21sh21:25:002
261408599127,4cyclictest2895741-21kworker/u8:4+flush-259:023:55:152
261408299128,3cyclictest2713916-21fschecks_count20:45:151
261408599118,2cyclictest2864506-21fschecks_count23:10:152
261408599118,2cyclictest0-21swapper/219:35:002
261408599118,1cyclictest0-21swapper/223:30:002
261408599116,3cyclictest1-21systemd22:10:012
261408599115,4cyclictest2665942-21wc19:55:232
261408599108,1cyclictest0-21swapper/220:35:172
261408599107,2cyclictest2859266-21cpuspeed_turbos23:05:122
261408599107,2cyclictest2781718-21cpuspeed_turbos21:50:142
261408599106,3cyclictest401ktimers/200:20:122
261408599106,2cyclictest2807182-21latency_hist22:15:012
261408599104,1cyclictest0-21swapper/222:00:002
26140859996,2cyclictest0-21swapper/222:45:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional