You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-08 - 10:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Apr 08, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2242086997369,2cyclictest75-21kswapd019:50:020
2242092994738,3cyclictest2182904-21kworker/u8:1+events_unbound19:35:222
2242096993832,4cyclictest2182904-21kworker/u8:1+flush-259:021:05:013
2242092993834,3cyclictest2247255-21kworker/u8:0+events_unbound19:20:152
2242088993833,3cyclictest252-21systemd-journal19:55:501
2242096993630,4cyclictest2475042-21kworker/u8:3+flush-259:023:05:183
2242092993632,3cyclictest2433986-21kworker/u8:2+events_unbound22:35:242
2242092993532,2cyclictest2371721-21kworker/u8:3+flush-259:022:05:242
2242092993532,2cyclictest2371721-21kworker/u8:3+flush-259:021:35:242
2242092993531,3cyclictest2182904-21kworker/u8:1+events_unbound20:25:252
2242092993430,3cyclictest2465500-21kworker/u8:2+events_unbound22:45:212
2242092993330,2cyclictest2443994-21kworker/u8:1+events_unbound22:55:202
2242092993329,3cyclictest2443994-21kworker/u8:1+flush-259:022:30:142
2242092993329,3cyclictest2443994-21kworker/u8:1+flush-259:022:30:142
2242092993328,4cyclictest2305099-21apt-get20:10:112
2242092993328,4cyclictest2305099-21apt-get20:10:112
2242092993228,3cyclictest2485519-21kworker/u8:2+flush-259:023:15:162
2242092993228,3cyclictest2444536-21apt-get22:25:132
2242096993127,3cyclictest2521603-21kworker/u8:0+flush-259:000:35:253
2242088993125,4cyclictest2584019-21latency_hist00:40:001
2242086993125,4cyclictest2325413-21latency_hist20:30:010
2242092993027,2cyclictest2273090-21kworker/u8:2+flush-259:021:05:202
2242092993026,3cyclictest2182904-21kworker/u8:1+events_unbound20:00:122
2242086993027,2cyclictest2475042-21kworker/u8:3+events_unbound23:03:440
2242092992926,2cyclictest2501194-21kworker/u8:1+events_unbound00:00:222
2242092992926,2cyclictest2193908-21kworker/u8:2+events_unbound19:10:232
2242092992926,2cyclictest2182904-21kworker/u8:1+events_unbound20:45:222
2242092992925,3cyclictest2182904-21kworker/u8:1+events_unbound20:55:232
2242092992826,2cyclictest2454590-21kworker/u8:0+events_unbound22:50:182
2242092992826,2cyclictest2182904-21kworker/u8:1+flush-259:019:30:252
2242092992825,2cyclictest2542297-21kworker/u8:2+events_unbound00:05:212
2242092992825,2cyclictest2521603-21kworker/u8:0+events_unbound00:15:202
2242092992825,2cyclictest2485519-21kworker/u8:2+flush-259:023:20:212
2242092992824,3cyclictest2443994-21kworker/u8:1+events_unbound22:40:232
2242092992824,3cyclictest2247255-21kworker/u8:0+events_unbound19:45:202
2242088992825,2cyclictest2485743-21apt-get23:05:121
2242088992823,4cyclictest2315381-21apt-get20:20:111
2242086992826,2cyclictest2371721-21kworker/u8:3+events_unbound22:11:430
2242086992825,2cyclictest2402913-21kworker/u8:2+events_unbound21:53:430
224208699280,26cyclictest2294204-21systemd19:55:500
2242096992722,3cyclictest2182904-21kworker/u8:1+flush-259:021:10:233
2242096992720,4cyclictest2418686-21cat22:00:013
2242092992724,2cyclictest2412985-21kworker/u8:0+events_unbound21:55:182
2242092992724,2cyclictest2273090-21kworker/u8:2+flush-259:021:31:422
2242092992724,2cyclictest2247255-21kworker/u8:0+events_unbound19:15:222
2242092992724,2cyclictest2182904-21kworker/u8:1+events_unbound20:30:272
2242088992724,2cyclictest2182904-21kworker/u8:1+flush-259:020:45:131
2242086992725,2cyclictest2475042-21kworker/u8:3+events_unbound23:08:440
2242086992724,2cyclictest2182904-21kworker/u8:1+events_unbound20:58:430
2242096992621,3cyclictest2182904-21kworker/u8:1+events_unbound19:25:003
2242092992623,2cyclictest2371721-21kworker/u8:3+events_unbound22:10:212
2242092992623,2cyclictest2273090-21kworker/u8:2+events_unbound20:05:222
2242092992620,2cyclictest2402913-21kworker/u8:2+flush-259:021:50:112
2242086992625,1cyclictest2397541-21kworker/u8:1+events_unbound21:48:430
2242086992624,2cyclictest2387404-21kworker/u8:0+events_unbound21:38:440
2242086992624,2cyclictest2182904-21kworker/u8:1+events_unbound19:26:170
2242092992523,2cyclictest2521603-21kworker/u8:0+events_unbound00:30:152
2242092992522,2cyclictest2542297-21kworker/u8:2+flush-259:000:20:202
2242092992522,2cyclictest2397541-21kworker/u8:1+events_unbound21:46:422
2242092992520,2cyclictest2273090-21kworker/u8:2+events_unbound19:58:442
2242086992523,2cyclictest2501194-21kworker/u8:1+events_unbound23:22:450
2242086992522,2cyclictest2521603-21kworker/u8:0+events_unbound23:49:460
2242096992417,5cyclictest2578828-21latency_hist00:35:013
2242092992422,2cyclictest2521603-21kworker/u8:0+flush-259:023:55:162
2242092992421,2cyclictest2501194-21kworker/u8:1+events_unbound23:35:212
2242092992421,2cyclictest2182904-21kworker/u8:1+flush-259:021:00:242
2242088992419,4cyclictest2397737-21/usr/sbin/munin21:40:141
2242088992418,4cyclictest252-21systemd-journal22:15:011
2242086992422,2cyclictest2182904-21kworker/u8:1+events_unbound19:16:130
2242086992421,2cyclictest2273090-21kworker/u8:2+events_unbound20:01:220
2242086992421,2cyclictest2182904-21kworker/u8:1+events_unbound19:13:430
2242092992320,2cyclictest2501194-21kworker/u8:1+flush-259:023:25:152
2242092992320,2cyclictest2371722-21kworker/u8:4+events_unbound21:25:152
2242092992320,2cyclictest2273090-21kworker/u8:2+events_unbound21:20:012
2242092992318,2cyclictest2521603-21kworker/u8:0+events_unbound00:35:152
2242092992318,2cyclictest2182904-21kworker/u8:1+events_unbound19:54:422
2242088992316,5cyclictest2412048-21ntpq21:50:181
2242086992321,2cyclictest2485519-21kworker/u8:2+events_unbound23:15:440
2242086992321,2cyclictest2371722-21kworker/u8:4+events_unbound21:19:430
2242086992321,2cyclictest2273090-21kworker/u8:2+events_unbound20:54:430
2242086992320,2cyclictest2247255-21kworker/u8:0+events_unbound19:23:460
2242096992218,3cyclictest2182904-21kworker/u8:1+flush-259:019:40:233
2242092992220,2cyclictest2182904-21kworker/u8:1+events_unbound20:40:142
2242092992219,2cyclictest2501194-21kworker/u8:1+events_unbound23:45:132
2242092992219,2cyclictest2485519-21kworker/u8:2+flush-259:023:10:242
2242092992219,2cyclictest2273090-21kworker/u8:2+flush-259:020:50:202
2242092992219,2cyclictest2182904-21kworker/u8:1+flush-259:019:40:162
2242092992218,3cyclictest2485519-21kworker/u8:2+events_unbound23:40:232
2242092992218,3cyclictest2475042-21kworker/u8:3+events_unbound23:00:202
2242092992218,3cyclictest2273090-21kworker/u8:2+events_unbound21:10:492
2242088992217,4cyclictest2340837-21latency_hist20:45:011
2242088992216,4cyclictest2289006-21latency_hist19:55:011
2242086992220,2cyclictest2465500-21kworker/u8:2+events_unbound22:46:440
2242086992220,2cyclictest2397541-21kworker/u8:1+events_unbound22:06:370
2242086992220,2cyclictest2182904-21kworker/u8:1+events_unbound19:45:410
2242086992219,2cyclictest2521603-21kworker/u8:0+events_unbound00:10:470
2242086992219,2cyclictest2521603-21kworker/u8:0+events_unbound00:04:450
2242086992219,2cyclictest2182904-21kworker/u8:1+events_unbound19:30:260
2242096992114,5cyclictest2475578-21diskstats22:55:133
2242088992118,2cyclictest2371722-21kworker/u8:4+flush-259:021:20:001
2242088992117,3cyclictest2247468-21/usr/sbin/munin19:15:141
2242086992119,2cyclictest2521603-21kworker/u8:0+events_unbound00:17:450
2242086992119,2cyclictest2371721-21kworker/u8:3+events_unbound22:01:370
2242086992118,2cyclictest2521603-21kworker/u8:0+events_unbound00:33:450
2242086992118,2cyclictest2273090-21kworker/u8:2+events_unbound20:45:420
2242086992117,3cyclictest2521567-21cron23:40:000
2242086992116,4cyclictest2475155-21latency_hist22:55:000
2242096992017,2cyclictest2444278-21grep22:25:003
2242096992015,4cyclictest2371721-21kworker/u8:3+flush-259:022:10:203
2242096992013,5cyclictest2319376-21ntpq20:20:203
2242092992018,2cyclictest2371721-21kworker/u8:3+events_unbound21:20:192
2242092992017,2cyclictest2521603-21kworker/u8:0+events_unbound00:10:202
2242092992017,2cyclictest2412985-21kworker/u8:0+events_unbound22:15:192
2242088992017,2cyclictest2371721-21kworker/u8:3+flush-259:022:00:231
2242088992016,3cyclictest2563595-21apt-get00:20:091
2242086992019,1cyclictest2501194-21kworker/u8:1+events_unbound23:28:470
2242086992018,2cyclictest2387404-21kworker/u8:0+events_unbound21:34:220
2242086992018,2cyclictest2182904-21kworker/u8:1+events_unbound19:35:270
2242086992017,2cyclictest2182904-21kworker/u8:1+events_unbound20:06:420
2242096991916,1cyclictest0-21swapper/319:50:003
2242092991916,2cyclictest2501194-21kworker/u8:1+events_unbound23:50:242
2242092991916,2cyclictest2371721-21kworker/u8:3+events_unbound21:40:272
2242092991916,2cyclictest2182904-21kworker/u8:1+events_unbound20:24:432
2242088991916,2cyclictest2547673-21apt-config00:05:001
2242088991915,3cyclictest2397541-21kworker/u8:1+flush-259:021:50:001
2242086991917,2cyclictest2371722-21kworker/u8:4+events_unbound21:29:270
2242086991917,2cyclictest2273090-21kworker/u8:2+events_unbound20:12:430
2242086991917,2cyclictest2273090-21kworker/u8:2+events_unbound20:12:420
2242086991916,2cyclictest2182904-21kworker/u8:1+events_unbound21:10:020
2242086991915,3cyclictest2182904-21kworker/u8:1+events_unbound21:07:430
2242086991914,4cyclictest2526757-21latency_hist23:45:020
2242096991814,2cyclictest2482883-21kthreadcore23:00:183
2242092991815,2cyclictest2542297-21kworker/u8:2+flush-259:000:25:522
2242092991815,2cyclictest2511940-21irqcore23:30:162
2242092991815,2cyclictest2475042-21kworker/u8:3+events_unbound23:05:232
224208899183,5cyclictest2574476-21sed00:30:161
2242088991816,1cyclictest0-21swapper/120:40:001
2242086991816,2cyclictest2521603-21kworker/u8:0+events_unbound00:37:030
2242086991816,2cyclictest2443994-21kworker/u8:1+events_unbound22:34:560
2242086991816,2cyclictest2443994-21kworker/u8:1+events_unbound22:34:560
2242086991815,2cyclictest507-21in:imuxsock21:05:000
2242086991815,2cyclictest2521603-21kworker/u8:0+events_unbound00:24:110
2242086991815,2cyclictest2182904-21kworker/u8:1+events_unbound19:42:210
224209699177,9cyclictest2371721-21kworker/u8:3+flush-259:021:40:233
2242096991713,3cyclictest2182904-21kworker/u8:1+flush-259:019:35:233
2242096991712,4cyclictest2433986-21kworker/u8:2+flush-259:022:30:003
2242092991714,2cyclictest2412985-21kworker/u8:0+flush-259:022:20:242
2242092991714,2cyclictest2182904-21kworker/u8:1+flush-259:020:15:132
2242088991715,1cyclictest2312537-21kthreadcore20:15:181
2242088991712,1cyclictest191rcu_preempt00:25:271
224208699177,3cyclictest2492513-21kthreadcore23:10:170
2242086991716,1cyclictest2371721-21kworker/u8:3+events_unbound22:36:050
2242086991715,2cyclictest2501194-21kworker/u8:1+events_unbound23:31:410
2242086991715,2cyclictest2433986-21kworker/u8:2+events_unbound22:25:440
2242086991715,2cyclictest2273090-21kworker/u8:2+events_unbound20:41:570
2242086991714,2cyclictest2573667-21sh00:29:590
2242086991714,2cyclictest2521603-21kworker/u8:0+events_unbound23:55:090
2242086991714,2cyclictest2501194-21kworker/u8:1+events_unbound23:50:280
2242086991714,2cyclictest2443994-21kworker/u8:1+events_unbound22:59:040
2242086991714,2cyclictest2443994-21kworker/u8:1+events_unbound22:43:530
2242086991714,2cyclictest2412985-21kworker/u8:0+flush-259:022:20:160
2242086991714,2cyclictest2412985-21kworker/u8:0+events_unbound21:57:190
2242086991714,2cyclictest2182904-21kworker/u8:1+events_unbound20:35:560
2242086991714,2cyclictest2182904-21kworker/u8:1+events_unbound20:32:550
2242096991613,2cyclictest2501194-21kworker/u8:1+flush-259:000:00:193
2242096991611,3cyclictest2273090-21kworker/u8:2+flush-259:020:50:173
224208899164,2cyclictest2387439-21apt-get21:30:131
224208899161,9cyclictest2282500-21ntpq19:45:201
224208899161,7cyclictest2329728-21ntpq20:30:221
2242088991613,2cyclictest2495779-21idleruntime-cro23:15:001
2242088991613,2cyclictest2448568-21ntp_offset22:25:241
2242088991612,1cyclictest191rcu_preempt20:51:181
2242088991612,1cyclictest191rcu_preempt00:12:191
2242086991613,2cyclictest2542297-21kworker/u8:2+events_unbound00:08:370
2242086991613,2cyclictest2371722-21kworker/u8:4+events_unbound21:20:490
2242086991613,2cyclictest2371721-21kworker/u8:3+events_unbound22:15:030
224209699159,4cyclictest2424067-21diskstats22:05:133
224209699159,4cyclictest2284061-21/usr/sbin/munin19:50:133
2242096991511,3cyclictest2542297-21kworker/u8:2+flush-259:000:20:223
2242092991512,2cyclictest2247255-21kworker/u8:0+flush-259:019:25:342
2242092991511,3cyclictest2182904-21kworker/u8:1+events_unbound20:38:422
224208899154,2cyclictest311ktimers/122:05:141
224208899152,3cyclictest2438205-21ld22:15:181
224208899152,2cyclictest2247107-21modprobe19:13:421
224208899151,4cyclictest2480314-21latency_hist23:00:001
2242088991513,1cyclictest2366549-21sh21:10:001
2242088991512,2cyclictest2532177-21apt-get23:50:111
2242088991512,1cyclictest191rcu_preempt19:21:561
2242088991512,1cyclictest0-21swapper/121:00:001
2242088991511,3cyclictest2382296-21apt-get21:25:121
2242088991510,3cyclictest2465089-21/usr/sbin/munin22:45:151
224208899150,5cyclictest2453718-21ntpq22:30:211
224208899150,5cyclictest2453718-21ntpq22:30:211
224208899150,4cyclictest2510421-21ntpq23:25:221
224208699156,1cyclictest191rcu_preempt20:15:120
2242086991513,2cyclictest2273090-21kworker/u8:2+events_unbound20:23:200
2242086991512,2cyclictest2387404-21kworker/u8:0+events_unbound21:42:450
224209699148,4cyclictest2485519-21kworker/u8:2+events_unbound23:10:173
224209699148,4cyclictest2387404-21kworker/u8:0+flush-259:021:30:173
224209699148,4cyclictest2247255-21kworker/u8:0+flush-259:019:15:243
2242096991410,2cyclictest252-21systemd-journal21:09:593
224208899149,2cyclictest2412985-21kworker/u8:0-events_unbound21:55:421
224208899148,3cyclictest2485519-21kworker/u8:2-events_unbound23:41:411
224208899142,4cyclictest2541359-21ntpq23:55:221
224208899142,3cyclictest2439730-21if_enp0s29f122:20:151
224208899142,2cyclictest32-21ksoftirqd/119:25:191
224208899142,2cyclictest2397548-21cut21:40:001
2242088991412,1cyclictest2305508-21irqcore20:10:161
2242088991412,1cyclictest2305508-21irqcore20:10:161
2242088991412,0cyclictest191rcu_preempt23:36:461
2242088991410,3cyclictest2531920-21latency_hist23:50:011
224209699139,3cyclictest2335684-21idleruntime-cro20:40:003
224209699139,2cyclictest0-21swapper/322:35:003
224209699139,2cyclictest0-21swapper/322:35:003
224209699138,4cyclictest2485519-21kworker/u8:2+flush-259:023:30:003
224209699138,3cyclictest2371956-21apt-get21:15:103
224209699137,4cyclictest252-21systemd-journal23:35:003
2242096991311,1cyclictest0-21swapper/321:00:003
2242096991310,2cyclictest2182904-21kworker/u8:1+flush-259:020:30:173
2242096991310,2cyclictest0-21swapper/323:40:163
2242096991310,1cyclictest0-21swapper/323:50:223
224208899136,1cyclictest191rcu_preempt20:00:201
224208899135,1cyclictest191rcu_preempt00:05:231
224208899132,3cyclictest2496209-21seq23:15:141
224208899132,2cyclictest32-21ksoftirqd/121:00:201
224208899132,2cyclictest2483554-21grep23:00:191
224208899132,1cyclictest2562417-21ld00:15:191
2242088991310,2cyclictest2366885-21cpuspeed_turbos21:10:131
224208899130,3cyclictest2381106-21ntpq21:20:201
224209699129,2cyclictest2520661-21ntp_kernel_err23:35:213
224209699129,2cyclictest2257893-21cpuspeed_turbos19:25:143
224209699129,1cyclictest0-21swapper/323:15:243
224209699129,1cyclictest0-21swapper/322:45:003
224209699128,3cyclictest2521603-21kworker/u8:0+flush-259:000:15:213
224209699128,3cyclictest2371721-21kworker/u8:3+flush-259:022:15:243
224208899125,1cyclictest191rcu_preempt22:50:151
224208899125,1cyclictest191rcu_preempt19:30:141
224209699119,1cyclictest0-21swapper/321:20:243
224209699119,1cyclictest0-21swapper/320:40:133
224209699118,2cyclictest2305459-21iwlist20:10:163
224209699118,2cyclictest2305459-21iwlist20:10:153
224209699118,2cyclictest0-21swapper/322:40:003
224209699117,3cyclictest2521603-21kworker/u8:0+flush-259:023:45:253
224209699117,3cyclictest2465500-21kworker/u8:2+flush-259:022:50:153
224209699115,4cyclictest2537329-21/usr/sbin/munin23:55:143
224208899114,1cyclictest191rcu_preempt22:35:161
224209699107,2cyclictest0-21swapper/319:30:173
224209699106,2cyclictest2394998-21kthreadcore21:35:173
224209699105,3cyclictest2465500-21kworker/u8:2+flush-259:022:45:163
224208899107,1cyclictest0-21swapper/119:10:001
224208699107,1cyclictest0-21swapper/019:10:010
22420969997,1cyclictest0-21swapper/321:50:093
22420969997,1cyclictest0-21swapper/319:55:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional