You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-23 - 04:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Sep 23, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2411716995549,4cyclictest2750627-21apt-get00:35:120
2411716994742,3cyclictest2469217-21apt-get20:05:130
2411716994742,3cyclictest2417116-21apt-get19:15:120
2411716994537,6cyclictest2588405-21latency_hist22:00:000
2411726994440,2cyclictest2484724-21apt-get20:20:123
2411722994239,2cyclictest2422640-21kworker/u8:1+flush-259:019:30:162
2411726994137,3cyclictest2713443-21kworker/u8:4+flush-259:000:05:013
2411722994034,4cyclictest2624630-21cp22:35:002
2411716994033,5cyclictest2625148-21cat22:35:000
2411726993933,4cyclictest335557-21systemd-journal21:25:003
2411719993935,3cyclictest2598942-21kworker/u8:0+events_unbound22:35:001
2411719993934,3cyclictest2672039-21apt-get23:20:111
2411719993933,4cyclictest2708250-21apt-get23:55:121
2411719993832,4cyclictest335557-21systemd-journal20:34:381
2411719993832,4cyclictest2443357-21/usr/sbin/munin19:40:151
2411719993733,3cyclictest2598942-21kworker/u8:0+events_unbound22:50:231
2411719993731,4cyclictest2745435-21/usr/sbin/munin00:30:131
2411722993633,2cyclictest2474335-21kworker/u8:1+flush-259:020:50:262
2411722993632,2cyclictest2368353-21kworker/u8:0+flush-259:020:25:162
2411719993631,4cyclictest2740240-21apt-get00:25:121
2411719993631,4cyclictest2551764-21latency_hist21:25:011
2411719993631,3cyclictest2500161-21/usr/sbin/munin20:35:221
2411719993631,3cyclictest2500161-21/usr/sbin/munin20:35:211
2411726993530,4cyclictest2368353-21kworker/u8:0+flush-259:020:30:133
2411726993528,5cyclictest2635808-21cp22:45:013
2411722993531,3cyclictest2666480-21kworker/u8:3+events_unbound23:50:192
2411722993529,4cyclictest2541462-21latency_hist21:15:012
2411716993531,3cyclictest2666480-21kworker/u8:3+flush-259:000:10:010
2411726993430,3cyclictest2713443-21kworker/u8:4+flush-259:000:35:173
2411722993431,2cyclictest2391244-21kworker/u8:3+flush-259:019:30:012
2411722993429,4cyclictest2422640-21kworker/u8:1+flush-259:019:50:252
2411716993428,4cyclictest2687568-21apt-get23:35:110
2411722993330,2cyclictest2713443-21kworker/u8:4+flush-259:000:05:162
2411719993329,3cyclictest2666480-21kworker/u8:3+flush-259:023:20:011
2411726993227,4cyclictest335557-21systemd-journal22:15:003
2411726993226,4cyclictest2635435-21base6422:45:003
2411722993229,2cyclictest2368353-21kworker/u8:0+flush-259:020:30:172
2411719993228,3cyclictest2391244-21kworker/u8:3+flush-259:020:55:001
2411719993227,4cyclictest2734615-21apt-get00:20:121
2411719993126,3cyclictest2391244-21kworker/u8:3+flush-259:020:30:001
2411726993026,3cyclictest2733958-21gpgv00:20:003
2411726993026,3cyclictest2510643-21apt-get20:45:163
2411722993026,3cyclictest2598942-21kworker/u8:0+flush-259:022:25:162
2411719993026,3cyclictest2391244-21kworker/u8:3+flush-259:020:00:251
2411719993024,4cyclictest2474107-21latency_hist20:10:011
2411726992925,3cyclictest2468769-21apt-get20:03:193
2411722992923,3cyclictest2391244-21kworker/u8:3+flush-259:020:20:182
2411722992922,4cyclictest2630083-21latency_hist22:40:012
2411722992921,5cyclictest2556527-21ntpq21:25:232
2411719992925,3cyclictest2666480-21kworker/u8:3+flush-259:023:25:251
2411716992926,2cyclictest2391244-21kworker/u8:3+flush-259:020:40:210
2411716992923,4cyclictest335557-21systemd-journal21:23:390
2411722992824,2cyclictest2495000-21kworker/u8:2+flush-259:021:05:202
2411719992823,3cyclictest2433050-21/usr/sbin/munin19:30:141
2411726992723,3cyclictest2728995-21kworker/u8:0+flush-259:000:30:153
2411726992723,3cyclictest2391244-21kworker/u8:3+flush-259:019:40:173
2411722992723,3cyclictest2391244-21kworker/u8:3+flush-259:019:55:162
2411722992720,4cyclictest2593532-21latency_hist22:05:002
2411716992721,4cyclictest2665726-21ntpq23:10:280
2411726992622,3cyclictest2713185-21cp00:00:013
2411726992621,4cyclictest335557-21systemd-journal21:40:383
2411722992622,3cyclictest2728995-21kworker/u8:0+flush-259:000:25:252
2411722992622,3cyclictest2598942-21kworker/u8:0+flush-259:022:45:262
2411722992621,4cyclictest2640855-21kworker/u8:1+flush-259:023:15:172
2411722992621,4cyclictest2495000-21kworker/u8:2+flush-259:021:40:202
2411719992623,2cyclictest2598942-21kworker/u8:0+events_unbound22:25:171
2411716992623,2cyclictest2531378-21kworker/u8:1+flush-259:021:30:150
2411726992523,1cyclictest2666480-21kworker/u8:3+flush-259:023:55:003
2411726992522,2cyclictest2495000-21kworker/u8:2+flush-259:020:50:203
2411722992521,3cyclictest2713443-21kworker/u8:4+events_unbound00:15:142
2411722992520,3cyclictest2640855-21kworker/u8:1+events_unbound23:13:572
2411719992522,2cyclictest2640855-21kworker/u8:1+flush-259:023:35:211
2411719992521,3cyclictest2666480-21kworker/u8:3+events_unbound23:45:191
2411716992519,4cyclictest2583233-21latency_hist21:55:010
2411726992420,3cyclictest2666480-21kworker/u8:3+flush-259:023:45:233
2411726992419,3cyclictest2740159-21base6400:25:013
2411726992418,4cyclictest2422163-21cat19:20:023
2411722992420,3cyclictest2723639-21kworker/u8:1+flush-259:000:40:002
2411722992420,3cyclictest2630121-21kworker/u8:3+events_unbound22:55:002
2411722992419,4cyclictest2598942-21kworker/u8:0+events_unbound22:12:392
2411722992419,3cyclictest335557-21systemd-journal20:09:382
2411722992419,3cyclictest2391244-21kworker/u8:3+events_unbound19:45:172
2411722992417,5cyclictest2546880-21apt-get21:20:132
2411722992416,5cyclictest2422621-21cp19:20:022
2411719992421,2cyclictest2598942-21kworker/u8:0+events_unbound22:30:231
2411716992421,2cyclictest2422640-21kworker/u8:1+events_unbound19:33:560
2411716992418,4cyclictest2634414-21ntpq22:40:200
2411726992320,2cyclictest2713443-21kworker/u8:4+flush-259:000:20:163
2411726992318,4cyclictest2391244-21kworker/u8:3+flush-259:020:10:003
2411722992320,2cyclictest2677217-21apt-get23:25:132
2411722992319,3cyclictest2656273-21kworker/u8:2+events_unbound23:08:392
2411722992319,3cyclictest2391244-21kworker/u8:3+events_unbound20:40:222
2411719992319,3cyclictest2495000-21kworker/u8:2+flush-259:021:40:141
2411719992319,3cyclictest2495000-21kworker/u8:2+flush-259:021:00:161
2411719992318,3cyclictest2656538-21apt-get23:05:121
2411716992319,3cyclictest2713443-21kworker/u8:4+flush-259:000:15:190
2411716992317,4cyclictest2656277-21latency_hist23:05:010
2411722992219,2cyclictest2495000-21kworker/u8:2+flush-259:021:35:162
2411722992218,3cyclictest2640855-21kworker/u8:1+flush-259:023:50:012
2411722992218,3cyclictest2630121-21kworker/u8:3+flush-259:022:40:222
2411722992215,5cyclictest2728995-21kworker/u8:0+events_unbound00:30:112
2411719992218,3cyclictest2593575-21kworker/u8:3+flush-259:022:15:151
2411719992218,3cyclictest2391244-21kworker/u8:3+flush-259:020:50:001
2411719992218,3cyclictest2368353-21kworker/u8:0+events_unbound21:10:291
2411716992218,3cyclictest2562279-21kworker/u8:3+flush-259:021:45:000
2411716992218,3cyclictest2474335-21kworker/u8:1+flush-259:020:55:170
2411716992218,3cyclictest2422640-21kworker/u8:1+flush-259:019:25:250
2411726992118,2cyclictest2474335-21kworker/u8:1+flush-259:020:55:243
2411726992117,3cyclictest2422640-21kworker/u8:1+flush-259:019:25:233
2411726992116,4cyclictest2666480-21kworker/u8:3+flush-259:023:30:243
2411722992117,3cyclictest2640855-21kworker/u8:1+events_unbound23:21:382
2411722992117,3cyclictest2391244-21kworker/u8:3+events_unbound20:20:002
2411722992113,5cyclictest2531147-21latency_hist21:05:012
2411719992116,4cyclictest2531378-21kworker/u8:1+flush-259:021:05:261
2411719992115,4cyclictest335557-21systemd-journal19:36:381
2411716992118,2cyclictest2541478-21systemd-run21:15:000
2411716992117,3cyclictest2391244-21kworker/u8:3+flush-259:020:00:170
2411726992017,2cyclictest2598942-21kworker/u8:0+flush-259:022:25:263
2411726992016,3cyclictest2577730-21kworker/u8:1+flush-259:022:05:143
2411722992017,2cyclictest2640855-21kworker/u8:1+flush-259:023:00:162
2411722992016,3cyclictest2495000-21kworker/u8:2+events_unbound21:33:392
2411722992016,3cyclictest2368353-21kworker/u8:0+flush-259:019:10:332
2411719992017,2cyclictest2640855-21kworker/u8:1+events_unbound23:10:301
2411719992016,3cyclictest2577730-21kworker/u8:1+events_unbound21:50:221
2411719992016,3cyclictest2495000-21kworker/u8:2+events_unbound21:35:251
2411719992016,3cyclictest2391244-21kworker/u8:3+flush-259:019:59:591
2411726991914,4cyclictest335557-21systemd-journal19:32:393
2411726991914,4cyclictest2489876-21apt-get20:25:123
2411722991916,2cyclictest2562279-21kworker/u8:3+events_unbound21:45:242
2411722991915,3cyclictest2713443-21kworker/u8:4+flush-259:000:20:122
2411722991915,3cyclictest2640855-21kworker/u8:1+flush-259:023:40:152
2411722991915,3cyclictest2495000-21kworker/u8:2+events_unbound21:59:382
2411722991914,4cyclictest2495000-21kworker/u8:2+events_unbound22:06:392
2411722991913,4cyclictest2474343-21/usr/sbin/munin20:10:242
2411719991916,2cyclictest2495000-21kworker/u8:2+events_unbound22:05:231
2411719991914,3cyclictest509-21rs:main1
2411716991915,3cyclictest2391244-21kworker/u8:3+flush-259:020:16:350
241172699180,17cyclictest1-21systemd19:36:383
2411722991814,3cyclictest2593575-21kworker/u8:3+events_unbound22:16:302
2411722991814,3cyclictest2495000-21kworker/u8:2+events_unbound20:35:402
2411722991814,3cyclictest2495000-21kworker/u8:2+events_unbound20:35:392
2411722991814,3cyclictest2463982-21kworker/u8:2+events_unbound20:00:272
2411722991814,3cyclictest2411907-21kworker/u8:4+events_unbound19:19:392
2411722991814,3cyclictest2368353-21kworker/u8:0+events_unbound21:15:162
2411722991811,5cyclictest2614221-21latency_hist22:25:012
2411719991814,3cyclictest2713443-21kworker/u8:4+events_unbound00:05:161
2411719991814,3cyclictest2666480-21kworker/u8:3+flush-259:023:30:151
2411716991814,3cyclictest335480-21sshd23:25:380
2411716991814,3cyclictest2739790-21gpgv00:25:000
2411726991713,3cyclictest2422649-21/usr/sbin/munin19:20:143
2411722991711,4cyclictest2474335-21kworker/u8:1+flush-259:020:45:222
2411722991710,5cyclictest2521222-21diskstats20:55:142
2411719991714,2cyclictest2614220-21sh22:25:001
2411719991714,2cyclictest2391244-21kworker/u8:3+events_unbound19:15:211
2411719991713,3cyclictest2713443-21kworker/u8:4+events_unbound00:00:241
2411716991714,2cyclictest60350irq/132-enp0s29f1:rx-021:45:250
2411716991714,2cyclictest60350irq/132-enp0s29f1:rx-021:04:580
2411716991714,2cyclictest2624930-21latency_hist22:35:010
2411716991713,3cyclictest2411952-21apt-get19:10:200
2411726991612,3cyclictest2368353-21kworker/u8:0+flush-259:019:10:323
2411726991610,4cyclictest2604154-21apt-get22:15:103
2411722991612,3cyclictest2713443-21kworker/u8:4+events_unbound00:10:182
2411722991612,3cyclictest2422640-21kworker/u8:1+events_unbound19:40:402
241171999163,6cyclictest2755574-21munin-run00:40:001
2411719991612,3cyclictest2391244-21kworker/u8:3+events_unbound19:45:241
2411719991610,4cyclictest2729030-21apt-get00:15:111
2411716991614,1cyclictest60350irq/132-enp0s29f1:rx-023:30:220
2411716991614,1cyclictest60350irq/132-enp0s29f1:rx-022:55:220
2411716991614,1cyclictest60350irq/132-enp0s29f1:rx-022:45:250
2411716991614,1cyclictest60350irq/132-enp0s29f1:rx-021:26:190
2411716991614,1cyclictest60350irq/132-enp0s29f1:rx-000:30:140
2411716991613,2cyclictest2712240-21ntp_kernel_pll_23:55:210
2411716991612,3cyclictest2656273-21kworker/u8:2+flush-259:023:10:000
2411716991612,3cyclictest2474335-21kworker/u8:1+events_unbound20:10:170
2411716991612,3cyclictest2368353-21kworker/u8:0+flush-259:020:25:240
2411726991513,1cyclictest0-21swapper/320:15:013
2411726991512,2cyclictest2640855-21kworker/u8:1+flush-259:022:57:063
2411726991511,3cyclictest2577730-21kworker/u8:1+flush-259:022:20:263
2411726991511,3cyclictest2552456-21apt-get21:25:133
2411722991512,2cyclictest2718391-21apt00:05:012
2411722991512,2cyclictest2666480-21kworker/u8:3+events_unbound23:35:122
2411722991511,3cyclictest2666480-21kworker/u8:3+events_unbound23:30:252
2411719991512,2cyclictest2713443-21kworker/u8:4+events_unbound00:10:241
2411719991512,2cyclictest2577730-21kworker/u8:1+flush-259:022:00:201
2411719991512,2cyclictest2391244-21kworker/u8:3+flush-259:020:40:281
2411719991511,3cyclictest2428050-21fschecks_count19:25:151
2411716991514,1cyclictest60350irq/132-enp0s29f1:rx-019:43:000
2411716991513,1cyclictest60350irq/132-enp0s29f1:rx-023:20:140
2411716991513,1cyclictest60350irq/132-enp0s29f1:rx-022:25:170
2411716991513,1cyclictest60350irq/132-enp0s29f1:rx-022:20:280
2411716991513,1cyclictest60350irq/132-enp0s29f1:rx-021:35:150
2411716991513,1cyclictest60350irq/132-enp0s29f1:rx-020:50:200
2411716991513,1cyclictest60350irq/132-enp0s29f1:rx-020:35:110
2411716991513,1cyclictest60350irq/132-enp0s29f1:rx-020:35:110
2411716991513,1cyclictest60350irq/132-enp0s29f1:rx-020:30:160
2411716991513,1cyclictest60350irq/132-enp0s29f1:rx-019:35:260
2411716991513,1cyclictest60350irq/132-enp0s29f1:rx-000:10:260
2411716991512,2cyclictest61150irq/133-enp0s29f1:tx-019:55:150
2411716991512,2cyclictest60350irq/132-enp0s29f1:rx-023:40:160
2411716991512,2cyclictest60350irq/132-enp0s29f1:rx-023:15:120
241172699148,4cyclictest2692459-21latency_hist23:40:003
2411726991411,2cyclictest2630067-21cron22:40:003
2411726991411,2cyclictest2531378-21kworker/u8:1+flush-259:021:10:003
2411722991411,2cyclictest2666480-21kworker/u8:3+flush-259:023:55:202
2411722991410,3cyclictest2630121-21kworker/u8:3+events_unbound22:56:382
2411719991411,2cyclictest2640817-21latency_hist22:50:001
2411719991411,2cyclictest2577730-21kworker/u8:1+flush-259:022:00:001
2411719991410,3cyclictest2474335-21kworker/u8:1+events_unbound20:55:241
2411719991410,3cyclictest2422640-21kworker/u8:1+flush-259:019:20:211
2411719991410,3cyclictest2416499-21journal-offline19:10:521
2411716991412,2cyclictest60350irq/132-enp0s29f1:rx-022:10:010
2411716991412,1cyclictest60350irq/132-enp0s29f1:rx-022:15:230
2411716991412,1cyclictest60350irq/132-enp0s29f1:rx-021:05:210
2411716991412,1cyclictest60350irq/132-enp0s29f1:rx-019:49:570
2411716991412,1cyclictest0-21swapper/022:10:000
2411716991411,2cyclictest60350irq/132-enp0s29f1:rx-023:45:230
2411716991411,2cyclictest60350irq/132-enp0s29f1:rx-000:03:430
241172699138,4cyclictest2578295-21apt-get21:50:113
2411726991311,1cyclictest2587423-21needreboot21:55:193
2411726991311,1cyclictest0-21swapper/320:40:223
2411726991310,2cyclictest2505054-21gdbus20:39:203
2411726991310,2cyclictest2505054-21gdbus20:39:203
241172299139,3cyclictest2391244-21kworker/u8:3+events_unbound19:37:382
241171999139,3cyclictest2531378-21kworker/u8:1+events_unbound21:30:211
2411719991311,1cyclictest2666480-21kworker/u8:3+flush-259:023:50:151
241171999131,10cyclictest335557-21systemd-journal21:47:381
2411719991310,2cyclictest2458134-21unixbench_singl19:50:271
2411716991311,1cyclictest60350irq/132-enp0s29f1:rx-023:50:150
2411716991311,1cyclictest60350irq/132-enp0s29f1:rx-021:15:200
2411716991311,1cyclictest60350irq/132-enp0s29f1:rx-020:22:320
2411716991311,1cyclictest60350irq/132-enp0s29f1:rx-019:24:240
2411726991210,1cyclictest2458574-21sh19:54:593
2411726991210,1cyclictest0-21swapper/322:35:003
241172699120,4cyclictest2728772-21awk00:15:013
241171999129,1cyclictest0-21swapper/122:45:011
241171999128,3cyclictest2640855-21kworker/u8:1+flush-259:023:00:171
241171999126,4cyclictest335557-21systemd-journal21:30:011
241171999126,4cyclictest2541699-21/usr/sbin/munin21:15:211
2411716991210,1cyclictest60350irq/132-enp0s29f1:rx-020:45:160
2411716991210,1cyclictest60350irq/132-enp0s29f1:rx-000:25:160
241172699118,2cyclictest2676493-21unixbench_multi23:20:253
241172699118,2cyclictest2651450-21cpuspeed_turbos23:00:143
241172699118,2cyclictest2526472-21fschecks_time21:00:153
241172699108,1cyclictest0-21swapper/323:15:143
241172699107,2cyclictest2540456-21needreboot21:10:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional