You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-20 - 22:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Thu Aug 20, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2310728994740,5cyclictest2336931-21latency_hist07:35:003
2310718994741,4cyclictest2550027-21latency_hist11:00:010
2310722994340,2cyclictest2373563-21kworker/u8:1+flush-259:008:30:261
2310722994339,3cyclictest2648875-21apt-get12:35:131
2310722994239,2cyclictest2638121-21apt-get12:25:111
2310718994239,2cyclictest2580668-21kworker/u8:2+flush-259:011:40:230
2310728994034,4cyclictest2560357-21latency_hist11:10:003
2310722994038,2cyclictest2544894-21kworker/u8:0+events_unbound11:50:271
2310728993831,5cyclictest2601687-21latency_hist11:50:003
2310718993833,3cyclictest335557-21systemd-journal10:03:560
2310726993734,2cyclictest2461458-21kworker/u8:4+flush-259:010:25:112
2310722993735,1cyclictest2492821-21kworker/u8:1+flush-259:010:50:241
2310722993733,3cyclictest2617453-21apt-get12:05:131
2310728993633,2cyclictest2321194-21kworker/u8:0+flush-259:007:40:163
2310726993631,3cyclictest2316291-21gpgv07:15:002
2310718993633,2cyclictest2596574-21kworker/u8:1+events_unbound11:55:100
2310722993531,3cyclictest2409767-21kworker/u8:0+flush-259:009:00:001
2310722993528,5cyclictest2512573-21ntpq10:20:211
2310722993431,2cyclictest2596574-21kworker/u8:1+events_unbound12:00:241
2310722993431,2cyclictest2461458-21kworker/u8:4+events_unbound10:15:241
2310722993430,3cyclictest2586442-21apt-get11:35:111
2310722993429,3cyclictest335557-21systemd-journal11:10:551
2310718993329,3cyclictest2508311-21latency_hist10:20:000
2310728993228,3cyclictest2637899-21kworker/u8:3+flush-259:012:35:263
2310728993228,3cyclictest2586194-21kworker/u8:3+events_unbound12:10:253
2310718993229,2cyclictest2461458-21kworker/u8:4+flush-259:010:25:160
2310728993126,3cyclictest2337491-21gpgv07:35:013
2310728993124,4cyclictest335557-21systemd-journal11:15:013
2310726993124,5cyclictest2612016-21latency_hist12:00:002
2310722993124,5cyclictest2471364-21ntpq09:40:211
2310718993128,2cyclictest2544894-21kworker/u8:0+events_unbound11:35:000
2310718993127,3cyclictest2622295-21kworker/u8:0+events_unbound12:18:570
2310718993127,3cyclictest2342574-21kworker/u8:3+events_unbound08:20:130
2310728993027,3cyclictest2321194-21kworker/u8:0+events_unbound07:50:213
2310728993026,3cyclictest2461458-21kworker/u8:4+events_unbound10:37:573
2310718993026,3cyclictest2430449-21kworker/u8:1+flush-259:009:15:320
2310718993026,3cyclictest2409767-21kworker/u8:0+events_unbound08:55:560
2310722992926,2cyclictest2492821-21kworker/u8:1+events_unbound10:05:551
2310722992926,2cyclictest2430449-21kworker/u8:1+flush-259:009:30:241
2310722992925,3cyclictest2373563-21kworker/u8:1+events_unbound08:15:001
2310722992925,3cyclictest2260884-21kworker/u8:1+events_unbound07:24:571
2310722992920,8cyclictest2321194-21kworker/u8:0+flush-259:007:35:141
2310718992926,3cyclictest2321194-21kworker/u8:0+events_unbound07:32:570
2310718992926,3cyclictest2260884-21kworker/u8:1+events_unbound07:19:570
2310718992926,2cyclictest2321194-21kworker/u8:0+flush-259:007:50:150
2310718992925,3cyclictest2342574-21kworker/u8:3+events_unbound08:39:560
2310728992824,3cyclictest2565735-21kworker/u8:3+events_unbound11:25:003
2310728992824,3cyclictest2461458-21kworker/u8:4+flush-259:009:45:213
2310728992824,3cyclictest2461458-21kworker/u8:4+flush-259:009:45:203
2310728992824,3cyclictest2409767-21kworker/u8:0+flush-259:008:50:183
2310728992821,5cyclictest2482897-21diskstats09:55:133
2310726992823,4cyclictest2409767-21kworker/u8:0+flush-259:008:50:012
2310722992824,3cyclictest2461458-21kworker/u8:4+events_unbound09:55:391
2310722992824,3cyclictest2399677-21apt-get08:35:121
2310722992824,3cyclictest2332002-21kworker/u8:2+events_unbound08:03:561
2310718992824,3cyclictest2492821-21kworker/u8:1+events_unbound11:12:550
2310722992725,1cyclictest2461458-21kworker/u8:4+events_unbound09:37:561
2310722992724,2cyclictest2622295-21kworker/u8:0+events_unbound12:24:561
2310722992724,2cyclictest2492821-21kworker/u8:1+flush-259:010:35:261
2310728992622,3cyclictest2622295-21kworker/u8:0+flush-259:012:25:163
2310726992620,4cyclictest2612242-21kworker/u8:2+flush-259:012:05:182
2310726992618,5cyclictest2466802-21cp09:40:012
2310722992622,3cyclictest2430449-21kworker/u8:1+events_unbound09:14:571
2310722992622,3cyclictest2373563-21kworker/u8:1+events_unbound08:22:561
2310718992623,2cyclictest2342574-21kworker/u8:3+flush-259:008:40:260
2310718992623,2cyclictest2260884-21kworker/u8:1+events_unbound07:27:560
2310718992622,3cyclictest2461458-21kworker/u8:4+flush-259:009:50:240
2310718992622,3cyclictest2321194-21kworker/u8:0+events_unbound07:20:040
2310718992621,3cyclictest2430449-21kworker/u8:1+events_unbound09:26:540
2310728992522,2cyclictest2342574-21kworker/u8:3+flush-259:009:20:003
2310728992522,2cyclictest2260884-21kworker/u8:1+flush-259:007:15:173
2310722992522,2cyclictest2565735-21kworker/u8:3+flush-259:011:20:571
2310722992522,2cyclictest2461458-21kworker/u8:4+events_unbound09:50:131
2310722992521,3cyclictest2514097-21kworker/u8:2+events_unbound10:26:561
2310722992521,3cyclictest2455922-21kworker/u8:3+events_unbound09:28:561
2310722992521,3cyclictest2321194-21kworker/u8:0+events_unbound07:50:141
2310718992522,2cyclictest2550285-21apt-get11:00:100
2310718992522,2cyclictest2430449-21kworker/u8:1+flush-259:009:30:310
2310718992521,3cyclictest2492821-21kworker/u8:1+events_unbound10:42:570
2310718992521,2cyclictest2332002-21kworker/u8:2+events_unbound07:35:170
2310728992418,4cyclictest2414941-21latency_hist08:50:023
2310726992418,4cyclictest335557-21systemd-journal10:30:552
2310726992417,5cyclictest335557-21systemd-journal09:00:002
2310722992422,2cyclictest2342574-21kworker/u8:3+events_unbound07:56:561
2310718992421,2cyclictest2332002-21kworker/u8:2+flush-259:008:05:150
2310718992420,3cyclictest2461458-21kworker/u8:4+events_unbound10:36:560
2310726992316,5cyclictest2363252-21cat07:59:552
2310726992315,5cyclictest2482477-21latency_hist09:55:012
2310722992319,3cyclictest2487890-21apt-get10:00:121
2310718992320,2cyclictest509-21rs:main0
2310718992320,2cyclictest2586194-21kworker/u8:3+events_unbound11:45:530
2310718992319,3cyclictest2544894-21kworker/u8:0+events_unbound11:23:570
2310718992319,3cyclictest2492821-21kworker/u8:1+events_unbound11:25:190
2310718992319,3cyclictest2446170-21kworker/u8:2+events_unbound09:38:570
2310718992317,4cyclictest335557-21systemd-journal08:00:180
2310728992217,3cyclictest509-21rs:main3
2310728992216,4cyclictest509-21rs:main3
2310726992218,3cyclictest2430449-21kworker/u8:1+flush-259:009:05:172
2310726992218,3cyclictest2342574-21kworker/u8:3+flush-259:008:35:012
2310722992219,2cyclictest2461458-21kworker/u8:4+events_unbound10:10:261
2310722992219,2cyclictest2420124-21kworker/u8:2+events_unbound09:06:561
2310722992219,2cyclictest2321194-21kworker/u8:0+events_unbound07:30:151
2310722992219,2cyclictest2310902-21kworker/u8:4+events_unbound07:15:001
2310718992219,2cyclictest2514097-21kworker/u8:2+events_unbound10:30:140
2310718992218,3cyclictest2492821-21kworker/u8:1+events_unbound10:05:580
2310718992218,3cyclictest2461458-21kworker/u8:4+flush-259:010:15:000
2310718992218,3cyclictest2461458-21kworker/u8:4+events_unbound10:45:460
2310718992218,3cyclictest2409767-21kworker/u8:0+events_unbound09:20:160
2310728992118,2cyclictest2455922-21kworker/u8:3+events_unbound09:54:563
2310728992117,3cyclictest2544894-21kworker/u8:0+flush-259:011:50:533
2310728992117,3cyclictest2461458-21kworker/u8:4+events_unbound10:10:153
2310728992117,3cyclictest2409767-21kworker/u8:0+events_unbound09:13:573
2310726992115,4cyclictest2435869-21/usr/sbin/munin09:10:152
2310726992115,4cyclictest2346818-21ntpq07:40:212
2310722992118,2cyclictest2455922-21kworker/u8:3+events_unbound09:49:561
2310722992118,2cyclictest2455922-21kworker/u8:3+events_unbound09:49:561
2310722992118,2cyclictest2342574-21kworker/u8:3+events_unbound08:54:551
2310718992118,2cyclictest2632407-21kworker/u8:1+flush-259:012:30:210
2310718992117,3cyclictest2415368-21diskstats08:50:160
2310726992015,4cyclictest2342574-21kworker/u8:3+flush-259:008:40:172
2310722992017,3cyclictest2260884-21kworker/u8:1+events_unbound07:15:561
2310722992014,4cyclictest335557-21systemd-journal12:20:001
2310718992017,2cyclictest2637899-21kworker/u8:3+events_unbound12:35:220
2310718992017,2cyclictest2586194-21kworker/u8:3+events_unbound11:35:180
2310718992017,2cyclictest2544894-21kworker/u8:0+events_unbound11:05:120
2310718992017,2cyclictest2342574-21kworker/u8:3+flush-259:007:55:200
2310718992016,3cyclictest2260884-21kworker/u8:1+events_unbound07:12:570
2310718992015,3cyclictest2513433-21apt-get10:25:000
2310728991916,2cyclictest2637874-21systemd-run12:25:003
2310728991915,3cyclictest2632407-21kworker/u8:1+events_unbound12:34:563
2310728991915,3cyclictest2373563-21kworker/u8:1+events_unbound08:10:243
2310728991915,3cyclictest2342574-21kworker/u8:3+events_unbound09:00:153
2310728991915,2cyclictest2373563-21kworker/u8:1+events_unbound08:35:193
2310726991916,2cyclictest2509595-21kthreadcore10:20:172
2310726991916,2cyclictest2503093-21cron10:15:002
2310726991915,3cyclictest2461420-21journal-offline09:34:592
2310726991915,3cyclictest2316431-21gpgv07:15:002
2310722991916,2cyclictest2420124-21kworker/u8:2+events_unbound09:01:561
2310722991916,2cyclictest2321194-21kworker/u8:0+events_unbound07:45:171
2310722991915,3cyclictest2492821-21kworker/u8:1+events_unbound10:40:461
2310718991916,2cyclictest2544894-21kworker/u8:0+events_unbound11:50:230
2310718991915,3cyclictest2632407-21kworker/u8:1+events_unbound12:22:570
2310728991816,1cyclictest2373563-21kworker/u8:1+events_unbound08:30:243
2310728991814,3cyclictest507-21in:imuxsock10:05:003
2310728991814,3cyclictest2332002-21kworker/u8:2+events_unbound08:05:203
2310728991814,3cyclictest2310902-21kworker/u8:4+events_unbound07:10:123
2310728991813,4cyclictest2342574-21kworker/u8:3+flush-259:007:55:203
2310726991815,2cyclictest2571354-21irqcore11:20:152
2310726991813,3cyclictest2643694-21/usr/sbin/munin12:30:192
2310722991816,2cyclictest2409767-21kworker/u8:0+flush-259:009:20:251
2310722991815,2cyclictest2492821-21kworker/u8:1+events_unbound10:45:241
2310722991814,3cyclictest2461458-21kworker/u8:4+events_unbound11:02:571
2310718991816,2cyclictest2342574-21kworker/u8:3+events_unbound08:32:570
2310718991815,2cyclictest2461458-21kworker/u8:4+events_unbound09:41:550
2310718991815,2cyclictest2436306-21irqcore09:10:170
2310718991815,2cyclictest2342574-21kworker/u8:3+events_unbound08:45:200
2310728991714,3cyclictest2342574-21kworker/u8:3+events_unbound08:20:223
2310728991714,2cyclictest2596574-21kworker/u8:1+flush-259:012:00:563
2310728991714,2cyclictest2409767-21kworker/u8:0+flush-259:009:20:163
2310728991713,3cyclictest2565735-21kworker/u8:3+flush-259:011:25:563
2310728991713,3cyclictest2321194-21kworker/u8:0+flush-259:007:48:553
2310726991713,2cyclictest2477333-21sh09:50:002
2310726991713,2cyclictest2477333-21sh09:49:592
2310722991715,2cyclictest2430449-21kworker/u8:1+events_unbound09:15:251
2310722991714,2cyclictest2544894-21kworker/u8:0+flush-259:011:05:211
2310722991714,2cyclictest2342574-21kworker/u8:3+events_unbound08:40:251
2310722991714,2cyclictest2332002-21kworker/u8:2+flush-259:008:05:201
2310718991714,2cyclictest2612242-21kworker/u8:2+events_unbound12:00:200
2310718991714,2cyclictest2342574-21kworker/u8:3+flush-259:007:45:240
2310718991713,3cyclictest2586194-21kworker/u8:3+events_unbound12:10:000
2310728991613,2cyclictest2612000-21idleruntime-cro12:00:003
2310728991613,2cyclictest2580668-21kworker/u8:2+events_unbound11:40:223
2310728991613,2cyclictest2430449-21kworker/u8:1+flush-259:009:05:253
2310728991612,3cyclictest2565735-21kworker/u8:3+flush-259:011:15:483
2310728991612,3cyclictest2544894-21kworker/u8:0+flush-259:010:55:473
2310728991612,3cyclictest2321194-21kworker/u8:0+events_unbound07:25:223
2310726991613,2cyclictest2404554-21sh08:40:002
2310726991613,2cyclictest0-21swapper/208:05:012
2310726991612,3cyclictest2555414-21/usr/sbin/munin11:05:132
2310726991611,3cyclictest2461458-21kworker/u8:4+flush-259:010:15:172
2310726991610,4cyclictest2550260-21/usr/sbin/munin11:00:142
2310722991613,2cyclictest2596574-21kworker/u8:1+flush-259:011:55:161
2310722991613,2cyclictest2581685-21irqcore11:30:151
2310722991613,2cyclictest2492821-21kworker/u8:1+flush-259:010:35:011
2310722991613,2cyclictest2373563-21kworker/u8:1+flush-259:008:45:231
2310722991613,2cyclictest2373563-21kworker/u8:1+flush-259:008:15:241
2310718991613,2cyclictest2461458-21kworker/u8:4+flush-259:009:55:210
2310718991613,2cyclictest2332002-21kworker/u8:2+events_unbound08:15:170
2310718991611,4cyclictest2389516-21diskstats08:25:130
2310718991610,5cyclictest2643032-21latency_hist12:30:010
231071899160,15cyclictest513-21gdbus09:50:000
231071899160,15cyclictest513-21gdbus09:50:000
2310728991513,1cyclictest2520326-21kthreadcore10:30:183
2310728991512,2cyclictest2492821-21kworker/u8:1+flush-259:010:50:213
2310728991512,2cyclictest2461458-21kworker/u8:4+events_unbound11:00:423
2310728991511,3cyclictest2430449-21kworker/u8:1+events_unbound09:25:183
2310726991513,1cyclictest2321194-21kworker/u8:0+flush-259:007:30:002
2310726991512,2cyclictest2600793-21ntp_kernel_pll_11:45:192
2310726991512,2cyclictest2565493-21cron11:15:012
2310726991511,3cyclictest500-21systemd-logind11:30:002
2310726991511,3cyclictest2461458-21kworker/u8:4+flush-259:009:40:112
2310726991511,3cyclictest2370963-21tr08:05:192
2310726991510,3cyclictest2260884-21kworker/u8:1+flush-259:007:25:012
2310722991512,2cyclictest2544894-21kworker/u8:0+flush-259:010:55:111
2310718991512,2cyclictest2321194-21kworker/u8:0+events_unbound07:40:180
231072899149,4cyclictest335557-21systemd-journal10:46:553
231072899149,3cyclictest2492821-21kworker/u8:1+flush-259:010:41:203
2310728991411,2cyclictest2332002-21kworker/u8:2+events_unbound08:20:003
2310728991411,2cyclictest2260884-21kworker/u8:1+flush-259:007:20:153
2310728991410,3cyclictest2586194-21kworker/u8:3+events_unbound11:35:223
2310728991410,3cyclictest2580668-21kworker/u8:2+flush-259:011:30:263
2310728991410,3cyclictest2461458-21kworker/u8:4+events_unbound09:40:223
2310722991412,2cyclictest2586194-21kworker/u8:3+events_unbound12:10:131
2310722991411,2cyclictest2580668-21kworker/u8:2+events_unbound11:48:561
2310722991410,3cyclictest2580668-21kworker/u8:2+events_unbound11:40:121
2310718991412,2cyclictest60350irq/132-enp0s29f1:rx-010:50:170
2310718991411,2cyclictest60350irq/132-enp0s29f1:rx-011:15:130
2310718991411,2cyclictest2342574-21kworker/u8:3+events_unbound09:00:110
2310728991310,2cyclictest2466638-21systemd-run09:39:593
231072699139,3cyclictest2586194-21kworker/u8:3+flush-259:012:10:212
231072699139,2cyclictest2545175-21cpuspeed_turbos10:55:122
231072699137,4cyclictest335557-21systemd-journal10:45:012
231072699136,1cyclictest0-21swapper/210:55:002
231072699133,3cyclictest2430442-21basename09:05:002
231072699131,9cyclictest2606861-21awk11:55:002
2310726991310,1cyclictest0-21swapper/209:15:232
231072699130,5cyclictest2420105-21cut08:54:592
2310722991311,2cyclictest2342574-21kworker/u8:3+events_unbound08:25:211
2310722991311,2cyclictest2321194-21kworker/u8:0+flush-259:007:40:181
2310722991311,1cyclictest0-21swapper/111:30:001
2310722991310,2cyclictest2260884-21kworker/u8:1+events_unbound07:25:121
2310718991312,1cyclictest60350irq/132-enp0s29f1:rx-009:05:160
231072899129,2cyclictest2586194-21kworker/u8:3+events_unbound12:15:193
231072899128,3cyclictest2389138-21kworker/u8:0+flush-259:008:27:053
231072699129,2cyclictest2393810-21unixbench_multi08:25:232
231072699129,1cyclictest0-21swapper/211:40:122
231072699127,4cyclictest335557-21systemd-journal10:39:542
231072699121,3cyclictest2643032-21latency_hist12:30:012
231071899129,2cyclictest2373563-21kworker/u8:1+flush-259:008:10:160
231072699117,3cyclictest2321194-21kworker/u8:0+flush-259:007:34:002
231072699117,2cyclictest2570688-21awk11:20:012
231072699117,2cyclictest0-21swapper/210:45:132
231072699117,2cyclictest0-21swapper/209:55:192
231072699111,3cyclictest2456269-21awk09:30:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional