You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-15 - 22:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri May 15, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2775089994440,3cyclictest2921352-21kworker/u8:0+flush-259:009:49:592
2775094994340,2cyclictest2764945-21kworker/u8:4+flush-259:007:20:003
2775094994236,4cyclictest2994234-21latency_hist10:40:013
2775089994240,1cyclictest2957845-21fwupd10:03:442
2775089994136,4cyclictest2805952-21latency_hist07:40:002
2775084994034,4cyclictest2837621-21latency_hist08:10:011
2775094993935,2cyclictest2957845-21fwupd10:03:443
2775089993935,3cyclictest2921352-21kworker/u8:0+flush-259:010:40:252
2775084993935,3cyclictest252-21systemd-journal10:03:481
2775084993831,5cyclictest2847923-21latency_hist08:20:011
2775084993734,2cyclictest2800807-21kworker/u8:2+events_unbound07:40:201
2775082993733,3cyclictest2926723-21kworker/u8:2+flush-259:009:35:140
2775082993730,5cyclictest3046445-21ntpq11:25:230
2775094993630,4cyclictest3047290-21latency_hist11:30:003
2775084993629,5cyclictest2972638-21ntpq10:15:211
2775094993530,3cyclictest2946953-21kworker/u8:4+flush-259:010:19:593
2775084993532,2cyclictest2999637-21kworker/u8:4+flush-259:011:35:151
2775082993532,2cyclictest2775024-21kworker/u8:1+flush-259:007:10:170
2775082993530,4cyclictest2811735-21apt-get07:45:110
2775094993430,3cyclictest2863168-21kworker/u8:3+flush-259:008:40:013
2775089993429,3cyclictest2884848-21latency_hist08:55:002
2775084993429,3cyclictest2795882-21/usr/sbin/munin07:30:151
2775094993329,3cyclictest2800807-21kworker/u8:2+flush-259:007:50:253
2775094993328,3cyclictest3015385-21latency_hist11:00:013
2775082993328,3cyclictest2879278-21apt-get08:50:000
2775089993228,3cyclictest2800807-21kworker/u8:2+flush-259:008:00:222
2775084993228,3cyclictest2821774-21apt-get07:54:591
2775084993228,3cyclictest2811494-21kworker/u8:1+flush-259:009:25:221
2775084993227,4cyclictest2983894-21latency_hist10:30:001
2775082993229,2cyclictest2989047-21kworker/u8:2+flush-259:011:35:240
2775089993127,3cyclictest2921352-21kworker/u8:0+events_unbound09:50:222
2775082993128,2cyclictest2811494-21kworker/u8:1+flush-259:008:10:150
2775082993126,4cyclictest3089233-21base6412:10:010
2775082993125,4cyclictest2820885-21ntpq07:50:210
2775082993026,3cyclictest2764945-21kworker/u8:4+flush-259:007:15:170
2775094992925,3cyclictest2775024-21kworker/u8:1+flush-259:007:15:003
2775094992923,4cyclictest3109668-21latency_hist12:30:003
2775084992927,1cyclictest3068212-21kworker/u8:0+events_unbound12:10:241
2775084992926,2cyclictest3026399-21kworker/u8:3+events_unbound11:51:441
2775084992925,3cyclictest3099381-21kworker/u8:2+events_unbound12:29:441
2775084992923,4cyclictest252-21systemd-journal11:05:431
2775082992925,3cyclictest3026399-21kworker/u8:3+events_unbound11:30:240
2775082992925,3cyclictest2868559-21gpgv08:40:000
2775082992924,4cyclictest252-21systemd-journal10:18:500
2775084992825,2cyclictest2921352-21kworker/u8:0+flush-259:010:45:231
2775084992724,2cyclictest2894848-21kworker/u8:3+events_unbound09:36:441
2775084992723,3cyclictest2811494-21kworker/u8:1+events_unbound08:35:221
2775084992721,4cyclictest2911030-21gpgv09:20:011
2775082992725,2cyclictest3068212-21kworker/u8:0+events_unbound12:15:250
2775082992724,2cyclictest3068212-21kworker/u8:0+flush-259:012:00:150
2775082992723,3cyclictest2989047-21kworker/u8:2+events_unbound10:50:200
2775082992722,4cyclictest2869046-21cat08:40:010
2775082992722,4cyclictest2853491-21diskstats08:25:150
2775094992623,2cyclictest2853087-21kworker/u8:0+flush-259:008:50:213
2775094992620,4cyclictest3004588-21latency_hist10:50:003
2775094992620,4cyclictest2894238-21ntpq09:00:223
2775089992623,2cyclictest2926723-21kworker/u8:2+events_unbound09:35:222
2775089992622,3cyclictest2942026-21kworker/u8:3+events_unbound09:55:222
2775084992622,3cyclictest2811494-21kworker/u8:1+events_unbound09:33:431
2775084992622,3cyclictest2811494-21kworker/u8:1+events_unbound08:13:351
2775084992621,3cyclictest252-21systemd-journal10:52:431
2775082992623,2cyclictest2785570-21kworker/u8:0+events_unbound07:25:230
2775094992519,4cyclictest2936792-21latency_hist09:45:013
2775084992522,2cyclictest3099381-21kworker/u8:2+events_unbound12:30:151
2775084992521,3cyclictest2942026-21kworker/u8:3+flush-259:009:55:151
2775084992521,3cyclictest2853087-21kworker/u8:0+flush-259:008:55:201
2775084992519,4cyclictest3077514-21ntpq11:55:221
2775084992519,4cyclictest2915320-21ntpq09:20:221
2775082992521,3cyclictest2800807-21kworker/u8:2+events_unbound08:15:250
2775082992521,3cyclictest2800807-21kworker/u8:2+events_unbound08:15:240
2775094992421,2cyclictest2946953-21kworker/u8:4+events_unbound10:10:243
2775094992420,3cyclictest2811494-21kworker/u8:1+flush-259:008:30:163
2775094992418,4cyclictest3062798-21latency_hist11:45:003
2775089992420,3cyclictest3088746-21gpgv12:09:592
2775084992420,3cyclictest2942026-21kworker/u8:3+flush-259:010:10:141
2775084992420,3cyclictest2811494-21kworker/u8:1+flush-259:007:58:441
2775084992419,3cyclictest252-21systemd-journal10:20:441
2775082992421,2cyclictest2921352-21kworker/u8:0+events_unbound09:40:200
2775082992421,2cyclictest2811494-21kworker/u8:1+events_unbound09:25:140
2775082992421,2cyclictest2800807-21kworker/u8:2+flush-259:008:20:240
2775082992420,3cyclictest2800807-21kworker/u8:2+flush-259:007:40:190
2775082992418,4cyclictest2999670-21apt-get10:45:120
2775089992319,3cyclictest2800807-21kworker/u8:2+events_unbound08:25:232
2775084992320,2cyclictest3068212-21kworker/u8:0+flush-259:012:05:191
2775084992320,2cyclictest3026399-21kworker/u8:3+events_unbound11:15:221
2775084992320,2cyclictest2971-21cron10:40:001
2775084992319,3cyclictest2989047-21kworker/u8:2+events_unbound11:43:441
2775084992319,3cyclictest2894848-21kworker/u8:3+flush-259:009:05:171
2775084992319,3cyclictest2811494-21kworker/u8:1+events_unbound08:50:431
2775082992320,2cyclictest2989047-21kworker/u8:2+events_unbound11:10:220
2775082992320,2cyclictest2921352-21kworker/u8:0+events_unbound11:05:190
2775082992320,2cyclictest2800807-21kworker/u8:2+events_unbound08:05:180
2775082992319,3cyclictest500-21systemd-logind12:10:000
2775082992319,3cyclictest2999637-21kworker/u8:4+events_unbound11:45:220
2775082992319,3cyclictest2942026-21kworker/u8:3+events_unbound09:55:130
2775082992319,3cyclictest2921591-21apt-get09:30:100
2775094992218,3cyclictest3026399-21kworker/u8:3+flush-259:011:15:173
2775089992220,2cyclictest3099381-21kworker/u8:2+events_unbound12:25:222
2775089992219,2cyclictest3026399-21kworker/u8:3+events_unbound11:30:152
2775089992219,2cyclictest2800807-21kworker/u8:2+flush-259:007:50:202
2775089992218,3cyclictest2811494-21kworker/u8:1+flush-259:008:30:212
2775089992218,3cyclictest2811494-21kworker/u8:1+events_unbound08:35:172
2775084992219,2cyclictest3093951-21kworker/u8:1+events_unbound12:24:271
2775084992219,2cyclictest2775024-21kworker/u8:1+events_unbound07:10:211
2775084992218,3cyclictest2921352-21kworker/u8:0+flush-259:010:30:451
2775084992218,3cyclictest2800807-21kworker/u8:2+events_unbound07:35:211
2775084992218,3cyclictest2790766-21apt-get07:25:111
2775082992219,2cyclictest2921352-21kworker/u8:0+events_unbound10:25:200
2775082992217,4cyclictest3104735-21/usr/sbin/munin12:25:130
2775082992216,4cyclictest252-21systemd-journal07:21:430
2775094992117,3cyclictest2894848-21kworker/u8:3+events_unbound09:05:223
2775094992117,3cyclictest2805972-21gpgv07:40:003
2775089992118,2cyclictest2942026-21kworker/u8:3+flush-259:010:20:212
2775089992118,2cyclictest2894848-21kworker/u8:3+flush-259:009:30:152
2775089992118,2cyclictest2894848-21kworker/u8:3+events_unbound09:15:012
2775089992118,2cyclictest2800807-21kworker/u8:2+events_unbound08:20:152
2775089992117,3cyclictest3026399-21kworker/u8:3+flush-259:011:15:172
2775089992117,3cyclictest2775024-21kworker/u8:1+flush-259:007:10:152
2775084992117,3cyclictest2800807-21kworker/u8:2+events_unbound07:46:441
2775084992116,4cyclictest2858230-21latency_hist08:30:001
2775082992115,4cyclictest3119093-21ntpq12:35:180
2775094992017,2cyclictest507-21in:imuxsock07:50:013
2775084992017,2cyclictest2921352-21kworker/u8:0+flush-259:010:05:151
2775084992016,3cyclictest3026399-21kworker/u8:3+events_unbound11:34:441
2775082992017,3cyclictest2921352-21kworker/u8:0+flush-259:010:34:450
2775082992017,2cyclictest2963799-21irqcore10:10:160
2775082992017,2cyclictest2942026-21kworker/u8:3+events_unbound10:00:170
2775094991915,3cyclictest3068212-21kworker/u8:0+events_unbound12:15:233
2775094991915,3cyclictest2999637-21kworker/u8:4+flush-259:011:35:213
2775089991915,3cyclictest3068212-21kworker/u8:0+flush-259:012:00:212
2775089991915,3cyclictest2800807-21kworker/u8:2+flush-259:007:40:232
2775089991914,4cyclictest2968285-21latency_hist10:15:012
2775089991914,3cyclictest2905698-21apt-get09:15:112
2775084991916,2cyclictest2989047-21kworker/u8:2+events_unbound10:59:201
2775084991916,2cyclictest2811494-21kworker/u8:1+flush-259:008:45:181
2775082991916,2cyclictest2921352-21kworker/u8:0+events_unbound09:50:200
2775082991916,2cyclictest2894848-21kworker/u8:3+events_unbound09:20:220
2775082991916,2cyclictest2884887-21kworker/u8:2+events_unbound09:00:010
2775082991915,3cyclictest3026399-21kworker/u8:3+events_unbound11:19:020
2775082991915,3cyclictest2800807-21kworker/u8:2+flush-259:007:35:150
2775094991814,3cyclictest3104729-21kworker/u8:0+events_unbound12:35:173
2775094991813,4cyclictest2795642-21latency_hist07:30:003
2775089991815,2cyclictest3026399-21kworker/u8:3+flush-259:011:20:242
2775089991815,2cyclictest2894848-21kworker/u8:3+flush-259:009:05:202
2775089991815,2cyclictest2863168-21kworker/u8:3+flush-259:008:40:162
2775082991815,2cyclictest3093951-21kworker/u8:1+events_unbound12:20:230
2775082991815,2cyclictest2921352-21kworker/u8:0+events_unbound10:05:170
2775082991814,3cyclictest2811494-21kworker/u8:1+flush-259:009:15:200
2775082991813,4cyclictest252-21systemd-journal09:49:590
2775094991715,1cyclictest2999394-21cron10:45:003
2775094991714,2cyclictest2989047-21kworker/u8:2+flush-259:011:10:013
2775094991713,3cyclictest3088630-21apt-get12:10:023
2775094991712,4cyclictest252-21systemd-journal10:00:003
2775094991712,3cyclictest2853087-21kworker/u8:0+flush-259:009:00:003
2775094991711,4cyclictest252-21systemd-journal08:29:553
2775089991714,2cyclictest2989047-21kworker/u8:2+events_unbound10:55:012
2775084991715,1cyclictest2994905-21irqcore10:40:171
2775084991714,2cyclictest3026399-21kworker/u8:3+events_unbound11:28:451
2775084991714,2cyclictest2811494-21kworker/u8:1+flush-259:008:30:161
2775084991713,3cyclictest2936597-21kworker/u8:1+events_unbound09:52:271
2775082991713,3cyclictest3109923-21apt-get12:30:100
2775082991713,3cyclictest2942026-21kworker/u8:3+flush-259:010:20:190
2775094991612,3cyclictest2800807-21kworker/u8:2+events_unbound08:15:223
2775094991612,3cyclictest2800807-21kworker/u8:2+events_unbound08:15:223
2775094991612,2cyclictest0-21swapper/308:10:003
2775089991613,2cyclictest0-21swapper/209:00:012
2775089991612,3cyclictest3104729-21kworker/u8:0+events_unbound12:30:222
2775089991612,3cyclictest2916449-21apt-get09:25:112
2775089991611,4cyclictest252-21systemd-journal08:50:012
2775089991610,4cyclictest2827341-21latency_hist08:00:012
2775084991612,3cyclictest3114566-21kworker/u8:3+events_unbound12:39:181
2775082991613,2cyclictest60350irq/132-enp0s29f1:rx-011:20:100
2775082991613,2cyclictest60350irq/132-enp0s29f1:rx-009:05:190
2775082991612,3cyclictest2921352-21kworker/u8:0+events_unbound10:43:450
2775082991611,4cyclictest3010471-21/usr/sbin/munin10:55:150
2775094991513,1cyclictest3020579-21munin-plugin-st11:05:003
2775094991512,2cyclictest3026399-21kworker/u8:3+flush-259:011:30:173
2775094991512,2cyclictest2894848-21kworker/u8:3+flush-259:009:20:193
2775094991511,3cyclictest2936597-21kworker/u8:1+events_unbound09:50:133
2775094991511,3cyclictest252-21systemd-journal07:30:443
2775094991510,3cyclictest2900507-21/usr/sbin/munin09:10:133
2775089991513,2cyclictest3026399-21kworker/u8:3+events_unbound11:55:232
2775089991512,2cyclictest2946953-21kworker/u8:4+flush-259:010:05:212
2775089991512,2cyclictest2921352-21kworker/u8:0+flush-259:011:05:192
2775084991512,2cyclictest2999637-21kworker/u8:4+flush-259:011:45:161
2775084991512,2cyclictest2921352-21kworker/u8:0+flush-259:009:45:181
2775084991512,2cyclictest2863168-21kworker/u8:3+events_unbound08:40:271
2775084991511,3cyclictest2989047-21kworker/u8:2+events_unbound11:11:451
2775082991513,2cyclictest2894848-21kworker/u8:3+events_unbound09:14:450
2775082991513,1cyclictest60350irq/132-enp0s29f1:rx-007:55:230
2775082991513,1cyclictest3026399-21kworker/u8:3+events_unbound11:55:010
2775082991512,2cyclictest60350irq/132-enp0s29f1:rx-008:55:100
2775082991512,2cyclictest60350irq/132-enp0s29f1:rx-008:00:240
277509499149,3cyclictest252-21systemd-journal11:48:433
2775094991412,1cyclictest0-21swapper/312:09:593
2775094991411,2cyclictest3068212-21kworker/u8:0+flush-259:011:50:163
2775094991411,2cyclictest2800807-21kworker/u8:2+flush-259:008:20:173
2775089991411,2cyclictest2764945-21kworker/u8:4+events_unbound07:15:172
2775089991410,3cyclictest3068212-21kworker/u8:0+flush-259:011:50:212
2775089991410,3cyclictest2921352-21kworker/u8:0+flush-259:009:40:232
2775089991410,3cyclictest2921352-21kworker/u8:0+events_unbound10:55:222
2775089991410,3cyclictest2759677-21kworker/u8:3+events_unbound07:20:222
277508499149,4cyclictest2790502-21latency_hist07:25:011
2775084991412,2cyclictest2811494-21kworker/u8:1+flush-259:009:10:441
2775084991411,2cyclictest3026399-21kworker/u8:3+flush-259:011:20:161
2775084991411,2cyclictest2921352-21kworker/u8:0+events_unbound09:40:131
2775084991411,2cyclictest2894848-21kworker/u8:3+events_unbound09:04:431
2775084991411,2cyclictest0-21swapper/112:05:001
2775084991410,2cyclictest2800807-21kworker/u8:2+events_unbound08:20:161
2775082991413,1cyclictest60350irq/132-enp0s29f1:rx-011:56:540
2775082991411,2cyclictest3019600-21needreboot11:00:190
2775082991410,3cyclictest2785570-21kworker/u8:0+flush-259:007:30:160
277509499139,3cyclictest2806458-21base6407:40:003
277509499139,3cyclictest2759677-21kworker/u8:3+flush-259:007:20:493
2775094991311,1cyclictest0-21swapper/310:10:003
2775094991310,2cyclictest3083053-21unixbench_multi12:00:253
2775094991310,2cyclictest3031383-21idleruntime-cro11:15:003
2775094991310,2cyclictest2811494-21kworker/u8:1+flush-259:008:00:003
2775094991310,2cyclictest2800807-21kworker/u8:2+events_unbound08:00:223
277508999139,3cyclictest2999637-21kworker/u8:4+flush-259:011:25:162
277508999137,5cyclictest3103676-21ntpq12:20:242
2775084991310,2cyclictest3068212-21kworker/u8:0+events_unbound12:15:161
2775084991310,2cyclictest2827602-21apt-get08:00:111
2775082991312,1cyclictest60350irq/132-enp0s29f1:rx-011:40:500
2775082991311,1cyclictest60350irq/132-enp0s29f1:rx-008:32:330
2775082991310,2cyclictest60350irq/132-enp0s29f1:rx-010:35:220
277509499129,2cyclictest2926017-21unixbench_multi09:30:243
277509499129,2cyclictest2811494-21kworker/u8:1+events_unbound08:45:213
277509499128,3cyclictest2973515-21kworker/u8:2+flush-259:010:25:003
277508999129,2cyclictest3004588-21latency_hist10:50:012
277508999129,2cyclictest2785570-21kworker/u8:0+events_unbound07:30:202
277508999129,2cyclictest0-21swapper/211:50:012
277508999128,3cyclictest2968812-21fschecks_time10:15:132
277508999127,4cyclictest3026399-21kworker/u8:3+events_unbound12:12:442
2775089991210,2cyclictest2811494-21kworker/u8:1+events_unbound08:12:462
2775089991210,1cyclictest0-21swapper/208:10:002
277508499129,2cyclictest2989047-21kworker/u8:2+events_unbound11:04:211
277509499118,2cyclictest3026399-21kworker/u8:3+flush-259:011:20:543
277509499118,2cyclictest2910813-21wc09:20:013
277509499118,2cyclictest2838054-21fschecks_count08:10:123
277508999118,2cyclictest3028470-21kthreadcore11:10:162
277508999116,3cyclictest2759677-21kworker/u8:3+events_unbound07:45:202
277508999111,2cyclictest2794111-21cut07:25:182
277508499118,2cyclictest2800807-21kworker/u8:2+flush-259:008:15:191
277508499117,3cyclictest2775024-21kworker/u8:1+events_unbound07:19:441
277509499107,2cyclictest2937136-21cpuspeed_turbos09:45:133
277508999108,1cyclictest0-21swapper/211:40:242
277508999107,2cyclictest2942026-21kworker/u8:3+events_unbound10:35:212
277508999104,4cyclictest252-21systemd-journal11:03:442
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional