You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 16:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sun Jun 14, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2498556994640,4cyclictest2561074-21cp08:10:011
2498554994540,3cyclictest509-21rs:main0
2498559994335,5cyclictest2545355-21latency_hist07:55:012
2498554994239,2cyclictest2675170-21kworker/u8:0+flush-259:011:00:000
2498554994137,3cyclictest2618008-21kworker/u8:1+events_unbound09:20:170
2498554994035,4cyclictest2841458-21ntpq12:35:200
2498554993732,4cyclictest2694895-21ntpq10:15:210
2498554993633,2cyclictest2561451-21gpgv08:10:010
2498554993630,4cyclictest2717316-21diskstats10:40:140
2498554993531,3cyclictest2753520-21kworker/u8:1+flush-259:011:15:140
2498554993529,4cyclictest2586256-21ntpq08:30:230
2498554993529,3cyclictest2700934-21kworker/u8:3+flush-259:010:55:000
2498554993528,5cyclictest2540197-21latency_hist07:50:010
2498559993428,4cyclictest2623144-21apt-get09:10:002
2498556993429,3cyclictest2827108-21/usr/sbin/munin12:25:131
2498564993327,4cyclictest2747759-21ntpq11:05:213
2498559993327,4cyclictest2727772-21cat10:50:012
2498556993229,2cyclictest2764922-21kworker/u8:4+flush-259:011:35:261
2498556993228,3cyclictest2571900-21apt-get08:20:121
2498556993227,4cyclictest2617101-21ntpq09:00:201
2498554993229,2cyclictest2545619-21apt-get07:55:120
2498554993227,3cyclictest1-21systemd09:45:000
2498554993225,5cyclictest2592646-21diskstats08:40:130
2498556993128,2cyclictest2561541-21kworker/u8:4+flush-259:009:30:151
2498556993125,4cyclictest2514223-21/usr/sbin/munin07:25:141
2498554993124,5cyclictest2670008-21latency_hist09:55:000
2498564993024,4cyclictest2545594-21/usr/sbin/munin07:55:153
2498556993024,4cyclictest2785831-21/usr/sbin/munin11:45:151
2498554993023,5cyclictest2764036-21ntpq11:20:210
2498556992925,3cyclictest2649480-21/usr/sbin/munin09:35:141
2498556992924,4cyclictest2659850-21/usr/sbin/munin09:45:141
2498559992824,3cyclictest2690793-21kworker/u8:2+flush-259:011:10:012
2498559992822,4cyclictest2801063-21latency_hist12:00:002
2498554992823,4cyclictest2727264-21gpgv10:50:000
2498554992822,4cyclictest2769242-21ntpq11:25:210
2498554992822,4cyclictest2623138-21latency_hist09:10:000
2498554992821,5cyclictest335557-21systemd-journal09:15:000
2498559992720,5cyclictest2555680-21latency_hist08:05:012
2498564992622,3cyclictest2700934-21kworker/u8:3+events_unbound10:50:173
2498564992622,3cyclictest2618008-21kworker/u8:1+events_unbound09:20:233
2498556992622,3cyclictest2597362-21kworker/u8:2+flush-259:009:15:251
2498556992621,3cyclictest2524314-21apt-get07:35:001
2498556992619,5cyclictest2659610-21latency_hist09:45:001
2498554992621,3cyclictest2811625-21apt-get12:10:110
2498554992621,3cyclictest2523373-21kworker/u8:4+flush-259:007:30:250
2498554992619,5cyclictest2810444-21ntpq12:05:200
2498564992521,3cyclictest335557-21systemd-journal09:55:003
2498564992519,4cyclictest2727464-21cat10:50:013
2498559992521,2cyclictest2765170-21apt-get11:25:112
2498556992522,2cyclictest2753520-21kworker/u8:1+events_unbound11:15:191
2498556992522,2cyclictest2540078-21kworker/u8:3+flush-259:007:55:171
2498556992521,3cyclictest2576799-21kworker/u8:1+flush-259:008:30:261
2498554992520,3cyclictest2561541-21kworker/u8:4+flush-259:008:15:160
2498554992519,4cyclictest2632964-21ntpq09:15:220
2498564992420,3cyclictest2801081-21kworker/u8:1+flush-259:012:10:003
2498564992420,3cyclictest2493402-21kworker/u8:1+flush-259:007:50:163
2498564992418,4cyclictest2561541-21kworker/u8:4+flush-259:008:20:163
2498559992418,4cyclictest335557-21systemd-journal09:52:342
2498556992420,3cyclictest2561574-21apt-get08:10:111
2498556992418,4cyclictest335557-21systemd-journal08:30:001
2498554992421,2cyclictest2618008-21kworker/u8:1+events_unbound09:49:560
2498554992420,3cyclictest2460994-21kworker/u8:2+events_unbound07:15:230
2498564992319,3cyclictest2675170-21kworker/u8:0+events_unbound11:50:233
2498564992318,4cyclictest335557-21systemd-journal09:04:413
2498564992318,4cyclictest2675170-21kworker/u8:0+events_unbound11:25:183
2498564992317,4cyclictest2701179-21apt-get10:25:143
2498564992316,5cyclictest2742542-21ntpq11:00:193
2498559992320,2cyclictest2690793-21kworker/u8:2+flush-259:010:40:002
2498559992319,3cyclictest2659240-21kworker/u8:3+flush-259:009:45:002
2498559992318,4cyclictest335557-21systemd-journal08:00:012
2498556992320,2cyclictest2460994-21kworker/u8:2+flush-259:007:15:171
2498556992319,3cyclictest2493402-21kworker/u8:1+flush-259:007:35:161
2498556992317,4cyclictest2503622-21latency_hist07:15:011
2498556992316,5cyclictest335557-21systemd-journal11:10:001
2498554992319,3cyclictest2770082-21kworker/u8:5+flush-259:012:00:160
2498554992319,3cyclictest2770082-21kworker/u8:5+flush-259:012:00:000
2498554992319,3cyclictest2618008-21kworker/u8:1+flush-259:009:55:250
2498554992316,5cyclictest2550777-21/usr/sbin/munin08:00:150
2498554992315,6cyclictest2529040-21ntpq07:35:220
2498564992217,4cyclictest2700934-21kworker/u8:3+events_unbound10:30:203
2498564992217,3cyclictest2785821-21kworker/u8:2+flush-259:012:25:153
2498564992217,3cyclictest2586574-21kworker/u8:0+flush-259:008:45:003
2498559992218,3cyclictest2785821-21kworker/u8:2+flush-259:012:20:252
2498559992216,5cyclictest335557-21systemd-journal10:50:002
2498556992218,3cyclictest2576799-21kworker/u8:1+events_unbound08:35:191
2498554992219,2cyclictest2561541-21kworker/u8:4+events_unbound08:50:020
2498554992218,3cyclictest2770082-21kworker/u8:5+events_unbound11:45:000
2498554992218,3cyclictest2690793-21kworker/u8:2+events_unbound11:12:340
2498554992217,4cyclictest2576799-21kworker/u8:1+events_unbound08:27:340
2498554992217,3cyclictest2764922-21kworker/u8:4+events_unbound11:30:210
2498554992216,4cyclictest2675170-21kworker/u8:0+events_unbound10:10:180
2498554992216,4cyclictest2493402-21kworker/u8:1+flush-259:007:55:000
2498564992116,3cyclictest2460994-21kworker/u8:2+flush-259:007:45:253
2498564992115,4cyclictest2695752-21latency_hist10:20:003
2498554992117,3cyclictest2555909-21kworker/u8:0+events_unbound08:08:350
2498554992116,4cyclictest2826894-21kworker/u8:1+events_unbound12:30:130
2498554992116,3cyclictest2587359-21apt-get08:35:120
2498564992017,2cyclictest2675170-21kworker/u8:0+events_unbound10:10:253
2498564992017,2cyclictest2493402-21kworker/u8:1+flush-259:007:40:243
2498564992017,2cyclictest2493402-21kworker/u8:1+flush-259:007:40:243
2498564992016,3cyclictest2623836-21apt-get09:10:123
2498564992016,3cyclictest2561541-21kworker/u8:4+events_unbound08:55:013
2498559992017,2cyclictest2493402-21kworker/u8:1+flush-259:007:45:162
2498559992016,3cyclictest2675170-21kworker/u8:0+flush-259:010:05:012
2498559992016,3cyclictest2675170-21kworker/u8:0+flush-259:010:05:002
2498559992016,1cyclictest0-21swapper/212:35:002
2498556992016,3cyclictest2801081-21kworker/u8:1+flush-259:012:05:241
2498556992016,3cyclictest2785821-21kworker/u8:2+flush-259:012:25:001
2498554992017,1cyclictest1-21systemd12:20:000
2498554992016,3cyclictest2675170-21kworker/u8:0+events_unbound10:06:360
2498554992016,3cyclictest2675170-21kworker/u8:0+events_unbound10:06:350
2498554992016,3cyclictest2675170-21kworker/u8:0+events_unbound10:00:150
2498554992016,3cyclictest2675170-21kworker/u8:0+events_unbound10:00:140
2498554992015,4cyclictest2561541-21kworker/u8:4+events_unbound08:55:030
2498564991915,3cyclictest2785821-21kworker/u8:2+flush-259:012:20:173
2498564991914,4cyclictest335557-21systemd-journal08:06:343
249855999193,9cyclictest2529902-21munin-run07:39:592
2498559991916,2cyclictest2790788-21idleruntime-cro11:50:002
2498559991916,2cyclictest2753716-21idleruntime-cro11:15:002
2498559991914,3cyclictest335557-21systemd-journal11:03:322
2498559991913,4cyclictest2638965-21latency_hist09:25:002
2498556991913,4cyclictest2690564-21latency_hist10:15:001
2498556991912,4cyclictest2623316-21cat09:10:001
2498554991915,3cyclictest2700934-21kworker/u8:3+flush-259:011:05:260
2498554991915,3cyclictest2675170-21kworker/u8:0+flush-259:011:35:230
2498554991912,5cyclictest335557-21systemd-journal09:40:000
2498554991912,5cyclictest2498745-21/usr/sbin/munin07:10:130
2498564991815,2cyclictest2821706-21idleruntime-cro12:19:593
2498564991814,3cyclictest2460994-21kworker/u8:2+events_unbound07:20:223
2498564991812,4cyclictest2566919-21diskstats08:15:123
2498559991813,4cyclictest2733318-21gpgv10:55:012
2498556991814,3cyclictest2675170-21kworker/u8:0+flush-259:011:51:381
2498556991813,4cyclictest2618008-21kworker/u8:1+flush-259:009:50:251
2498556991812,4cyclictest335557-21systemd-journal12:19:331
2498554991814,3cyclictest2675170-21kworker/u8:0+events_unbound11:47:350
2498554991812,4cyclictest2795913-21idleruntime-cro11:54:590
2498564991715,1cyclictest2826894-21kworker/u8:1+events_unbound12:35:233
2498564991715,1cyclictest2460994-21kworker/u8:2+events_unbound07:25:213
2498564991714,2cyclictest2700934-21kworker/u8:3+flush-259:010:35:143
2498564991714,2cyclictest2644097-21cron09:30:003
2498559991714,2cyclictest2700934-21kworker/u8:3+flush-259:010:45:002
2498559991713,2cyclictest2664801-21sh09:50:002
2498559991711,5cyclictest2775310-21latency_hist11:35:002
2498556991714,2cyclictest2675170-21kworker/u8:0+flush-259:010:50:001
2498556991711,4cyclictest2597785-21diskstats08:45:131
2498554991715,2cyclictest2561541-21kworker/u8:4+events_unbound08:25:000
2498554991712,3cyclictest2675170-21kworker/u8:0+flush-259:011:00:170
2498564991612,3cyclictest335557-21systemd-journal11:55:173
2498564991612,3cyclictest2561541-21kworker/u8:4+flush-259:008:10:213
2498564991611,3cyclictest2561541-21kworker/u8:4+events_unbound08:45:183
2498559991614,1cyclictest0-21swapper/208:35:002
2498559991613,2cyclictest2561541-21kworker/u8:4+events_unbound09:30:172
2498559991612,3cyclictest2675170-21kworker/u8:0+flush-259:012:05:002
2498556991612,3cyclictest2727841-21apt-get10:50:121
2498556991611,4cyclictest2530491-21kworker/u8:0+flush-259:007:50:001
2498554991614,1cyclictest60350irq/132-enp0s29f1:rx-010:23:210
2498554991613,2cyclictest60350irq/132-enp0s29f1:rx-010:27:430
2498554991613,2cyclictest60350irq/132-enp0s29f1:rx-009:25:200
2498554991612,3cyclictest2785821-21kworker/u8:2+events_unbound12:25:230
2498554991612,3cyclictest2700934-21kworker/u8:3+events_unbound10:30:180
2498554991612,3cyclictest2460994-21kworker/u8:2+flush-259:007:45:000
2498554991612,3cyclictest2460994-21kworker/u8:2+flush-259:007:44:590
2498564991511,3cyclictest2597362-21kworker/u8:2+events_unbound09:15:223
2498559991512,2cyclictest2700934-21kworker/u8:3+events_unbound10:35:002
2498559991512,2cyclictest2675170-21kworker/u8:0+flush-259:010:20:002
2498559991512,2cyclictest2499468-21irqcore07:10:152
2498559991511,3cyclictest2816808-21apt-get12:15:112
2498559991511,3cyclictest2597362-21kworker/u8:2+flush-259:008:56:042
249855699159,4cyclictest2700934-21kworker/u8:3+flush-259:011:20:051
2498554991513,1cyclictest60350irq/132-enp0s29f1:rx-012:20:230
2498554991513,1cyclictest60350irq/132-enp0s29f1:rx-007:20:250
249856499149,4cyclictest2576799-21kworker/u8:1+events_unbound08:35:233
2498564991411,2cyclictest2675170-21kworker/u8:0+events_unbound10:04:223
2498564991411,2cyclictest2675170-21kworker/u8:0+events_unbound10:04:223
2498564991410,3cyclictest2811592-21kworker/u8:3+flush-259:012:10:233
2498564991410,3cyclictest2690793-21kworker/u8:2+events_unbound10:40:243
2498559991411,2cyclictest490-21dbus-daemon09:10:002
2498559991411,2cyclictest2761028-21kthreadcore11:20:172
2498559991411,2cyclictest2690557-21cron10:15:002
2498559991411,2cyclictest2680630-21cpuspeed_turbos10:05:172
2498559991411,2cyclictest2680630-21cpuspeed_turbos10:05:172
2498559991410,3cyclictest2596939-21unixbench_singl08:40:242
249855699148,4cyclictest335557-21systemd-journal07:45:001
249855699148,4cyclictest335557-21systemd-journal07:45:001
2498556991410,3cyclictest2690793-21kworker/u8:2+flush-259:010:40:161
2498554991412,1cyclictest60350irq/132-enp0s29f1:rx-009:00:240
2498554991412,1cyclictest60350irq/132-enp0s29f1:rx-008:49:580
2498554991411,2cyclictest60350irq/132-enp0s29f1:rx-007:27:100
2498554991410,3cyclictest2561541-21kworker/u8:4+events_unbound09:33:330
249856499139,3cyclictest507-21in:imuxsock08:30:003
249856499137,4cyclictest2780427-21latency_hist11:40:013
2498564991310,2cyclictest2487865-21kworker/u8:0+flush-259:007:30:243
249855999139,3cyclictest2518225-21kworker/u8:3+flush-259:007:29:282
249855999139,3cyclictest2460994-21kworker/u8:2+flush-259:007:15:252
249855999139,2cyclictest0-21swapper/207:20:202
249855999137,4cyclictest2816545-21latency_hist12:15:002
2498559991310,2cyclictest2780955-21fschecks_time11:40:142
2498559991310,2cyclictest2780425-21sh11:40:002
2498559991310,2cyclictest2561541-21kworker/u8:4+flush-259:009:01:042
249855699139,3cyclictest2753844-21gpgv11:15:001
249855699139,2cyclictest490-21dbus-daemon12:14:591
249855699137,4cyclictest2513967-21cron07:24:591
249856499129,2cyclictest2555206-21unixbench_multi08:00:263
249856499126,4cyclictest2587095-21awk08:35:003
2498564991210,1cyclictest2790802-21idleruntime-cro11:49:593
249855999129,2cyclictest2572040-21cpuspeed_turbos08:20:132
2498559991210,1cyclictest0-21swapper/207:35:002
249855699129,2cyclictest2774881-21unixbench_singl11:30:231
249855699129,2cyclictest2540531-21cpuspeed_turbos07:50:121
249855699128,2cyclictest0-21swapper/108:05:011
249855699127,4cyclictest335557-21systemd-journal09:00:001
249855699125,2cyclictest2738329-21munin-plugin-st11:00:001
2498556991210,1cyclictest0-21swapper/108:50:201
249856499119,1cyclictest0-21swapper/311:40:223
249856499118,2cyclictest2644589-21fschecks_time09:30:143
249856499117,3cyclictest2806185-21cron12:04:593
249856499115,4cyclictest335557-21systemd-journal10:25:003
249855999118,1cyclictest0-21swapper/208:15:162
249855999117,3cyclictest2690793-21kworker/u8:2+events_unbound10:20:172
249855999110,6cyclictest490-21dbus-daemon10:00:002
249855699118,2cyclictest2837547-21cpuspeed_turbos12:35:121
249855699118,2cyclictest2780918-21fschecks_time11:40:141
249856499100,2cyclictest2759325-21awk11:20:003
249855999101,2cyclictest2759304-21awk11:20:002
249855999100,2cyclictest2832030-21latency_hist12:30:002
249855699107,2cyclictest2639450-21fschecks_time09:25:141
249855699106,3cyclictest2618008-21kworker/u8:1+flush-259:009:20:261
24985649997,1cyclictest0-21swapper/311:30:133
24985649995,3cyclictest2733447-21apt-get10:55:113
24985599997,1cyclictest0-21swapper/208:35:122
24985599995,2cyclictest2701154-21/usr/sbin/munin10:25:132
24985569997,1cyclictest0-21swapper/112:30:121
24985569996,2cyclictest2712960-21kthreadcore10:35:161
24985569995,3cyclictest2680712-21sh10:05:171
24985569995,3cyclictest2680712-21sh10:05:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional