You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 17:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Wed Jul 01, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2380082994844,3cyclictest2600055-21kworker/u8:1+flush-259:011:25:001
2380082994340,2cyclictest2442034-21kworker/u8:0+flush-259:008:15:001
2380089994236,4cyclictest2453432-21latency_hist08:20:013
2380082994138,2cyclictest2495167-21kworker/u8:0+events_unbound09:25:011
2380079994137,2cyclictest2619760-21kworker/u8:3+flush-259:011:08:410
2380082993936,2cyclictest2443134-21kworker/u8:4+flush-259:008:30:001
2380082993935,3cyclictest2600055-21kworker/u8:1+flush-259:011:30:111
2380079993936,2cyclictest211rcuc/012:10:000
2380082993734,2cyclictest2640269-21kworker/u8:2+flush-259:011:40:241
2380089993632,3cyclictest2505913-21kworker/u8:2+flush-259:011:00:233
2380082993634,1cyclictest2671295-21kworker/u8:3+flush-259:012:25:251
2380089993427,4cyclictest2671268-21latency_hist11:50:013
2380085993428,4cyclictest2400638-21latency_hist07:30:002
2380082993431,2cyclictest2385250-21kworker/u8:2+flush-259:007:40:001
2380079993430,3cyclictest2552604-21kworker/u8:0+flush-259:010:20:180
2380089993329,3cyclictest2505913-21kworker/u8:2+flush-259:010:30:173
2380082993329,3cyclictest2458619-21kworker/u8:5+flush-259:008:40:251
2380085993225,5cyclictest2567831-21latency_hist10:10:012
2380079993228,3cyclictest2645519-21kworker/u8:0+flush-259:011:45:160
2380079993225,5cyclictest2484847-21latency_hist08:50:010
2380085993124,5cyclictest2718712-21latency_hist12:35:012
2380082993128,2cyclictest2458619-21kworker/u8:5+events_unbound09:10:011
2380079993128,2cyclictest2442034-21kworker/u8:0+flush-259:008:20:170
2380079993128,2cyclictest2385250-21kworker/u8:2+flush-259:007:25:000
2380079993127,3cyclictest2600055-21kworker/u8:1+flush-259:011:40:010
2380082993026,3cyclictest2364409-21kworker/u8:3+events_unbound07:26:121
2380079993023,5cyclictest2702804-21latency_hist12:20:000
2380085992922,4cyclictest2511016-21latency_hist09:15:012
2380082992926,2cyclictest2385250-21kworker/u8:2+flush-259:008:40:001
2380085992822,4cyclictest2656032-21/usr/sbin/munin11:35:192
2380082992825,2cyclictest2600055-21kworker/u8:1+events_unbound10:55:171
2380082992824,3cyclictest2645758-21apt-get11:25:111
2380082992822,5cyclictest2583217-21latency_hist10:25:001
2380079992824,3cyclictest2417193-21apt-get07:45:120
2380079992822,4cyclictest2577204-21ntpq10:15:210
2380089992722,4cyclictest2364409-21kworker/u8:3+flush-259:007:45:003
2380089992721,4cyclictest335557-21systemd-journal09:09:103
2380085992721,4cyclictest2385628-21diskstats07:15:142
2380082992723,3cyclictest2505913-21kworker/u8:2+flush-259:011:00:101
2380082992723,3cyclictest2505913-21kworker/u8:2+events_unbound09:48:251
2380079992724,2cyclictest2385250-21kworker/u8:2+flush-259:008:00:000
2380079992723,3cyclictest2505913-21kworker/u8:2+flush-259:010:50:240
2380079992721,4cyclictest2624879-21latency_hist11:05:010
2380089992621,4cyclictest2600055-21kworker/u8:1+flush-259:012:20:003
2380085992622,3cyclictest2640269-21kworker/u8:2+flush-259:012:00:222
2380082992623,2cyclictest2640269-21kworker/u8:2+flush-259:012:15:191
2380082992622,3cyclictest2521380-21kworker/u8:1+events_unbound09:32:111
2380079992622,3cyclictest2640269-21kworker/u8:2+events_unbound11:23:100
2380089992518,6cyclictest2530806-21ntpq09:30:363
2380085992519,4cyclictest2703069-21apt-get12:20:132
2380085992518,5cyclictest2604072-21cat10:45:002
2380082992522,2cyclictest2671295-21kworker/u8:3+events_unbound12:30:191
2380082992522,2cyclictest2671295-21kworker/u8:3+events_unbound12:30:191
2380082992522,2cyclictest2640269-21kworker/u8:2+events_unbound11:50:431
2380082992522,2cyclictest2552604-21kworker/u8:0+events_unbound10:05:231
2380082992522,2cyclictest2364409-21kworker/u8:3+flush-259:007:55:181
2380082992521,3cyclictest2385250-21kworker/u8:2+events_unbound08:01:101
2380082992520,4cyclictest2537134-21apt-get09:40:121
2380082992520,3cyclictest2427271-21latency_hist07:55:011
2380079992521,3cyclictest335557-21systemd-journal10:28:100
2380089992420,3cyclictest2625143-21apt-get11:05:113
2380085992417,5cyclictest335557-21systemd-journal08:14:102
2380085992416,5cyclictest2614578-21latency_hist10:55:012
2380082992421,2cyclictest2505913-21kworker/u8:2+flush-259:010:30:201
2380082992421,2cyclictest2505913-21kworker/u8:2+events_unbound10:40:201
2380082992421,2cyclictest2364409-21kworker/u8:3+events_unbound07:15:191
2380082992420,3cyclictest2600055-21kworker/u8:1+flush-259:011:15:201
2380082992420,3cyclictest2521380-21kworker/u8:1+flush-259:009:25:201
2380082992420,3cyclictest2505913-21kworker/u8:2+flush-259:009:15:011
2380082992419,3cyclictest2347477-21kworker/u8:0+flush-259:007:10:251
2380082992417,5cyclictest335557-21systemd-journal09:55:001
2380079992421,2cyclictest2686847-21kworker/u8:4+events_unbound12:13:100
2380089992318,4cyclictest335557-21systemd-journal10:00:003
2380089992318,4cyclictest2707953-21latency_hist12:25:003
2380089992315,6cyclictest2697409-21cp12:15:013
2380082992320,2cyclictest2505913-21kworker/u8:2+flush-259:010:25:201
2380082992320,2cyclictest2458619-21kworker/u8:5+flush-259:008:55:221
2380079992318,3cyclictest2432858-21kworker/u8:1+flush-259:008:25:160
2380089992219,2cyclictest2500295-21cut09:05:013
2380089992215,5cyclictest335557-21systemd-journal09:00:003
2380089992215,5cyclictest2395508-21latency_hist07:25:003
238008599221,14cyclictest335557-21systemd-journal08:35:002
2380082992219,2cyclictest2645519-21kworker/u8:0+flush-259:011:45:211
2380082992219,2cyclictest2600055-21kworker/u8:1+events_unbound12:21:131
2380082992216,2cyclictest2495167-21kworker/u8:0+events_unbound09:15:151
2380079992217,3cyclictest2619760-21kworker/u8:3+flush-259:011:15:010
2380089992118,2cyclictest2442034-21kworker/u8:0+flush-259:008:20:253
2380085992116,3cyclictest2557803-21apt-get10:00:112
2380082992119,2cyclictest2432858-21kworker/u8:1+events_unbound09:03:121
2380082992118,2cyclictest2645519-21kworker/u8:0+events_unbound11:55:181
2380082992117,3cyclictest2485117-21apt-get08:50:131
2380082992116,4cyclictest2380011-21latency_hist07:10:001
2380082992115,4cyclictest509-21rs:main1
2380082992114,2cyclictest2505913-21kworker/u8:2+events_unbound10:15:181
2380082992113,6cyclictest2535906-21ntpq09:35:201
2380079992118,2cyclictest2505913-21kworker/u8:2+events_unbound09:35:150
2380079992117,3cyclictest2552604-21kworker/u8:0+flush-259:010:05:200
2380079992117,3cyclictest2385250-21kworker/u8:2+events_unbound07:53:110
2380079992114,5cyclictest2499447-21ntpq09:00:210
2380089992018,1cyclictest2660764-21fwupd11:38:113
2380089992016,3cyclictest2686847-21kworker/u8:4+flush-259:012:05:233
2380089992016,3cyclictest2640269-21kworker/u8:2+events_unbound11:50:173
2380089992015,4cyclictest2411577-21kworker/u8:0+flush-259:007:50:253
2380089992015,3cyclictest2495167-21kworker/u8:0+flush-259:009:15:173
2380089992015,3cyclictest2468989-21apt-get08:35:023
2380085992015,4cyclictest2526743-21apt-get09:30:112
2380085992013,5cyclictest335557-21systemd-journal09:45:002
2380082992017,2cyclictest2640269-21kworker/u8:2+flush-259:012:00:151
2380082992016,3cyclictest2600055-21kworker/u8:1+events_unbound11:35:141
2380082992016,3cyclictest2505913-21kworker/u8:2+events_unbound10:38:111
2380082992016,3cyclictest2505913-21kworker/u8:2+events_unbound10:10:201
2380082992015,4cyclictest2687065-21/usr/sbin/munin12:05:201
2380082992014,4cyclictest509-21rs:main1
2380079992017,2cyclictest2505913-21kworker/u8:2+flush-259:010:30:250
2380079992017,2cyclictest2458619-21kworker/u8:5+flush-259:008:40:200
2380079992016,3cyclictest2671295-21kworker/u8:3+flush-259:012:32:150
2380079992016,3cyclictest2671295-21kworker/u8:3+flush-259:012:32:140
2380079992016,3cyclictest2645519-21kworker/u8:0+events_unbound11:55:150
2380079992016,3cyclictest2505913-21kworker/u8:2+events_unbound09:18:190
2380079992014,4cyclictest335557-21systemd-journal10:05:010
2380089991913,4cyclictest2713796-21/usr/sbin/munin12:30:203
2380089991913,4cyclictest2713796-21/usr/sbin/munin12:30:193
2380085991913,4cyclictest335557-21systemd-journal11:30:002
2380085991913,4cyclictest2438261-21/usr/sbin/munin08:05:162
2380085991912,5cyclictest2696299-21ntpq12:10:202
2380085991912,5cyclictest2410494-21ntpq07:35:222
2380082991916,2cyclictest2505913-21kworker/u8:2+flush-259:010:00:201
2380082991916,2cyclictest2505913-21kworker/u8:2+events_unbound09:55:141
2380082991915,3cyclictest2686847-21kworker/u8:4+events_unbound12:10:571
2380082991915,3cyclictest2385250-21kworker/u8:2+events_unbound07:23:001
2380079991916,2cyclictest2505913-21kworker/u8:2+events_unbound09:50:220
2380079991915,3cyclictest2671295-21kworker/u8:3+events_unbound12:25:240
2380079991915,3cyclictest2505913-21kworker/u8:2+events_unbound09:55:240
2380079991915,3cyclictest2411577-21kworker/u8:0+events_unbound07:40:220
2380079991915,3cyclictest2385250-21kworker/u8:2+flush-259:007:35:150
2380079991913,4cyclictest335557-21systemd-journal12:01:090
2380089991814,3cyclictest2640321-21idleruntime-cro11:20:013
2380085991814,2cyclictest2474840-21apt-get08:40:122
2380085991812,4cyclictest2520517-21ntpq09:20:222
2380082991816,1cyclictest0-21swapper/107:45:001
2380079991815,2cyclictest2707981-21kworker/u8:0+flush-259:012:35:150
2380079991815,2cyclictest2432858-21kworker/u8:1+flush-259:009:05:160
2380079991814,3cyclictest2593566-21kworker/u8:3+events_unbound10:35:170
2380079991814,3cyclictest2385250-21kworker/u8:2+events_unbound08:30:240
2380079991814,3cyclictest2364409-21kworker/u8:3+events_unbound07:30:190
2380079991812,4cyclictest2438023-21latency_hist08:05:010
2380089991714,2cyclictest509-21rs:main3
2380089991713,3cyclictest2640269-21kworker/u8:2+flush-259:011:35:013
2380089991712,4cyclictest2364409-21kworker/u8:3+flush-259:007:30:003
2380089991711,4cyclictest2405978-21gpgv07:35:003
2380089991710,5cyclictest2421266-21ntpq07:45:223
2380089991710,5cyclictest2405781-21apt-get07:35:013
2380085991711,4cyclictest2536863-21latency_hist09:40:002
2380082991713,3cyclictest2385250-21kworker/u8:2+events_unbound08:24:111
2380082991713,3cyclictest2364409-21kworker/u8:3+events_unbound07:30:141
2380079991714,2cyclictest60350irq/132-enp0s29f1:rx-008:17:290
2380079991714,2cyclictest2619709-21cron11:00:010
2380079991713,3cyclictest2609438-21kworker/u8:0+events_unbound11:19:100
2380079991713,3cyclictest2458619-21kworker/u8:5+flush-259:009:20:110
2380089991612,3cyclictest2600055-21kworker/u8:1+flush-259:011:00:003
2380089991612,3cyclictest2462881-21ntp_kernel_err08:25:223
2380089991610,4cyclictest2385196-21latency_hist07:14:593
2380085991611,3cyclictest2650892-21apt-get11:30:112
2380082991613,2cyclictest2385250-21kworker/u8:2+events_unbound08:30:201
2380082991612,3cyclictest2600055-21kworker/u8:1+events_unbound11:13:471
2380082991610,4cyclictest335557-21systemd-journal10:53:101
2380079991614,1cyclictest60350irq/132-enp0s29f1:rx-008:55:290
2380079991614,1cyclictest2495167-21kworker/u8:0+events_unbound09:28:200
2380079991613,2cyclictest2645519-21kworker/u8:0+flush-259:011:30:230
2380079991613,2cyclictest2505913-21kworker/u8:2+events_unbound10:10:180
2380079991613,2cyclictest2385250-21kworker/u8:2+events_unbound08:50:160
2380079991612,3cyclictest2600055-21kworker/u8:1+flush-259:011:25:170
2380079991612,3cyclictest2521380-21kworker/u8:1+flush-259:009:30:320
2380079991612,3cyclictest2495167-21kworker/u8:0+events_unbound09:40:270
2380079991612,3cyclictest2364409-21kworker/u8:3+events_unbound07:10:140
2380089991512,2cyclictest2390336-21basename07:20:003
2380089991511,3cyclictest2600055-21kworker/u8:1+flush-259:012:00:003
2380089991510,3cyclictest2609414-21latency_hist10:50:013
2380085991512,2cyclictest2489985-21sh08:55:002
2380085991511,3cyclictest2645519-21kworker/u8:0+flush-259:011:45:202
2380082991511,3cyclictest2442034-21kworker/u8:0+events_unbound08:16:031
2380082991510,4cyclictest2640269-21kworker/u8:2+events_unbound12:36:271
2380079991513,1cyclictest60350irq/132-enp0s29f1:rx-009:12:090
2380079991513,1cyclictest60350irq/132-enp0s29f1:rx-008:35:170
2380079991513,1cyclictest60350irq/132-enp0s29f1:rx-008:05:260
2380079991512,2cyclictest60350irq/132-enp0s29f1:rx-011:43:040
2380079991512,2cyclictest60350irq/132-enp0s29f1:rx-010:40:220
2380079991512,2cyclictest2364409-21kworker/u8:3+events_unbound07:15:290
238008999147,5cyclictest2603854-21latency_hist10:45:013
238008999140,3cyclictest2614570-21awk10:55:013
238008599141,11cyclictest490-21dbus-daemon10:00:002
2380085991410,3cyclictest2600055-21kworker/u8:1+flush-259:012:16:012
2380085991410,3cyclictest2600055-21kworker/u8:1+flush-259:010:55:242
2380079991412,2cyclictest60350irq/132-enp0s29f1:rx-008:10:250
2380079991412,1cyclictest60350irq/132-enp0s29f1:rx-012:20:240
2380079991412,1cyclictest60350irq/132-enp0s29f1:rx-009:48:020
2380079991411,2cyclictest2395889-21cpuspeed_turbos07:25:150
238008999139,3cyclictest2552604-21kworker/u8:0+flush-259:010:10:053
238008999138,3cyclictest2640269-21kworker/u8:2+flush-259:012:35:543
2380089991310,2cyclictest2489525-21unixbench_multi08:50:263
2380089991310,2cyclictest2432858-21kworker/u8:1+flush-259:008:05:003
2380089991310,1cyclictest0-21swapper/310:15:163
238008599139,3cyclictest2707981-21kworker/u8:0+flush-259:012:35:252
238008599138,4cyclictest2469655-21/usr/sbin/munin08:35:152
238008599138,3cyclictest2676691-21/usr/sbin/munin11:55:152
238008299139,3cyclictest2458619-21kworker/u8:5+events_unbound08:45:251
2380082991310,2cyclictest2385250-21kworker/u8:2+events_unbound07:46:121
2380079991311,1cyclictest60350irq/132-enp0s29f1:rx-011:50:240
238008999129,2cyclictest2542728-21tr09:45:153
238008999128,3cyclictest2506338-21fschecks_count09:10:153
238008599129,2cyclictest2640269-21kworker/u8:2+events_unbound11:40:172
238008599129,2cyclictest2511705-21irqcore09:15:172
238008599129,2cyclictest0-21swapper/209:00:002
238008599128,3cyclictest2442034-21kworker/u8:0+flush-259:008:15:152
238008599128,3cyclictest2411577-21kworker/u8:0+flush-259:007:40:252
238008599127,3cyclictest2630429-21diskstats11:10:132
238008599126,4cyclictest2427821-21cp07:55:012
238008999119,1cyclictest0-21swapper/308:05:153
238008999119,1cyclictest0-21swapper/308:00:003
238008999118,2cyclictest2709063-21irqcore12:25:183
238008999117,3cyclictest2474907-21cpuspeed_turbos08:40:143
238008999115,4cyclictest509-21rs:main3
238008599119,1cyclictest0-21swapper/210:25:192
238008599118,2cyclictest2573304-21cpuspeed_turbos10:15:122
238008599118,2cyclictest0-21swapper/208:00:192
238008599118,1cyclictest0-21swapper/208:20:252
238008599115,4cyclictest2573069-21cat10:15:002
238008599110,8cyclictest2691996-21latency_hist12:10:002
238008999107,2cyclictest2536881-21turbostat09:44:563
238008999107,2cyclictest2536860-21idleruntime-cro09:40:003
238008999107,2cyclictest0-21swapper/311:20:113
238008999104,4cyclictest2587572-21ntp_states10:25:243
238008599107,2cyclictest2404863-21ntpq07:30:202
238008599107,2cyclictest2364409-21kworker/u8:3+flush-259:007:10:152
238008599107,2cyclictest0-21swapper/210:30:182
238008599107,1cyclictest0-21swapper/211:25:012
238008599101,7cyclictest2640335-21latency_hist11:20:022
23800859994,4cyclictest401ktimers/209:00:122
23800859990,8cyclictest0-21swapper/209:45:112
23800899983,3cyclictest2520427-21ldconfig09:20:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional