You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-20 - 21:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Apr 20, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2560180994744,2cyclictest2648316-21apt-get08:35:123
2560177994438,4cyclictest2860836-21gpgv12:00:002
2560171994134,5cyclictest2741330-21latency_hist10:05:000
2560177994033,5cyclictest252-21systemd-journal10:20:132
2560171994036,3cyclictest2544317-21kworker/u8:3+flush-259:008:15:000
2560180993935,3cyclictest2637396-21kworker/u8:1+flush-259:009:25:153
2560174993832,4cyclictest2710329-21latency_hist09:35:011
2560174993831,5cyclictest2798456-21latency_hist11:00:011
2560171993733,3cyclictest75-21kswapd012:00:020
2560180993632,3cyclictest2642756-21gpgv08:30:013
2560174993629,5cyclictest2761955-21latency_hist10:25:001
2560177993530,3cyclictest2705129-21latency_hist09:30:002
2560177993527,5cyclictest252-21systemd-journal09:36:142
2560177993429,4cyclictest2695092-21apt-get09:20:132
2560177993229,2cyclictest2653210-21kworker/u8:2+flush-259:008:55:012
2560177993227,4cyclictest2642526-21apt-get08:30:022
2560171993227,4cyclictest2725824-21latency_hist09:50:010
2560174993124,5cyclictest2866341-21latency_hist12:05:011
2560171993128,3cyclictest2527182-21kworker/u8:2+events_unbound07:15:160
2560171993128,2cyclictest2637396-21kworker/u8:1+flush-259:008:50:220
2560180993026,3cyclictest2705147-21kworker/u8:3+events_unbound09:30:153
2560174993025,3cyclictest252-21systemd-journal09:53:131
2560174993022,6cyclictest2871499-21latency_hist12:10:011
2560171993027,2cyclictest2792928-21kworker/u8:3+flush-259:011:35:210
2560171993026,3cyclictest2829684-21cat11:29:590
2560180992926,2cyclictest2637396-21kworker/u8:1+flush-259:009:45:173
2560180992925,3cyclictest2761979-21kworker/u8:0+flush-259:010:45:213
2560174992923,4cyclictest2663714-21apt-get08:50:121
2560171992926,2cyclictest2803607-21kworker/u8:0+events_unbound12:30:180
2560171992924,3cyclictest252-21systemd-journal11:11:130
2560180992825,2cyclictest2544317-21kworker/u8:3+events_unbound07:20:173
2560180992824,3cyclictest2803607-21kworker/u8:0+flush-259:012:20:223
2560174992825,2cyclictest2669277-21apt-get08:55:111
2560171992825,2cyclictest2575342-21kworker/u8:0+flush-259:007:30:230
2560180992724,2cyclictest2601107-21kworker/u8:2+flush-259:007:50:213
2560180992723,3cyclictest2653210-21kworker/u8:2+flush-259:008:50:163
2560177992722,3cyclictest2725850-21kworker/u8:2+flush-259:010:00:162
2560174992723,3cyclictest2565509-21/usr/sbin/munin07:15:131
2560171992722,4cyclictest252-21systemd-journal08:05:000
2560174992622,3cyclictest2855807-21apt-get11:55:111
2560174992620,4cyclictest2653210-21kworker/u8:2+flush-259:008:45:001
2560171992622,3cyclictest2786653-21kworker/u8:2+events_unbound11:00:190
2560171992622,3cyclictest2544317-21kworker/u8:3+flush-259:007:55:200
2560171992620,5cyclictest2767121-21latency_hist10:30:010
2560180992522,2cyclictest2897141-21kworker/u8:1+events_unbound12:35:193
2560180992522,2cyclictest2575342-21kworker/u8:0+events_unbound07:25:213
2560180992522,2cyclictest2575342-21kworker/u8:0+events_unbound07:25:213
2560180992521,3cyclictest2814105-21apt-get11:15:123
2560180992521,3cyclictest2637396-21kworker/u8:1+events_unbound10:35:213
2560180992521,3cyclictest2601107-21kworker/u8:2+flush-259:007:50:013
2560180992520,4cyclictest252-21systemd-journal11:40:383
2560177992520,3cyclictest2834557-21fwupd11:31:152
2560177992520,3cyclictest2793489-21base6410:55:022
2560177992518,5cyclictest2870645-21ntpq12:05:202
2560174992520,4cyclictest2581001-21apt-get07:30:121
2560171992522,2cyclictest2616792-21kworker/u8:0+events_unbound08:30:120
2560171992522,2cyclictest2586129-21kworker/u8:2+flush-259:007:40:000
2560180992421,2cyclictest2575342-21kworker/u8:0+events_unbound07:30:123
2560180992420,3cyclictest2684511-21latency_hist09:10:013
2560180992420,3cyclictest2668630-21kworker/u8:3+events_unbound09:10:223
2560180992419,4cyclictest2793739-21diskstats10:55:133
2560180992419,3cyclictest252-21systemd-journal10:10:013
2560177992419,3cyclictest2808964-21/usr/sbin/munin11:10:212
2560174992420,3cyclictest2544317-21kworker/u8:3+flush-259:007:10:241
2560171992420,3cyclictest2850652-21apt-get11:50:120
2560171992420,3cyclictest2616792-21kworker/u8:0+events_unbound08:45:230
2560171992418,4cyclictest252-21systemd-journal09:09:590
256017199240,22cyclictest2653214-21unin-run08:40:010
2560180992321,1cyclictest2705147-21kworker/u8:3+events_unbound10:25:133
2560180992320,2cyclictest2694847-21kworker/u8:0+events_unbound09:20:253
2560180992320,2cyclictest2544317-21kworker/u8:3+flush-259:008:20:213
2560180992319,3cyclictest2705147-21kworker/u8:3+events_unbound10:30:203
2560180992319,3cyclictest252-21systemd-journal12:00:013
2560177992316,5cyclictest2887430-21diskstats12:25:142
2560174992318,3cyclictest2544317-21kworker/u8:3+events_unbound08:00:181
2560174992318,3cyclictest252-21systemd-journal09:42:121
2560171992320,2cyclictest2694847-21kworker/u8:0+events_unbound09:20:220
2560171992320,2cyclictest2575342-21kworker/u8:0+events_unbound07:29:140
2560171992320,2cyclictest2575342-21kworker/u8:0+events_unbound07:29:130
2560171992320,2cyclictest2544317-21kworker/u8:3+flush-259:007:55:000
2560171992319,3cyclictest2871536-21kworker/u8:1+events_unbound12:27:120
2560180992220,1cyclictest0-21swapper/312:00:003
2560180992219,2cyclictest2677263-21kworker/u8:4+events_unbound09:35:243
2560180992219,2cyclictest2544317-21kworker/u8:3+events_unbound07:10:223
2560180992218,3cyclictest2677263-21kworker/u8:4+flush-259:009:15:253
2560180992218,3cyclictest2544317-21kworker/u8:3+events_unbound08:05:143
2560180992217,3cyclictest2793066-21base6410:55:003
2560177992217,3cyclictest2668630-21kworker/u8:3+flush-259:009:10:142
2560177992215,5cyclictest252-21systemd-journal07:25:012
2560174992217,3cyclictest252-21systemd-journal08:27:131
2560174992216,4cyclictest2829968-21apt-get11:30:101
2560171992219,2cyclictest2705147-21kworker/u8:3+events_unbound10:15:200
2560171992219,2cyclictest2653210-21kworker/u8:2+events_unbound08:40:130
2560171992219,2cyclictest2637396-21kworker/u8:1+events_unbound10:20:120
2560171992218,3cyclictest3694817-21kworker/u8:1+events_unbound07:14:140
2560171992218,3cyclictest2668630-21kworker/u8:3+events_unbound09:10:130
2560180992118,3cyclictest2694847-21kworker/u8:0+events_unbound09:55:213
2560180992118,2cyclictest2855779-21kworker/u8:3+flush-259:012:10:233
2560180992117,3cyclictest2803607-21kworker/u8:0+events_unbound12:34:173
2560180992117,3cyclictest2637396-21kworker/u8:1+events_unbound08:55:233
2560180992117,3cyclictest2544317-21kworker/u8:3+flush-259:008:00:163
2560180992117,3cyclictest2544317-21kworker/u8:3+flush-259:007:40:153
2560180992117,3cyclictest2544317-21kworker/u8:3+events_unbound07:56:143
2560177992116,4cyclictest2616792-21kworker/u8:0+flush-259:008:45:252
2560174992116,3cyclictest2700226-21/usr/sbin/munin09:25:141
2560171992118,2cyclictest2637396-21kworker/u8:1+events_unbound10:50:220
2560171992118,2cyclictest2637396-21kworker/u8:1+events_unbound08:55:200
2560171992117,3cyclictest2544317-21kworker/u8:3+events_unbound08:15:150
2560171992115,4cyclictest2860718-21apt-get12:00:000
2560180992016,3cyclictest2871536-21kworker/u8:1+events_unbound12:25:213
2560180992016,3cyclictest2586129-21kworker/u8:2+events_unbound07:35:223
2560180992015,3cyclictest2560083-21latency_hist07:10:003
2560177992016,2cyclictest2705147-21kworker/u8:3+events_unbound10:10:222
2560177992013,5cyclictest2803607-21kworker/u8:0+flush-259:011:15:162
2560174992016,2cyclictest0-21swapper/110:00:001
2560174992015,3cyclictest2720920-21/usr/sbin/munin09:45:161
2560171992018,2cyclictest2803607-21kworker/u8:0+events_unbound11:20:280
2560171992017,2cyclictest2803607-21kworker/u8:0+events_unbound11:30:020
2560171992017,2cyclictest2725850-21kworker/u8:2+flush-259:009:50:200
2560171992016,3cyclictest2746780-21apt-get10:10:120
2560171992016,3cyclictest2586129-21kworker/u8:2+events_unbound07:40:260
2560171992015,4cyclictest2845665-21diskstats11:45:150
2560180991916,2cyclictest2845466-21kworker/u8:4+events_unbound11:45:273
2560180991916,2cyclictest2829528-21latency_hist11:30:003
2560180991915,3cyclictest2871536-21kworker/u8:1+events_unbound12:16:143
2560180991915,3cyclictest2871536-21kworker/u8:1+events_unbound12:16:143
2560180991915,3cyclictest2803607-21kworker/u8:0+events_unbound11:34:143
2560180991915,3cyclictest2725850-21kworker/u8:2+events_unbound10:13:133
2560180991915,3cyclictest2637396-21kworker/u8:1+events_unbound10:40:123
2560180991914,4cyclictest2626229-21ntpq08:10:213
2560177991915,3cyclictest2674179-21grep09:00:012
2560174991916,2cyclictest2792897-21apt-get10:55:011
2560174991913,4cyclictest2819012-21latency_hist11:20:001
2560171991916,2cyclictest2637396-21kworker/u8:1+flush-259:011:00:010
2560171991915,3cyclictest2845466-21kworker/u8:4+events_unbound12:07:130
2560171991915,3cyclictest2777701-21apt-get10:40:120
256017199191,16cyclictest2621957-21unin-run08:10:010
2560180991815,2cyclictest2725850-21kworker/u8:2+events_unbound10:00:223
2560180991815,2cyclictest2544317-21kworker/u8:3+events_unbound08:19:143
2560180991814,3cyclictest2803607-21kworker/u8:0+events_unbound11:37:143
2560180991814,3cyclictest2705147-21kworker/u8:3+flush-259:010:20:253
2560180991814,3cyclictest2616792-21kworker/u8:0+events_unbound08:48:153
2560177991813,4cyclictest2616792-21kworker/u8:0+flush-259:009:00:142
2560177991813,3cyclictest2586129-21kworker/u8:2+events_unbound07:35:182
2560177991811,5cyclictest509-21rs:main2
256017499183,4cyclictest2608305-21grep07:55:191
2560171991814,3cyclictest2637396-21kworker/u8:1+flush-259:009:25:240
2560180991714,2cyclictest3694817-21kworker/u8:1+flush-259:007:15:233
2560180991714,2cyclictest2725850-21kworker/u8:2+flush-259:009:50:253
2560180991713,3cyclictest2705147-21kworker/u8:3+events_unbound10:15:173
2560180991713,2cyclictest2845466-21kworker/u8:4+events_unbound12:05:233
2560177991714,2cyclictest2971-21cron10:35:012
2560177991714,2cyclictest2626197-21ntp_kernel_pll_08:10:222
2560177991714,2cyclictest2560788-21irqcore07:10:162
2560177991711,4cyclictest2792886-21latency_hist10:55:002
2560177991711,4cyclictest2601339-21latency_hist07:50:002
2560177991711,4cyclictest252-21systemd-journal11:47:122
2560177991710,5cyclictest252-21systemd-journal07:30:002
2560177991710,5cyclictest252-21systemd-journal07:30:002
2560174991714,2cyclictest2767378-21apt-get10:30:101
2560174991711,4cyclictest2616792-21kworker/u8:0+flush-259:008:20:001
2560174991710,5cyclictest252-21systemd-journal09:04:131
2560171991714,2cyclictest2855779-21kworker/u8:3+flush-259:012:10:450
2560171991714,2cyclictest2705147-21kworker/u8:3+flush-259:009:30:220
2560171991714,2cyclictest2637396-21kworker/u8:1+flush-259:009:44:540
2560180991612,3cyclictest2803607-21kworker/u8:0+events_unbound11:12:143
2560180991612,3cyclictest2637396-21kworker/u8:1+events_unbound09:40:233
2560180991611,4cyclictest2807906-21ntpq11:05:223
2560177991612,3cyclictest2876910-21/usr/sbin/munin12:15:212
2560177991612,3cyclictest2876910-21/usr/sbin/munin12:15:212
2560177991612,3cyclictest2840076-21kworker/u8:2+flush-259:011:40:252
2560177991611,3cyclictest2705147-21kworker/u8:3+flush-259:009:30:172
2560177991611,3cyclictest252-21systemd-journal10:26:142
2560177991610,4cyclictest252-21systemd-journal09:55:002
256017499169,5cyclictest2600512-21ntpq07:45:221
256017499169,5cyclictest252-21systemd-journal12:25:001
2560174991612,3cyclictest2897637-21apt-get12:35:131
2560171991614,1cyclictest60350irq/132-enp0s29f1:rx-010:45:110
2560171991614,1cyclictest60350irq/132-enp0s29f1:rx-010:30:090
2560171991613,2cyclictest2725850-21kworker/u8:2+flush-259:010:08:220
2560171991612,3cyclictest2855779-21kworker/u8:3+events_unbound12:25:010
2560171991612,3cyclictest2637396-21kworker/u8:1+events_unbound10:35:190
2560171991612,3cyclictest2595794-21kworker/u8:1+flush-259:007:45:190
2560180991512,2cyclictest2803607-21kworker/u8:0+flush-259:011:20:153
2560180991511,3cyclictest2616792-21kworker/u8:0+events_unbound08:42:153
2560180991510,4cyclictest2643154-21cat08:30:013
256017799159,4cyclictest2720672-21latency_hist09:45:002
256017799159,4cyclictest252-21systemd-journal11:50:132
2560177991511,3cyclictest2668630-21kworker/u8:3+flush-259:009:15:172
2560177991510,4cyclictest2668630-21kworker/u8:3+flush-259:009:05:172
256017499151,4cyclictest2893479-21cut12:30:181
2560174991513,1cyclictest2891724-21unixbench_singl12:25:251
2560174991512,2cyclictest2705147-21kworker/u8:3+flush-259:010:10:181
2560174991512,2cyclictest2601107-21kworker/u8:2+flush-259:007:50:181
2560174991510,4cyclictest2824405-21apt-get11:25:111
2560174991510,3cyclictest2871760-21apt-get12:10:121
256017499150,14cyclictest1-21systemd09:36:131
2560171991513,1cyclictest60350irq/132-enp0s29f1:rx-011:40:150
2560171991513,1cyclictest60350irq/132-enp0s29f1:rx-009:15:350
2560171991513,1cyclictest60350irq/132-enp0s29f1:rx-009:00:230
2560171991512,2cyclictest60350irq/132-enp0s29f1:rx-009:35:220
2560171991512,2cyclictest2616792-21kworker/u8:0+flush-259:008:30:000
2560171991511,3cyclictest2725850-21kworker/u8:2+flush-259:009:55:210
256017799148,4cyclictest252-21systemd-journal11:38:142
256017799147,5cyclictest252-21systemd-journal08:20:132
2560177991411,2cyclictest2855779-21kworker/u8:3+flush-259:012:10:172
2560177991410,3cyclictest2601107-21kworker/u8:2+flush-259:007:53:182
256017499142,4cyclictest2591299-21/usr/sbin/munin07:40:171
256017499142,2cyclictest2762220-21apt-get10:25:131
2560174991411,2cyclictest2621037-21ntp_kernel_pll_08:05:221
2560171991412,1cyclictest60350irq/132-enp0s29f1:rx-012:36:250
2560171991412,1cyclictest60350irq/132-enp0s29f1:rx-012:18:530
2560171991412,1cyclictest60350irq/132-enp0s29f1:rx-012:18:520
2560171991412,1cyclictest60350irq/132-enp0s29f1:rx-008:20:330
256017799137,4cyclictest2746519-21latency_hist10:10:002
256017799131,3cyclictest2658352-21awk08:45:012
2560177991310,2cyclictest2899952-21kthreadcore12:35:182
2560177991310,2cyclictest0-21swapper/210:40:162
2560177991310,2cyclictest0-21swapper/208:00:192
256017499135,6cyclictest252-21systemd-journal11:40:001
256017499132,2cyclictest2807799-21ntp_11:05:211
256017499131,4cyclictest2570651-21/usr/sbin/munin07:20:231
2560174991310,2cyclictest2690348-21irqcore09:15:181
2560174991310,2cyclictest2689209-21unixbench_multi09:10:261
256017199131,10cyclictest2570829-21df07:20:120
2560171991310,2cyclictest60350irq/132-enp0s29f1:rx-011:16:460
256017799129,2cyclictest2648720-21irqcore08:35:172
256017799129,1cyclictest2736154-21cron09:59:592
256017799128,2cyclictest0-21swapper/211:05:012
256017799127,3cyclictest2808728-21awk11:10:012
256017799127,3cyclictest2544317-21kworker/u8:3+flush-259:008:25:222
256017799126,4cyclictest252-21systemd-journal07:45:002
256017499129,2cyclictest2845909-21irqcore11:45:171
256017499128,3cyclictest490-21dbus-daemon12:20:001
256017499128,3cyclictest490-21dbus-daemon12:20:001
256017499128,3cyclictest2782851-21apt-get10:45:101
256017499128,3cyclictest2658872-21fschecks_time08:45:141
256017499125,5cyclictest2803170-21grep11:00:221
256017499124,6cyclictest252-21systemd-journal11:55:001
256017499123,5cyclictest0-21swapper/110:35:171
2560174991210,1cyclictest0-21swapper/109:05:231
256017499120,7cyclictest2741910-21hddtemp_smartct10:05:161
256017799119,1cyclictest0-21swapper/212:00:142
256017799119,1cyclictest0-21swapper/210:35:192
256017799118,2cyclictest2819338-21cpuspeed_turbos11:20:142
256017799115,4cyclictest2884402-21kthreadcore12:20:162
256017799115,4cyclictest252-21systemd-journal07:35:012
256017499119,1cyclictest2809104-21cpuspeed_turbos11:10:141
256017499118,2cyclictest2576862-21kthreadcore07:25:171
256017499118,2cyclictest2576862-21kthreadcore07:25:171
256017499116,4cyclictest252-21systemd-journal08:10:141
256017499113,5cyclictest0-21swapper/110:00:141
256017499112,1cyclictest0-21swapper/107:35:141
256017499111,2cyclictest32-21ksoftirqd/111:40:121
256017499110,3cyclictest2755981-21ntpq10:15:221
256017499110,2cyclictest32-21ksoftirqd/108:30:251
256018099107,2cyclictest2792928-21kworker/u8:3+flush-259:011:02:213
256018099106,3cyclictest2616792-21kworker/u8:0+events_unbound09:00:143
256017499101,2cyclictest32-21ksoftirqd/109:20:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional