You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-12 - 13:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sun Apr 12, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27160132770,3sleep375-21kworker/3:1+mm_percpu_wq22:35:013
26010822590,2chrt75-21kworker/3:1+events20:36:343
2510228995244,6cyclictest2649611-21kworker/u8:2+flush-8:022:26:351
2510224995041,7cyclictest2626689-21apt-get21:05:010
2510228994640,4cyclictest2751092-21apt-get23:11:151
2510224994641,3cyclictest1676926-21kworker/u8:3+flush-8:021:35:010
2510228994540,4cyclictest2596527-21kworker/u8:0+flush-8:020:51:341
2510228994438,4cyclictest1676926-21kworker/u8:3+flush-8:021:16:201
2510228994438,4cyclictest1676926-21kworker/u8:3+flush-8:021:16:201
2510228994435,7cyclictest2815575-21/usr/sbin/munin00:16:261
25629622430,2sleep3481ktimers/320:01:233
2510228994338,4cyclictest2557067-21kworker/u8:2+flush-8:020:31:201
2510228994338,4cyclictest1676926-21kworker/u8:3+events_unbound21:21:191
2510228994332,9cyclictest2799308-21ntpq23:56:301
2510228994330,10cyclictest280-21systemd-journal19:30:001
2510228994235,5cyclictest2696124-21latency_hist22:15:011
2510233994130,8cyclictest2591897-21awk20:30:002
2510228994132,7cyclictest2676683-21/usr/sbin/munin21:56:271
2510228994131,7cyclictest280-21systemd-journal21:45:011
2510224994031,6cyclictest2571885-21latency_hist20:10:010
2510228993934,4cyclictest2676382-21kworker/u8:1+flush-8:000:31:201
2510228993934,3cyclictest1676926-21kworker/u8:3+flush-8:020:11:201
2510224993934,4cyclictest2774892-21kworker/u8:3+events_unbound23:41:220
2510224993929,8cyclictest280-21systemd-journal23:40:000
2510224993832,4cyclictest2765528-21apt23:25:000
2510228993731,4cyclictest2582361-21apt-get20:21:161
2510228993727,8cyclictest2839172-21ntpq00:36:321
2510228993726,9cyclictest2714995-21ntpq22:31:261
2510224993727,8cyclictest2587520-21diskstats20:26:170
2510224993720,4cyclictest2602497-21fschecks_time20:41:200
27353662360,3sleep10-21swapper/122:51:361
2510228993631,4cyclictest1676926-21kworker/u8:3+flush-8:020:01:331
2510228993630,4cyclictest2676382-21kworker/u8:1+flush-8:022:41:271
2510228993629,5cyclictest1676926-21kworker/u8:3+flush-8:020:26:311
2510224993629,5cyclictest2725783-21latency_hist22:45:010
2510224993626,8cyclictest2552430-21/usr/sbin/munin19:51:270
2510224993621,13cyclictest2771182-21fschecks_time23:31:190
2510228993530,4cyclictest2596527-21kworker/u8:0+flush-8:020:46:271
2510228993528,5cyclictest2716210-21apt-get22:36:161
2510224993521,12cyclictest2517751-21fschecks_time19:16:190
2510224993519,14cyclictest2815951-21fschecks_time00:16:180
2510228993429,4cyclictest2800387-21kworker/u8:0+flush-8:000:26:301
2510228993427,5cyclictest2676382-21kworker/u8:1+flush-8:023:36:331
2510228993427,5cyclictest2596527-21kworker/u8:0+flush-8:023:21:301
2510228993328,4cyclictest2800387-21kworker/u8:0+events_unbound00:21:321
2510228993328,4cyclictest2510097-21kworker/u8:0+flush-8:019:41:311
2510228993328,4cyclictest2500520-21kworker/u8:1+events_unbound19:56:451
2510228993328,3cyclictest1676926-21kworker/u8:3+flush-8:019:20:011
2510228993327,4cyclictest2500520-21kworker/u8:1+events_unbound20:56:321
2510228993323,7cyclictest2750517-21apt-get23:10:001
2510228993321,8cyclictest2596527-21kworker/u8:0+events_unbound21:46:151
2510224993328,4cyclictest2562028-21sendmail20:00:000
2510224993327,4cyclictest2661246-21unixbench_singl21:36:350
2510228993227,3cyclictest2676380-21systemd-run21:55:011
2510228993226,4cyclictest2647028-21apt-get21:26:151
2510228993226,4cyclictest2596527-21kworker/u8:0+events_unbound23:31:191
2510228993224,6cyclictest2740944-21apt-get23:01:151
2510228993223,7cyclictest2526085-21ntpq19:21:261
2510228993222,7cyclictest2631853-21latency_hist21:10:001
2510224993226,4cyclictest2810995-21fschecks_time00:11:190
2510224993226,4cyclictest2671077-21unixbench_multi21:46:360
2510224993223,7cyclictest2745877-21/usr/sbin/munin23:06:260
25054252324,9sleep10-21swapper/119:05:191
2510228993126,3cyclictest2814908-21unixbench_multi00:11:341
2510228993125,5cyclictest2800387-21kworker/u8:0+flush-8:000:06:311
2510228993125,4cyclictest2567300-21apt-get20:06:141
2510228993125,3cyclictest2649611-21kworker/u8:2+events_unbound21:35:011
2510228993124,5cyclictest2557036-21cron19:55:001
2510228993117,10cyclictest280-21systemd-journal19:14:531
2510224993125,4cyclictest2736280-21fschecks_count22:56:200
2510224993125,4cyclictest2562637-21fschecks_count20:01:200
2510224993125,4cyclictest2522672-21fschecks_time19:21:180
2510224993124,6cyclictest2800387-21kworker/u8:0+flush-8:000:21:190
2510224993124,5cyclictest2755283-21grep23:11:360
2510224993122,7cyclictest2735635-21cron22:55:000
2510224993117,12cyclictest2726471-21fschecks_time22:46:190
2510233993027,2cyclictest2805305-21apt-key00:05:012
2510233993025,3cyclictest2755285-21unixbench_multi23:11:362
2510228993025,3cyclictest2686969-21cut22:06:191
2510228993023,5cyclictest280-21systemd-journal20:37:561
2510228993022,5cyclictest2733633-21kworker/u8:2+flush-8:023:16:331
2510228993019,8cyclictest280-21systemd-journal22:20:001
2510224993025,4cyclictest2510097-21kworker/u8:0+events_unbound19:39:060
2510224993025,3cyclictest2641727-21sh21:20:000
2510224993025,3cyclictest2641727-21sh21:20:000
2510224993025,3cyclictest2592546-21fschecks_time20:31:200
2510224993024,4cyclictest2835035-21cron00:35:000
2510224993024,4cyclictest2790930-21fschecks_time23:51:180
2510224993024,4cyclictest2696757-21fschecks_count22:16:200
2510224993024,4cyclictest2581664-21unixbench_singl20:16:360
2510224993024,4cyclictest2572586-21fschecks_time20:11:200
2510224993021,7cyclictest280-21systemd-journal00:30:010
2510233992925,2cyclictest2814936-21unixbench_singl00:11:352
2510233992925,2cyclictest2582473-21aten2_r5power_v20:21:182
2510228992922,5cyclictest280-21systemd-journal22:49:571
2510228992922,5cyclictest2701424-21apt-get22:21:151
2510228992920,6cyclictest280-21systemd-journal00:00:571
2510224992925,2cyclictest2682240-21irqcore22:01:230
2510224992923,4cyclictest2756268-21fschecks_count23:16:190
2510224992923,4cyclictest2745548-21cron23:05:000
2510224992923,4cyclictest2672019-21cpuspeed_turbos21:51:190
2510224992923,4cyclictest2510729-21fschecks_count19:11:190
2510224992920,7cyclictest2621415-21unixbench_singl20:56:350
2510233992824,2cyclictest2806039-21fschecks_time00:06:212
2510233992824,2cyclictest2781097-21fschecks_time23:41:192
2510233992824,2cyclictest2671077-21unixbench_multi21:46:362
2510233992823,4cyclictest2733633-21kworker/u8:2-ext4-rsv-conversion00:20:002
2510228992824,3cyclictest2596527-21kworker/u8:0+events_unbound21:11:191
2510228992824,3cyclictest2596527-21kworker/u8:0+events_unbound21:11:191
2510228992822,4cyclictest1676926-21kworker/u8:3+events_unbound19:46:191
2510228992820,6cyclictest1676926-21kworker/u8:3+flush-8:019:31:201
2510224992822,4cyclictest2839970-21cron00:40:000
2510224992822,4cyclictest2795756-21cpuspeed_turbos23:56:180
2510224992822,4cyclictest2597499-21fschecks_time20:36:220
2510224992821,5cyclictest2662216-21fschecks_count21:41:190
2510224992818,8cyclictest280-21systemd-journal23:30:000
2510224992818,8cyclictest280-21systemd-journal23:30:000
2510233992720,5cyclictest280-21systemd-journal22:50:002
2510228992721,4cyclictest2780746-21apt-get23:41:141
2510228992720,5cyclictest2790614-21apt-get23:51:141
2510228992715,9cyclictest2541996-21apt-get19:40:001
2510224992722,3cyclictest2532731-21fschecks_count19:31:200
2510224992721,4cyclictest2607323-21fschecks_count20:46:190
2510224992721,4cyclictest2527606-21fschecks_time19:26:180
251022499271,3cyclictest2719220-21grep22:36:270
2510233992623,2cyclictest2627293-21aten2_r5power_c21:06:172
2510233992622,2cyclictest2532670-21cpuspeed_turbos19:31:182
2510228992623,2cyclictest2683854-21kthreadcore22:01:251
2510228992622,3cyclictest2596527-21kworker/u8:0+events_unbound23:26:301
2510228992622,3cyclictest2596527-21kworker/u8:0+events_unbound23:26:291
2510224992621,3cyclictest2633125-21kthreadcore21:11:240
2510224992621,3cyclictest2633125-21kthreadcore21:11:240
2510224992621,3cyclictest2582651-21fschecks_count20:21:200
2510224992620,4cyclictest2705685-21unixbench_singl22:21:360
2510224992620,4cyclictest2642445-21fschecks_time21:21:210
2510224992620,4cyclictest2541996-21apt-get19:40:020
2510233992522,2cyclictest2746193-21fschecks_count23:06:202
2510233992522,2cyclictest2740975-21aten2_r5power_c23:01:172
2510233992519,4cyclictest2500520-21kworker/u8:1+flush-8:019:11:242
2510228992519,4cyclictest2596527-21kworker/u8:0+flush-8:021:01:301
2510228992519,4cyclictest2581990-21cron20:20:001
2510224992521,2cyclictest2715011-21/usr/sbin/munin22:31:260
2510233992420,3cyclictest2800387-21kworker/u8:0+flush-8:000:36:222
2510233992420,2cyclictest2795746-21cpuspeed_turbos23:56:182
2510233992420,2cyclictest0-21swapper/220:55:002
2510233992419,3cyclictest2641359-21unixbench_multi21:16:362
2510233992419,3cyclictest2641359-21unixbench_multi21:16:352
2510233992414,8cyclictest2671796-21apt-get21:51:162
2510224992421,2cyclictest2786273-21irqcore23:46:220
2510224992419,3cyclictest2710600-21unixbench_multi22:26:360
2510224992417,5cyclictest2500520-21kworker/u8:1+flush-8:019:46:240
251023399234,2cyclictest27646472awk23:21:272
2510233992320,2cyclictest2701643-21cpuspeed_turbos22:21:182
2510233992319,2cyclictest2551790-21unixbench_singl19:46:342
2510228992319,2cyclictest0-21swapper/122:56:231
2510228992319,2cyclictest0-21swapper/121:36:151
2510228992318,3cyclictest2605960-21ntp_states20:41:321
25100372233,7sleep20-21swapper/219:09:582
2510233992219,2cyclictest2721525-21fschecks_time22:41:202
2510233992219,2cyclictest2696693-21cpuspeed_turbos22:16:192
2510233992218,2cyclictest2607089-21aten2_r5power_c20:46:172
2510233992218,2cyclictest2557683-21fschecks_count19:56:202
2510233992217,3cyclictest2646674-21cron21:25:002
2510233992213,7cyclictest2600613-21kthreadcore20:36:272
2510224992218,3cyclictest2804807-21unixbench_singl00:01:360
2510224992218,3cyclictest2651279-21unixbench_multi21:26:350
2510224992216,4cyclictest2695115-21latency22:11:270
2510224992214,6cyclictest2631923-21date21:10:000
2510233992118,2cyclictest2771122-21fschecks_count23:31:192
2510233992117,2cyclictest2577462-21aten2_r5power_e20:16:172
2510233992116,3cyclictest2657144-21cpuspeed_turbos21:36:182
2510233992115,4cyclictest2793092-21kthreadcore23:51:242
2510233992115,4cyclictest2602412-21fschecks_count20:41:202
2510228992116,4cyclictest2789453-21ntp_kernel_pll_23:46:301
2510224992116,4cyclictest2500520-21kworker/u8:1+flush-8:020:51:220
2510224992115,4cyclictest2687716-21kthreadcore22:06:230
2510224992114,5cyclictest401-21dbus-daemon00:10:010
25097792218,7sleep00-21swapper/019:06:390
2510233992017,2cyclictest2632553-21fschecks_time21:11:202
2510233992017,2cyclictest2632553-21fschecks_time21:11:202
2510233992016,3cyclictest2706647-21fschecks_count22:26:192
2510233992016,3cyclictest2681023-21unixbench_singl21:56:352
2510233992016,2cyclictest0-21swapper/219:15:042
2510233992015,3cyclictest2691778-21cpuspeed_turbos22:11:192
2510233992014,4cyclictest2627059-21base6421:05:012
251022499206,5cyclictest2677110-21basename21:56:210
2510233991916,2cyclictest2716561-21fschecks_time22:36:212
2510233991915,2cyclictest2775777-21aten2_r5power_c23:36:162
25060002193,9sleep30-21swapper/319:06:223
251023399182,15cyclictest0-21swapper/220:06:332
2510233991814,3cyclictest2760599-21sh23:20:002
2510233991814,2cyclictest2681942-21cpuspeed_turbos22:01:182
2510233991814,2cyclictest0-21swapper/220:31:272
2510233991813,3cyclictest2617355-21cpuspeed_turbos20:56:182
2510233991813,3cyclictest0-21swapper/219:36:172
2510233991812,5cyclictest280-21systemd-journal21:30:012
2510233991812,3cyclictest2737121-21kthreadcore22:56:232
2510233991812,3cyclictest2576819-21sh20:15:002
2510233991811,5cyclictest2531946-21base6419:30:012
2510233991713,2cyclictest2557041-21sh19:55:002
2510233991713,2cyclictest0-21swapper/200:26:162
2510233991712,3cyclictest0-21swapper/221:31:202
251023399163,7cyclictest2765874-21apt-get23:26:162
251023399163,7cyclictest2765874-21apt-get23:26:162
251023399162,8cyclictest2824329-21ntpq00:21:282
251023399162,13cyclictest0-21swapper/222:05:312
251023399162,13cyclictest0-21swapper/200:31:142
2510233991612,2cyclictest0-21swapper/219:45:012
251023399161,11cyclictest2522667-21/usr/sbin/munin19:21:182
251023399161,10cyclictest2731078-21apt-get22:51:172
251023399157,6cyclictest2785965-21grep23:46:202
251023399157,6cyclictest2562906-21sed20:01:232
2510233991510,3cyclictest0-21swapper/222:31:212
2510233991510,3cyclictest0-21swapper/221:41:242
28005002142,8sleep30-21swapper/300:01:183
27605842144,6sleep30-21swapper/323:19:593
27459002142,8sleep30-21swapper/323:06:163
25941912142,8sleep30-21swapper/320:31:263
25572192143,6sleep30-21swapper/319:55:023
28344992132,7sleep30-21swapper/300:31:363
27247772132,7sleep30-21swapper/322:41:283
26787662133,5sleep30-21swapper/321:56:253
25877592132,7sleep30-21swapper/320:26:203
25784622132,6sleep30-21swapper/320:16:253
25768122132,7sleep30-21swapper/320:15:003
25419772130,7sleep30-21swapper/319:40:013
28257652122,6sleep30-21swapper/300:26:183
28209312122,6sleep30-21swapper/300:21:203
28198972122,6sleep30-21swapper/300:16:353
28106482122,6sleep30-21swapper/300:11:173
28061722121,7sleep30-21swapper/300:06:243
27997622122,6sleep30-21swapper/323:56:363
27903702122,5sleep30-21swapper/323:50:023
27853252121,7sleep30-21swapper/323:45:013
27762282122,6sleep30-21swapper/323:36:223
27750142122,6sleep30-21swapper/323:31:363
27626882123,5sleep30-21swapper/323:21:253
27514662122,6sleep30-21swapper/323:11:223
27408232122,5sleep30-21swapper/323:00:023
26964392122,6sleep30-21swapper/322:16:163
26915582122,6sleep30-21swapper/322:11:183
26866232122,6sleep30-21swapper/322:06:173
26665362122,5sleep30-21swapper/321:45:023
26631722122,6sleep30-21swapper/321:41:243
26564642122,6sleep30-21swapper/321:33:423
26477402122,6sleep30-21swapper/321:26:243
26370612122,6sleep30-21swapper/321:15:203
26370612122,6sleep30-21swapper/321:15:203
26210802122,6sleep30-21swapper/320:56:343
26110642122,6sleep30-21swapper/320:46:353
25669732122,5sleep30-21swapper/320:05:003
25461672122,7sleep30-21swapper/319:41:253
25368002122,6sleep30-21swapper/319:31:543
25234362122,6sleep30-21swapper/319:21:233
25104392123,5sleep30-21swapper/319:11:163
28353642112,5sleep30-21swapper/300:36:173
27860542112,5sleep30-21swapper/323:46:213
27663522112,6sleep30-21swapper/323:26:233
27663522112,6sleep30-21swapper/323:26:233
27362562112,5sleep30-21swapper/322:56:213
27345812112,6sleep30-21swapper/322:51:273
27257922112,4sleep30-21swapper/322:45:013
27160132112,5sleep30-21swapper/322:35:023
27066032110,7sleep30-21swapper/322:26:193
27017972112,5sleep30-21swapper/322:21:213
26815882112,5sleep30-21swapper/322:00:023
26722912112,5sleep30-21swapper/321:51:243
26567752112,6sleep30-21swapper/321:35:023
26459572112,6sleep30-21swapper/321:21:343
26362212112,5sleep30-21swapper/321:11:353
26362212112,5sleep30-21swapper/321:11:353
26276072112,5sleep30-21swapper/321:06:213
26260962112,5sleep30-21swapper/321:01:363
26124772112,6sleep30-21swapper/320:51:243
26024492112,5sleep30-21swapper/320:41:213
25822392112,5sleep30-21swapper/320:20:023
25524592112,5sleep30-21swapper/319:51:173
25477942112,5sleep30-21swapper/319:46:193
25312682112,5sleep30-21swapper/319:26:333
25159182112,5sleep30-21swapper/319:15:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional