You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-04 - 06:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Aug 04, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2556165995348,4cyclictest2619020-21kworker/u8:0+flush-259:020:35:001
2556163994945,3cyclictest2863912-21gpgv00:05:010
2556163994643,2cyclictest2681538-21kworker/u8:0+flush-259:022:10:010
2556165994541,3cyclictest2681538-21kworker/u8:0+events_unbound00:00:151
2556169994439,3cyclictest2613523-21gpgv20:04:592
2556165994437,5cyclictest2811455-21base6423:15:011
2556169994339,3cyclictest2613097-21kworker/u8:3+flush-259:020:50:012
2556163994338,4cyclictest2869411-21kworker/u8:3+flush-259:000:20:010
2556169994238,3cyclictest2587819-21kworker/u8:2+flush-259:020:40:012
2556165994237,3cyclictest2795495-21gpgv23:00:001
2556165994134,5cyclictest335557-21systemd-journal21:47:591
2556165994037,2cyclictest2754052-21kworker/u8:3+events_unbound22:25:001
2556165993834,3cyclictest2666207-21kworker/u8:4+events_unbound21:07:001
2556169993734,2cyclictest2681538-21kworker/u8:0+flush-259:023:40:002
2556165993733,2cyclictest2560933-21kworker/u8:1+events_unbound20:00:191
2556163993731,4cyclictest2900492-21latency_hist00:40:000
2556169993631,3cyclictest2779866-21latency_hist22:45:002
2556165993632,3cyclictest2800973-21kworker/u8:2+events_unbound23:40:201
2556165993632,3cyclictest2681538-21kworker/u8:0+events_unbound00:36:021
2556165993632,3cyclictest2587819-21kworker/u8:2+flush-259:021:00:011
2556165993631,4cyclictest2666207-21kworker/u8:4+events_unbound21:02:011
2556165993629,5cyclictest2702305-21latency_hist21:30:011
2556165993531,3cyclictest2697123-21kworker/u8:1+events_unbound22:06:561
2556165993431,2cyclictest2681538-21kworker/u8:0+flush-259:000:35:001
2556172993329,3cyclictest335557-21systemd-journal19:56:013
2556165993325,6cyclictest2873653-21ntpq00:10:201
2556172993226,4cyclictest2728204-21latency_hist21:55:003
2556172993226,4cyclictest2644912-21latency_hist20:35:003
2556172993225,5cyclictest2890128-21latency_hist00:30:003
2556169993229,2cyclictest2619020-21kworker/u8:0+flush-259:020:25:002
2556165993228,3cyclictest2681538-21kworker/u8:0+events_unbound22:02:001
2556165993228,3cyclictest2587819-21kworker/u8:2+events_unbound22:12:081
2556169993126,3cyclictest335557-21systemd-journal22:30:012
2556165993128,2cyclictest2800973-21kworker/u8:2+events_unbound23:20:181
2556165993127,3cyclictest2697123-21kworker/u8:1+events_unbound21:36:431
2556165993125,4cyclictest335557-21systemd-journal19:52:011
2556163993125,4cyclictest2665735-21cp20:55:000
2556169993025,4cyclictest2660618-21apt-get20:50:132
2556169993023,5cyclictest335557-21systemd-journal22:50:002
2556165993026,3cyclictest2759391-21kworker/u8:1+events_unbound22:29:011
2556165993026,3cyclictest2681746-21kworker/u8:3+events_unbound21:16:441
2556165993026,3cyclictest2587819-21kworker/u8:2+events_unbound21:23:001
2556165993026,3cyclictest2571694-21kworker/u8:0+events_unbound19:30:011
2556165993025,3cyclictest2816595-21kworker/u8:1+flush-259:023:20:001
2556163993023,5cyclictest2701392-21ntpq21:25:220
2556169992923,4cyclictest2748866-21latency_hist22:15:002
2556165992926,2cyclictest2613097-21kworker/u8:3+events_unbound20:47:021
2556165992926,2cyclictest2587819-21kworker/u8:2+events_unbound20:42:011
2556165992925,3cyclictest2697123-21kworker/u8:1+events_unbound21:44:011
2556165992924,4cyclictest2613097-21kworker/u8:3+events_unbound20:28:021
2556163992923,4cyclictest2707476-21latency_hist21:35:000
2556169992822,4cyclictest2764332-21latency_hist22:30:002
2556165992825,2cyclictest2681538-21kworker/u8:0+events_unbound21:10:231
2556165992824,3cyclictest2790235-21kworker/u8:1+events_unbound23:02:141
2556169992723,3cyclictest2785313-21apt-get22:50:142
2556169992723,3cyclictest2681538-21kworker/u8:0+flush-259:023:55:262
2556165992725,1cyclictest2681538-21kworker/u8:0+events_unbound00:05:241
2556165992722,4cyclictest2800973-21kworker/u8:2+events_unbound23:35:021
2556172992621,3cyclictest2795387-21apt-get23:00:013
2556172992620,4cyclictest335557-21systemd-journal00:25:003
2556169992623,2cyclictest2795375-21latency_hist23:00:002
2556169992622,3cyclictest2738780-21apt-get22:05:142
2556165992620,4cyclictest2754005-21latency_hist22:20:001
2556163992621,4cyclictest2801195-21/usr/sbin/munin23:05:190
2556169992521,3cyclictest2697123-21kworker/u8:1+flush-259:021:40:262
2556169992519,4cyclictest2822434-21diskstats23:25:142
2556165992522,2cyclictest2619020-21kworker/u8:0+flush-259:020:35:191
2556165992522,2cyclictest1973988-21kworker/u8:4+flush-259:019:10:161
2556165992521,3cyclictest2769748-21kworker/u8:4+flush-259:022:37:111
2556165992521,3cyclictest2681538-21kworker/u8:0+events_unbound23:47:091
2556163992520,4cyclictest335557-21systemd-journal21:09:590
2556172992419,4cyclictest2603044-21latency_hist19:55:003
2556172992418,4cyclictest2556082-21latency_hist19:10:003
2556169992420,3cyclictest2571694-21kworker/u8:0+flush-259:019:45:362
2556165992420,3cyclictest2822270-21apt-get23:25:121
2556163992420,3cyclictest2800973-21kworker/u8:2+flush-259:023:35:170
2556163992420,3cyclictest2800973-21kworker/u8:2+flush-259:000:15:010
2556163992418,4cyclictest2592769-21latency_hist19:45:010
255616399240,22cyclictest2613804-21cat20:05:010
2556169992317,4cyclictest2884907-21latency_hist00:25:012
2556165992320,2cyclictest2800973-21kworker/u8:2+flush-259:000:20:241
2556165992319,3cyclictest2822023-21kworker/u8:3+flush-259:023:30:251
2556165992319,3cyclictest2681538-21kworker/u8:0+flush-259:023:55:161
2556165992319,3cyclictest2587819-21kworker/u8:2+events_unbound20:15:141
255616399239,12cyclictest2571981-21cpuspeed_turbos19:25:120
2556163992320,2cyclictest2884912-21idleruntime-cro00:25:000
255616399230,21cyclictest2774692-21idleruntime-cro22:40:000
2556172992219,2cyclictest2681538-21kworker/u8:0+flush-259:022:50:203
2556172992219,2cyclictest2665765-21gpgv20:55:013
2556172992218,3cyclictest2832488-21base6423:35:013
2556172992217,4cyclictest335557-21systemd-journal20:20:003
2556165992219,2cyclictest2800973-21kworker/u8:2+events_unbound23:05:131
2556165992219,2cyclictest2681538-21kworker/u8:0+events_unbound00:27:221
2556165992219,2cyclictest2560933-21kworker/u8:1+events_unbound19:30:171
2556165992218,3cyclictest2697123-21kworker/u8:1+events_unbound21:51:471
2556163992218,3cyclictest2707502-21kworker/u8:3+flush-259:021:40:010
2556163992216,4cyclictest2619020-21kworker/u8:0+flush-259:020:45:000
255616399220,21cyclictest2748151-21/usr/sbin/munin22:10:230
2556172992115,4cyclictest2634573-21latency_hist20:25:013
2556172992114,5cyclictest2837930-21latency_hist23:40:013
255617299210,19cyclictest1-21systemd21:45:013
2556169992115,4cyclictest2728444-21/usr/sbin/munin21:55:152
2556165992118,2cyclictest2571694-21kworker/u8:0+events_unbound19:35:021
2556165992117,3cyclictest2619020-21kworker/u8:0+events_unbound20:50:001
2556165992116,2cyclictest2560933-21kworker/u8:1+events_unbound19:55:141
2556163992115,4cyclictest2691914-21latency_hist21:20:000
255616399210,19cyclictest2634576-21turbostat20:25:000
2556172992016,3cyclictest335557-21systemd-journal21:35:013
2556172992015,4cyclictest2571656-21latency_hist19:25:013
2556169992013,5cyclictest2680687-21ntpq21:05:232
2556165992017,2cyclictest2697123-21kworker/u8:1+events_unbound21:59:021
2556165992016,3cyclictest2587819-21kworker/u8:2+events_unbound22:30:171
255616399208,11cyclictest60350irq/132-enp0s29f1:rx-023:00:000
255616399205,13cyclictest335557-21systemd-journal20:10:000
255616399201,5cyclictest2570811-21ntpq19:20:240
2556163992014,4cyclictest2608207-21latency_hist20:00:000
255616399200,18cyclictest2624757-21grep20:15:170
2556165991916,2cyclictest2619020-21kworker/u8:0+events_unbound20:20:171
2556165991916,2cyclictest1973988-21kworker/u8:4+events_unbound19:19:011
2556165991915,3cyclictest2869411-21kworker/u8:3+events_unbound00:15:211
255616399197,10cyclictest0-21swapper/023:55:210
255616399193,2cyclictest2890400-21apt00:30:120
255616399192,2cyclictest2581503-21ntpq19:30:200
255616399191,6cyclictest2810467-21ntpq23:10:230
255616399191,5cyclictest2775379-21irqcore22:40:170
2556163991912,5cyclictest2643992-21ntpq20:30:200
2556163991910,7cyclictest60350irq/132-enp0s29f1:rx-021:45:170
255616399190,4cyclictest2670338-21ntpq20:55:230
2556172991815,2cyclictest2895297-21idleruntime-cro00:35:003
2556172991815,2cyclictest2560933-21kworker/u8:1+flush-259:019:15:273
2556169991815,2cyclictest2874546-21idleruntime-cro00:15:002
2556169991815,2cyclictest2629419-21systemd-run20:19:592
2556169991814,3cyclictest509-21rs:main2
2556169991812,4cyclictest2800973-21kworker/u8:2+flush-259:023:10:002
255616399186,10cyclictest0-21swapper/019:55:010
255616399182,2cyclictest0-21swapper/020:10:180
255616399181,3cyclictest2560304-21/usr/sbin/munin19:10:190
255616399181,2cyclictest2890117-21idleruntime-cro00:29:590
255616399181,2cyclictest2838193-21apt-get23:40:110
255616399181,2cyclictest2785721-21ps22:50:180
255616399181,2cyclictest2597028-21ntpq19:45:360
255616399181,1cyclictest2800049-21ntpq23:00:220
255616399180,4cyclictest2869367-21sh00:10:000
255616399180,4cyclictest2815912-21/usr/sbin/munin23:15:210
255616399180,4cyclictest2749132-21apt22:15:120
255616399180,4cyclictest2638741-21/usr/sbin/munin20:25:180
255616399180,3cyclictest2818133-21ps23:20:170
255616399180,3cyclictest2764336-21sh22:30:000
255616399180,3cyclictest2727393-21nvmesmart_nvme021:50:230
2556172991714,1cyclictest0-21swapper/323:15:003
2556172991713,3cyclictest2587819-21kworker/u8:2+flush-259:021:45:193
2556169991712,4cyclictest2614097-21apt-get20:05:112
2556169991711,4cyclictest335557-21systemd-journal21:40:002
2556169991711,4cyclictest2894403-21ntpq00:30:222
2556165991714,2cyclictest2666207-21kworker/u8:4+events_unbound21:30:241
2556165991714,2cyclictest2571694-21kworker/u8:0+events_unbound19:40:161
2556165991714,2cyclictest2560933-21kworker/u8:1+events_unbound20:10:221
2556165991713,3cyclictest2681538-21kworker/u8:0+events_unbound22:50:201
2556165991713,3cyclictest2587819-21kworker/u8:2+events_unbound20:05:201
255616399178,8cyclictest60350irq/132-enp0s29f1:rx-023:25:130
255616399173,2cyclictest2783370-21kthreadcore22:45:220
255616399171,3cyclictest2843473-21grep23:45:150
2556163991713,3cyclictest2619020-21kworker/u8:0+flush-259:020:35:250
255616399171,2cyclictest2682197-21ps21:10:170
255616399171,2cyclictest2586707-21ntpq19:35:220
255616399170,4cyclictest2848608-21cpuspeed_turbos23:50:130
255616399170,4cyclictest2831364-21needreboot23:30:200
255616399170,4cyclictest2728767-21/usr/sbin/munin21:55:150
255616399170,4cyclictest2671496-21/usr/sbin/munin21:00:120
255616399170,3cyclictest2758602-21/usr/sbin/munin22:20:230
255616399170,3cyclictest2733647-21apt-get22:00:130
255616399170,3cyclictest2655833-21if_enp0s29f120:45:170
255616399170,3cyclictest2565692-21rt-features19:15:250
2556172991613,2cyclictest2635251-21irqcore20:25:163
2556172991611,4cyclictest2686719-21latency_hist21:15:003
2556172991610,4cyclictest2874545-21latency_hist00:15:013
2556169991612,3cyclictest2697123-21kworker/u8:1+flush-259:022:00:162
2556169991611,3cyclictest2723014-21cron21:50:012
2556169991610,4cyclictest2863791-21latency_hist00:05:012
2556163991614,1cyclictest60350irq/132-enp0s29f1:rx-021:40:150
255616399161,2cyclictest2692288-21cpuspeed_turbos21:20:140
255616399161,2cyclictest0-21swapper/019:10:010
255616399160,3cyclictest2764706-21cpuspeed_turbos22:30:140
2556172991511,2cyclictest2681538-21kworker/u8:0+flush-259:022:50:003
2556172991510,4cyclictest2560328-21ntpq19:10:203
255617299150,3cyclictest2753161-21ntpq22:15:213
255616999159,5cyclictest509-21rs:main2
255616999156,3cyclictest2971-21cron20:29:592
2556169991512,1cyclictest0-21swapper/220:10:192
2556169991511,3cyclictest2697095-21sh21:25:002
2556169991511,3cyclictest2681538-21kworker/u8:0+flush-259:021:15:202
2556169991511,2cyclictest0-21swapper/219:15:192
255617299149,4cyclictest2577655-21diskstats19:30:133
2556172991410,3cyclictest2671184-21latency_hist21:00:003
2556172991410,3cyclictest2587819-21kworker/u8:2+flush-259:021:00:243
255616999149,4cyclictest2681538-21kworker/u8:0+flush-259:021:10:182
2556169991411,2cyclictest0-21swapper/200:05:182
2556169991411,1cyclictest0-21swapper/219:30:012
2556169991410,3cyclictest2869411-21kworker/u8:3+flush-259:000:15:222
2556169991410,3cyclictest2640085-21cpuspeed_turbos20:30:122
2556165991410,3cyclictest2571694-21kworker/u8:0+events_unbound19:50:001
2556172991311,1cyclictest509-21rs:main3
2556172991310,2cyclictest2795375-21latency_hist23:00:013
2556172991310,2cyclictest2765029-21sed22:30:173
2556172991310,2cyclictest2650429-21cpuspeed_turbos20:40:133
255616999139,2cyclictest2567116-21irqcore19:20:182
255616999139,2cyclictest0-21swapper/219:50:252
255616999138,3cyclictest2671853-21irqcore21:00:162
2556169991310,2cyclictest2796173-21cpuspeed_turbos23:00:152
2556169991310,2cyclictest2650372-21cpuspeed_turbos20:40:122
255616599139,3cyclictest2681538-21kworker/u8:0+events_unbound22:49:121
2556165991310,2cyclictest2769553-21kworker/u8:3+events_unbound22:40:151
2556165991310,2cyclictest2681538-21kworker/u8:0+flush-259:023:50:191
255617299129,2cyclictest2838277-21cpuspeed_turbos23:40:113
255617299129,2cyclictest2758667-21unixbench_multi22:20:233
255617299129,2cyclictest2593309-21fschecks_time19:45:303
2556172991210,1cyclictest2827163-21idleruntime-cro23:30:003
255616999129,2cyclictest2845644-21kthreadcore23:45:202
255616999129,1cyclictest2583067-21irqcore19:35:162
255616999128,3cyclictest2769553-21kworker/u8:3+flush-259:022:35:482
255616999126,4cyclictest2811271-21cron23:15:002
255617299118,2cyclictest0-21swapper/323:20:003
255617299117,3cyclictest2864483-21apt-get00:05:123
255616999115,4cyclictest1-21systemd23:20:002
255616999114,5cyclictest2587854-21apt-get19:40:152
255616999111,8cyclictest2728205-21awk21:55:012
255617299107,2cyclictest2769748-21kworker/u8:4+flush-259:022:35:173
255617299106,3cyclictest2681538-21kworker/u8:0+flush-259:022:40:263
255616999109,0cyclictest0-21swapper/200:35:172
255616999106,3cyclictest2831368-21uname23:30:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional