You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 00:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed Apr 22, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
259426521740,3sleep3481ktimers/308:11:143
27126102800,6sleep30-21swapper/310:11:143
2530753996151,7cyclictest2726675-21kworker/u8:2+events_unbound10:26:201
27464852590,3sleep375-21kworker/3:1+mm_percpu_wq10:45:013
2530753995649,6cyclictest2716264-21kworker/u8:1+flush-8:010:16:251
2530753995649,6cyclictest2716264-21kworker/u8:1+flush-8:010:16:251
2530753995646,7cyclictest2652650-21diskstats09:11:101
2530753995548,5cyclictest2741778-21kworker/u8:0+flush-8:010:41:251
2530753995548,5cyclictest2716264-21kworker/u8:1+flush-8:010:51:251
2530753995546,6cyclictest2597628-21kworker/u8:1+flush-8:009:16:201
2530753995447,5cyclictest2477782-21kworker/u8:3+events_unbound08:11:231
2530753995446,6cyclictest2756062-21kworker/u8:3+flush-8:011:01:261
2530753995445,6cyclictest2760979-21kworker/u8:4+flush-8:012:26:191
2530753995347,4cyclictest2493695-21kworker/u8:0+events_unbound07:41:201
2530753995346,4cyclictest2800912-21kworker/u8:1+flush-8:011:51:101
2530753995345,6cyclictest2821244-21kworker/u8:1+flush-8:012:21:211
2530753995344,6cyclictest2641925-21latency_hist09:00:011
2530753995343,7cyclictest2726453-21latency_hist10:25:001
2530749995344,6cyclictest2760979-21kworker/u8:4+flush-8:011:26:110
2530753995246,5cyclictest2641432-21kworker/u8:2+flush-8:009:01:221
2530753995245,5cyclictest2493695-21kworker/u8:0+flush-8:007:11:211
2530753995241,5cyclictest2760979-21kworker/u8:4+flush-8:011:31:111
2530753995144,5cyclictest2641432-21kworker/u8:2+flush-8:009:56:251
2530753995144,5cyclictest2617213-21kworker/u8:3+flush-8:008:46:211
2530757995041,6cyclictest2562640-21cat07:40:012
2530753995045,4cyclictest2641432-21kworker/u8:2+events_unbound09:26:231
2530753995045,3cyclictest2641432-21kworker/u8:2+events_unbound09:36:221
2530753995043,5cyclictest2667102-21kworker/u8:3+flush-8:009:51:181
2530753994945,3cyclictest2510794-21kworker/u8:2+flush-8:007:16:271
2530753994944,3cyclictest2641432-21kworker/u8:2+events_unbound09:41:251
2530749994939,7cyclictest2716537-21latency_hist10:15:000
2530753994842,4cyclictest2760979-21kworker/u8:4+events_unbound11:21:141
2530753994842,4cyclictest2701726-21kworker/u8:0+flush-8:010:06:201
2530753994842,4cyclictest2493695-21kworker/u8:0+flush-8:007:56:251
2530753994842,4cyclictest2493695-21kworker/u8:0+events_unbound09:21:111
2530753994841,5cyclictest2493695-21kworker/u8:0+flush-8:008:21:221
2530749994840,5cyclictest280-21systemd-journal07:50:000
2530753994743,2cyclictest2861212-21latency_hist12:40:001
2530753994742,4cyclictest2821244-21kworker/u8:1+flush-8:012:01:221
2530753994742,3cyclictest2760979-21kworker/u8:4+events_unbound12:20:001
2530753994742,3cyclictest2716264-21kworker/u8:1+flush-8:010:56:251
2530753994742,3cyclictest2716264-21kworker/u8:1+events_unbound10:46:121
2530753994741,5cyclictest2667102-21kworker/u8:3+events_unbound09:46:221
2530753994741,5cyclictest2493695-21kworker/u8:0+flush-8:007:51:231
2530753994740,4cyclictest2510794-21kworker/u8:2+events_unbound07:36:231
2530753994732,11cyclictest280-21systemd-journal11:06:101
2530753994640,4cyclictest2741778-21kworker/u8:0+events_unbound12:06:201
2530753994639,5cyclictest2641432-21kworker/u8:2+flush-8:009:06:221
2530749994636,8cyclictest2705569-21ntpq10:01:210
2530753994537,4cyclictest2641432-21kworker/u8:2+flush-8:009:31:221
2530749994536,7cyclictest280-21systemd-journal12:00:000
2530757994420,21cyclictest2737157-21diskstats10:36:112
2530753994441,2cyclictest2701726-21kworker/u8:0+flush-8:010:01:261
2530753994440,3cyclictest2477782-21kworker/u8:3+events_unbound07:46:261
2530753994438,4cyclictest2760979-21kworker/u8:4+flush-8:011:26:221
2530753994438,4cyclictest2597628-21kworker/u8:1+flush-8:008:16:211
2530753994437,5cyclictest2597628-21kworker/u8:1+flush-8:008:41:221
2530753994338,4cyclictest2667102-21kworker/u8:3+flush-8:010:31:231
2530753994337,3cyclictest2760979-21kworker/u8:4+flush-8:011:46:261
2530753994336,5cyclictest2701726-21kworker/u8:0+flush-8:010:11:221
2530753994336,4cyclictest2493695-21kworker/u8:0+events_unbound07:31:171
2530749994334,7cyclictest2556399-21ntpq07:31:220
25952712420,1sleep00-21swapper/008:11:160
2530757994221,6cyclictest280-21systemd-journal07:44:592
2530753994235,5cyclictest2726675-21kworker/u8:2+flush-8:010:36:211
2530753994137,3cyclictest2617213-21kworker/u8:3+events_unbound08:51:231
2530753994137,3cyclictest2477782-21kworker/u8:3+flush-8:008:06:271
2530753994137,3cyclictest2477782-21kworker/u8:3+flush-8:008:06:261
2530749994134,4cyclictest2756325-21latency_hist10:55:010
2530753994035,3cyclictest2493695-21kworker/u8:0+flush-8:008:31:261
2530753994034,4cyclictest2760979-21kworker/u8:4+events_unbound11:36:231
2530753994031,6cyclictest280-21systemd-journal08:26:101
253074999401,36cyclictest2572513-21munin-run07:50:000
2530757993933,4cyclictest2731382-21apt-get10:30:012
2530753993934,3cyclictest2760979-21kworker/u8:4+events_unbound11:15:011
2530749993932,5cyclictest2662378-21grep09:21:100
2530749993930,6cyclictest2641066-21ntpq08:56:200
2530757993818,3cyclictest2731979-21aten2_r5power_c10:31:092
2530757993817,8cyclictest2825934-21apt-get12:05:002
2530749993829,7cyclictest2657314-21apt-get09:16:060
2530749993829,6cyclictest2781167-21latency_hist11:20:010
2530757993719,2cyclictest0-21swapper/212:00:002
2530753993731,5cyclictest2760979-21kworker/u8:4+events_unbound12:11:211
2530757993620,13cyclictest2617550-21aten2_r5power_c08:36:102
2530757993618,3cyclictest0-21swapper/212:30:002
253075799360,12cyclictest2860622-21python312:36:252
2530757993526,7cyclictest280-21systemd-journal12:16:112
2530757993525,8cyclictest2602374-21awk08:20:002
2530753993523,9cyclictest2856256-21turbostat.cron12:35:001
2530753993429,4cyclictest2741778-21kworker/u8:0+events_unbound11:41:151
2530753993428,4cyclictest2552328-21cron07:30:001
2530749993426,6cyclictest280-21systemd-journal10:06:110
25304992343,6sleep10-21swapper/107:09:141
2530757993317,3cyclictest2661946-21turbostat.cron09:20:002
2530753993329,3cyclictest2741778-21kworker/u8:0+flush-8:011:56:261
2530749993325,6cyclictest2760926-21unixbench_multi10:56:260
2530757993217,3cyclictest2742213-21fschecks_time10:41:112
2530757993210,7cyclictest2716535-21cat10:15:002
2530753993227,3cyclictest2618240-21irqrtprio08:36:161
2530749993227,3cyclictest2623217-21irqrtprio08:41:140
27828612310,5sleep3451irq_work/311:21:163
2530757993124,5cyclictest2572708-21gpgv07:50:012
2530749993126,4cyclictest2726675-21kworker/u8:2+flush-8:010:26:160
2530749993123,6cyclictest280-21systemd-journal09:43:110
2530749993121,8cyclictest2616344-21ntpq08:31:220
2530749993120,8cyclictest280-21systemd-journal07:40:100
2530757993016,2cyclictest2547364-21sh07:25:002
2530749993026,2cyclictest2652935-21irqcore09:11:140
2530749993025,3cyclictest2552332-21sh07:30:000
2530749993023,5cyclictest2538053-21diskstats07:16:110
2530749993021,7cyclictest2851189-21cp12:30:000
2530753992924,3cyclictest2544916-21kthreadcore07:21:141
2530749992925,2cyclictest2732669-21irqrtprio10:31:150
2530749992924,3cyclictest2775309-21needreboot11:11:180
2530749992921,6cyclictest2587557-21latency_hist08:05:000
2530757992825,2cyclictest2841644-21aten2_r5power_p12:21:082
2530749992825,2cyclictest2836024-21cron12:15:000
2530749992824,2cyclictest2851978-21fschecks_time12:31:120
2530749992822,4cyclictest2805796-21unixbench_singl11:41:280
2530749992822,4cyclictest2716264-21kworker/u8:1+flush-8:010:21:260
2530749992822,4cyclictest2535577-21latency_hist07:15:010
2530749992820,6cyclictest280-21systemd-journal10:40:010
2530749992819,6cyclictest2651261-21ntpq09:06:220
2530749992819,6cyclictest2647138-21latency_hist09:05:010
2530757992724,2cyclictest2791650-21aten2_r5power_c11:31:082
2530757992723,2cyclictest2592883-21aten2_r5power_p08:11:092
2530757992722,3cyclictest2751065-21unixbench_singl10:46:282
2530753992721,4cyclictest280-21systemd-journal11:15:111
2530749992724,2cyclictest2607302-21cron08:25:010
2530749992723,3cyclictest2597628-21kworker/u8:1+flush-8:008:26:250
2530749992722,4cyclictest2821244-21kworker/u8:1+flush-8:012:01:160
2530749992722,3cyclictest2811666-21cpuspeed_turbos11:51:080
2530749992720,6cyclictest2597628-21kworker/u8:1+flush-8:008:47:410
2530749992717,8cyclictest280-21systemd-journal11:40:000
2530757992622,2cyclictest2775838-21unixbench_multi11:11:262
2530749992622,3cyclictest2602026-21unixbench_singl08:16:260
2530749992622,2cyclictest2582618-21sh08:00:000
2530757992518,5cyclictest2801783-21diskstats11:41:122
2530757992517,6cyclictest2701483-21ls10:00:002
2530749992521,2cyclictest2671856-21apt09:30:000
2530749992520,3cyclictest2672719-21sort09:31:140
2530749992520,3cyclictest0-21swapper/009:59:590
2530749992517,6cyclictest2691916-21/usr/sbin/munin09:51:170
2530757992420,2cyclictest2612612-21aten2_r5power_c08:31:092
2530757992419,3cyclictest2726116-21unixbench_singl10:21:272
2530757992416,6cyclictest280-21systemd-journal12:09:592
2530757992415,7cyclictest280-21systemd-journal12:30:072
253074999242,21cyclictest0-21swapper/012:16:240
2530749992420,3cyclictest2770893-21unixbench_multi11:06:270
2530749992420,3cyclictest2622164-21sendmail08:40:000
2530749992420,2cyclictest2681716-21cron09:40:000
2530749992419,3cyclictest2861230-21sendmail12:40:000
2530749992419,3cyclictest2785791-21unixbench_singl11:21:280
2530749992419,3cyclictest2588420-21sort08:06:140
2530749992419,3cyclictest2588420-21sort08:06:140
2530749992418,4cyclictest2751009-21grep10:46:280
27570872230,5sleep3481ktimers/310:56:123
2530757992314,6cyclictest2696734-21latency_hist09:55:012
2530749992319,3cyclictest2807000-21sort11:46:140
2530749992318,3cyclictest2742393-21sort10:41:140
2530757992219,2cyclictest2602796-21aten2_r5power_p08:21:092
2530757992218,2cyclictest2752042-21fschecks_time10:51:112
2530757992214,6cyclictest2655089-21cut09:11:172
2530757992213,7cyclictest2652112-21cat09:10:012
2530757992210,4cyclictest0-21swapper/209:41:082
2530753992218,3cyclictest2493695-21kworker/u8:0+flush-8:008:01:261
2530749992218,2cyclictest0-21swapper/012:21:160
2530749992216,5cyclictest2510794-21kworker/u8:2+flush-8:007:36:250
253075799212,13cyclictest2642508-21apt-get09:01:102
2530757992118,2cyclictest2671853-21idleruntime-cro09:30:002
2530757992117,2cyclictest2627768-21fschecks_time08:46:122
2530749992118,2cyclictest1-21systemd09:49:110
2530749992116,3cyclictest2720826-21mailstats10:16:240
2530749992116,3cyclictest2720826-21mailstats10:16:240
2530749992115,4cyclictest2493695-21kworker/u8:0+flush-8:008:51:260
25298612212,10sleep02529966-21/usr/sbin/munin07:06:240
2530757992017,2cyclictest2811474-21aten2_r5power_c11:51:072
2530757992017,2cyclictest2796613-21aten2_r5power_e11:36:092
2530757992015,3cyclictest2556923-21unixbench_singl07:31:292
2530757992010,8cyclictest2572454-21apt-get07:50:032
2530749992016,2cyclictest2766304-21cron11:05:000
2530749992016,2cyclictest0-21swapper/011:31:240
253075799192,12cyclictest2835275-21ntpq12:11:222
253075799192,12cyclictest2677099-21apt-get09:36:092
2530757991915,2cyclictest2761750-21aten2_r5power_p11:01:102
2530757991915,2cyclictest0-21swapper/207:56:082
2530757991914,3cyclictest0-21swapper/209:00:012
2530757991910,7cyclictest2586094-21tr08:01:172
2530749991917,1cyclictest0-21swapper/007:21:250
25304262193,9sleep30-21swapper/307:08:203
25300482194,9sleep20-21swapper/207:06:262
2530757991815,2cyclictest2766912-21fschecks_count11:06:112
2530757991815,2cyclictest2531256-21fschecks_count07:11:102
2530757991814,2cyclictest2761008-21unixbench_singl10:56:262
2530757991814,2cyclictest0-21swapper/211:30:012
253075799179,6cyclictest2633279-21cut08:51:152
253075799176,8cyclictest2779951-21tr11:16:162
2530757991713,2cyclictest2806704-21cpuspeed_turbos11:46:102
2530757991713,2cyclictest0-21swapper/210:16:342
2530757991713,2cyclictest0-21swapper/210:16:332
2530757991713,2cyclictest0-21swapper/210:01:082
2530757991713,2cyclictest0-21swapper/208:06:072
2530757991713,2cyclictest0-21swapper/208:06:072
253074999171,12cyclictest2826394-21apt-get12:05:030
253075799169,5cyclictest2609642-21tr08:26:172
253075799167,7cyclictest2781609-21cut11:21:092
2530757991613,2cyclictest0-21swapper/209:30:302
2530757991612,3cyclictest2666487-21unixbench_multi09:21:282
2530757991612,2cyclictest0-21swapper/210:06:122
2530757991612,2cyclictest0-21swapper/209:46:192
2530757991612,2cyclictest0-21swapper/207:26:152
2530757991611,3cyclictest0-21swapper/208:41:142
2530757991611,3cyclictest0-21swapper/207:15:022
26211342145,5sleep30-21swapper/308:36:203
28179572133,6sleep30-21swapper/311:56:163
27313672132,7sleep30-21swapper/310:30:013
27172432133,6sleep30-21swapper/310:16:123
27172432133,6sleep30-21swapper/310:16:123
26718782132,6sleep30-21swapper/309:30:023
26660452132,7sleep30-21swapper/309:21:233
26072992132,7sleep30-21swapper/308:25:013
25982582132,7sleep30-21swapper/308:16:143
28565962122,6sleep30-21swapper/312:36:093
28556682122,6sleep30-21swapper/312:31:283
28467312121,7sleep30-21swapper/312:26:093
28415612122,6sleep30-21swapper/312:21:083
28272242122,6sleep30-21swapper/312:06:153
28210232122,5sleep30-21swapper/312:00:013
28068412122,6sleep30-21swapper/311:46:133
27919922122,6sleep30-21swapper/311:31:123
27712912122,5sleep30-21swapper/311:10:023
27705152122,6sleep30-21swapper/311:06:243
27560992122,7sleep30-21swapper/310:52:123
27464852122,5sleep30-21swapper/310:45:013
27368082122,6sleep30-21swapper/310:35:103
27216622122,6sleep30-21swapper/310:20:023
27004022122,6sleep30-21swapper/309:56:183
26875442122,6sleep30-21swapper/309:46:153
26815322122,6sleep30-21swapper/309:37:443
26672092122,6sleep30-21swapper/309:26:083
26471562122,5sleep30-21swapper/309:05:023
26431162122,6sleep30-21swapper/309:01:163
26274252122,6sleep30-21swapper/308:46:083
26221762122,6sleep30-21swapper/308:40:023
26124322122,6sleep30-21swapper/308:30:023
25883852122,6sleep30-21swapper/308:06:153
25883852122,6sleep30-21swapper/308:06:153
25779792122,6sleep30-21swapper/307:56:083
25729142122,6sleep30-21swapper/307:50:063
25681992122,6sleep30-21swapper/307:46:123
25531302122,6sleep30-21swapper/307:31:163
25427612122,7sleep30-21swapper/307:21:083
25418082122,6sleep30-21swapper/307:16:273
28362572112,5sleep30-21swapper/312:15:023
28314722112,5sleep30-21swapper/312:11:093
28113352112,5sleep30-21swapper/311:50:013
28051232112,5sleep30-21swapper/311:41:193
27962402112,5sleep30-21swapper/311:35:013
27863402112,5sleep30-21swapper/311:25:023
27802752112,5sleep30-21swapper/311:16:203
27615552112,5sleep30-21swapper/311:00:013
27323252112,5sleep30-21swapper/310:31:133
27064182112,5sleep30-21swapper/310:05:013
27020732112,5sleep30-21swapper/310:01:123
26920002112,6sleep30-21swapper/309:51:083
26824482112,5sleep30-21swapper/309:41:133
26573182112,5sleep30-21swapper/309:16:083
26532892112,5sleep30-21swapper/309:11:163
26372102112,5sleep30-21swapper/308:55:023
26348052112,5sleep30-21swapper/308:51:173
26079352112,5sleep30-21swapper/308:26:133
25825642112,5sleep30-21swapper/308:00:013
25627482112,6sleep30-21swapper/307:40:273
25579992112,5sleep30-21swapper/307:36:133
25473892112,5sleep30-21swapper/307:25:023
25347522112,5sleep30-21swapper/307:11:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional