You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 00:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Apr 20, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
316572422000,3sleep375-21kworker/3:1+events11:11:173
2924266995450,3cyclictest3055177-21kworker/u8:3+flush-8:009:41:282
2924266995442,4cyclictest2924380-21kworker/u8:2+flush-8:008:16:232
2924263995346,5cyclictest3005694-21kworker/u8:0+events_unbound08:31:251
29660652510,6sleep30-21swapper/307:50:003
2924263995147,3cyclictest3099384-21kworker/u8:2+flush-8:010:16:291
2924263995146,4cyclictest3169703-21kworker/u8:0+events_unbound11:46:131
2924266995045,4cyclictest3099384-21kworker/u8:2+events_unbound10:16:262
2924266995045,3cyclictest3223628-21kworker/u8:3+flush-8:012:16:272
2924258995040,7cyclictest3209561-21latency_hist11:55:010
2924263994944,4cyclictest3194442-21kworker/u8:2+flush-8:012:01:241
2924263994944,4cyclictest3129618-21kworker/u8:1+events_unbound11:16:271
2924258994939,7cyclictest2945886-21latency_hist07:30:010
2924263994844,3cyclictest3194442-21kworker/u8:2+flush-8:012:11:261
2924263994844,3cyclictest2924380-21kworker/u8:2+flush-8:008:46:291
2924263994843,4cyclictest2892774-21kworker/u8:1+flush-8:007:36:141
2924263994843,3cyclictest3083952-21ntpq09:46:211
2924263994843,3cyclictest2924380-21kworker/u8:2+flush-8:008:11:281
2924263994839,7cyclictest3074944-21latency_hist09:40:011
2924263994837,8cyclictest280-21systemd-journal10:45:011
292425899481,45cyclictest1-21systemd11:45:000
2924266994742,4cyclictest3169703-21kworker/u8:0+events_unbound11:41:282
2924263994743,3cyclictest3169703-21kworker/u8:0+flush-8:012:06:291
2924263994742,3cyclictest2096582-21kworker/u8:4+events_unbound08:01:271
2924263994741,4cyclictest3045502-21kworker/u8:2+events_unbound09:26:131
2924263994737,8cyclictest3103766-21ntpq10:06:221
2924263994737,8cyclictest3103766-21ntpq10:06:221
2924258994740,5cyclictest2924085-21latency_hist07:10:010
2924258994739,6cyclictest3133492-21ntpq10:36:210
2924266994642,3cyclictest2924380-21kworker/u8:2+events_unbound07:56:282
2924266994641,4cyclictest3169703-21kworker/u8:0+flush-8:012:36:242
2924263994642,3cyclictest3099384-21kworker/u8:2+flush-8:010:51:231
2924263994642,3cyclictest2096582-21kworker/u8:4+flush-8:007:31:271
2924263994640,5cyclictest3169703-21kworker/u8:0+events_unbound11:56:231
2924263994636,7cyclictest3159336-21latency_hist11:05:011
2924263994541,3cyclictest3236881-21kworker/u8:1+flush-8:012:26:261
2924263994541,3cyclictest3236881-21kworker/u8:1+flush-8:012:26:261
2924263994541,3cyclictest3065253-21kworker/u8:0+flush-8:010:01:271
2924263994540,4cyclictest3194442-21kworker/u8:2+flush-8:012:21:141
2924263994540,4cyclictest3099384-21kworker/u8:2+flush-8:010:21:231
2924263994441,2cyclictest3129618-21kworker/u8:1+events_unbound10:36:091
2924263994440,3cyclictest3148887-21kworker/u8:3+flush-8:011:06:111
2924263994440,3cyclictest3119694-21kworker/u8:3+flush-8:010:26:141
2924263994440,3cyclictest3109776-21kworker/u8:0+flush-8:010:46:141
2924266994339,3cyclictest3055177-21kworker/u8:3+flush-8:009:51:252
2924263994339,3cyclictest2892774-21kworker/u8:1+events_unbound07:16:111
2924263994336,5cyclictest2990980-21apt-get08:16:081
2924263994335,3cyclictest3055177-21kworker/u8:3+events_unbound09:56:291
2924263994332,8cyclictest280-21systemd-journal11:32:521
2924263994329,9cyclictest280-21systemd-journal12:20:001
2924258994338,3cyclictest3236881-21kworker/u8:1+events_unbound12:31:110
2924263994238,3cyclictest3236881-21kworker/u8:1+flush-8:012:36:131
2924263994238,3cyclictest3129618-21kworker/u8:1+events_unbound11:21:281
2924263994237,4cyclictest3055177-21kworker/u8:3+flush-8:009:41:151
2924263994233,7cyclictest2975845-21latency_hist08:00:001
2924263994232,8cyclictest2096582-21kworker/u8:4+flush-8:007:11:151
2924266994137,3cyclictest3010667-21kworker/u8:3+flush-8:008:56:132
2924263994137,3cyclictest3119694-21kworker/u8:3+flush-8:010:31:141
2924263994137,3cyclictest3045502-21kworker/u8:2+events_unbound09:21:121
2924263994137,3cyclictest2892774-21kworker/u8:1+events_unbound08:26:281
2924263994135,4cyclictest3035632-21kworker/u8:1+events_unbound09:31:151
2924266994036,3cyclictest3065253-21kworker/u8:0+flush-8:009:31:302
2924263994036,3cyclictest3169703-21kworker/u8:0+events_unbound11:26:271
2924263994036,3cyclictest2924380-21kworker/u8:2+flush-8:008:06:111
2924263994036,3cyclictest2924380-21kworker/u8:2+flush-8:008:06:111
2924263994035,4cyclictest3069686-21kworker/u8:4+events_unbound10:11:291
2924263994035,4cyclictest3010667-21kworker/u8:3+flush-8:008:36:421
2924263994031,7cyclictest3244499-21/usr/sbin/munin12:31:211
2924258994034,4cyclictest3149735-21apt-get10:56:080
2924266993935,3cyclictest2924380-21kworker/u8:2+events_unbound08:06:262
2924266993935,3cyclictest2924380-21kworker/u8:2+events_unbound08:06:262
2924263993935,3cyclictest3129618-21kworker/u8:1+events_unbound11:36:101
2924258993933,4cyclictest280-21systemd-journal09:21:100
2924263993834,3cyclictest3154079-21kworker/u8:2+flush-8:011:11:221
2924263993834,3cyclictest3069686-21kworker/u8:4+flush-8:009:51:151
2924263993834,3cyclictest2924380-21kworker/u8:2+events_unbound08:41:271
2924263993833,3cyclictest2924380-21kworker/u8:2+events_unbound07:41:181
2924258993831,5cyclictest280-21systemd-journal10:14:590
2924266993733,3cyclictest3169703-21kworker/u8:0+events_unbound11:46:212
2924266993733,3cyclictest2096582-21kworker/u8:4+events_unbound08:01:182
2924263993733,3cyclictest3045502-21kworker/u8:2+flush-8:009:11:141
2924263993733,3cyclictest3035632-21kworker/u8:1+events_unbound09:16:311
2924263993733,3cyclictest3010667-21kworker/u8:3+events_unbound09:00:101
2924263993727,7cyclictest280-21systemd-journal07:52:091
2924258993726,8cyclictest2950846-21latency_hist07:35:010
2924266993627,7cyclictest280-21systemd-journal11:35:002
2924263993631,4cyclictest2924380-21kworker/u8:2+events_unbound08:51:071
2924263993631,4cyclictest2892774-21kworker/u8:1+events_unbound08:23:461
2924258993629,5cyclictest3109831-21/usr/sbin/munin10:16:210
2924258993627,7cyclictest3004620-21ntpq08:26:220
2924258993625,9cyclictest3120044-21diskstats10:26:130
2924258993625,8cyclictest3010667-21kworker/u8:3+events_unbound08:56:100
2924263993531,3cyclictest3194442-21kworker/u8:2+flush-8:011:51:141
2924263993525,8cyclictest2965107-21ntpq07:46:241
29240522352,28sleep30-21swapper/307:09:453
29239482354,9sleep10-21swapper/107:08:211
30952912340,2sleep20-21swapper/210:01:132
2924263993422,4cyclictest3169703-21kworker/u8:0+events_unbound11:41:361
2924258993430,3cyclictest3119694-21kworker/u8:3+events_unbound10:31:190
2924258993427,5cyclictest3184630-21true11:30:000
2924258993423,9cyclictest3006034-21diskstats08:31:120
2924263993329,3cyclictest3129618-21kworker/u8:1+events_unbound10:56:171
2924263993328,4cyclictest3010667-21kworker/u8:3+events_unbound09:08:111
2924258993325,6cyclictest3035632-21kworker/u8:1+events_unbound09:16:290
2924263993229,2cyclictest3010667-21kworker/u8:3+flush-8:008:56:161
2924263993228,3cyclictest2096582-21kworker/u8:4+flush-8:007:25:551
2924263993227,4cyclictest2892774-21kworker/u8:1+flush-8:007:20:211
2924258993223,7cyclictest280-21systemd-journal11:25:000
2924258993220,9cyclictest2929141-21latency_hist07:15:010
2924266993127,3cyclictest3129618-21kworker/u8:1+events_unbound10:40:092
2924258993125,4cyclictest3020010-21unixbench_singl08:41:300
2924258993123,6cyclictest280-21systemd-journal09:01:140
2924258993121,8cyclictest2936606-21diskstats07:21:120
30132162300,5sleep20-21swapper/208:36:182
2924266993024,4cyclictest3039948-21unixbench_multi09:01:292
2924258993024,4cyclictest3169703-21kworker/u8:0+flush-8:011:46:140
2924258993024,4cyclictest2892774-21kworker/u8:1+flush-8:007:20:000
2924266992924,4cyclictest3248763-21unixbench_multi12:31:292
2924266992923,4cyclictest280-21systemd-journal07:25:002
2924266992923,4cyclictest2096582-21kworker/u8:4+events_unbound07:30:202
2924258992925,3cyclictest401-21dbus-daemon11:15:010
2924258992924,3cyclictest3065253-21kworker/u8:0+events_unbound10:01:280
2924258992924,3cyclictest2924380-21kworker/u8:2+flush-8:008:46:190
2924258992923,4cyclictest2924380-21kworker/u8:2+flush-8:007:51:260
2924266992824,3cyclictest3129618-21kworker/u8:1+flush-8:010:36:412
2924266992820,6cyclictest280-21systemd-journal12:25:002
2924258992824,2cyclictest3249773-21fschecks_count12:36:140
2924258992822,4cyclictest3055177-21kworker/u8:3+flush-8:009:36:290
2924258992821,5cyclictest3010667-21kworker/u8:3+flush-8:008:36:230
2924258992821,4cyclictest3229697-21apt-get12:16:090
2924266992724,2cyclictest3219838-21aten2_r5power_c12:06:112
2924266992723,3cyclictest3099384-21kworker/u8:2+events_unbound10:26:302
2924266992723,3cyclictest3069686-21kworker/u8:4+flush-8:010:06:152
2924266992723,3cyclictest3069686-21kworker/u8:4+flush-8:010:06:152
2924266992723,3cyclictest2096582-21kworker/u8:4+events_unbound07:35:042
2924266992723,2cyclictest3224825-21aten2_r5power_p12:11:102
2924266992723,2cyclictest3139703-21aten2_r5power_e10:46:112
2924258992722,4cyclictest2924380-21kworker/u8:2+flush-8:007:37:150
2924258992722,3cyclictest3085884-21grep09:51:180
2924266992622,3cyclictest3005435-21cron08:30:012
2924266992622,2cyclictest3214182-21unixbench_singl11:56:282
2924266992621,3cyclictest3026089-21fschecks_count08:51:142
2924258992622,2cyclictest0-21swapper/010:51:160
2924258992621,4cyclictest2924380-21kworker/u8:2+flush-8:007:46:300
2924258992620,4cyclictest2960713-21unixbench_singl07:41:300
2924258992617,7cyclictest3093797-21ntpq09:56:220
32398602250,4sleep20-21swapper/212:26:122
32398602250,4sleep20-21swapper/212:26:122
2924266992522,2cyclictest3148785-21unixbench_multi10:51:292
2924266992521,3cyclictest3069686-21kworker/u8:4+flush-8:009:35:152
2924266992521,2cyclictest3175047-21aten2_r5power_e11:21:112
2924258992521,3cyclictest3243883-21unixbench_singl12:26:280
2924258992521,3cyclictest3243883-21unixbench_singl12:26:280
2924258992521,3cyclictest3214207-21unixbench_singl11:56:290
2924258992521,3cyclictest3148887-21kworker/u8:3+flush-8:011:06:160
2924258992520,3cyclictest3169703-21kworker/u8:0+flush-8:012:06:180
2924258992519,3cyclictest0-21swapper/012:01:230
2924258992518,5cyclictest3035632-21kworker/u8:1+flush-8:009:06:210
2924258992514,9cyclictest3174397-21apt-get11:20:000
2924266992421,2cyclictest3125067-21fschecks_time10:31:142
2924266992420,2cyclictest2961712-21fschecks_time07:46:152
2924266992420,2cyclictest0-21swapper/211:05:012
2924266992419,4cyclictest3174524-21apt-key11:20:012
2924266992418,4cyclictest280-21systemd-journal09:50:002
2924258992420,3cyclictest3100216-21cpuspeed_turbos10:06:100
2924258992420,3cyclictest3100216-21cpuspeed_turbos10:06:100
2924258992420,3cyclictest3046194-21sort09:11:160
2924258992420,3cyclictest2976178-21sshd08:01:090
2924258992420,2cyclictest3234686-21aten2_r5power_c12:21:110
2924258992420,2cyclictest0-21swapper/009:41:130
2924258992419,3cyclictest2986777-21tr08:11:170
2924258992418,4cyclictest3228977-21unixbench_multi12:11:270
2924258992418,4cyclictest3010667-21kworker/u8:3+events_unbound08:51:130
2924258992418,4cyclictest280-21systemd-journal09:35:000
2924266992319,3cyclictest3025615-21latency_hist08:50:012
2924266992319,3cyclictest2924380-21kworker/u8:2+flush-8:007:15:062
2924266992318,3cyclictest3154353-21idleruntime-cro11:00:002
2924266992316,5cyclictest3008869-21cut08:31:192
2924258992319,3cyclictest3135280-21sort10:41:180
2924258992318,4cyclictest3158060-21kthreadcore11:01:190
2924258992318,3cyclictest3189155-21unixbench_multi11:31:270
2924258992314,6cyclictest3000509-21latency_hist08:25:000
2924266992218,2cyclictest3056024-21irqcore09:21:172
2924266992218,2cyclictest2956481-21aten2_r5power_c07:41:112
2924266992217,4cyclictest2892774-21kworker/u8:1+events_unbound07:51:302
2924258992219,1cyclictest3055177-21kworker/u8:3+events_unbound09:46:110
2924258992218,2cyclictest0-21swapper/011:36:190
2924258992217,4cyclictest3143882-21unixbench_multi10:46:290
2924258992217,4cyclictest3064172-21ntp_kernel_pll_09:26:230
2924258992213,6cyclictest3114861-21sshd10:21:090
292426699214,2cyclictest161rcu_preempt10:21:192
292426699213,2cyclictest161rcu_preempt10:11:122
292426699213,2cyclictest161rcu_preempt07:15:002
2924266992118,2cyclictest3040884-21cpuspeed_turbos09:06:092
2924266992117,2cyclictest0-21swapper/212:05:002
2924266992117,2cyclictest0-21swapper/209:11:222
292426699210,5cyclictest3208884-21/usr/sbin/munin11:51:272
2924258992117,2cyclictest0-21swapper/008:06:160
2924258992117,2cyclictest0-21swapper/008:06:160
2924258992116,3cyclictest2971457-21cpuspeed_turbos07:56:120
29236652214,10sleep20-21swapper/207:06:302
30723552200,2sleep3481ktimers/309:36:193
292426699201,7cyclictest3064209-21grep09:26:242
2924266992016,2cyclictest3160193-21fschecks_count11:06:102
2924266992016,2cyclictest0-21swapper/207:26:172
292426699201,4cyclictest161rcu_preempt09:16:112
2924258992016,2cyclictest0-21swapper/008:16:160
292426699196,2cyclictest421rcuog/208:25:012
292426699195,2cyclictest280-21systemd-journal10:00:002
292426699193,14cyclictest2986160-21grep08:11:112
292426699192,5cyclictest0-21swapper/211:13:592
2924266991915,2cyclictest0-21swapper/211:40:002
2924266991911,2cyclictest161rcu_preempt11:29:192
292426699181,2cyclictest161rcu_preempt08:40:262
31356352156,6sleep30-21swapper/310:41:203
29399882142,8sleep30-21swapper/307:21:203
32145612132,6sleep30-21swapper/312:00:013
31393222132,6sleep30-21swapper/310:45:013
30806112132,7sleep30-21swapper/309:46:153
30210292132,7sleep30-21swapper/308:46:163
30017322134,5sleep30-21swapper/308:26:173
32374612122,6sleep30-21swapper/312:21:203
32237272122,6sleep30-21swapper/312:06:283
32134952122,6sleep30-21swapper/311:56:203
32044702122,6sleep30-21swapper/311:48:103
31900952123,5sleep30-21swapper/311:36:103
31714552122,6sleep30-21swapper/311:16:193
31636722122,6sleep30-21swapper/311:06:203
31546012122,5sleep30-21swapper/311:00:023
31491532122,6sleep30-21swapper/310:55:013
31295122122,6sleep30-21swapper/310:35:013
31147542122,6sleep30-21swapper/310:20:103
31138992122,6sleep30-21swapper/310:16:283
30989672122,6sleep30-21swapper/310:01:283
30898272122,5sleep30-21swapper/309:55:023
30855452122,6sleep30-21swapper/309:51:153
30797402122,6sleep30-21swapper/309:43:103
30650502122,5sleep30-21swapper/309:30:023
30641762122,6sleep30-21swapper/309:26:243
30403512122,5sleep30-21swapper/309:05:023
30294122122,6sleep30-21swapper/308:51:213
30153962122,5sleep30-21swapper/308:40:023
30056142122,6sleep30-21swapper/308:30:023
30000892122,6sleep30-21swapper/308:21:323
29864572122,6sleep30-21swapper/308:11:163
29736422122,6sleep30-21swapper/307:56:203
29662942122,6sleep30-21swapper/307:51:103
29466502122,6sleep30-21swapper/307:31:163
29409552122,5sleep30-21swapper/307:25:023
32494542112,5sleep30-21swapper/312:36:093
32445422112,5sleep30-21swapper/312:31:113
32393722112,5sleep30-21swapper/312:25:013
32393722112,5sleep30-21swapper/312:25:003
32296122112,6sleep30-21swapper/312:15:223
32250942112,5sleep30-21swapper/312:11:133
32048482112,5sleep30-21swapper/311:50:023
31995802113,5sleep30-21swapper/311:43:243
31851952112,5sleep30-21swapper/311:31:123
31798782112,5sleep30-21swapper/311:25:013
31749602112,5sleep30-21swapper/311:21:093
31499852112,5sleep30-21swapper/310:56:133
31247242112,5sleep30-21swapper/310:31:093
31197992112,5sleep30-21swapper/310:26:113
31051722112,5sleep30-21swapper/310:11:153
30996382112,5sleep30-21swapper/310:05:013
30996382112,5sleep30-21swapper/310:05:013
30553802112,5sleep30-21swapper/309:20:023
30456082112,5sleep30-21swapper/309:11:113
30362162112,5sleep30-21swapper/309:01:163
30306762112,6sleep30-21swapper/308:55:303
30107082112,6sleep30-21swapper/308:36:043
29908972112,6sleep30-21swapper/308:15:263
29811192112,5sleep30-21swapper/308:06:113
29811192112,5sleep30-21swapper/308:06:113
29801902112,5sleep30-21swapper/308:01:293
29563322112,5sleep30-21swapper/307:40:023
29554922112,5sleep30-21swapper/307:36:293
29313232112,6sleep30-21swapper/307:15:313
29244642112,5sleep30-21swapper/307:11:093
30538632102,5sleep30-21swapper/309:16:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional