You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 14:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Thu Apr 23, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
259559721190,1sleep02595603-21tr11:21:150
23456562910,1sleep02345661-21tr07:11:160
23616752800,5chrt0-21swapper/307:26:153
2342536996255,5cyclictest2569402-21kworker/u8:0+events_unbound12:21:252
2342536995948,3cyclictest2449589-21kworker/u8:1+flush-8:009:16:222
2342534995753,3cyclictest2539188-21kworker/u8:2+flush-8:010:46:091
2342536995651,4cyclictest2658639-21kworker/u8:1+events_unbound12:26:222
25365772550,4chrt0-21swapper/010:21:160
24806762550,0sleep0201rcuc/009:26:140
2342534995551,3cyclictest2539188-21kworker/u8:2+flush-8:011:06:241
2342534995548,5cyclictest2554084-21kworker/u8:1+flush-8:010:56:251
2342536995448,5cyclictest2369494-21kworker/u8:2+events_unbound07:41:252
2342534995448,4cyclictest2290705-21kworker/u8:1+events_unbound08:16:191
2342531995444,7cyclictest2489389-21latency_hist09:35:010
2342534995346,6cyclictest2399874-21kworker/u8:2+events_unbound08:41:091
2342531995345,6cyclictest280-21systemd-journal11:35:010
2342534995244,6cyclictest2464155-21kworker/u8:3+events_unbound10:21:211
2342534995240,5cyclictest2489107-21kworker/u8:1+events_unbound09:46:201
2342534995147,3cyclictest2648226-21kworker/u8:3+flush-8:012:31:251
2342534995147,3cyclictest2554084-21kworker/u8:1+events_unbound11:01:251
2342536995046,3cyclictest2559281-21kworker/u8:3+flush-8:010:46:202
2342536995042,6cyclictest280-21systemd-journal08:40:002
2342536995042,6cyclictest280-21systemd-journal08:40:002
2342534995046,3cyclictest2380162-21kworker/u8:0+flush-8:007:56:191
2342534995046,3cyclictest2290705-21kworker/u8:1+events_unbound08:21:161
2342534995045,4cyclictest2290705-21kworker/u8:1+events_unbound07:26:211
2342536994944,4cyclictest2554084-21kworker/u8:1+events_unbound11:21:242
2342534994944,4cyclictest2603773-21kworker/u8:3+flush-8:012:01:211
2342534994944,4cyclictest2489107-21kworker/u8:1+flush-8:009:36:121
2342531994940,6cyclictest2499321-21latency_hist09:45:000
2342534994844,3cyclictest2569402-21kworker/u8:0+events_unbound12:36:241
2342534994844,3cyclictest2569402-21kworker/u8:0+events_unbound12:36:241
2342534994844,3cyclictest2554084-21kworker/u8:1+flush-8:011:21:271
2342534994844,3cyclictest2474071-21kworker/u8:2+flush-8:009:26:251
2342534994844,3cyclictest2434525-21kworker/u8:0+events_unbound08:46:291
2342534994844,3cyclictest2318142-21kworker/u8:0+flush-8:007:11:251
2342531994843,4cyclictest2380162-21kworker/u8:0+events_unbound07:56:220
2342536994743,3cyclictest2318142-21kworker/u8:0+events_unbound07:31:212
2342536994742,3cyclictest2539188-21kworker/u8:2+flush-8:010:26:102
2342534994743,3cyclictest2603773-21kworker/u8:3+flush-8:011:36:241
2342534994743,3cyclictest2489107-21kworker/u8:1+flush-8:009:56:261
2342534994742,4cyclictest2318142-21kworker/u8:0+flush-8:007:16:201
2342534994642,3cyclictest2609251-21kworker/u8:2+flush-8:011:56:211
2342534994642,3cyclictest2554084-21kworker/u8:1+flush-8:011:31:251
2342534994642,3cyclictest2554084-21kworker/u8:1+flush-8:010:41:101
2342534994642,3cyclictest2554084-21kworker/u8:1+flush-8:010:41:101
2342531994637,7cyclictest280-21systemd-journal10:16:180
2342536994541,3cyclictest2380162-21kworker/u8:0+flush-8:007:56:242
2342536994541,3cyclictest2342408-21kworker/u8:3+events_unbound07:11:202
2342536994541,3cyclictest2290705-21kworker/u8:1+events_unbound07:21:272
2342534994541,3cyclictest2533180-21kworker/u8:1+events_unbound10:16:271
2342534994541,3cyclictest2464155-21kworker/u8:3+events_unbound09:21:101
2342534994541,3cyclictest2454536-21kworker/u8:0+flush-8:010:11:211
2342534994538,5cyclictest2489107-21kworker/u8:1+flush-8:010:01:101
2342534994535,7cyclictest2628737-21latency_hist11:55:001
2342534994440,3cyclictest2318142-21kworker/u8:0+events_unbound07:31:281
2342536994339,3cyclictest2454536-21kworker/u8:0+flush-8:010:11:262
2342536994338,4cyclictest2399874-21kworker/u8:2+events_unbound08:06:292
2342534994339,3cyclictest2359490-21kworker/u8:4+events_unbound08:36:121
2342534994339,3cyclictest2359490-21kworker/u8:4+events_unbound08:36:121
2342534994338,4cyclictest2290705-21kworker/u8:1+events_unbound08:26:151
2342531994335,5cyclictest280-21systemd-journal08:55:000
2342531994332,8cyclictest2524084-21latency_hist10:10:010
2342534994238,3cyclictest2464155-21kworker/u8:3+flush-8:009:41:201
2342534994238,3cyclictest2399874-21kworker/u8:2+events_unbound09:06:091
2342534994237,4cyclictest2380162-21kworker/u8:0+flush-8:007:46:221
2342531994237,4cyclictest2548542-21kworker/u8:3+events_unbound10:36:220
2342534994138,2cyclictest2464155-21kworker/u8:3+events_unbound10:06:111
2342534994137,3cyclictest2359490-21kworker/u8:4+flush-8:007:36:151
2342534994136,4cyclictest2658639-21kworker/u8:1+events_unbound12:26:281
2342534994136,4cyclictest2449589-21kworker/u8:1+events_unbound09:11:091
2342534994133,6cyclictest2509218-21latency_hist09:55:011
2342531994135,4cyclictest2354555-21apt-get07:20:000
2342531994134,5cyclictest2399874-21kworker/u8:2+flush-8:008:06:110
2342531994129,8cyclictest280-21systemd-journal11:50:000
2342536994033,5cyclictest280-21systemd-journal12:20:002
2342534994036,3cyclictest2603773-21kworker/u8:3+events_unbound11:41:081
2342534994036,3cyclictest2449589-21kworker/u8:1+flush-8:008:56:191
2342536993935,3cyclictest2658639-21kworker/u8:1+events_unbound12:31:212
2342536993931,6cyclictest280-21systemd-journal11:20:002
2342534993935,3cyclictest2554084-21kworker/u8:1+events_unbound11:13:221
2342534993935,3cyclictest2533180-21kworker/u8:1+events_unbound10:26:281
2342534993935,3cyclictest2290705-21kworker/u8:1+flush-8:008:01:221
2342534993934,3cyclictest2638351-21kworker/u8:1+flush-8:012:11:161
2342531993929,8cyclictest280-21systemd-journal09:00:010
2342536993829,7cyclictest280-21systemd-journal09:40:002
2342534993834,3cyclictest2609251-21kworker/u8:2+events_unbound12:21:151
2342531993824,10cyclictest2474334-21apt-get09:20:010
2342536993733,3cyclictest2474071-21kworker/u8:2+events_unbound09:31:252
2342536993727,8cyclictest280-21systemd-journal10:08:202
2342534993733,3cyclictest2454536-21kworker/u8:0+events_unbound10:31:261
2342531993729,6cyclictest2379667-21apt-get07:45:010
2342534993631,4cyclictest2290705-21kworker/u8:1+flush-8:007:21:281
2342534993627,6cyclictest280-21systemd-journal09:05:011
2342531993628,6cyclictest280-21systemd-journal08:21:330
2342531993628,5cyclictest2579056-21apt11:05:010
2342531993626,8cyclictest2378801-21ntpq07:41:190
2342531993626,7cyclictest2568935-21latency_hist10:55:010
2342536993530,3cyclictest2454536-21kworker/u8:0+events_unbound09:50:292
2342534993531,3cyclictest2290705-21kworker/u8:1+flush-8:007:51:261
2342531993529,4cyclictest2514545-21apt-get10:01:060
2342531993510,16cyclictest0-21swapper/011:14:240
23377492353,9sleep10-21swapper/107:05:101
2342536993430,3cyclictest2454536-21kworker/u8:0+events_unbound10:17:022
2342536993430,3cyclictest2443772-21kworker/u8:3+events_unbound08:46:352
2342536993430,3cyclictest2290705-21kworker/u8:1+events_unbound08:44:332
2342536993429,4cyclictest2638351-21kworker/u8:1+events_unbound12:02:292
2342536993429,3cyclictest2533180-21kworker/u8:1+events_unbound10:30:072
2342536993425,7cyclictest2558808-21apt-get10:45:002
2342536993425,7cyclictest2558808-21apt-get10:45:002
2342534993430,3cyclictest2548542-21kworker/u8:3+flush-8:010:36:241
2342534993430,3cyclictest2464155-21kworker/u8:3+flush-8:009:15:211
2342534993430,3cyclictest2369494-21kworker/u8:2+events_unbound07:41:191
2342531993425,7cyclictest2579359-21/usr/sbin/munin11:06:240
2342534993329,3cyclictest2569402-21kworker/u8:0+events_unbound12:19:281
234253199331,14cyclictest589-21runrttasks07:26:070
2342536993227,4cyclictest2318142-21kworker/u8:0+events_unbound07:18:382
2342536993225,3cyclictest2603773-21kworker/u8:3+events_unbound11:30:032
2342534993228,3cyclictest2569402-21kworker/u8:0+events_unbound11:49:211
2342534993228,3cyclictest2359490-21kworker/u8:4+flush-8:008:05:211
2342534993227,4cyclictest2589178-21kworker/u8:3+flush-8:011:17:111
2342534993227,4cyclictest2359490-21kworker/u8:4+events_unbound08:31:191
2342531993223,7cyclictest2508333-21ntpq09:51:210
2342531993219,11cyclictest2554769-21sort10:41:130
2342531993219,11cyclictest2554769-21sort10:41:130
234253199320,11cyclictest589-21runrttasks10:58:320
2342536993127,3cyclictest2569402-21kworker/u8:0+events_unbound12:36:262
2342536993127,3cyclictest2569402-21kworker/u8:0+events_unbound12:36:262
2342536993127,3cyclictest2454536-21kworker/u8:0+events_unbound09:05:232
2342536993126,4cyclictest2399874-21kworker/u8:2+events_unbound09:03:582
2342536993125,4cyclictest2290705-21kworker/u8:1+events_unbound08:00:032
2342536993124,5cyclictest280-21systemd-journal09:57:202
2342534993127,3cyclictest2464155-21kworker/u8:3+events_unbound09:33:061
2342534993127,3cyclictest2443772-21kworker/u8:3+flush-8:008:50:211
2342534993126,4cyclictest2399874-21kworker/u8:2+events_unbound08:11:251
2342531993123,6cyclictest2459829-21apt-get09:06:060
234253199312,16cyclictest0-21swapper/010:46:050
2342531993113,14cyclictest0-21swapper/011:51:120
2342536993024,4cyclictest2638351-21kworker/u8:1+events_unbound12:05:012
2342536993023,5cyclictest280-21systemd-journal11:57:142
2342534993026,3cyclictest2609251-21kworker/u8:2+events_unbound12:06:071
2342534993017,2cyclictest161rcu_preempt11:26:201
2342531993026,3cyclictest2653064-21grep12:16:250
2342531993025,3cyclictest2429551-21apt08:35:000
2342531993024,4cyclictest280-21systemd-journal11:40:010
2342531993024,4cyclictest2504272-21cron09:50:000
2342531993023,5cyclictest280-21systemd-journal08:01:270
234253199302,27cyclictest2332640-21kworker/0:0+events07:51:140
234253199301,27cyclictest1-21systemd08:45:000
2342531993010,9cyclictest589-21runrttasks09:57:560
2342536992925,3cyclictest2569402-21kworker/u8:0+events_unbound10:55:372
234253199293,14cyclictest0-21swapper/010:31:550
2342531992922,4cyclictest2468511-21ntpq09:11:190
2342531992921,6cyclictest2444050-21grep08:46:260
2342531992920,7cyclictest2413634-21ntpq08:16:200
2342531992920,6cyclictest2354555-21apt-get07:20:010
2342536992824,2cyclictest2603671-21unixbench_multi11:26:262
2342536992824,2cyclictest2515470-21kthreadcore10:01:142
2342534992824,3cyclictest2559281-21kworker/u8:3+flush-8:010:51:361
234253199287,13cyclictest589-21runrttasks12:22:250
234253199283,5cyclictest0-21swapper/008:36:070
234253199283,5cyclictest0-21swapper/008:36:060
234253199283,15cyclictest0-21swapper/012:06:090
2342531992823,3cyclictest2664290-21sort12:31:140
234253199282,13cyclictest2370011-21apt-get07:36:090
2342531992811,4cyclictest2662357-21memory12:26:160
2342536992723,2cyclictest2584377-21aten2_r5power_e11:11:092
2342536992722,3cyclictest2618537-21unixbench_multi11:41:262
234253199278,7cyclictest0-21swapper/007:31:080
234253199273,15cyclictest2342525-21cyclictest12:40:000
234253199273,15cyclictest2342525-21cyclictest12:39:590
234253199272,6cyclictest0-21swapper/012:05:000
2342531992721,4cyclictest2593886-21basename11:19:590
234253199272,11cyclictest0-21swapper/011:42:130
234253199270,16cyclictest2632850-21ntpq11:56:200
2342536992622,3cyclictest2539188-21kworker/u8:2+events_unbound10:38:292
2342536992622,2cyclictest2624475-21fschecks_time11:51:122
2342536992620,4cyclictest880-21mta-sts-daemon07:51:132
234253199262,12cyclictest26445862irqcore12:11:130
234253199260,15cyclictest2459281-21sshd09:02:200
234253699259,2cyclictest161rcu_preempt08:30:002
234253699255,11cyclictest2453903-21python308:56:252
2342536992520,4cyclictest2374631-21cron07:40:002
234253199252,9cyclictest2404847-21seq08:10:020
2342531992517,5cyclictest2543914-21latency_hist10:30:010
234253199251,12cyclictest2493594-21ntpq09:36:240
234253199250,8cyclictest2603004-21latency11:26:170
234253199250,15cyclictest2527229-21kthreadcore10:11:160
2342536992420,2cyclictest2384507-21unixbench_singl07:46:272
234253199240,15cyclictest2475350-21if_enp4s009:21:130
234253199240,10cyclictest1-21systemd08:26:330
24248802230,5sleep22424881-21anacron08:30:512
234253699237,4cyclictest161rcu_preempt08:51:092
234253699236,7cyclictest39-21ksoftirqd/211:08:142
234253699233,11cyclictest421rcuog/209:24:382
2342536992319,3cyclictest2449589-21kworker/u8:1+flush-8:009:11:312
2342536992319,3cyclictest0-21swapper/210:55:012
234253699231,7cyclictest2613936-21idleruntime-cro11:40:002
234253699230,11cyclictest2501826-21tr09:46:162
2342536992217,4cyclictest2414527-21sendmail-msp08:20:002
2342536992217,3cyclictest0-21swapper/208:15:002
234253699220,9cyclictest2577093-21kthreadcore11:01:162
23380892226,9sleep30-21swapper/307:06:103
23378512225,9sleep00-21swapper/007:06:070
2342536992117,2cyclictest2644110-21cpuspeed_turbos12:11:082
2342536992111,8cyclictest280-21systemd-journal09:45:002
24622312200,5sleep3451irq_work/309:06:153
234253699200,5cyclictest2479924-21aten2_r5power_e09:26:092
23377602204,9sleep20-21swapper/207:05:202
234253699197,2cyclictest161rcu_preempt11:46:152
234253699192,4cyclictest0-21swapper/208:21:102
234253699190,3cyclictest2534859-21cut10:21:132
2342536991811,1cyclictest161rcu_preempt07:25:042
25740852141,9sleep30-21swapper/311:00:013
26391642132,7sleep30-21swapper/312:06:103
26360772132,7sleep30-21swapper/312:01:163
25988202132,6sleep30-21swapper/311:25:013
25619492132,7sleep30-21swapper/310:46:163
24764492134,5sleep30-21swapper/309:21:173
26730392122,6sleep30-21swapper/312:37:203
26730392122,6sleep30-21swapper/312:37:203
26634132122,5sleep30-21swapper/312:30:013
26524382122,6sleep30-21swapper/312:16:173
26139772122,5sleep30-21swapper/311:40:003
26042312122,5sleep30-21swapper/311:30:023
25930922122,6sleep30-21swapper/311:16:223
25791512122,6sleep30-21swapper/311:05:023
25445012122,6sleep30-21swapper/310:31:113
25395252122,6sleep30-21swapper/310:26:103
25339602121,7sleep30-21swapper/310:20:003
25240672122,5sleep30-21swapper/310:10:013
25142372122,5sleep30-21swapper/310:00:013
25138902122,6sleep30-21swapper/309:56:283
24989272122,6sleep30-21swapper/309:41:283
24894062122,5sleep30-21swapper/309:35:023
24870322123,6sleep30-21swapper/309:31:163
24644522122,5sleep30-21swapper/309:10:023
24546522122,5sleep30-21swapper/309:00:013
24386312121,7sleep30-21swapper/308:41:203
24337272122,6sleep30-21swapper/308:36:233
24337272122,6sleep30-21swapper/308:36:233
24243442122,5sleep30-21swapper/308:30:013
24146082122,5sleep30-21swapper/308:20:023
23958702120,2sleep3481ktimers/308:01:153
23686692122,6sleep30-21swapper/307:31:183
23589582122,7sleep30-21swapper/307:21:233
23491442120,8sleep30-21swapper/307:15:053
26587842112,5sleep30-21swapper/312:26:083
26578172112,5sleep30-21swapper/312:21:273
26477392112,5sleep30-21swapper/312:11:233
26289632112,5sleep30-21swapper/311:55:013
26280002112,5sleep30-21swapper/311:51:253
26229632112,5sleep30-21swapper/311:46:193
26093442112,5sleep30-21swapper/311:36:083
25994052112,5sleep30-21swapper/311:26:093
25881872112,6sleep30-21swapper/311:11:243
25744562112,5sleep30-21swapper/311:01:093
25657942112,5sleep30-21swapper/310:51:173
25579152112,5sleep30-21swapper/310:41:193
25579152112,5sleep30-21swapper/310:41:183
25527982112,5sleep30-21swapper/310:36:173
25355902110,3sleep3481ktimers/310:21:153
25249002112,5sleep30-21swapper/310:11:133
25045012112,5sleep30-21swapper/309:50:013
24996602112,4sleep30-21swapper/309:46:093
24797442112,5sleep30-21swapper/309:25:023
24702472112,5sleep30-21swapper/309:16:113
24498992113,5sleep30-21swapper/308:56:093
24449122112,5sleep30-21swapper/308:51:073
24396432112,5sleep30-21swapper/308:45:023
24253092112,5sleep30-21swapper/308:31:133
24116152112,6sleep30-21swapper/308:16:153
24048462112,5sleep30-21swapper/308:10:023
23999932112,5sleep30-21swapper/308:06:093
23897812112,5sleep30-21swapper/307:55:023
23850892112,6sleep30-21swapper/307:50:283
23808782112,5sleep30-21swapper/307:46:153
23790722112,5sleep30-21swapper/307:41:253
23699942112,5sleep30-21swapper/307:36:083
23427692112,5sleep30-21swapper/307:11:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional