You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 20:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Thu Jun 04, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24051292910,3chrt0-21swapper/011:00:410
24954302840,3chrt75-21kworker/3:1-events12:30:403
2173304996358,3cyclictest2205225-21kworker/u8:2+events_unbound09:50:500
2173304996254,6cyclictest2244829-21/usr/sbin/munin08:20:510
2173312996140,17cyclictest2218989-21ntpq07:50:491
2173312996051,7cyclictest2417793-21ntpq11:10:451
2173312995950,6cyclictest2384093-21latency_hist10:40:011
2173312995950,6cyclictest2384093-21latency_hist10:40:001
2173304995754,2cyclictest2369251-21kworker/u8:1+events_unbound10:41:540
2173312995538,14cyclictest2422975-21ntpq11:15:451
2173312995448,4cyclictest2487899-21ntpq12:20:491
2173304995446,6cyclictest2294233-21apt-get09:10:010
2173304995349,3cyclictest2234881-21kworker/u8:0+events_unbound09:45:510
2173312995241,8cyclictest2358225-21ntpq10:10:451
2173312995236,13cyclictest2248615-21ntpq08:20:461
2173312995233,12cyclictest161rcu_preempt10:00:421
2173304995249,2cyclictest2483970-21kworker/u8:3+events_unbound12:30:500
2173304995148,2cyclictest2030499-21kworker/u8:1+events_unbound07:25:490
2173318995031,16cyclictest2289045-21apt-get09:05:012
2173312995029,17cyclictest1704890-21systemd-journal09:30:501
2173304995046,3cyclictest2438721-21kworker/u8:1+events_unbound11:45:370
2173304994946,2cyclictest2468946-21kworker/u8:1+events_unbound12:15:540
2173304994945,3cyclictest2224789-21kworker/u8:3+events_unbound08:30:350
2173304994844,3cyclictest2224789-21kworker/u8:3+events_unbound09:34:510
2173304994844,3cyclictest2205225-21kworker/u8:2+events_unbound09:15:360
2173304994840,6cyclictest2468963-21/usr/sbin/munin12:05:460
2173304994840,6cyclictest2468963-21/usr/sbin/munin12:05:450
2173304994743,3cyclictest2234881-21kworker/u8:0+events_unbound09:27:510
2173304994739,3cyclictest2030499-21kworker/u8:1+events_unbound07:48:500
2173318994529,14cyclictest2199216-21ntpq07:30:502
2173304994542,2cyclictest2454036-21kworker/u8:0+events_unbound12:00:530
2173304994540,4cyclictest2418370-21kworker/u8:0+events_unbound11:29:510
2173318994437,4cyclictest1704890-21systemd-journal12:00:002
2173318994429,13cyclictest1704890-21systemd-journal12:10:002
2173318994429,13cyclictest1704890-21systemd-journal12:10:002
2173304994441,2cyclictest2205225-21kworker/u8:2+events_unbound10:00:570
2173304994440,3cyclictest2224789-21kworker/u8:3+events_unbound10:39:520
2173304994440,3cyclictest2224789-21kworker/u8:3+events_unbound10:39:510
2173304994440,3cyclictest2205225-21kworker/u8:2+events_unbound09:00:360
2173304994440,3cyclictest1341629-21kworker/u8:4+events_unbound07:35:200
2173312994316,15cyclictest0-21swapper/111:35:501
217331299431,29cyclictest589-21runrttasks08:15:351
2173304994339,3cyclictest2454036-21kworker/u8:0+events_unbound12:10:360
2173304994339,3cyclictest2205225-21kworker/u8:2+events_unbound07:54:520
2173312994234,6cyclictest2428887-21latency_hist11:25:011
2173304994238,3cyclictest2438721-21kworker/u8:1+events_unbound11:33:510
2173304994238,3cyclictest2369251-21kworker/u8:1+events_unbound11:15:050
2173304994238,3cyclictest2234881-21kworker/u8:0+events_unbound08:25:550
2173304994238,3cyclictest1340637-21kworker/u8:0+events_unbound07:20:180
2173304994238,3cyclictest1340637-21kworker/u8:0+events_unbound07:20:180
2173304994233,7cyclictest2503756-21latency_hist12:40:010
2173312994137,3cyclictest2224789-21kworker/u8:3+flush-8:010:20:531
2173304994138,2cyclictest2454036-21kworker/u8:0+events_unbound12:21:520
2173304994138,2cyclictest2030499-21kworker/u8:1+events_unbound07:10:550
2173304994137,3cyclictest2224789-21kworker/u8:3+events_unbound10:12:520
2173304994137,3cyclictest1340637-21kworker/u8:0+events_unbound07:16:510
2173304994134,5cyclictest2418719-21apt-get11:15:010
2173304994133,6cyclictest2263430-21ntpq08:35:460
2173312994031,7cyclictest1704890-21systemd-journal07:20:501
2173312994031,7cyclictest1704890-21systemd-journal07:20:501
2173304994036,3cyclictest2224789-21kworker/u8:3+events_unbound10:05:390
2173304994036,3cyclictest2224789-21kworker/u8:3+events_unbound09:57:510
2173304994036,3cyclictest2205225-21kworker/u8:2+events_unbound07:57:520
2173312993927,9cyclictest1704890-21systemd-journal09:41:501
2173312993924,13cyclictest2227214-21kthreadcore08:00:441
217331299391,23cyclictest2274192-21runrttasks08:49:341
217331299391,22cyclictest2363737-21runrttasks10:16:101
217331299391,22cyclictest2220046-21runrttasks07:55:131
217331299391,21cyclictest2373983-21apt-key10:29:591
217331299390,24cyclictest2284609-21taskset09:00:361
2173304993935,3cyclictest2205225-21kworker/u8:2+events_unbound09:24:500
2173318993822,14cyclictest0-21swapper/212:35:002
2173312993828,6cyclictest1704890-21systemd-journal09:26:501
2173312993825,11cyclictest2433817-21apt-key11:30:001
217331299381,20cyclictest2230377-21sort08:05:411
217331299380,29cyclictest2299173-21taskset09:12:131
217331299380,23cyclictest2448610-21runrttasks11:41:441
217331299380,23cyclictest2354159-21runrttasks10:09:561
217331299380,22cyclictest2408795-21runrttasks11:04:331
2173304993834,3cyclictest2424154-21kworker/u8:2+events_unbound11:50:530
2173304993834,3cyclictest2234881-21kworker/u8:0+events_unbound10:23:490
2173304993834,3cyclictest2234881-21kworker/u8:0+events_unbound08:48:520
2173304993834,3cyclictest2224789-21kworker/u8:3+events_unbound11:41:140
2173304993834,3cyclictest2224789-21kworker/u8:3+events_unbound10:31:500
2173304993834,3cyclictest2224789-21kworker/u8:3+events_unbound10:15:580
2173304993834,3cyclictest2205225-21kworker/u8:2+events_unbound08:58:510
2173304993834,3cyclictest2030499-21kworker/u8:1+events_unbound08:05:340
2173318993730,5cyclictest1704890-21systemd-journal11:45:492
2173312993730,5cyclictest2210235-21apt-get07:45:331
2173312993728,6cyclictest1704890-21systemd-journal07:15:011
2173312993727,7cyclictest2205522-21diskstats07:40:351
217331299371,21cyclictest2283970-21runrttasks08:59:011
217331299371,20cyclictest2388277-21runrttasks10:40:541
217331299371,17cyclictest2438673-21runrttasks11:31:261
217331299370,27cyclictest2378952-21taskset10:32:351
217331299370,24cyclictest2483425-21runrttasks12:19:291
217331299370,22cyclictest2468480-21runrttasks12:02:201
217331299370,22cyclictest2304166-21runrttasks09:17:391
217331299370,22cyclictest2294148-21runrttasks09:09:071
217331299370,21cyclictest2184870-21runrttasks07:16:311
2173304993733,3cyclictest2369251-21kworker/u8:1+events_unbound11:06:080
2173304993733,3cyclictest2369251-21kworker/u8:1+events_unbound10:49:380
2173304993733,3cyclictest2234881-21kworker/u8:0+events_unbound08:44:380
2173304993733,3cyclictest2205225-21kworker/u8:2+events_unbound08:53:520
2173304993733,3cyclictest2205225-21kworker/u8:2+events_unbound08:53:510
217279123725,9sleep20-21swapper/207:07:162
22896182360,2sleep2371rcuc/209:05:332
2173318993627,7cyclictest2483597-21cp12:20:002
217331899362,13cyclictest2404174-21apt-get11:00:352
2173318993614,6cyclictest1704890-21systemd-journal07:55:002
2173312993628,6cyclictest2394261-21apt-get10:50:331
2173312993627,6cyclictest2333380-21ntpq09:45:481
217331299361,24cyclictest2234880-21taskset08:10:051
217331299361,20cyclictest2463638-21runrttasks11:59:431
217331299361,20cyclictest2458490-21runrttasks11:51:361
217331299361,20cyclictest2399180-21runrttasks10:55:221
217331299361,20cyclictest2393873-21runrttasks10:48:521
217331299361,20cyclictest2344080-21runrttasks09:57:081
217331299361,19cyclictest2493464-21runrttasks12:27:471
217331299361,19cyclictest2259200-21runrttasks08:32:571
217331299361,18cyclictest2307053-21kthreadcore09:20:411
217331299360,23cyclictest2268992-21runrttasks08:41:231
217331299360,21cyclictest2453722-21runrttasks11:49:031
217331299360,21cyclictest2194952-21runrttasks07:28:441
2173318993527,6cyclictest1704890-21systemd-journal10:35:002
2173318993520,13cyclictest0-21swapper/208:45:002
2173318993517,2cyclictest0-21swapper/209:35:012
2173318993512,6cyclictest0-21swapper/211:30:032
217331299351,20cyclictest2199845-21runrttasks07:32:571
217331299351,19cyclictest2259601-21runrttasks08:35:041
217331299350,21cyclictest2339203-21runrttasks09:52:331
217331299350,21cyclictest2254234-21runrttasks08:27:511
217331299350,20cyclictest2478274-21runrttasks12:11:221
217331299350,19cyclictest2278904-21runrttasks08:51:591
217331299350,19cyclictest2278904-21runrttasks08:51:581
2173304993532,2cyclictest2369251-21kworker/u8:1+events_unbound10:58:500
2173304993531,3cyclictest2224789-21kworker/u8:3+events_unbound11:37:520
2173304993531,3cyclictest2224789-21kworker/u8:3+events_unbound08:19:370
2173304993531,3cyclictest2030499-21kworker/u8:1+events_unbound07:40:230
217331899343,9cyclictest2180486-21apt-get07:15:352
217331899343,12cyclictest2279436-21apt-get08:55:352
2173318993420,12cyclictest2269602-21aten2_r5power_c08:45:342
217331299341,20cyclictest2324215-21runrttasks09:38:251
217331299341,18cyclictest589-21runrttasks12:35:021
217331299341,18cyclictest2473431-21runrttasks12:07:331
217331299341,18cyclictest2473431-21runrttasks12:07:331
217331299340,20cyclictest2493902-21runrttasks12:30:251
217331299340,19cyclictest2413736-21runrttasks11:09:391
2173304993431,2cyclictest2205225-21kworker/u8:2+events_unbound09:11:510
2173304993430,3cyclictest2454036-21kworker/u8:0+events_unbound11:57:490
2173304993430,3cyclictest2418370-21kworker/u8:0+events_unbound11:21:450
2173304993430,3cyclictest2369251-21kworker/u8:1+events_unbound10:52:360
2173304993421,2cyclictest161rcu_preempt09:35:350
21728252344,10sleep10-21swapper/107:07:441
217331299331,19cyclictest2204753-21runrttasks07:37:271
2173304993329,3cyclictest2030499-21kworker/u8:1+events_unbound07:30:100
2173318993218,12cyclictest2394489-21cpuspeed_turbos10:50:372
2173304993228,3cyclictest2224789-21kworker/u8:3+events_unbound10:25:020
2173304993228,3cyclictest2205225-21kworker/u8:2+events_unbound08:02:570
217331899319,7cyclictest2258551-21ntpq08:30:492
2173304993127,3cyclictest2454036-21kworker/u8:0+events_unbound12:29:210
2173304993127,3cyclictest2224789-21kworker/u8:3+events_unbound08:13:380
2173318993024,4cyclictest2313537-21grep09:25:442
2173318993017,11cyclictest0-21swapper/209:50:012
2173318993015,3cyclictest0-21swapper/208:05:552
2173318993015,2cyclictest0-21swapper/212:00:452
2173318993014,2cyclictest0-21swapper/210:25:002
217331899301,13cyclictest2354471-21taskset10:10:342
217330499300,28cyclictest1-21systemd09:45:010
2173318992924,2cyclictest2445152-21kthreadcore11:40:402
2173318992923,4cyclictest2433794-21idleruntime-cro11:30:002
2173318992824,2cyclictest2225083-21aten2_r5power_c08:00:352
2173318992814,12cyclictest0-21swapper/212:25:012
2173318992723,2cyclictest2344841-21cpuspeed_turbos10:00:372
21726922273,7sleep00-21swapper/007:05:590
217331899262,8cyclictest2418719-21apt-get11:15:022
217331899262,8cyclictest2190420-21apt-get07:25:332
2173318992622,2cyclictest2499477-21fschecks_time12:35:362
2173318992621,3cyclictest2424430-21cpuspeed_turbos11:20:352
2173318992621,3cyclictest2379672-21cpuspeed_turbos10:35:362
2173318992621,3cyclictest2379672-21cpuspeed_turbos10:35:362
2173318992615,9cyclictest1704890-21systemd-journal07:44:502
2173318992521,2cyclictest2304358-21cron09:20:012
2173318992520,4cyclictest2214520-21unixbench_singl07:45:542
2173318992516,7cyclictest1704890-21systemd-journal09:25:012
2173318992510,3cyclictest0-21swapper/208:20:432
2173318992420,3cyclictest20977-21cron11:40:002
2173318992420,2cyclictest2339909-21cpuspeed_turbos09:55:352
2173318992420,2cyclictest2173662-21aten2_r5power_e07:10:362
2173318992420,2cyclictest0-21swapper/210:30:012
2173318992420,2cyclictest0-21swapper/208:15:002
2173318992320,2cyclictest2294839-21aten2_r5power_p09:10:352
2173318992218,2cyclictest2274637-21aten2_r5power_v08:50:352
2173318992218,2cyclictest2274637-21aten2_r5power_v08:50:342
2173318992117,3cyclictest2361572-21kthreadcore10:15:442
2173318992117,2cyclictest885-21mta-sts-daemon12:15:002
2173318992117,2cyclictest2399532-21fschecks_time10:55:372
2173318992016,2cyclictest0-21swapper/207:40:012
2173318992013,5cyclictest2239976-21seq08:15:362
21681652193,7sleep30-21swapper/307:05:003
217331899187,4cyclictest0-21swapper/209:38:222
2173318991815,2cyclictest2414150-21aten2_r5power_p11:10:352
217331899181,13cyclictest2412944-21ntpq11:05:472
217331899178,7cyclictest2186241-21sed07:20:412
217331899178,7cyclictest2186241-21sed07:20:402
2173318991711,4cyclictest0-21swapper/209:45:002
22138522167,5sleep30-21swapper/307:45:473
217331899168,6cyclictest2263599-21sshd08:35:502
217331899167,7cyclictest2349906-21sort10:05:382
217331899167,7cyclictest2334849-21cut09:50:362
217331899164,4cyclictest0-21swapper/208:25:342
2173318991612,2cyclictest2389381-21aten2_r5power_c10:45:352
2173318991611,4cyclictest0-21swapper/210:40:362
23335632156,5sleep30-21swapper/309:45:533
217331899156,7cyclictest2220796-21sed07:55:402
217331899151,11cyclictest2454344-21diskstats11:50:372
25037372143,7sleep30-21swapper/312:40:013
22311812142,8sleep30-21swapper/308:05:453
2173318991410,2cyclictest0-21swapper/212:25:362
24785522132,6sleep30-21swapper/312:15:013
24627582132,7sleep30-21swapper/311:55:473
23534142134,5sleep30-21swapper/310:05:513
23486342131,8sleep30-21swapper/310:00:533
23043472132,7sleep30-21swapper/309:20:013
22942152133,5sleep30-21swapper/309:10:023
22799482132,7sleep30-21swapper/308:55:413
22239442132,7sleep30-21swapper/307:55:503
22189332132,8sleep30-21swapper/307:50:473
21805732132,7sleep30-21swapper/307:15:373
24890082122,6sleep30-21swapper/312:25:363
24836192122,6sleep30-21swapper/312:20:023
24729972122,6sleep30-21swapper/312:05:543
24729972122,6sleep30-21swapper/312:05:533
24346872122,6sleep30-21swapper/311:30:383
24327392122,6sleep30-21swapper/311:25:453
24140812122,6sleep30-21swapper/311:10:363
24089972122,6sleep30-21swapper/311:05:023
23765052122,6sleep30-21swapper/310:30:423
23644422122,6sleep30-21swapper/310:20:363
23600862122,6sleep30-21swapper/310:15:423
23549612122,6sleep30-21swapper/310:10:413
23096822122,5sleep30-21swapper/309:25:013
22984412122,6sleep30-21swapper/309:10:453
22843712122,6sleep30-21swapper/309:00:353
22749972122,6sleep30-21swapper/308:50:393
22749972122,6sleep30-21swapper/308:50:383
22699022122,6sleep30-21swapper/308:45:383
22445922122,5sleep30-21swapper/308:20:023
22391402122,6sleep30-21swapper/308:10:553
21993842122,6sleep30-21swapper/307:30:543
21940132122,6sleep30-21swapper/307:25:443
21863482122,6sleep30-21swapper/307:20:433
21863482122,6sleep30-21swapper/307:20:423
24787972112,6sleep30-21swapper/312:15:083
24683902112,6sleep30-21swapper/312:01:123
24577072112,5sleep30-21swapper/311:50:453
24528762112,5sleep30-21swapper/311:45:463
24439642112,5sleep30-21swapper/311:40:023
24431162112,6sleep30-21swapper/311:35:523
24247072112,5sleep30-21swapper/311:20:393
24229632112,5sleep30-21swapper/311:15:453
24048082112,5sleep30-21swapper/311:00:413
23995902112,5sleep30-21swapper/310:55:393
23978772111,6sleep30-21swapper/310:50:463
23892882112,6sleep30-21swapper/310:45:043
23843492112,6sleep30-21swapper/310:40:173
23830322112,5sleep30-21swapper/310:35:453
23830322112,5sleep30-21swapper/310:35:453
23690322112,5sleep30-21swapper/310:25:023
23434562111,6sleep30-21swapper/309:55:483
23346922112,5sleep30-21swapper/309:50:023
23250322112,5sleep30-21swapper/309:40:383
23194562112,5sleep30-21swapper/309:35:023
23057852112,5sleep30-21swapper/309:20:413
22646422112,5sleep30-21swapper/308:40:353
22595962112,5sleep30-21swapper/308:35:023
22581132112,5sleep30-21swapper/308:30:453
22501402112,5sleep30-21swapper/308:25:383
22436552112,6sleep30-21swapper/308:15:483
22254272112,5sleep30-21swapper/308:00:393
22064352110,7sleep30-21swapper/307:40:413
22049022112,6sleep30-21swapper/307:39:243
21773602112,5sleep30-21swapper/307:10:473
23147302102,5sleep30-21swapper/309:30:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional