You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-20 - 20:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Thu Aug 20, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
232894521820,2sleep3481ktimers/312:02:413
205668121050,3chrt575-21kworker/3:2+events07:27:453
20957352830,1chrt2095736-21/usr/sbin/munin08:07:442
2037749996149,9cyclictest275-21systemd-journal12:25:001
2037749995841,14cyclictest2104444-21apt-get08:15:001
2037749995446,6cyclictest2169396-21base6409:20:001
2037749995445,6cyclictest2233861-21latency_hist10:25:011
2037749995432,7cyclictest275-21systemd-journal12:29:201
2037749995344,6cyclictest2064687-21latency_hist07:35:011
2037747995344,6cyclictest2367834-21latency_hist12:40:010
2037747995247,4cyclictest2037603-21kworker/u8:2+events_unbound09:02:550
2037747994942,5cyclictest2004918-21kworker/u8:1+flush-8:007:15:060
2037747994841,5cyclictest2273651-21latency_hist11:05:010
2037747994637,5cyclictest2263546-21kworker/u8:1+flush-8:012:22:380
2037747994537,6cyclictest2199256-21latency_hist09:50:010
2037747994336,5cyclictest275-21systemd-journal08:45:010
2037754994237,4cyclictest2037603-21kworker/u8:2+flush-8:008:37:562
2037747994135,4cyclictest1983844-21kworker/u8:0+flush-8:007:37:530
2037747994132,7cyclictest2346988-21ntpq12:17:490
2037754994035,4cyclictest2293403-21kworker/u8:0+events_unbound11:57:432
2037754994035,4cyclictest2037603-21kworker/u8:2+flush-8:007:52:542
2037749994029,9cyclictest2203473-21ntpq09:52:481
2037749994029,8cyclictest2248210-21ntpq10:37:511
2037749993930,7cyclictest2140049-21/usr/sbin/munin08:52:461
2037747993934,4cyclictest1983844-21kworker/u8:0+events_unbound08:37:480
2037747993832,4cyclictest2248727-21grep10:37:580
2037747993831,5cyclictest2060159-21/usr/sbin/munin07:32:540
2037754993729,6cyclictest275-21systemd-journal09:02:582
2037749993729,6cyclictest2183654-21ntpq09:32:491
2037749993728,6cyclictest2119544-21latency_hist08:30:001
2037749993728,6cyclictest2119544-21latency_hist08:30:001
2037749993727,8cyclictest2163639-21ntpq09:12:501
2037747993724,9cyclictest275-21systemd-journal11:20:000
2037754993631,4cyclictest1983844-21kworker/u8:0+flush-8:007:57:502
2037754993630,4cyclictest2174341-21kworker/u8:2+flush-8:010:02:462
2037749993629,5cyclictest1983844-21kworker/u8:0+flush-8:007:42:501
2037749993628,6cyclictest2293829-21apt-get11:27:341
2037749993626,8cyclictest2108853-21ntpq08:17:501
2037747993629,5cyclictest2263546-21kworker/u8:1+flush-8:011:35:000
2037754993530,4cyclictest2293403-21kworker/u8:0+flush-8:012:32:412
2037754993524,9cyclictest2288435-21awk11:20:002
2037749993528,5cyclictest2224416-21apt-get10:17:351
2037749993525,7cyclictest2069656-21latency_hist07:40:011
2037747993529,4cyclictest2037603-21kworker/u8:2+flush-8:007:52:400
203291723521,10sleep20-21swapper/207:05:132
2037749993426,6cyclictest2269112-21/usr/sbin/munin11:02:501
20336312341,29sleep00-21swapper/007:07:440
2037754993327,4cyclictest1983844-21kworker/u8:0+flush-8:008:42:432
2037749993326,5cyclictest2053754-21ntpq07:22:501
2037749993324,7cyclictest2130140-21apt-get08:42:371
2037749993323,8cyclictest2367105-21ntpq12:37:491
2037747993328,4cyclictest1983844-21kworker/u8:0+flush-8:008:17:420
2037747993327,5cyclictest1983844-21kworker/u8:0+flush-8:008:32:400
2037747993327,4cyclictest2037603-21kworker/u8:2+flush-8:008:12:550
2037747993326,6cyclictest2293191-21unixbench_singl11:22:560
2037747993326,5cyclictest2037603-21kworker/u8:2+flush-8:008:30:000
2037747993326,5cyclictest2037603-21kworker/u8:2+flush-8:008:30:000
22853192320,2sleep10-21swapper/111:17:451
2037754993227,4cyclictest2219001-21kworker/u8:3+flush-8:010:32:492
2037754993227,3cyclictest2037603-21kworker/u8:2+flush-8:007:47:532
2037754993226,4cyclictest2279004-21munin-node11:12:362
2037749993228,3cyclictest1983844-21kworker/u8:0+events_unbound08:22:461
2037749993228,3cyclictest1983844-21kworker/u8:0+events_unbound08:22:461
2037747993225,5cyclictest2037603-21kworker/u8:2+flush-8:007:42:380
2037747993225,5cyclictest1983844-21kworker/u8:0+flush-8:008:22:550
2037747993225,5cyclictest1983844-21kworker/u8:0+flush-8:008:22:550
20374102323,7sleep10-21swapper/107:08:011
2037754993124,5cyclictest2059498-21apt-get07:30:002
2037749993128,2cyclictest2204909-21cpuspeed_turbos09:57:391
2037749993124,5cyclictest275-21systemd-journal07:58:191
2037749993123,6cyclictest2223966-21latency_hist10:15:011
2037749993121,7cyclictest2313166-21latency_hist11:45:001
2037747993124,5cyclictest2134913-21kworker/u8:1+flush-8:010:17:400
2037747993120,7cyclictest275-21systemd-journal11:30:000
2037747993119,9cyclictest275-21systemd-journal11:40:000
2037747993119,9cyclictest275-21systemd-journal11:40:000
2037754993025,4cyclictest1983844-21kworker/u8:0+flush-8:008:47:582
2037754993021,7cyclictest2313169-21/usr/sbin/munin11:45:002
2037754993021,7cyclictest2189352-21awk09:40:002
2037749993027,2cyclictest2253918-21systemd-run10:45:001
2037749993025,3cyclictest2323021-21cron11:55:001
2037747993026,3cyclictest2219001-21kworker/u8:3+flush-8:010:13:350
2037747993026,2cyclictest2327739-21unixbench_singl11:57:560
2037747993025,3cyclictest2274319-21cpuspeed_turbos11:07:390
2037747993023,5cyclictest1983844-21kworker/u8:0+flush-8:008:52:470
2037747993022,6cyclictest2179442-21cron09:30:000
2037747993021,7cyclictest2170234-21diskstats09:22:390
2037747993020,8cyclictest2041887-21ntpq07:12:470
2037754992924,4cyclictest2174341-21kworker/u8:2+flush-8:009:47:412
2037754992919,7cyclictest2233922-21cat10:25:012
2037749992925,3cyclictest2293408-21systemd-run11:25:001
2037749992925,2cyclictest2281188-21kthreadcore11:12:461
2037749992921,6cyclictest275-21systemd-journal10:51:201
2037749992919,8cyclictest2193563-21ntpq09:42:501
2037747992925,2cyclictest2199919-21cpuspeed_turbos09:52:380
2037747992923,4cyclictest2164576-21kworker/u8:3+events_unbound09:20:010
2037747992923,4cyclictest2089407-21grep07:57:530
2037747992921,6cyclictest2174341-21kworker/u8:2+flush-8:010:07:500
2037747992919,8cyclictest2213365-21ntpq10:02:500
2037747992918,9cyclictest2322271-21ntpq11:52:470
2037754992822,4cyclictest2219001-21kworker/u8:3+flush-8:010:15:082
2037754992818,8cyclictest275-21systemd-journal08:20:192
2037754992818,8cyclictest275-21systemd-journal08:20:192
2037749992824,3cyclictest2189344-21sendmail09:40:001
2037749992817,8cyclictest2058748-21ntpq07:27:491
2037747992823,4cyclictest2293403-21kworker/u8:0+flush-8:011:50:010
2037747992823,4cyclictest2037603-21kworker/u8:2+flush-8:008:02:410
2037747992822,4cyclictest2037603-21kworker/u8:2+flush-8:008:07:240
2037747992821,5cyclictest2360510-21sed12:32:450
2037747992821,5cyclictest2037603-21kworker/u8:2+flush-8:007:45:020
2037754992724,2cyclictest2332646-21unixbench_multi12:02:542
2037754992723,2cyclictest2070235-21aten2_r5power_v07:42:382
2037754992723,2cyclictest2038178-21aten2_r5power_p07:12:372
2037754992722,4cyclictest2219001-21kworker/u8:3+events_unbound10:37:412
2037754992722,3cyclictest2263546-21kworker/u8:1+flush-8:012:20:052
2037754992720,5cyclictest2189813-21apt-get09:42:382
2037749992723,2cyclictest0-21swapper/108:47:451
2037749992721,5cyclictest2037603-21kworker/u8:2+flush-8:007:52:421
2037749992719,6cyclictest2239497-21apt-get10:32:361
2037749992716,9cyclictest2093824-21ntpq08:02:491
2037747992723,3cyclictest2219001-21kworker/u8:3+flush-8:012:07:540
2037747992723,2cyclictest2149494-21ls09:00:000
2037754992623,2cyclictest2313698-21aten2_r5power_p11:47:382
2037754992623,2cyclictest2045064-21aten2_r5power_c07:17:372
2037754992622,3cyclictest1983844-21kworker/u8:0+flush-8:007:38:292
2037754992617,7cyclictest2298791-21apt-get11:32:372
2037754992616,8cyclictest2293384-21awk11:25:002
2037754992616,8cyclictest2174510-21awk09:25:002
2037749992623,2cyclictest2325639-21kthreadcore11:57:461
2037749992622,3cyclictest2095556-21irqcore08:07:441
2037749992621,3cyclictest0-21swapper/111:50:011
2037749992617,7cyclictest275-21systemd-journal09:05:191
2037749992617,7cyclictest2302552-21ntpq11:32:521
2037747992615,6cyclictest0-21swapper/008:47:390
2037754992522,2cyclictest2214895-21fschecks_time10:07:412
2037754992522,2cyclictest2100012-21aten2_r5power_e08:12:402
2037754992521,2cyclictest2180119-21cpuspeed_turbos09:32:392
2037754992521,2cyclictest2115300-21fschecks_count08:27:402
2037754992521,2cyclictest2115300-21fschecks_count08:27:402
2037754992515,8cyclictest2179460-21awk09:30:002
2037754992511,10cyclictest2274096-21apt-get11:07:372
2037749992521,3cyclictest2154491-21systemd-run09:05:001
2037749992521,2cyclictest2268716-21systemd-run11:00:001
2037749992521,2cyclictest2170573-21irqcore09:22:431
2037749992520,3cyclictest2149541-21systemd-run09:00:011
2037747992521,3cyclictest414-21systemd-logind11:45:000
2037747992520,4cyclictest1983844-21kworker/u8:0+flush-8:007:23:210
2037747992519,4cyclictest2159922-21aten2_r5power_p09:12:380
2037747992518,5cyclictest2263504-21grep10:52:560
2037747992518,5cyclictest2174341-21kworker/u8:2+flush-8:009:32:480
2037754992420,2cyclictest2254398-21aten2_r5power_e10:47:382
2037754992420,2cyclictest2223749-21unixbench_singl10:12:592
2037749992418,4cyclictest2234538-21apt-get10:27:361
2037749992418,4cyclictest0-21swapper/109:47:401
2037749992416,6cyclictest275-21systemd-journal08:40:001
2037747992419,3cyclictest2238223-21needreboot10:27:490
2037747992419,3cyclictest2193804-21mailstats09:42:560
2037747992417,5cyclictest2164576-21kworker/u8:3+flush-8:009:37:240
2037747992416,6cyclictest2158642-21ntpq09:07:490
203775499232,14cyclictest2145012-21apt-get08:57:412
2037754992320,2cyclictest2050325-21fschecks_count07:22:422
2037754992319,3cyclictest2263546-21kworker/u8:1+events_unbound12:35:022
2037754992318,4cyclictest20823-21cron08:35:002
2037754992318,3cyclictest2293403-21kworker/u8:0+flush-8:011:25:062
2037749992320,2cyclictest2254316-21/usr/sbin/munin10:47:531
2037749992319,3cyclictest2347501-21unixbench_multi12:17:561
2037749992319,3cyclictest2332392-21mailstats12:02:521
2037749992319,3cyclictest0-21swapper/109:30:001
2037749992319,2cyclictest0-21swapper/111:40:001
2037749992319,2cyclictest0-21swapper/111:40:001
2037749992319,2cyclictest0-21swapper/108:32:551
2037749992318,3cyclictest0-21swapper/107:15:011
2037747992317,4cyclictest2293403-21kworker/u8:0+flush-8:012:02:440
2037747992317,4cyclictest2219001-21kworker/u8:3+events_unbound10:42:530
2037747992317,4cyclictest1983844-21kworker/u8:0+events_unbound07:27:560
2037747992316,5cyclictest2239418-21kworker/u8:0+flush-8:010:35:010
2037747992315,6cyclictest2254341-21apt-get10:47:350
2037754992218,2cyclictest2165147-21fschecks_time09:17:412
2037754992218,2cyclictest0-21swapper/208:05:012
2037749992218,2cyclictest2213881-21unixbench_singl10:02:571
2037749992218,2cyclictest0-21swapper/112:32:451
2037749992217,4cyclictest2342569-21unixbench_singl12:12:571
2037749992215,5cyclictest0-21swapper/110:07:421
2037747992218,3cyclictest2205211-21sort09:57:440
2037747992218,3cyclictest0-21swapper/011:00:010
2037747992217,3cyclictest2357809-21latency_hist12:30:010
2037747992213,7cyclictest2233129-21ntpq10:22:490
203774799221,18cyclictest2283540-21munin-run11:15:000
2037754992118,2cyclictest2273375-21unixbench_multi11:02:552
2037754992118,2cyclictest2155234-21fschecks_time09:07:402
2037754992111,8cyclictest2239037-21cron10:30:002
2037749992118,2cyclictest2333589-21cpuspeed_turbos12:07:381
2037749992117,2cyclictest0-21swapper/107:47:441
2037749992115,4cyclictest2274096-21apt-get11:07:361
2037747992116,4cyclictest2219001-21kworker/u8:3+flush-8:012:12:540
20761302200,5sleep30-21swapper/307:47:443
203775499202,13cyclictest2338301-21apt-get12:12:392
2037754992016,2cyclictest0-21swapper/208:55:002
2037754992015,4cyclictest2224351-21kworker/u8:2+events_unbound10:57:522
2037754992013,5cyclictest275-21systemd-journal12:10:022
2037749992015,3cyclictest2044844-21kworker/u8:3+flush-8:007:20:001
203775499192,9cyclictest0-21swapper/209:52:462
2037754991915,3cyclictest2293403-21kworker/u8:0+flush-8:012:15:062
2037754991910,7cyclictest275-21systemd-journal08:17:002
2037754991814,2cyclictest0-21swapper/211:37:402
2037754991814,2cyclictest0-21swapper/211:37:402
2037754991812,4cyclictest371rcuc/210:00:002
20330072183,9sleep30-21swapper/307:06:223
2037754991713,2cyclictest0-21swapper/212:27:462
2037754991713,2cyclictest0-21swapper/211:52:442
2037754991713,2cyclictest0-21swapper/210:52:462
2037754991713,2cyclictest0-21swapper/209:10:572
203775499168,6cyclictest2251642-21cut10:42:482
203775499163,8cyclictest2059498-21apt-get07:30:032
22827652156,6sleep30-21swapper/311:12:503
21088032150,5sleep3481ktimers/308:17:493
23619492142,8sleep30-21swapper/312:32:483
22383162142,8sleep30-21swapper/310:27:523
22940712133,6sleep30-21swapper/311:27:393
21893282132,7sleep30-21swapper/309:40:003
21445882132,6sleep30-21swapper/308:55:023
23531992122,6sleep30-21swapper/312:27:383
23515362120,8sleep30-21swapper/312:22:443
23382752122,6sleep30-21swapper/312:12:373
23377152122,6sleep30-21swapper/312:08:243
23145382123,5sleep30-21swapper/311:47:453
23092222122,6sleep30-21swapper/311:42:443
22897832122,5sleep30-21swapper/311:22:453
22839382122,6sleep30-21swapper/311:17:363
22727222120,2sleep3575-21kworker/3:2+events11:02:463
22597392122,6sleep30-21swapper/310:52:443
22547232122,6sleep30-21swapper/310:47:423
22508172122,6sleep30-21swapper/310:42:483
22440462121,6sleep30-21swapper/310:35:023
22297632122,6sleep30-21swapper/310:22:423
22133842122,6sleep30-21swapper/310:02:513
21999502122,6sleep30-21swapper/309:52:403
21794402122,5sleep30-21swapper/309:30:013
21749172122,6sleep30-21swapper/309:27:363
21704792122,6sleep30-21swapper/309:22:433
21650522122,6sleep30-21swapper/309:17:413
21642032122,6sleep30-21swapper/309:13:203
21552972122,6sleep30-21swapper/309:07:423
21539552122,6sleep30-21swapper/309:02:563
21354262122,6sleep30-21swapper/308:47:433
21276642123,6sleep30-21swapper/308:37:483
21144192122,6sleep30-21swapper/308:23:193
21144192122,6sleep30-21swapper/308:23:193
21038702122,6sleep30-21swapper/308:12:563
20953902122,6sleep30-21swapper/308:07:423
20851322122,6sleep30-21swapper/307:57:353
20802012122,6sleep30-21swapper/307:52:383
20701402122,6sleep30-21swapper/307:42:383
20650072122,6sleep30-21swapper/307:36:203
20504722122,6sleep30-21swapper/307:22:443
20450062122,6sleep30-21swapper/307:17:343
23636452112,5sleep30-21swapper/312:37:413
23431082112,5sleep30-21swapper/312:16:183
23232722113,5sleep30-21swapper/311:55:163
23185172112,5sleep30-21swapper/311:52:353
23033022112,5sleep30-21swapper/311:35:013
23033022112,5sleep30-21swapper/311:35:013
22986642112,6sleep30-21swapper/311:31:203
22738842113,5sleep30-21swapper/311:05:123
22644222112,5sleep30-21swapper/310:57:413
22242722112,6sleep30-21swapper/310:16:083
22202862111,6sleep30-21swapper/310:12:473
22147952112,5sleep30-21swapper/310:07:413
22042572112,5sleep30-21swapper/309:55:013
21946822112,6sleep30-21swapper/309:46:503
21896362112,6sleep30-21swapper/309:40:403
21400782111,6sleep30-21swapper/308:52:373
21303892112,6sleep30-21swapper/308:42:423
21201412112,5sleep30-21swapper/308:31:503
21148462112,6sleep30-21swapper/308:25:483
21148462112,6sleep30-21swapper/308:25:483
20898842112,5sleep30-21swapper/308:00:203
20606672112,5sleep30-21swapper/307:32:433
20378892112,5sleep30-21swapper/307:10:203
22392732102,5sleep30-21swapper/310:30:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional