You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 05:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Thu Mar 26, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
223174121120,6chrt0-21swapper/221:06:342
24155242860,5sleep20-21swapper/200:11:332
23475342700,2chrt75-21kworker/3:1-events23:01:363
2114374995940,16cyclictest280-21systemd-journal22:21:381
2114372995646,7cyclictest2180725-21latency_hist20:15:010
23874262510,2sleep3481ktimers/323:41:373
23571602480,4chrt0-21swapper/023:11:360
23688502450,5sleep20-21swapper/223:21:372
22663252440,5sleep375-21kworker/3:1-events21:41:343
21289292440,2sleep3471rcuc/319:21:373
2114374994435,7cyclictest2126774-21/usr/sbin/munin19:21:391
2114372994333,8cyclictest2166556-21diskstats20:01:310
2114372994234,6cyclictest2389648-21latency_hist23:45:010
23092212400,6sleep20-21swapper/222:21:422
2114374994031,7cyclictest280-21systemd-journal21:18:381
2114374993932,5cyclictest2176149-21apt-get20:11:261
2114376993832,4cyclictest2354246-21journal-offline23:07:312
2114372993829,7cyclictest2439873-21cpuspeed_turbos00:36:300
2114372993829,6cyclictest2190636-21latency_hist20:25:010
21138082384,10sleep10-21swapper/119:07:231
2114372993626,8cyclictest2254583-21ntpq21:26:410
211437299361,30cyclictest2094084-21kworker/0:2+events19:45:460
2114372993529,4cyclictest2364594-21dpkg23:20:000
211437299351,29cyclictest2094084-21kworker/0:2+events19:20:540
2114376993424,7cyclictest2444225-21apt-get00:40:012
2114374993426,6cyclictest2335029-21/usr/sbin/munin22:51:391
2114372993427,5cyclictest2285682-21grep22:01:300
211437299342,27cyclictest2225721-21kworker/0:0+events22:20:280
211437299342,15cyclictest2276219-21cut21:51:330
2114376993328,4cyclictest2176018-21kworker/u8:2+flush-8:022:31:432
2114374993227,3cyclictest2320948-21irqrtprio22:36:321
2114372993225,5cyclictest280-21systemd-journal19:42:010
211437299322,29cyclictest2205740-21kworker/0:1+events21:03:160
211437299321,26cyclictest2225721-21kworker/0:0+events21:55:420
211437299321,25cyclictest2205740-21kworker/0:1+events20:50:420
211437299319,20cyclictest2161016-21kworker/0:0+events20:30:060
211437299319,20cyclictest2161016-21kworker/0:0+events20:30:060
2114372993123,7cyclictest2404958-21kworker/u8:0+flush-8:000:16:320
2114372993123,5cyclictest2314918-21latency_hist22:30:010
2114372993121,7cyclictest2205704-21latency_hist20:40:000
2114372993121,7cyclictest2205704-21latency_hist20:40:000
211437299311,29cyclictest2161016-21kworker/0:0+events20:06:400
211437299310,25cyclictest2225721-21kworker/0:0+events23:00:320
2114374993026,2cyclictest2319881-21munin-run22:35:001
2114374993019,9cyclictest2140401-21ntpq19:31:391
211437299307,18cyclictest2094084-21kworker/0:2+events19:30:500
211437299302,27cyclictest2225721-21kworker/0:0+events23:51:020
2114372993022,6cyclictest2184729-21missed_timers20:16:380
211437299300,26cyclictest2225721-21kworker/0:0+events21:30:040
211437299300,25cyclictest2225721-21kworker/0:0+events23:46:080
2114376992923,4cyclictest1965130-21kworker/u8:0+flush-8:020:41:502
2114374992922,5cyclictest2255065-21grep21:26:461
2114374992920,6cyclictest280-21systemd-journal21:21:381
211437299293,25cyclictest2225721-21kworker/0:0+events00:21:000
211437299293,25cyclictest2225721-21kworker/0:0+events00:21:000
2114372992924,3cyclictest2300075-21cron22:15:000
211437299292,25cyclictest2225721-21kworker/0:0+events21:35:300
211437299292,22cyclictest2225721-21kworker/0:0+events00:05:200
211437299291,27cyclictest2225721-21kworker/0:0+events22:51:240
211437299291,26cyclictest2225721-21kworker/0:0+events23:27:380
211437299291,26cyclictest2225721-21kworker/0:0+events21:06:440
2114372992910,17cyclictest2094084-21kworker/0:2+events19:20:000
2114372992910,14cyclictest2225721-21kworker/0:0+events22:35:520
211437299290,24cyclictest2225721-21kworker/0:0+events21:40:200
2114376992824,2cyclictest2201159-21aten2_r5power_e20:36:302
2114376992824,2cyclictest2201159-21aten2_r5power_e20:36:302
2114374992825,2cyclictest2302606-21kthreadcore22:16:361
2114374992825,2cyclictest2302606-21kthreadcore22:16:361
2114374992824,2cyclictest2266349-21irqrtprio21:41:341
2114374992824,2cyclictest2170879-21ls20:05:001
2114374992823,3cyclictest2350600-21irqrtprio23:06:341
2114374992823,3cyclictest2225653-21cron21:00:001
2114374992822,4cyclictest2345528-21irqcore23:01:331
2114374992819,6cyclictest280-21systemd-journal00:32:591
2114374992818,8cyclictest2373876-21ntpq23:26:391
2114374992818,8cyclictest2234753-21ntpq21:06:401
211437299287,19cyclictest2225721-21kworker/0:0+events21:22:020
211437299286,21cyclictest2094084-21kworker/0:2+events19:38:360
211437299286,18cyclictest2414642-21kworker/0:1+events00:10:200
211437299286,18cyclictest2225721-21kworker/0:0+events21:10:260
211437299282,25cyclictest2205740-21kworker/0:1+events20:44:340
2114372992822,4cyclictest2350137-21grep23:06:310
211437299282,24cyclictest2225721-21kworker/0:0+events23:31:300
2114372992822,4cyclictest2061778-21kworker/u8:1+events_unbound19:11:350
2114372992816,9cyclictest2408882-21ntpq00:01:400
211437299281,25cyclictest2225721-21kworker/0:0+events21:47:300
211437299281,23cyclictest2225721-21kworker/0:0+events22:45:140
211437299280,27cyclictest2225721-21kworker/0:0+events23:57:240
2114376992723,2cyclictest2324505-21unixbench_singl22:36:452
2114376992723,2cyclictest2310626-21fschecks_count22:26:292
2114376992722,3cyclictest2284696-21unixbench_singl21:56:462
2114374992723,2cyclictest2285371-21latency_hist22:00:011
2114374992723,2cyclictest2156075-21cron19:50:001
2114374992723,2cyclictest0-21swapper/100:40:011
2114374992722,3cyclictest2394877-21systemd-run23:50:001
2114374992722,3cyclictest0-21swapper/119:20:001
2114374992718,6cyclictest2423637-21ntpq00:16:401
2114374992717,8cyclictest2289404-21ntpq22:01:421
2114374992717,7cyclictest280-21systemd-journal21:00:381
211437299278,18cyclictest2225721-21kworker/0:0+events22:32:000
211437299278,14cyclictest2225721-21kworker/0:0+events00:30:080
211437299272,20cyclictest2225721-21kworker/0:0+events22:40:430
2114372992718,6cyclictest2384336-21grep23:36:460
211437299271,25cyclictest2225721-21kworker/0:0+events22:57:040
211437299271,25cyclictest2225721-21kworker/0:0+events00:28:180
211437299271,25cyclictest2205740-21kworker/0:1+events20:59:020
211437299271,25cyclictest2094084-21kworker/0:2+events19:26:520
2114372992712,13cyclictest2094084-21kworker/0:2+events19:55:000
2114372992710,16cyclictest2205740-21kworker/0:1+events20:46:440
2114376992622,3cyclictest2175487-21unixbench_singl20:06:482
2114376992622,2cyclictest2196018-21aten2_r5power_p20:31:302
2114376992622,2cyclictest2196018-21aten2_r5power_p20:31:302
2114376992622,2cyclictest2181434-21fschecks_time20:16:312
2114376992621,4cyclictest2365067-21kworker/u8:3+flush-8:023:56:392
2114374992623,2cyclictest2188222-21kthreadcore20:21:371
2114374992622,2cyclictest0-21swapper/100:21:471
2114374992622,2cyclictest0-21swapper/100:21:471
2114374992620,4cyclictest2205354-21unixbench_multi20:36:471
2114374992620,4cyclictest2205354-21unixbench_multi20:36:471
2114374992617,7cyclictest280-21systemd-journal23:25:001
2114374992615,8cyclictest2354449-21apt-get23:10:011
211437299267,18cyclictest2161016-21kworker/0:0+events20:26:200
211437299266,19cyclictest2225721-21kworker/0:0+events22:15:040
211437299266,19cyclictest2225721-21kworker/0:0+events22:15:040
211437299266,18cyclictest2094084-21kworker/0:2+events19:57:260
23126322250,2sleep12312636-21cut22:26:341
2114376992521,2cyclictest2405401-21fschecks_time00:01:302
2114376992521,2cyclictest2279729-21unixbench_multi21:51:462
2114376992521,2cyclictest2166529-21cpuspeed_turbos20:01:302
2114376992521,2cyclictest2137038-21fschecks_time19:31:312
2114376992521,2cyclictest2119018-21unixbench_singl19:11:462
2114376992520,4cyclictest2195559-21cron20:30:002
2114376992519,4cyclictest2145903-21unixbench_singl19:36:482
2114376992518,5cyclictest280-21systemd-journal23:50:002
2114374992522,2cyclictest2398877-21needreboot23:51:381
2114374992521,3cyclictest2215257-21unixbench_singl20:46:461
2114374992521,2cyclictest0-21swapper/123:31:281
2114374992521,2cyclictest0-21swapper/100:05:001
2114374992520,4cyclictest2208235-21sed20:41:361
2114374992520,3cyclictest2145851-21unixbench_multi19:36:471
211437299256,18cyclictest2225721-21kworker/0:0+events23:20:560
211437299256,18cyclictest2225721-21kworker/0:0+events21:17:320
21597722240,2sleep10-21swapper/119:51:361
2114376992419,4cyclictest2274888-21kworker/u8:1+events_unbound22:56:392
2114376992418,4cyclictest2428551-21needreboot00:21:392
2114376992418,4cyclictest2428551-21needreboot00:21:392
2114374992420,3cyclictest2300113-21systemd-run22:15:001
2114374992420,2cyclictest0-21swapper/121:50:001
2114374992420,2cyclictest0-21swapper/120:00:001
2114374992420,2cyclictest0-21swapper/100:06:441
2114374992418,4cyclictest2260012-21unixbench_singl21:31:481
2114374992418,4cyclictest2119044-21unixbench_singl19:11:461
2114374992416,6cyclictest2181083-21apt-get20:16:271
2114374992414,8cyclictest2175058-21ntpq20:06:441
211437299241,21cyclictest2225721-21kworker/0:0+events22:05:220
2114376992319,2cyclictest2395503-21fschecks_count23:51:312
2114376992315,6cyclictest2274247-21grep21:46:382
2114376992314,7cyclictest2245490-21awk21:20:002
2114374992319,2cyclictest2340728-21irqrtprio22:56:331
2114374992319,2cyclictest0-21swapper/123:56:381
2114374992318,3cyclictest885-21mta-sts-daemon20:51:331
2114374992318,3cyclictest1-21systemd00:11:481
2114374992315,6cyclictest2200177-21unixbench_multi20:31:471
2114374992315,6cyclictest2200177-21unixbench_multi20:31:471
2114374992218,2cyclictest0-21swapper/123:41:291
2114374992218,2cyclictest0-21swapper/121:51:311
2114374992218,2cyclictest0-21swapper/100:26:311
2114374992216,4cyclictest0-21swapper/122:06:361
2114372992215,4cyclictest2114412-21latency_hist19:10:010
2114376992118,2cyclictest2375397-21fschecks_time23:31:312
2114376992118,2cyclictest2240242-21unixbench_singl21:11:462
2114376992117,2cyclictest2127017-21cpuspeed_turbos19:21:302
2114376992117,2cyclictest0-21swapper/223:30:002
211437699210,8cyclictest21878712cut20:21:372
211437499217,5cyclictest0-21swapper/121:35:481
2114374992117,2cyclictest2193156-21kthreadcore20:26:361
2114374992117,2cyclictest0-21swapper/123:16:261
2114374992117,2cyclictest0-21swapper/122:41:371
2114374992113,6cyclictest2334044-21ps22:46:481
211437699202,13cyclictest2269347-21ntpq21:41:392
211437699202,13cyclictest2255722-21apt-get21:31:292
211437699202,12cyclictest2151486-21apt-get19:46:272
2114376992016,2cyclictest2211095-21aten2_r5power_p20:46:282
2114376992016,2cyclictest0-21swapper/223:45:012
2114376992016,2cyclictest0-21swapper/222:50:002
2114376992015,4cyclictest1965130-21kworker/u8:0+flush-8:019:15:052
2114376992015,3cyclictest0-21swapper/222:20:002
2114376992015,3cyclictest0-21swapper/222:20:002
2114376992012,6cyclictest2179758-21sed20:11:382
2114374992016,2cyclictest0-21swapper/123:35:381
2114374992016,2cyclictest0-21swapper/121:11:331
2114374992016,2cyclictest0-21swapper/119:26:361
2114374992014,4cyclictest0-21swapper/119:41:351
2114376991915,3cyclictest0-21swapper/221:21:382
2114376991915,2cyclictest2424184-21unixbench_singl00:16:472
2114376991914,3cyclictest0-21swapper/219:51:362
211437699191,13cyclictest2146575-21apt-get19:41:292
2114376991910,7cyclictest2364621-21systemd-run23:20:002
2114376991815,2cyclictest2161580-21cpuspeed_turbos19:56:292
2114376991814,3cyclictest2274888-21kworker/u8:1+flush-8:022:41:362
2114376991814,2cyclictest2222921-21kthreadcore20:56:372
2114376991814,2cyclictest0-21swapper/223:36:452
2114376991814,2cyclictest0-21swapper/223:01:392
2114376991812,4cyclictest2220920-21cat20:55:012
211437699181,12cyclictest2131757-21apt-get19:26:292
21137612184,10sleep20-21swapper/219:06:482
21093962183,8sleep30-21swapper/319:05:203
23400072172,9sleep30-21swapper/322:56:273
2114376991713,2cyclictest0-21swapper/222:15:002
2114376991713,2cyclictest0-21swapper/221:36:282
2114376991713,2cyclictest0-21swapper/200:06:282
2114376991712,3cyclictest0-21swapper/221:26:352
211437699171,12cyclictest2290581-21apt-get22:06:292
211437699171,12cyclictest2285009-21apt-get22:00:032
211437699170,6cyclictest2339648-21sh22:55:002
211437699167,7cyclictest2436989-21tr00:31:372
2114376991613,2cyclictest0-21swapper/223:11:452
2114376991612,2cyclictest2226307-21fschecks_count21:01:312
2114376991611,3cyclictest0-21swapper/200:26:362
22347212154,8sleep30-21swapper/321:06:403
23496792132,6sleep30-21swapper/323:05:023
22752782132,6sleep30-21swapper/321:50:023
21519632132,7sleep30-21swapper/319:46:343
21218572132,7sleep30-21swapper/319:16:333
24384782122,6sleep30-21swapper/300:31:423
24306892123,5sleep30-21swapper/300:26:363
24253582122,6sleep30-21swapper/300:21:353
24253582122,6sleep30-21swapper/300:21:353
24193632123,5sleep30-21swapper/300:12:283
24097122122,5sleep30-21swapper/300:05:013
24050912122,6sleep30-21swapper/300:01:283
24000342122,6sleep30-21swapper/323:55:383
23989502122,6sleep30-21swapper/323:51:413
23803742122,6sleep30-21swapper/323:36:323
23749082122,6sleep30-21swapper/323:30:023
23663322122,6sleep30-21swapper/323:21:353
23596322122,5sleep30-21swapper/323:15:013
23561502122,6sleep30-21swapper/323:11:363
23389412122,6sleep30-21swapper/322:51:463
23346822121,6sleep30-21swapper/322:50:013
23242452122,6sleep30-21swapper/322:36:453
23092422122,6sleep30-21swapper/322:21:443
23009242122,6sleep30-21swapper/322:16:343
23009242122,6sleep30-21swapper/322:16:343
22945962122,6sleep30-21swapper/322:06:473
22850462122,5sleep30-21swapper/322:00:013
22804382122,6sleep30-21swapper/321:56:283
22602862122,5sleep30-21swapper/321:35:013
22504542122,5sleep30-21swapper/321:25:023
22469702122,6sleep30-21swapper/321:21:363
22387872122,6sleep30-21swapper/321:11:373
22256972122,6sleep30-21swapper/321:00:013
22249422122,6sleep30-21swapper/320:56:443
22176692123,5sleep30-21swapper/320:51:353
22097912122,6sleep30-21swapper/320:41:393
21464762122,6sleep30-21swapper/319:40:323
24396222112,5sleep30-21swapper/300:36:273
24199372112,5sleep30-21swapper/300:16:293
23939672112,5sleep30-21swapper/323:46:393
23701752112,5sleep30-21swapper/323:26:293
23248522112,5sleep30-21swapper/322:40:023
23191502112,5sleep30-21swapper/322:31:433
23103092112,5sleep30-21swapper/322:26:253
22955272112,5sleep30-21swapper/322:11:293
22751282112,6sleep30-21swapper/321:49:583
22644502112,5sleep30-21swapper/321:36:413
22407622112,5sleep30-21swapper/321:15:023
22142352112,5sleep30-21swapper/320:46:373
22011062112,6sleep30-21swapper/320:36:303
22011062112,6sleep30-21swapper/320:36:303
21968182112,5sleep30-21swapper/320:31:363
21968182112,5sleep30-21swapper/320:31:363
21950062112,5sleep30-21swapper/320:26:473
21899022112,6sleep30-21swapper/320:21:453
21818502112,5sleep30-21swapper/320:16:353
21760712112,6sleep30-21swapper/320:10:453
21711072112,5sleep30-21swapper/320:05:043
21661712112,5sleep30-21swapper/320:00:023
21613572112,5sleep30-21swapper/319:56:293
21567862112,5sleep30-21swapper/319:51:313
21413852112,5sleep30-21swapper/319:35:023
21367052112,5sleep30-21swapper/319:31:293
21317292112,5sleep30-21swapper/319:26:273
21149212112,6sleep30-21swapper/319:11:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional