You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-27 - 09:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot4s.osadl.org (updated Thu Aug 27, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
250272722140,2sleep3471rcuc/300:32:403
232090522030,3sleep3575-21kworker/3:2-events21:27:443
220362221590,3sleep30-21swapper/319:32:393
230470721390,3chrt575-21kworker/3:2-events21:12:433
24312652620,5sleep12431266-21unixbench_multi23:17:501
2180968996053,5cyclictest2187929-21kworker/u8:1+flush-8:019:52:511
2180968995852,4cyclictest2471674-21kworker/u8:0+events_unbound00:40:001
2180968995549,4cyclictest2161284-21kworker/u8:2+events_unbound19:17:431
2180968995448,5cyclictest2212164-21kworker/u8:0+flush-8:020:12:461
2180968995348,4cyclictest2471708-21kworker/u8:4+events_unbound00:17:341
2180973995247,4cyclictest2307069-21kworker/u8:3+flush-8:021:17:482
2180968995245,5cyclictest2336454-21kworker/u8:3+flush-8:021:52:511
2180968995145,5cyclictest2386720-21kworker/u8:2+flush-8:023:02:451
2180968995145,5cyclictest2386720-21kworker/u8:2+flush-8:023:02:451
2180968994944,3cyclictest2336454-21kworker/u8:3+events_unbound21:47:361
2180968994943,4cyclictest2426448-21kworker/u8:2+flush-8:023:57:521
2180968994943,4cyclictest2406803-21kworker/u8:0+events_unbound23:07:491
2180968994943,4cyclictest2406803-21kworker/u8:0+events_unbound23:07:491
2180968994943,4cyclictest2312362-21kworker/u8:1+flush-8:021:37:491
2180968994942,5cyclictest2461308-21kworker/u8:1+flush-8:000:22:351
2180968994940,6cyclictest2316822-21latency_hist21:25:011
2180963994939,7cyclictest2316819-21apt-get21:25:010
2180968994844,3cyclictest2471708-21kworker/u8:4+flush-8:000:32:521
2180968994842,4cyclictest2161284-21kworker/u8:2+events_unbound19:22:341
2180963994840,5cyclictest2185829-21latency_hist19:15:010
218096399483,36cyclictest2331893-21kworker/0:1+events22:02:320
2180968994742,4cyclictest2366517-21kworker/u8:1+flush-8:022:57:461
2180968994742,4cyclictest2212164-21kworker/u8:0+events_unbound19:42:501
2180973994634,10cyclictest2317738-21diskstats21:27:362
2180968994639,5cyclictest2406578-21latency_hist22:55:001
2180973994540,4cyclictest2212164-21kworker/u8:0+flush-8:021:47:452
2180968994541,3cyclictest2312362-21kworker/u8:1+events_unbound21:32:361
2180968994540,4cyclictest2356447-21kworker/u8:2+events_unbound22:12:451
2180968994540,4cyclictest2187929-21kworker/u8:1+events_unbound20:22:381
2180968994540,3cyclictest2441784-21kworker/u8:1+flush-8:023:37:531
2180968994540,3cyclictest2212164-21kworker/u8:0+flush-8:022:07:401
2180968994539,5cyclictest2271977-21kworker/u8:2+events_unbound21:27:491
2180968994539,5cyclictest2237541-21kworker/u8:2+flush-8:020:07:491
2180963994534,9cyclictest2371940-21kworker/u8:0+flush-8:022:32:470
2180973994438,4cyclictest2471708-21kworker/u8:4+flush-8:000:12:542
2180968994439,4cyclictest2371940-21kworker/u8:0+events_unbound22:37:381
2180968994438,5cyclictest2336454-21kworker/u8:3+flush-8:021:57:511
2180968994437,6cyclictest2212164-21kworker/u8:0+flush-8:019:57:341
2180963994433,9cyclictest275-21systemd-journal19:30:000
2180973994333,8cyclictest2336030-21ntpq21:42:432
2180968994338,4cyclictest2187929-21kworker/u8:1+events_unbound20:27:391
2180968994338,3cyclictest2212164-21kworker/u8:0+events_unbound21:42:421
2180968994337,5cyclictest2202879-21kworker/u8:3+flush-8:019:32:401
2180968994337,4cyclictest2386720-21kworker/u8:2+flush-8:022:47:371
2180968994337,4cyclictest2212164-21kworker/u8:0+events_unbound20:57:391
2180968994336,5cyclictest2161284-21kworker/u8:2+flush-8:019:27:331
2180968994335,6cyclictest2396688-21latency_hist22:45:011
2180973994238,3cyclictest2271977-21kworker/u8:2+flush-8:020:52:402
2180973994238,3cyclictest2271977-21kworker/u8:2+flush-8:020:52:402
2180968994238,3cyclictest2406803-21kworker/u8:0+events_unbound23:12:401
2180968994237,4cyclictest2271977-21kworker/u8:2+flush-8:021:12:381
2180968994236,5cyclictest2217971-21kworker/u8:3+flush-8:020:37:511
2180968994236,4cyclictest2471708-21kworker/u8:4+flush-8:000:02:401
2180968994236,4cyclictest2271977-21kworker/u8:2+flush-8:020:42:391
2180968994235,5cyclictest2471674-21kworker/u8:0+flush-8:000:07:471
2180968994235,5cyclictest2426448-21kworker/u8:2+flush-8:023:47:511
2180968994235,5cyclictest2217971-21kworker/u8:3+events_unbound20:02:491
2180963994232,7cyclictest2212511-21latency_hist19:40:010
2180968994135,4cyclictest2372155-21apt-get22:22:321
2180968994135,4cyclictest2217971-21kworker/u8:3+events_unbound20:17:391
2180968994135,4cyclictest2212164-21kworker/u8:0+events_unbound20:47:431
2180968994134,5cyclictest2371940-21kworker/u8:0+flush-8:022:32:461
22208372400,9sleep0141ktimers/019:47:490
2180973994035,4cyclictest2161284-21kworker/u8:2+flush-8:019:27:432
2180968994035,4cyclictest2336454-21kworker/u8:3+events_unbound22:17:351
2180968994034,4cyclictest2336454-21kworker/u8:3+flush-8:022:02:351
2180968994034,4cyclictest2217971-21kworker/u8:3+flush-8:021:07:461
2180968994034,4cyclictest2212164-21kworker/u8:0+events_unbound21:02:421
2180968994034,4cyclictest2161284-21kworker/u8:2+events_unbound19:12:371
2180963994030,8cyclictest2213221-21diskstats19:42:350
2180963994030,7cyclictest2311773-21latency_hist21:20:010
2180973993935,3cyclictest2461308-21kworker/u8:1+flush-8:000:17:472
2180973993930,7cyclictest275-21systemd-journal21:59:292
2180968993933,4cyclictest2406803-21kworker/u8:0+flush-8:023:22:471
2180968993933,4cyclictest2187929-21kworker/u8:1+events_unbound20:32:511
218096399393,29cyclictest2366520-21kworker/0:2+events22:57:340
2180963993931,5cyclictest2361568-21latency_hist22:10:010
2180963993920,14cyclictest2471708-21kworker/u8:4+flush-8:000:17:310
2180973993834,3cyclictest2312362-21kworker/u8:1+flush-8:021:22:522
2180968993832,5cyclictest2436733-21kworker/u8:3+flush-8:023:42:421
2180963993829,7cyclictest2262677-21/usr/sbin/munin20:32:500
218096399381,32cyclictest2421691-21kworker/0:0+events00:02:120
21767712384,10sleep10-21swapper/119:07:371
2180973993728,7cyclictest2376652-21turbostat.cron22:25:002
2180968993732,4cyclictest2371940-21kworker/u8:0+flush-8:022:27:531
2180968993728,6cyclictest275-21systemd-journal23:30:001
2180968993728,6cyclictest275-21systemd-journal21:18:291
2180963993728,6cyclictest275-21systemd-journal22:45:000
2180963993727,7cyclictest2381613-21latency_hist22:30:010
2180963993726,9cyclictest275-21systemd-journal23:20:010
2180973993632,3cyclictest2161284-21kworker/u8:2+flush-8:019:22:412
2180968993629,5cyclictest2271977-21kworker/u8:2+flush-8:020:52:341
2180968993629,5cyclictest2271977-21kworker/u8:2+flush-8:020:52:341
2180963993627,6cyclictest2441486-21latency_hist23:30:010
2180963993626,7cyclictest2207597-21latency_hist19:35:010
218096399361,30cyclictest2331893-21kworker/0:1+events21:40:100
2180973993530,4cyclictest2271977-21kworker/u8:2+flush-8:020:47:502
2180973993530,4cyclictest2149424-21kworker/u8:0+flush-8:019:15:062
2180968993529,4cyclictest2461308-21kworker/u8:1+flush-8:000:27:511
2180968993529,4cyclictest2426448-21kworker/u8:2+flush-8:023:52:411
218096399351,33cyclictest2252437-21kworker/0:2+events21:01:340
2180973993429,3cyclictest2161284-21kworker/u8:2+flush-8:019:30:072
2180968993430,3cyclictest2187929-21kworker/u8:1+events_unbound19:47:591
218096399343,29cyclictest2421691-21kworker/0:0+events23:42:320
2180963993429,3cyclictest1-21systemd23:15:000
2180963993425,7cyclictest2233005-21/usr/sbin/munin20:02:500
218096399341,31cyclictest2237544-21kworker/0:0+events20:07:300
2180963993411,21cyclictest2237544-21kworker/0:0+events20:22:340
21764732340,4sleep20-21swapper/219:07:332
2180973993328,4cyclictest2406803-21kworker/u8:0+flush-8:023:07:382
2180973993328,4cyclictest2406803-21kworker/u8:0+flush-8:023:07:382
2180973993318,2cyclictest421rcuog/222:32:332
218096399339,19cyclictest2366520-21kworker/0:2+events22:35:520
2180963993324,7cyclictest2321981-21latency_hist21:30:010
2180963993324,6cyclictest2471184-21latency_hist00:00:010
2180963993319,12cyclictest2322427-21apt-get21:32:320
2180973993228,3cyclictest2237541-21kworker/u8:2+flush-8:020:05:012
2180973993227,4cyclictest2461308-21kworker/u8:1+flush-8:000:28:162
2180968993228,3cyclictest2471708-21kworker/u8:4+flush-8:000:12:571
218096399329,21cyclictest2252437-21kworker/0:2+events20:39:340
218096399329,18cyclictest2366520-21kworker/0:2+events23:00:400
218096399329,18cyclictest2366520-21kworker/0:2+events23:00:400
2180963993227,3cyclictest2506682-21sshd00:37:320
218096399322,29cyclictest2331893-21kworker/0:1+events21:52:460
218096399321,30cyclictest2331893-21kworker/0:1+events22:17:320
218096399321,29cyclictest2185874-21kworker/0:2+events19:22:380
2180963993211,19cyclictest2331893-21kworker/0:1+events22:10:280
2180963993211,16cyclictest2366520-21kworker/0:2+events22:20:020
2180968993124,5cyclictest275-21systemd-journal23:33:291
218096399317,19cyclictest2421691-21kworker/0:0+events00:25:520
218096399312,27cyclictest2421691-21kworker/0:0+events00:07:520
218096399312,27cyclictest2331893-21kworker/0:1+events21:47:500
218096399312,27cyclictest2312247-21kworker/0:3+events21:37:480
218096399312,27cyclictest2252437-21kworker/0:2+events20:57:340
218096399311,29cyclictest2331893-21kworker/0:1+events21:59:120
218096399311,28cyclictest2421691-21kworker/0:0+events23:52:320
2180973993025,3cyclictest2432068-21aten2_r5power_e23:22:342
2180968993025,3cyclictest2208040-21apt-get19:37:331
2180963993025,3cyclictest2301839-21cron21:10:000
218096399302,27cyclictest2237544-21kworker/0:0+events20:12:400
218096399301,27cyclictest2421691-21kworker/0:0+events23:22:320
218096399301,27cyclictest2252437-21kworker/0:2+events20:52:440
218096399301,27cyclictest2252437-21kworker/0:2+events20:52:440
2180973992926,2cyclictest2510743-21unixbench_multi00:37:492
2180973992925,3cyclictest2302582-21fschecks_count21:12:382
2180973992924,3cyclictest2367162-21cpuspeed_turbos22:17:342
2180973992924,3cyclictest2223383-21fschecks_count19:52:362
2180963992921,6cyclictest2496208-21latency_hist00:25:010
218096399291,27cyclictest2237544-21kworker/0:0+events20:17:440
218096399291,26cyclictest2421691-21kworker/0:0+events23:32:440
2180963992910,17cyclictest2366520-21kworker/0:2+events23:07:400
2180963992910,17cyclictest2366520-21kworker/0:2+events23:07:400
218096399290,27cyclictest2421691-21kworker/0:0+events00:12:500
2180973992825,2cyclictest2292746-21fschecks_time21:02:372
2180973992824,2cyclictest2181529-21cpuspeed_turbos19:12:342
2180973992821,5cyclictest2253205-21cut20:22:352
2180973992817,8cyclictest2416491-21apt23:05:002
2180973992817,8cyclictest2416491-21apt23:05:002
218096399288,19cyclictest2421691-21kworker/0:0+events23:36:480
218096399282,25cyclictest2252437-21kworker/0:2+events20:27:520
2180963992822,4cyclictest1-21systemd23:50:000
2180963992811,16cyclictest2185874-21kworker/0:2+events19:52:520
2180963992810,16cyclictest2366520-21kworker/0:2+events22:47:300
23424602270,3sleep20-21swapper/221:52:352
2180973992723,3cyclictest2441958-21aten2_r5power_c23:32:332
2180973992723,3cyclictest2238226-21fschecks_count20:07:332
2180973992723,2cyclictest2451101-21unixbench_multi23:37:522
2180973992722,3cyclictest2406803-21kworker/u8:0+flush-8:022:55:052
2180973992722,3cyclictest2357339-21fschecks_count22:07:352
2180973992719,6cyclictest275-21systemd-journal00:35:002
218096399277,16cyclictest2252437-21kworker/0:2+events21:10:320
218096399276,20cyclictest2185874-21kworker/0:2+events19:17:280
218096399273,19cyclictest2366520-21kworker/0:2+events22:52:060
2180963992710,15cyclictest2252437-21kworker/0:2+events20:47:300
21762292273,18sleep00-21swapper/019:06:080
2180973992622,3cyclictest2296929-21kworker/u8:1+flush-8:021:08:052
218096399267,14cyclictest2252437-21kworker/0:2+events20:40:020
218096399266,19cyclictest2227648-21kworker/0:1+events19:56:320
218096399263,21cyclictest2421691-21kworker/0:0+events00:31:340
2180973992522,2cyclictest2258056-21fschecks_count20:27:372
2180973992522,2cyclictest2218412-21cpuspeed_turbos19:47:422
2180973992421,2cyclictest2291940-21basename21:00:002
2180973992420,2cyclictest2431340-21unixbench_singl23:17:502
2180973992419,4cyclictest2371940-21kworker/u8:0+flush-8:022:27:422
218097399237,3cyclictest161rcu_preempt23:15:002
2180973992319,3cyclictest2356330-21unixbench_multi22:02:522
2180973992318,4cyclictest2461308-21kworker/u8:1+flush-8:000:00:212
2180973992310,4cyclictest0-21swapper/222:12:352
218097399230,5cyclictest22764422ld20:42:472
2180973992213,7cyclictest2455115-21seq23:42:412
218097399214,15cyclictest2266645-21awk20:32:502
218097399202,12cyclictest2228052-21apt-get19:57:332
2180973992016,2cyclictest2495944-21unixbench_multi00:22:502
2180973992015,3cyclictest0-21swapper/219:45:012
21806462202,10sleep30-21swapper/319:08:163
21890572190,3sleep3575-21kworker/3:2+mm_percpu_wq19:17:383
218097399196,2cyclictest421rcuog/223:47:422
218097399192,12cyclictest2402056-21apt-get22:52:302
2180973991916,2cyclictest2477005-21aten2_r5power_v00:07:332
2180973991916,2cyclictest2331858-21sendmail21:40:002
2180973991914,3cyclictest2212289-21unixbench_singl19:37:532
218097399190,5cyclictest2440838-21ntpq23:27:482
21945902180,2sleep3471rcuc/319:22:393
218097399182,4cyclictest0-21swapper/223:50:282
218097399182,4cyclictest0-21swapper/221:33:432
2180973991815,2cyclictest2471421-21latency_hist00:00:012
2180973991814,2cyclictest0-21swapper/222:42:402
2180973991812,4cyclictest2399772-21kthreadcore22:47:392
2180973991811,5cyclictest2268383-21ps20:37:392
218097399181,11cyclictest2242921-21apt-get20:12:342
22792532170,2sleep3471rcuc/320:47:393
218097399172,4cyclictest0-21swapper/220:15:262
2180973991611,3cyclictest0-21swapper/222:40:002
23817902142,6sleep30-21swapper/322:30:013
21983672142,8sleep30-21swapper/319:27:343
24953102132,7sleep30-21swapper/300:22:423
24315892132,6sleep30-21swapper/323:20:023
24020282132,7sleep30-21swapper/322:52:293
24008642132,7sleep30-21swapper/322:47:433
23777962132,6sleep30-21swapper/322:27:413
23282722132,7sleep30-21swapper/321:37:443
23220282132,6sleep30-21swapper/321:30:023
22978232132,7sleep30-21swapper/321:07:393
25068982122,6sleep30-21swapper/300:37:353
24865532122,6sleep30-21swapper/300:15:323
24815572122,6sleep30-21swapper/300:10:023
24804642122,6sleep30-21swapper/300:07:453
24755512122,6sleep30-21swapper/300:02:443
24704182122,6sleep30-21swapper/323:57:463
24564062122,6sleep30-21swapper/323:45:023
24556172123,5sleep30-21swapper/323:42:453
24508512122,6sleep30-21swapper/323:37:523
24419322122,6sleep30-21swapper/323:32:343
24414712122,6sleep30-21swapper/323:30:013
24265972123,6sleep30-21swapper/323:15:003
24211562122,6sleep30-21swapper/323:07:503
24211562122,6sleep30-21swapper/323:07:503
23921962122,6sleep30-21swapper/322:42:343
23880992122,6sleep30-21swapper/322:37:403
23668332122,6sleep30-21swapper/322:16:293
23622552122,6sleep30-21swapper/322:12:363
23469432122,5sleep30-21swapper/321:55:023
23461172123,6sleep30-21swapper/321:52:493
23318382122,5sleep30-21swapper/321:40:013
23109582122,6sleep30-21swapper/321:17:423
22964632122,6sleep30-21swapper/321:02:533
22824752122,6sleep30-21swapper/320:52:303
22824752122,6sleep30-21swapper/320:52:303
22723732122,6sleep30-21swapper/320:40:023
22659212122,6sleep30-21swapper/320:32:433
22580462122,6sleep30-21swapper/320:27:383
22531162122,6sleep30-21swapper/320:22:363
22500802122,6sleep30-21swapper/320:17:423
22377462122,5sleep30-21swapper/320:05:023
22368752122,6sleep30-21swapper/320:02:503
22226922122,5sleep30-21swapper/319:50:013
22185642122,6sleep30-21swapper/319:47:453
24970552112,6sleep30-21swapper/300:27:403
24616402113,5sleep30-21swapper/323:51:403
24268522113,5sleep30-21swapper/323:15:163
24122192112,5sleep30-21swapper/323:02:363
24122192112,5sleep30-21swapper/323:02:363
23719342112,5sleep30-21swapper/322:20:023
23566342112,5sleep30-21swapper/322:05:013
23519562112,6sleep30-21swapper/322:00:483
23381292112,5sleep30-21swapper/321:47:403
23161152112,5sleep30-21swapper/321:22:483
22879862112,5sleep30-21swapper/320:57:393
22680302112,5sleep30-21swapper/320:37:373
22279742113,5sleep30-21swapper/319:56:523
22127362112,5sleep30-21swapper/319:40:023
22087752113,5sleep30-21swapper/319:37:413
21811932112,5sleep30-21swapper/319:11:293
24067972102,5sleep30-21swapper/322:55:023
22427042102,5sleep30-21swapper/320:10:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional