You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-25 - 11:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue Aug 25, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2790118996861,4cyclictest3063245-21kworker/u8:2+events_unbound00:00:011
30867422650,2sleep3471rcuc/300:15:013
2790115995647,6cyclictest3035650-21latency_hist23:15:000
2790115995647,6cyclictest3035650-21latency_hist23:15:000
2790118995450,2cyclictest2976071-21kworker/u8:2+flush-8:022:42:501
2790115995441,10cyclictest275-21systemd-journal20:10:000
2790115995316,24cyclictest0-21swapper/022:07:350
2790120995245,5cyclictest2871709-21apt-get20:30:002
2790118995243,6cyclictest2941248-21latency_hist21:40:011
2790118995146,4cyclictest2976071-21kworker/u8:2+events_unbound23:12:521
2790118995146,4cyclictest2976071-21kworker/u8:2+events_unbound23:12:521
2790115995131,17cyclictest2866759-21latency_hist20:25:010
2790118994942,5cyclictest2871536-21kworker/u8:3+flush-8:021:07:421
2790118994942,5cyclictest2871536-21kworker/u8:3+flush-8:021:07:421
2790115994928,18cyclictest2985315-21ntpq22:22:500
2790118994843,4cyclictest3063245-21kworker/u8:2+flush-8:000:04:431
2790118994642,3cyclictest2976071-21kworker/u8:2+flush-8:023:00:001
2790118994640,4cyclictest2871536-21kworker/u8:3+flush-8:020:45:311
2790115994627,17cyclictest2791363-21kthreadcore19:12:410
2790118994540,3cyclictest2871536-21kworker/u8:3+flush-8:020:32:431
2790118994539,4cyclictest2911550-21kworker/u8:1+flush-8:023:02:351
28570192440,1sleep12857018-21cat20:15:011
2790118994436,6cyclictest2881857-21latency_hist20:40:011
2790118994337,4cyclictest3030305-21kworker/u8:3+flush-8:023:17:511
2790118994336,5cyclictest3063245-21kworker/u8:2+events_unbound00:17:511
2790118994336,5cyclictest2918006-21kworker/u8:0+flush-8:021:30:311
2790118994236,4cyclictest2871536-21kworker/u8:3+flush-8:020:52:411
2790118994235,5cyclictest3097629-21/usr/sbin/munin00:32:531
2790118994235,5cyclictest1987140-21kworker/u8:4+events_unbound19:42:471
2790118994235,5cyclictest1987140-21kworker/u8:4+events_unbound19:37:441
2790118994136,4cyclictest2797204-21kworker/u8:0+flush-8:019:55:311
2790115994129,9cyclictest275-21systemd-journal00:00:170
2790115994030,7cyclictest2945666-21ntpq21:42:460
2790115994028,10cyclictest3025545-21latency_hist23:05:000
2790115994025,13cyclictest275-21systemd-journal20:19:430
2790120993930,7cyclictest275-21systemd-journal23:35:002
2790118993934,4cyclictest2826492-21kworker/u8:1+flush-8:019:50:311
2790118993932,5cyclictest2918006-21kworker/u8:0+flush-8:000:07:461
2790118993931,6cyclictest2811818-21latency_hist19:30:011
2790115993917,20cyclictest2822419-21diskstats19:42:370
2790118993834,3cyclictest2976071-21kworker/u8:2+events_unbound22:25:001
2790118993832,4cyclictest2918006-21kworker/u8:0+events_unbound23:07:541
2790115993827,8cyclictest275-21systemd-journal23:38:310
2790120993726,8cyclictest2881873-21awk20:40:002
2790118993733,3cyclictest3030305-21kworker/u8:3+flush-8:023:32:531
2790118993729,6cyclictest2797204-21kworker/u8:0+flush-8:020:17:521
2790115993726,8cyclictest275-21systemd-journal22:40:000
279011599372,10cyclictest571-21snmpd21:12:330
2790115993720,15cyclictest2806639-21unixbench_singl19:22:540
2790115993719,15cyclictest0-21swapper/019:15:050
2790120993626,8cyclictest2856727-21cp20:15:012
2790118993632,3cyclictest2871536-21kworker/u8:3+flush-8:020:45:001
2790118993630,4cyclictest2640161-21kworker/u8:2+flush-8:020:07:481
2790118993627,7cyclictest3010059-21ntpq22:47:481
2790118993625,9cyclictest275-21systemd-journal21:13:311
2790115993632,3cyclictest1987140-21kworker/u8:4+flush-8:019:35:010
2790118993530,4cyclictest2871536-21kworker/u8:3+flush-8:020:57:381
2790118993530,3cyclictest2971092-21cron22:10:001
2790118993529,5cyclictest2911550-21kworker/u8:1+flush-8:022:02:521
2790115993526,7cyclictest2980265-21ntpq22:17:450
2790115993526,6cyclictest3054918-21ntpq23:32:450
2790115993524,8cyclictest275-21systemd-journal23:59:000
2790115993520,13cyclictest2842436-21cpuspeed_turbos20:02:380
2790115993517,16cyclictest3046514-21irqcore23:27:390
2790118993429,3cyclictest1987140-21kworker/u8:4+events_unbound19:15:001
2790118993428,4cyclictest3070198-21kworker/u8:1+flush-8:000:37:471
2790118993426,6cyclictest3050478-21latency_hist23:30:011
2790115993428,4cyclictest3090831-21needreboot00:17:460
279011599341,8cyclictest3106203-21memory00:37:450
2790115993418,14cyclictest3098110-21runrttasks00:32:400
2790115993417,15cyclictest2941392-21systemd21:40:010
279011599341,4cyclictest3010245-21python322:47:520
279011599341,31cyclictest1-21systemd19:37:300
279011599341,10cyclictest3011881-21/usr/sbin/munin22:52:400
279011599341,10cyclictest2855901-21ntpq20:12:480
2790118993328,4cyclictest2871536-21kworker/u8:3+events_unbound21:27:381
2790118993328,4cyclictest2797204-21kworker/u8:0+events_unbound20:02:441
2790118993328,3cyclictest2797204-21kworker/u8:0+flush-8:019:22:501
2790118993327,4cyclictest2902078-21apt-get21:02:321
2790118993327,4cyclictest2797204-21kworker/u8:0+flush-8:020:22:461
2790118993326,5cyclictest2918006-21kworker/u8:0+flush-8:023:45:011
2790118993325,6cyclictest2976071-21kworker/u8:2+flush-8:022:52:451
2790118993324,7cyclictest275-21systemd-journal23:47:401
279011599338,8cyclictest3082778-21ps00:12:430
2790115993315,16cyclictest3026758-21sort23:07:420
2790115993315,14cyclictest0-21swapper/023:20:000
279011599330,9cyclictest2925817-21/usr/sbin/munin21:22:530
279011599330,27cyclictest2881901-21kworker/0:1+events21:05:480
279011599330,27cyclictest2881901-21kworker/0:1+events21:05:480
2790118993227,3cyclictest2946430-21apt21:45:001
2790118993226,5cyclictest2918006-21kworker/u8:0+events_unbound22:37:471
2790118993225,5cyclictest2911550-21kworker/u8:1+flush-8:022:32:381
2790118993225,5cyclictest2871709-21apt-get20:30:011
2790118993225,5cyclictest2797204-21kworker/u8:0+events_unbound19:32:511
279011599321,9cyclictest3062010-21/usr/sbin/munin23:42:480
279011599321,8cyclictest2832445-21/usr/sbin/munin19:52:390
2790115993216,15cyclictest0-21swapper/023:55:000
2790115993216,14cyclictest0-21swapper/020:47:450
2790115993215,15cyclictest2811839-21systemd-run19:30:010
2790115993214,16cyclictest2935778-21mailstats21:32:480
2790115993213,17cyclictest2841246-21unixbench_multi19:57:530
2790115993212,18cyclictest2931395-21sh21:30:010
279011599321,11cyclictest571-21snmpd22:27:470
279011599320,8cyclictest2921447-21sendmail21:20:000
2790118993126,4cyclictest2911550-21kworker/u8:1+flush-8:022:27:561
2790118993126,3cyclictest2871536-21kworker/u8:3+events_unbound21:25:011
279011599318,21cyclictest0-21swapper/020:37:390
279011599312,8cyclictest2975297-21ntpq22:12:470
279011599312,5cyclictest3005308-21python322:42:510
279011599311,9cyclictest2956754-21/usr/sbin/munin21:57:340
279011599311,9cyclictest2876183-21ntpq20:32:480
279011599311,8cyclictest2947296-21/usr/sbin/munin21:47:400
2790115993114,15cyclictest0-21swapper/020:51:130
2790115993114,15cyclictest0-21swapper/020:27:450
2790115993111,7cyclictest2827020-21seq19:46:470
2790115993110,6cyclictest2886427-21sed20:42:540
279011599310,8cyclictest3016201-21/usr/sbin/munin22:57:340
279011599310,8cyclictest2952187-21/usr/sbin/munin21:52:420
279011599310,8cyclictest2906033-21find21:02:500
2790118993025,4cyclictest2911550-21kworker/u8:1+events_unbound22:17:491
279011599302,5cyclictest2790117-21latency_hist19:10:000
279011599302,5cyclictest2790117-21latency_hist19:10:000
279011599301,9cyclictest3077603-21/usr/sbin/munin00:07:360
279011599301,8cyclictest2991594-21/usr/sbin/munin22:32:370
279011599301,8cyclictest2961855-21/usr/sbin/munin22:02:360
2790115993012,16cyclictest0-21swapper/000:27:370
2790118992925,3cyclictest2871536-21kworker/u8:3+flush-8:021:17:371
2790118992919,8cyclictest2830900-21ntpq19:47:481
279011599291,8cyclictest3069925-21/usr/sbin/munin23:47:520
279011599291,8cyclictest2900869-21ntpq20:57:460
2790120992824,2cyclictest2837081-21aten2_r5power_p19:57:352
2790120992821,5cyclictest2941361-21cp21:40:012
2790120992820,6cyclictest275-21systemd-journal23:40:012
2790118992823,4cyclictest3063245-21kworker/u8:2+flush-8:000:12:371
2790118992823,4cyclictest2918006-21kworker/u8:0+events_unbound00:24:271
2790118992822,4cyclictest2976071-21kworker/u8:2+events_unbound23:22:421
2790118992822,4cyclictest2911550-21kworker/u8:1+events_unbound21:52:501
2790120992724,2cyclictest3056422-21fschecks_count23:37:372
2790120992723,3cyclictest2851381-21unixbench_multi20:07:532
2790120992723,2cyclictest2986673-21fschecks_count22:27:382
2790120992717,8cyclictest2891755-21awk20:50:002
2790120992717,8cyclictest275-21systemd-journal00:10:002
2790120992716,9cyclictest3015669-21awk22:55:002
2790118992722,4cyclictest2797204-21kworker/u8:0+events_unbound19:17:361
279011599271,9cyclictest573-21runrttasks23:22:340
2790120992621,4cyclictest3071779-21idleruntime-cro00:00:002
2790118992622,3cyclictest3056218-21aten2_r5power_p23:37:351
2790118992622,3cyclictest2911550-21kworker/u8:1+events_unbound22:15:001
2790118992622,3cyclictest2911550-21kworker/u8:1+events_unbound21:58:151
2790118992620,4cyclictest3097223-21systemd-run00:30:001
2790120992522,2cyclictest3021282-21cpuspeed_turbos23:02:372
2790120992520,4cyclictest3045531-21idleruntime-cro23:25:012
279011599250,8cyclictest3092288-21idleruntime-cro00:25:000
2790120992420,2cyclictest2797738-21fschecks_time19:17:372
2790120992419,3cyclictest2832963-21sed19:52:412
2790118992419,3cyclictest0-21swapper/121:47:381
279012099232,8cyclictest29066232latency_hist21:05:002
2790120992319,2cyclictest2816780-21sh19:35:002
2790120992319,2cyclictest0-21swapper/223:20:002
2790118992319,2cyclictest0-21swapper/123:55:011
279012099222,15cyclictest2892191-21apt-get20:52:342
2790120992219,2cyclictest2790497-21aten2_r5power_e19:12:352
279012099215,3cyclictest30981112cat00:32:402
279012099212,13cyclictest2946873-21apt-get21:47:362
2790120992118,2cyclictest2981693-21cpuspeed_turbos22:22:372
2790120992118,2cyclictest2926949-21aten2_r5power_v21:27:362
2790120992117,2cyclictest2991429-21aten2_r5power_p22:32:352
2790120992117,2cyclictest2827419-21fschecks_time19:47:382
2790120992117,2cyclictest0-21swapper/223:30:012
27853532214,11sleep10-21swapper/119:05:591
27853532214,11sleep10-21swapper/119:05:591
28309762203,6sleep30-21swapper/319:47:513
279012099202,13cyclictest3001303-21apt-get22:42:342
2790120992016,2cyclictest3097073-21unixbench_singl00:28:592
2790120992016,2cyclictest2946207-21unixbench_singl21:42:532
2790120992016,2cyclictest0-21swapper/220:20:002
2790120992015,4cyclictest20823-21cron00:20:002
2790120992015,4cyclictest0-21swapper/222:57:492
2790120992011,7cyclictest2826650-21cron19:45:002
2790120992010,7cyclictest2935279-21tr21:32:412
27898802204,10sleep20-21swapper/219:09:342
27898802204,10sleep20-21swapper/219:09:342
279012099195,9cyclictest2872389-21apt-get20:32:352
279012099192,12cyclictest2817214-21apt-get19:37:342
2790120991915,2cyclictest0-21swapper/221:07:382
2790120991915,2cyclictest0-21swapper/221:07:382
2790120991913,4cyclictest3030305-21kworker/u8:3+flush-8:023:47:422
2790120991910,7cyclictest2974513-21tr22:12:452
2790120991910,2cyclictest0-21swapper/222:07:482
29362112182,5sleep30-21swapper/321:34:183
279012099189,7cyclictest2844382-21cut20:02:442
2790120991814,2cyclictest2862486-21cpuspeed_turbos20:22:372
2790120991814,2cyclictest0-21swapper/222:02:352
2790120991812,2cyclictest0-21swapper/222:17:462
2790120991811,5cyclictest3082091-21seq00:11:372
2790120991811,5cyclictest275-21systemd-journal23:10:002
27853972183,9sleep30-21swapper/319:06:343
27853972183,9sleep30-21swapper/319:06:343
31070412172,5sleep30-21swapper/300:39:263
28216282172,5sleep30-21swapper/319:39:123
27948402173,4sleep30-21swapper/319:13:043
279012099179,6cyclictest2804007-21tr19:22:432
279012099178,7cyclictest2922737-21sed21:22:432
279012099172,11cyclictest2996830-21ps22:37:402
279012099172,11cyclictest2915768-21ntpq21:12:462
2790120991713,2cyclictest0-21swapper/222:47:532
2790120991713,2cyclictest0-21swapper/221:52:562
279012099171,12cyclictest2811077-21ntpq19:27:472
2790120991711,2cyclictest0-21swapper/223:12:522
2790120991711,2cyclictest0-21swapper/223:12:522
30816532162,4sleep30-21swapper/300:09:003
279012099167,7cyclictest3103481-21cut00:37:422
279012099162,13cyclictest0-21swapper/220:57:512
279012099162,13cyclictest0-21swapper/220:40:472
2790120991613,2cyclictest0-21swapper/221:15:032
2790120991612,3cyclictest3072282-21aten2_r5power_c00:02:312
29664992151,4sleep30-21swapper/322:06:323
279012099152,12cyclictest0-21swapper/223:51:572
2790120991510,3cyclictest0-21swapper/221:57:402
2790120991410,2cyclictest0-21swapper/200:20:102
30705612132,6sleep30-21swapper/323:50:023
30455532132,6sleep30-21swapper/323:25:023
30316912132,7sleep30-21swapper/323:12:423
30316912132,7sleep30-21swapper/323:12:423
30265102133,6sleep30-21swapper/323:07:403
30149362132,7sleep30-21swapper/322:52:473
29653952132,7sleep30-21swapper/322:02:473
28951002132,7sleep30-21swapper/320:52:443
28869982132,6sleep30-21swapper/320:45:023
28860962132,7sleep30-21swapper/320:42:493
28716972131,6sleep30-21swapper/320:30:013
28613082132,6sleep30-21swapper/320:17:533
28459422132,7sleep30-21swapper/320:02:483
30935992123,6sleep30-21swapper/300:27:383
30918932122,6sleep30-21swapper/300:20:113
30867422122,6sleep30-21swapper/300:15:023
30724982122,6sleep30-21swapper/300:02:343
30658562122,6sleep30-21swapper/323:45:403
30598272123,6sleep30-21swapper/323:37:463
30552022122,6sleep30-21swapper/323:32:523
30408522122,6sleep30-21swapper/323:20:043
30381992122,6sleep30-21swapper/323:17:433
30247122122,6sleep30-21swapper/323:02:463
30100732122,6sleep30-21swapper/322:47:503
30012752122,6sleep30-21swapper/322:42:323
29958852122,5sleep30-21swapper/322:35:013
29918392122,6sleep30-21swapper/322:32:413
29720452122,6sleep30-21swapper/322:12:423
29610992122,6sleep30-21swapper/321:58:503
29522872122,6sleep30-21swapper/321:52:443
29453112122,6sleep30-21swapper/321:42:443
29363192122,5sleep30-21swapper/321:35:023
29307352122,6sleep30-21swapper/321:27:523
29222792122,6sleep30-21swapper/321:22:423
29207492123,6sleep30-21swapper/321:17:483
29060972122,6sleep30-21swapper/321:02:523
29009562122,6sleep30-21swapper/320:57:503
28810582122,6sleep30-21swapper/320:37:473
28618442122,6sleep30-21swapper/320:20:023
28564412122,6sleep30-21swapper/320:12:553
28365762122,5sleep30-21swapper/319:55:023
28118012122,5sleep30-21swapper/319:30:013
28035152122,6sleep30-21swapper/319:22:433
28016612122,6sleep30-21swapper/319:17:533
31013422112,5sleep30-21swapper/300:32:483
30714672112,6sleep30-21swapper/323:56:083
30608652112,5sleep30-21swapper/323:40:023
30159232112,6sleep30-21swapper/322:55:323
29861882112,5sleep30-21swapper/322:25:023
29858152112,6sleep30-21swapper/322:23:183
29764482112,6sleep30-21swapper/322:17:163
29467182112,6sleep30-21swapper/321:45:533
29118622113,5sleep30-21swapper/321:11:263
29071942112,5sleep30-21swapper/321:07:373
29071942112,5sleep30-21swapper/321:07:373
28723142112,6sleep30-21swapper/320:31:583
28471062112,6sleep30-21swapper/320:07:133
28318902112,6sleep30-21swapper/319:50:403
28262532112,5sleep30-21swapper/319:42:543
28071342112,6sleep30-21swapper/319:25:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional