You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-12 - 05:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Thu Nov 12, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
101174521040,6chrt0-21swapper/223:58:302
722960996963,4cyclictest4108854-21kworker/u8:0+events_unbound19:10:010
722960996859,7cyclictest823964-21latency_hist20:50:010
722960996556,7cyclictest1013094-21/usr/sbin/munin00:03:370
722960996556,7cyclictest1013094-21/usr/sbin/munin00:03:370
722965996353,8cyclictest988378-21/usr/sbin/munin23:38:391
8850882620,3chrt75-21kworker/3:1-events21:53:263
722969996050,8cyclictest734722-21cat19:20:002
722965996052,6cyclictest4108854-21kworker/u8:0+flush-8:019:28:411
722965995953,4cyclictest854057-21kworker/u8:0+flush-8:022:23:221
722960995848,7cyclictest932956-21latency_hist22:40:010
722965995752,4cyclictest873522-21kworker/u8:1+events_unbound22:33:361
722965995749,6cyclictest764348-21apt-get19:50:001
722960995650,4cyclictest722809-21kworker/u8:2+flush-8:020:38:360
722960995649,5cyclictest722809-21kworker/u8:2+flush-8:021:23:260
722960995648,5cyclictest765080-21apt-get19:53:190
722965995550,3cyclictest769772-21kworker/u8:1+events_unbound19:58:271
722960995549,4cyclictest873522-21kworker/u8:1+flush-8:021:48:250
722960995549,4cyclictest873522-21kworker/u8:1+flush-8:021:48:250
722960995547,6cyclictest942838-21apt-get22:50:010
722969995447,5cyclictest1012619-21kworker/u8:0+flush-8:000:13:402
722965995447,5cyclictest1002696-21latency_hist23:50:011
7272702530,6sleep20-21swapper/219:13:372
722960995245,5cyclictest838060-21ntpq21:03:320
722960995245,5cyclictest754684-21kworker/u8:1+flush-8:019:43:260
722965995143,6cyclictest912522-21ntpq22:18:351
722965995043,5cyclictest794582-21kworker/u8:3+flush-8:021:03:241
722960995044,4cyclictest789324-21kworker/u8:1+flush-8:020:23:240
722960995039,8cyclictest740384-21diskstats19:28:250
722965994945,3cyclictest854057-21kworker/u8:0+events_unbound22:45:011
722965994942,5cyclictest898852-21apt-get22:08:221
722965994940,7cyclictest833834-21latency_hist21:00:011
722965994842,4cyclictest722809-21kworker/u8:2+flush-8:020:03:381
722960994842,4cyclictest690093-21kworker/u8:3+flush-8:019:23:400
722960994842,4cyclictest690093-21kworker/u8:3+flush-8:019:23:400
722965994738,6cyclictest278-21systemd-journal23:15:451
722960994742,3cyclictest794582-21kworker/u8:3+flush-8:022:28:280
722960994736,8cyclictest952265-21ntpq22:58:340
722969994637,7cyclictest928500-21apt-get22:38:192
722965994636,8cyclictest1031731-21ntpq00:18:341
722960994638,6cyclictest962186-21ntpq23:08:300
722969994531,9cyclictest759409-21awk19:45:012
722965994538,5cyclictest943576-21apt-get22:53:181
722960994539,4cyclictest903804-21apt-get22:13:190
722960994538,5cyclictest773790-21ntpq19:58:310
72296099451,40cyclictest1-21systemd20:35:010
722965994438,4cyclictest809671-21apt-get20:38:181
722965994437,5cyclictest784884-21apt-get20:13:211
722965994436,7cyclictest690093-21kworker/u8:3+flush-8:019:38:381
722960994439,3cyclictest1012619-21kworker/u8:0+events_unbound00:10:010
722960994438,4cyclictest853617-21gpgv21:20:000
722960994438,4cyclictest764377-21kworker/u8:0+flush-8:020:18:340
722960994437,5cyclictest1052224-21latency_hist00:40:000
722960994434,8cyclictest957282-21ntpq23:03:320
722965994338,4cyclictest764377-21kworker/u8:0+flush-8:019:53:241
722965994337,4cyclictest938434-21apt-get22:48:181
722960994336,5cyclictest873522-21kworker/u8:1+flush-8:021:43:350
722969994230,9cyclictest764410-21cat19:50:012
722965994238,3cyclictest854057-21kworker/u8:0+flush-8:021:53:281
722965994236,4cyclictest1012619-21kworker/u8:0+flush-8:000:08:291
722960994235,5cyclictest690093-21kworker/u8:3+flush-8:019:38:280
722960994232,8cyclictest854057-21kworker/u8:0+flush-8:022:33:250
722965994132,7cyclictest819810-21diskstats20:48:241
722965994131,8cyclictest903779-21/usr/sbin/munin22:13:381
722960994136,4cyclictest873522-21kworker/u8:1+events_unbound23:13:300
722960994136,4cyclictest722809-21kworker/u8:2+flush-8:020:53:220
722960994134,5cyclictest953217-21kworker/u8:2+flush-8:023:23:280
722960994035,4cyclictest978234-21kworker/u8:1+events_unbound23:38:270
722960994034,4cyclictest722809-21kworker/u8:2+flush-8:020:58:240
722960994033,6cyclictest978234-21kworker/u8:1+flush-8:023:43:370
722969993933,4cyclictest1037422-21kworker/u8:1+events_unbound00:33:372
722965993933,4cyclictest723353-21apt-get19:13:201
722965993932,5cyclictest794582-21kworker/u8:3+flush-8:022:28:371
722960993935,2cyclictest4108854-21kworker/u8:0+events_unbound19:13:380
722960993933,4cyclictest789324-21kworker/u8:1+events_unbound21:08:320
722960993933,4cyclictest769772-21kworker/u8:1+flush-8:020:03:340
722960993932,5cyclictest779313-21kworker/u8:3+events_unbound20:13:350
722960993931,6cyclictest854057-21kworker/u8:0+flush-8:022:03:320
722969993831,5cyclictest794582-21kworker/u8:3+events_unbound00:18:262
722965993834,3cyclictest794582-21kworker/u8:3+flush-8:020:33:261
722965993831,6cyclictest690093-21kworker/u8:3+events_unbound19:15:021
722965993830,6cyclictest978234-21kworker/u8:1+flush-8:023:43:331
722960993832,4cyclictest854057-21kworker/u8:0+flush-8:022:53:360
72296099381,35cyclictest1-21systemd22:23:450
722965993731,5cyclictest978234-21kworker/u8:1+flush-8:023:58:231
722965993730,5cyclictest690093-21kworker/u8:3+flush-8:019:23:251
722965993730,5cyclictest690093-21kworker/u8:3+flush-8:019:23:251
722965993728,7cyclictest1037908-21apt-get00:28:211
722960993730,5cyclictest967753-21kworker/u8:0+events_unbound23:18:310
7869742360,4sleep30-21swapper/320:13:303
722969993631,4cyclictest978234-21kworker/u8:1+events_unbound23:28:372
722965993630,4cyclictest794582-21kworker/u8:3+events_unbound21:28:241
722965993629,5cyclictest967212-21ntpq23:13:341
722965993628,6cyclictest278-21systemd-journal20:06:291
722965993628,5cyclictest952971-21latency_hist23:00:011
722965993627,7cyclictest893424-21latency_hist22:00:001
722965993626,8cyclictest818458-21ntpq20:43:351
722965993626,7cyclictest873640-21latency_hist21:40:011
722960993630,4cyclictest690093-21kworker/u8:3+events_unbound19:33:270
722969993530,4cyclictest4108854-21kworker/u8:0+flush-8:019:33:312
722969993525,7cyclictest278-21systemd-journal23:20:002
722965993531,3cyclictest722809-21kworker/u8:2+events_unbound21:23:391
722965993529,5cyclictest1037422-21kworker/u8:1+events_unbound00:38:311
722965993529,4cyclictest873522-21kworker/u8:1+events_unbound22:38:221
722965993528,5cyclictest854057-21kworker/u8:0+flush-8:022:03:361
722965993527,6cyclictest874158-21apt-get21:43:191
722965993524,9cyclictest977084-21ntpq23:23:311
722960993530,4cyclictest794582-21kworker/u8:3+flush-8:021:13:370
722960993529,4cyclictest794582-21kworker/u8:3+events_unbound21:38:410
722960993528,5cyclictest854057-21kworker/u8:0+flush-8:022:43:220
722960993528,5cyclictest789324-21kworker/u8:1+events_unbound20:28:330
722960993526,7cyclictest1047292-21latency_hist00:35:010
722969993429,4cyclictest769772-21kworker/u8:1+events_unbound20:03:242
722965993429,4cyclictest794582-21kworker/u8:3+events_unbound21:35:011
722965993428,5cyclictest789324-21kworker/u8:1+flush-8:021:13:421
722965993428,4cyclictest764377-21kworker/u8:0+flush-8:020:18:311
722960993429,4cyclictest987281-21kworker/u8:2+events_unbound23:53:220
722960993428,4cyclictest794582-21kworker/u8:3+flush-8:021:28:370
722960993427,5cyclictest794582-21kworker/u8:3+events_unbound22:08:260
722960993426,6cyclictest4108854-21kworker/u8:0+flush-8:019:18:340
722960993422,2cyclictest0-21swapper/020:08:290
722969993327,3cyclictest780239-21fschecks_count20:08:252
722965993327,4cyclictest722809-21kworker/u8:2+flush-8:021:18:331
722965993325,5cyclictest1042863-21apt-get00:33:201
722965993226,5cyclictest978234-21kworker/u8:1+flush-8:023:53:351
722965993222,8cyclictest745041-21/usr/sbin/munin19:33:311
722960993228,3cyclictest690093-21kworker/u8:3+events_unbound19:48:210
722960993223,7cyclictest983759-21fschecks_time23:33:250
722960993222,8cyclictest909093-21fschecks_time22:18:250
722969993122,6cyclictest799802-21apt-get20:28:192
722965993126,4cyclictest794582-21kworker/u8:3+events_unbound00:05:001
722965993126,4cyclictest794582-21kworker/u8:3+events_unbound00:05:001
722965993125,5cyclictest722809-21kworker/u8:2+events_unbound20:53:311
722960993125,4cyclictest889207-21cpuspeed_turbos21:58:230
722960993120,9cyclictest278-21systemd-journal00:30:010
722969993026,3cyclictest854057-21kworker/u8:0+events_unbound21:38:252
722969993025,3cyclictest878403-21unixbench_multi21:43:392
722965993025,3cyclictest1027457-21cron00:15:011
722965993021,7cyclictest879117-21apt-get21:48:191
722965993021,7cyclictest879117-21apt-get21:48:191
722965993020,2cyclictest421rcuog/223:33:351
722960993026,3cyclictest854057-21kworker/u8:0+flush-8:021:33:380
722960993025,3cyclictest978234-21kworker/u8:1+flush-8:023:58:340
722960993025,3cyclictest1023370-21fschecks_time00:13:250
722960993024,4cyclictest794582-21kworker/u8:3+events_unbound00:18:410
722969992924,4cyclictest794582-21kworker/u8:3+flush-8:020:23:332
722969992924,4cyclictest794582-21kworker/u8:3+events_unbound00:25:012
722969992924,4cyclictest764377-21kworker/u8:0+flush-8:019:58:362
722969992924,3cyclictest952752-21unixbench_multi22:58:422
722969992921,6cyclictest765302-21tr19:53:222
722969992918,9cyclictest853667-21cat21:20:002
722965992924,4cyclictest1012619-21kworker/u8:0+events_unbound00:23:281
722965992923,5cyclictest794582-21kworker/u8:3+events_unbound23:08:211
722965992922,5cyclictest798529-21needreboot20:23:311
722960992925,2cyclictest979433-21kthreadcore23:28:280
722960992923,4cyclictest987281-21kworker/u8:2+flush-8:023:48:260
722969992823,3cyclictest789954-21aten2_r5power_v20:18:202
722965992824,3cyclictest722809-21kworker/u8:2+flush-8:019:43:401
722965992821,5cyclictest789324-21kworker/u8:1+flush-8:021:08:341
722969992723,2cyclictest750356-21fschecks_time19:38:272
722969992722,3cyclictest894200-21fschecks_count22:03:222
722969992721,4cyclictest947872-21unixbench_singl22:53:372
722969992720,6cyclictest839-21mta-sts-daemon22:20:002
722969992615,8cyclictest848616-21turbostat.cron21:15:002
722965992622,3cyclictest794582-21kworker/u8:3+flush-8:023:03:361
722965992620,5cyclictest789324-21kworker/u8:1+events_unbound20:28:351
72296099260,25cyclictest828924-21kworker/0:0+events21:51:000
722969992520,3cyclictest942671-21unixbench_singl22:48:392
722969992520,3cyclictest1018345-21fschecks_count00:08:242
722969992516,6cyclictest278-21systemd-journal23:35:002
722969992513,9cyclictest744571-21awk19:30:002
722960992521,3cyclictest794582-21kworker/u8:3+flush-8:020:43:380
722969992420,3cyclictest923649-21aten2_r5power_p22:33:232
722969992420,2cyclictest839382-21aten2_r5power_v21:08:232
722969992420,2cyclictest278-21systemd-journal23:40:002
722969992419,3cyclictest967686-21unixbench_singl23:13:402
722969992419,3cyclictest1042191-21unixbench_singl00:28:412
722969992413,9cyclictest813419-21ntpq20:38:332
722965992418,4cyclictest978234-21kworker/u8:1+flush-8:023:28:401
722969992318,3cyclictest1017356-21unixbench_multi00:03:382
722969992318,3cyclictest1017356-21unixbench_multi00:03:382
722969992311,9cyclictest854581-21diskstats21:23:262
722960992315,5cyclictest1033214-21grep00:23:270
7930652220,1sleep375-21kworker/3:1-events20:18:273
722969992218,2cyclictest0-21swapper/220:13:322
722969992218,2cyclictest0-21swapper/200:40:002
722969992217,3cyclictest863546-21unixbench_singl21:28:382
7182182214,12sleep10-21swapper/119:05:591
722969992016,2cyclictest0-21swapper/221:03:332
722969992015,3cyclictest987281-21kworker/u8:2+flush-8:023:55:012
72296999201,17cyclictest977825-21munin-run23:25:002
722969992011,6cyclictest868874-21sort21:35:012
722969991916,2cyclictest735398-21cpuspeed_turbos19:23:232
722969991916,2cyclictest735398-21cpuspeed_turbos19:23:222
722969991915,3cyclictest884160-21aten2_r5power_v21:53:212
722969991914,3cyclictest904119-21fschecks_time22:13:242
722969991911,5cyclictest937575-21threads22:43:372
722969991910,6cyclictest278-21systemd-journal20:33:322
72296999190,10cyclictest9604021kthreadcore23:08:262
7184272193,9sleep30-21swapper/319:08:223
72296999188,8cyclictest891616-21tr21:58:292
72296999187,8cyclictest903308-21awk22:10:012
72296999182,12cyclictest957290-21ntpq23:03:332
722969991813,3cyclictest0-21swapper/222:30:002
72296999181,12cyclictest913691-21apt-get22:23:192
7181472184,10sleep20-21swapper/219:05:032
7840102170,2sleep3471rcuc/320:08:403
722969991713,3cyclictest819876-21fschecks_time20:48:242
722969991713,2cyclictest0-21swapper/223:48:312
722969991712,3cyclictest0-21swapper/221:48:242
722969991712,3cyclictest0-21swapper/221:48:232
10013102170,2sleep3451irq_work/323:48:283
722969991612,2cyclictest0-21swapper/220:56:462
722969991611,3cyclictest0-21swapper/223:43:292
7997772152,8sleep30-21swapper/320:28:193
722969991512,2cyclictest0-21swapper/220:42:022
8479512142,8sleep30-21swapper/321:13:343
7536952143,7sleep30-21swapper/319:38:343
72296999143,9cyclictest824532-21cut20:53:202
9777902132,6sleep30-21swapper/323:25:003
8934032132,6sleep30-21swapper/322:00:023
8499052133,7sleep30-21swapper/321:18:273
8190462132,6sleep30-21swapper/320:45:013
10274512132,6sleep30-21swapper/300:15:003
10027192133,6sleep30-21swapper/323:50:013
9920912122,6sleep30-21swapper/323:38:343
9770602122,6sleep30-21swapper/323:23:333
9683652122,6sleep30-21swapper/323:18:193
9633312122,6sleep30-21swapper/323:12:443
9606082122,6sleep30-21swapper/323:08:283
9435502122,6sleep30-21swapper/322:53:193
9409202122,6sleep30-21swapper/322:48:293
9334792122,6sleep30-21swapper/322:43:203
9282762122,6sleep30-21swapper/322:35:443
9240892122,6sleep30-21swapper/322:33:283
9115082122,6sleep30-21swapper/322:18:323
8987762122,6sleep30-21swapper/322:07:443
8979282122,6sleep30-21swapper/322:03:393
8828712122,6sleep30-21swapper/321:48:343
8828712122,6sleep30-21swapper/321:48:333
8687052122,6sleep30-21swapper/321:35:013
8679602122,6sleep30-21swapper/321:33:333
8601602122,6sleep30-21swapper/321:28:273
8398172122,6sleep30-21swapper/321:08:293
8377982122,6sleep30-21swapper/321:03:313
8331582122,6sleep30-21swapper/320:58:343
8189242122,6sleep30-21swapper/320:43:403
8137732122,6sleep30-21swapper/320:38:393
8046752122,6sleep30-21swapper/320:33:093
7793112122,6sleep30-21swapper/320:03:403
7594152122,6sleep30-21swapper/319:45:023
7445582122,6sleep30-21swapper/319:30:013
7347562122,6sleep30-21swapper/319:20:013
7347562122,6sleep30-21swapper/319:20:013
7305882122,6sleep30-21swapper/319:18:253
10513192122,6sleep30-21swapper/300:38:293
10430462122,6sleep30-21swapper/300:33:233
10322532122,6sleep30-21swapper/300:18:433
10180522122,6sleep30-21swapper/300:08:193
10125712122,5sleep30-21swapper/300:00:013
9930902112,5sleep30-21swapper/323:40:143
9831692113,5sleep30-21swapper/323:30:073
9482992113,5sleep30-21swapper/322:55:363
9191022112,6sleep30-21swapper/322:28:273
9136602112,6sleep30-21swapper/322:23:133
9035742112,6sleep30-21swapper/322:10:413
8750762112,5sleep30-21swapper/321:43:283
8542092112,6sleep30-21swapper/321:22:053
8242022112,6sleep30-21swapper/320:50:113
7946252112,6sleep30-21swapper/320:21:053
7697742112,6sleep30-21swapper/319:55:133
7549212112,6sleep30-21swapper/319:43:133
7401392112,5sleep30-21swapper/319:28:243
7232172112,6sleep30-21swapper/319:11:553
10376442112,6sleep30-21swapper/300:25:163
10333222112,5sleep30-21swapper/300:23:283
10130392112,6sleep30-21swapper/300:02:373
10130392112,6sleep30-21swapper/300:02:363
9532142102,5sleep30-21swapper/323:00:053
7648022102,5sleep30-21swapper/319:50:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional