You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 23:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sun May 31, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
331852421430,2sleep3471rcuc/312:15:593
33068832630,3sleep375-21kworker/3:1+events12:05:433
3008893996156,4cyclictest2649202-21kworker/u8:2+flush-8:007:20:001
31729062590,1sleep13172910-21kthreadcore09:50:471
3008893995750,5cyclictest3254380-21kworker/u8:3+events_unbound11:45:501
3008893995748,6cyclictest3100012-21latency_hist08:40:001
32153172560,4chrt0-21swapper/010:35:430
3008893995648,5cyclictest1913152-21kworker/u8:0+events_unbound08:50:501
3008891995240,9cyclictest3337968-21ntpq12:35:480
3008893995045,4cyclictest1913152-21kworker/u8:0+flush-8:008:20:551
3008893995045,3cyclictest3035703-21kworker/u8:3+events_unbound07:40:001
3008893995043,5cyclictest3150006-21kworker/u8:3+flush-8:010:25:521
3008893995043,5cyclictest3150006-21kworker/u8:3+flush-8:010:25:511
3008891994938,8cyclictest3025585-21latency_hist07:25:010
30279592470,1chrt3027962-21kthreadcore07:25:451
32848012460,1sleep03284803-21cat11:45:390
3008891994637,7cyclictest3029643-21ntpq07:25:490
3008891994635,8cyclictest3263408-21ntpq11:20:500
3008891994534,8cyclictest3178714-21ntpq09:55:480
3008893994438,4cyclictest3254380-21kworker/u8:3+flush-8:011:25:521
3008893994337,4cyclictest1913152-21kworker/u8:0+events_unbound07:55:491
30412462420,1chrt3041247-21/usr/sbin/munin07:40:410
30412462420,1chrt3041247-21/usr/sbin/munin07:40:410
3008897994233,7cyclictest1704890-21systemd-journal09:53:592
3008893994237,3cyclictest1913152-21kworker/u8:0+flush-8:007:50:431
3008893994236,4cyclictest3294725-21diskstats11:55:401
3008893994236,3cyclictest3199663-21kworker/u8:1+flush-8:011:30:451
3008893994233,6cyclictest3090389-21/usr/sbin/munin08:30:531
32328482410,2sleep2371rcuc/210:50:472
3008893994136,3cyclictest3104677-21kworker/u8:2+flush-8:010:20:431
3008891994134,5cyclictest1704890-21systemd-journal07:59:590
3008891994131,8cyclictest3313038-21ntpq12:10:530
3008891994131,8cyclictest3074423-21ntpq08:10:510
3008891994131,8cyclictest3049802-21ntpq07:45:520
3008897994027,11cyclictest3035702-21true07:35:002
3008893994035,4cyclictest1913152-21kworker/u8:0+events_unbound10:00:491
3008893994033,5cyclictest1704890-21systemd-journal09:09:581
3008893994032,6cyclictest3199663-21kworker/u8:1+events_unbound11:35:521
3008893994032,6cyclictest3150006-21kworker/u8:3+flush-8:009:35:351
3008891994029,9cyclictest3124177-21ntpq09:00:520
3008891994029,9cyclictest3124177-21ntpq09:00:510
31465762390,1sleep03146582-21tr09:25:460
3008897993933,4cyclictest3284078-21apt-get11:45:002
3008893993934,4cyclictest2649202-21kworker/u8:2+flush-8:007:10:431
3008893993932,5cyclictest3273834-21kworker/u8:0+flush-8:012:20:411
3008893993932,5cyclictest3104677-21kworker/u8:2+flush-8:009:30:561
3008893993928,8cyclictest3144821-21apt-get09:25:001
3008897993823,13cyclictest3165443-21fschecks_time09:45:412
3008893993831,6cyclictest3199663-21kworker/u8:1+flush-8:010:30:571
3008893993831,5cyclictest3239362-21kworker/u8:0+events_unbound11:00:531
3008891993832,4cyclictest3199663-21kworker/u8:1+flush-8:010:40:460
3008891993830,6cyclictest3079339-21ntpq08:15:490
3008891993828,7cyclictest3328738-21latency_hist12:30:010
3008891993825,10cyclictest3084265-21ntpq08:20:510
3008897993723,12cyclictest3264602-21aten2_r5power_c11:25:372
3008893993733,2cyclictest1913152-21kworker/u8:0+events_unbound08:00:401
3008893993732,4cyclictest3104677-21kworker/u8:2+flush-8:008:45:471
3008893993731,4cyclictest3199663-21kworker/u8:1+events_unbound11:10:401
3008893993730,5cyclictest2649202-21kworker/u8:2+flush-8:007:20:441
3008893993729,5cyclictest1913152-21kworker/u8:0+flush-8:008:05:501
3008891993728,7cyclictest1704890-21systemd-journal11:15:000
30760342360,6sleep20-21swapper/208:15:422
3008893993632,3cyclictest3150006-21kworker/u8:3+flush-8:009:45:461
3008893993631,3cyclictest3254380-21kworker/u8:3+events_unbound12:05:531
3008893993631,3cyclictest3199663-21kworker/u8:1+events_unbound10:55:451
3008893993631,3cyclictest3031760-21irqrtprio07:30:441
3008893993629,6cyclictest2649202-21kworker/u8:2+flush-8:008:25:501
3008893993627,6cyclictest1704890-21systemd-journal10:42:591
3008891993626,8cyclictest3140438-21diskstats09:20:400
3008891993626,7cyclictest3120051-21latency_hist09:00:010
3008897993519,13cyclictest3304712-21fschecks_time12:05:392
3008893993528,5cyclictest3254380-21kworker/u8:3+flush-8:012:15:411
3008893993528,5cyclictest1913152-21kworker/u8:0+flush-8:007:40:511
3008893993528,5cyclictest1913152-21kworker/u8:0+flush-8:007:40:511
3008893993527,6cyclictest3254380-21kworker/u8:3+events_unbound12:00:511
3008893993527,6cyclictest1913152-21kworker/u8:0+flush-8:008:40:561
3008891993526,7cyclictest3258465-21ntpq11:15:500
3008891993526,7cyclictest3031290-21diskstats07:30:410
3008891993525,8cyclictest3329005-21/usr/sbin/munin12:30:480
300889799343,24cyclictest3289563-21apt-get11:50:382
3008893993430,3cyclictest3254380-21kworker/u8:3+flush-8:011:15:391
3008893993429,4cyclictest3254380-21kworker/u8:3+flush-8:011:40:531
3008893993429,3cyclictest1913152-21kworker/u8:0+flush-8:009:10:461
3008893993428,4cyclictest3138996-21ntpq09:15:511
3008893993424,8cyclictest3228707-21ntpq10:45:511
3008893993422,9cyclictest1704890-21systemd-journal08:15:001
3008891993429,3cyclictest1913152-21kworker/u8:0+events_unbound08:35:460
31006842330,4sleep2371rcuc/208:40:412
300889799336,10cyclictest32848032cat11:45:382
3008897993327,4cyclictest3254380-21kworker/u8:3+flush-8:011:15:492
3008897993320,12cyclictest3190389-21fschecks_time10:10:422
3008893993329,3cyclictest3119738-21kworker/u8:1+events_unbound09:25:561
3008893993327,4cyclictest3333425-21kworker/u8:2+events_unbound12:35:471
3008893993326,5cyclictest3199663-21kworker/u8:1+flush-8:012:10:541
3008893993326,5cyclictest1913152-21kworker/u8:0+events_unbound08:15:371
3008893993320,10cyclictest1704890-21systemd-journal10:35:591
300889199339,22cyclictest3139916-21kworker/0:2+events10:10:510
3008891993324,7cyclictest3243575-21ntpq11:00:490
3008891993311,20cyclictest3139916-21kworker/0:2+events10:20:390
300889199330,27cyclictest3003864-21kworker/0:0+events07:10:390
300889799327,19cyclictest3105284-21apt-get08:45:392
3008897993223,7cyclictest2649202-21kworker/u8:2+flush-8:008:00:552
3008893993226,4cyclictest3095104-21kworker/u8:3+events_unbound08:55:531
3008893993225,5cyclictest3249052-21grep11:05:561
3008893993224,5cyclictest3188643-21ntpq10:05:501
300889199328,19cyclictest3139916-21kworker/0:2+events11:30:150
3008891993224,6cyclictest3168848-21ntpq09:45:490
3008891993220,10cyclictest0-21swapper/010:50:010
3008897993125,4cyclictest3050250-21unixbench_singl07:45:582
3008897993119,10cyclictest3240097-21fschecks_count11:00:412
3008897993118,11cyclictest0-21swapper/210:10:012
3008897993116,13cyclictest3224795-21latency_hist10:45:012
300889199319,16cyclictest3139916-21kworker/0:2+events10:25:390
300889199319,16cyclictest3139916-21kworker/0:2+events10:25:390
300889199317,22cyclictest3003864-21kworker/0:0+events09:05:550
300889199312,27cyclictest3139916-21kworker/0:2+events11:55:380
300889799305,21cyclictest3201130-21kthreadcore10:20:472
3008897993023,5cyclictest3150006-21kworker/u8:3+flush-8:010:31:052
3008897993016,12cyclictest3009300-21cpuspeed_turbos07:10:412
3008893993025,4cyclictest3254380-21kworker/u8:3+flush-8:011:20:501
3008893993022,6cyclictest3229106-21kworker/u8:2+events_unbound10:50:391
300889199307,17cyclictest3139916-21kworker/0:2+events10:15:370
300889199302,27cyclictest3139916-21kworker/0:2+events10:00:530
300889199302,26cyclictest3003864-21kworker/0:0+events08:05:410
300889199302,26cyclictest3003864-21kworker/0:0+events07:50:490
300889199302,26cyclictest3003864-21kworker/0:0+events07:35:460
3008891993020,7cyclictest3214473-21latency_hist10:35:010
300889199301,27cyclictest3003864-21kworker/0:0+events08:30:530
300889799297,18cyclictest3126092-21sed09:05:432
300889799292,21cyclictest3198829-21ntpq10:15:512
300889799291,8cyclictest3095800-21/usr/sbin/munin08:35:462
300889799291,23cyclictest3089308-21ntpq08:25:532
3008893992925,3cyclictest3104677-21kworker/u8:2+flush-8:009:55:431
3008893992923,4cyclictest1913152-21kworker/u8:0+flush-8:009:00:461
3008893992923,4cyclictest1913152-21kworker/u8:0+flush-8:009:00:461
3008893992921,6cyclictest3289538-21/usr/sbin/munin11:50:491
300889199297,20cyclictest3003864-21kworker/0:0+events08:47:030
300889199296,22cyclictest3299158-21kworker/0:0+events12:20:370
3008891992923,4cyclictest3314499-21fschecks_count12:15:410
300889199292,25cyclictest3003864-21kworker/0:0+events08:50:400
300889199291,26cyclictest3299158-21kworker/0:0+events12:05:470
300889199291,26cyclictest3139916-21kworker/0:2+events10:50:500
300889199290,27cyclictest3139916-21kworker/0:2+events11:05:540
300889199290,27cyclictest3139916-21kworker/0:2+events10:05:460
300889799283,6cyclictest3130278-21apt-get09:10:392
300889799283,4cyclictest3294994-21/usr/sbin/munin11:55:422
300889799282,21cyclictest3317927-21ntpq12:15:492
3008897992815,11cyclictest3149621-21unixbench_singl09:25:572
3008897992815,11cyclictest0-21swapper/209:25:012
300889799281,10cyclictest3225662-21ps10:45:452
3008893992823,4cyclictest1913152-21kworker/u8:0+events_unbound09:40:441
3008891992824,3cyclictest3254380-21kworker/u8:3+events_unbound11:50:390
3008891992811,16cyclictest3003864-21kworker/0:0+events08:00:500
300889199280,27cyclictest3003864-21kworker/0:0+events09:15:470
300889799279,16cyclictest3081471-21sort08:20:462
300889799272,20cyclictest3273303-21ntpq11:30:502
300889799271,9cyclictest3278209-21ntpq11:35:492
300889799271,6cyclictest3327833-21ntpq12:25:492
3008897992714,11cyclictest0-21swapper/208:50:402
3008897992710,15cyclictest3136419-21tr09:15:462
3008897992710,15cyclictest0-21swapper/212:30:542
3008893992723,3cyclictest1913152-21kworker/u8:0+events_unbound10:10:541
300889199279,17cyclictest3139916-21kworker/0:2+events11:45:000
300889199278,14cyclictest3139916-21kworker/0:2+events09:35:340
300889199274,22cyclictest3139916-21kworker/0:2+events11:25:340
3008891992722,3cyclictest2649202-21kworker/u8:2+flush-8:007:15:050
3008891992710,16cyclictest3139916-21kworker/0:2+events10:55:470
30085992273,6sleep20-21swapper/207:08:362
300889799269,15cyclictest3024453-21tr07:20:482
300889799269,15cyclictest0-21swapper/207:35:472
300889799267,16cyclictest3300600-21cut12:00:442
300889799266,18cyclictest3336662-21cut12:35:442
300889799266,18cyclictest3016024-21cut07:15:392
3008897992622,2cyclictest3090499-21aten2_r5power_p08:30:402
300889799262,19cyclictest3248558-21ntpq11:05:492
3008897992620,4cyclictest3313555-21unixbench_singl12:11:002
3008897992620,4cyclictest3239110-21unixbench_multi10:55:572
300889799261,8cyclictest3208866-21/usr/sbin/munin10:25:552
300889799261,8cyclictest3208866-21/usr/sbin/munin10:25:542
3008897992614,10cyclictest0-21swapper/212:20:412
3008897992610,13cyclictest0-21swapper/209:05:012
3008897992610,13cyclictest0-21swapper/209:05:012
300889799260,8cyclictest3164163-21/usr/sbin/munin09:40:542
300889799260,7cyclictest3249690-21seq11:10:152
300889199269,16cyclictest3299158-21kworker/0:0+events12:05:010
300889199268,17cyclictest3003864-21kworker/0:0+events09:12:070
300889199267,17cyclictest3139916-21kworker/0:2+events09:40:490
300889799255,4cyclictest3070899-21tr08:10:412
300889799251,9cyclictest3218412-21/usr/sbin/munin10:35:492
300889799251,8cyclictest3183700-21ntpq10:00:492
300889799251,7cyclictest3054736-21ntpq07:50:522
300889799251,7cyclictest3041736-21tr07:40:452
300889799251,7cyclictest3041736-21tr07:40:442
3008897992511,12cyclictest0-21swapper/207:59:172
3008897992511,11cyclictest0-21swapper/209:30:562
3008897992510,13cyclictest0-21swapper/209:55:372
3008897992510,13cyclictest0-21swapper/208:55:462
300889799250,9cyclictest3066353-21/usr/sbin/munin08:05:442
300889799250,6cyclictest3025836-21taskset07:25:272
3008893992519,4cyclictest3199650-21sendmail10:20:001
3008893992519,3cyclictest0-21swapper/107:10:001
3008893992518,5cyclictest3273834-21kworker/u8:0+flush-8:012:25:361
300889199259,15cyclictest3139916-21kworker/0:2+events09:30:510
300889199258,15cyclictest3003864-21kworker/0:0+events08:25:510
3008891992519,4cyclictest3278723-21unixbench_multi11:35:570
30085152253,3sleep00-21swapper/007:07:310
3008893992419,3cyclictest3273834-21kworker/u8:0+flush-8:012:30:561
300889199248,15cyclictest3003864-21kworker/0:0+events08:43:570
300889199246,17cyclictest3139916-21kworker/0:2+events09:50:400
300889799237,14cyclictest0-21swapper/211:20:462
300889799231,3cyclictest3155214-21munin-node09:35:352
3008893992217,4cyclictest3048179-21kthreadcore07:45:471
30085032183,8sleep30-21swapper/307:07:223
31052582142,8sleep30-21swapper/308:45:373
33287232131,8sleep30-21swapper/312:30:013
32194422132,6sleep30-21swapper/310:40:023
31697912132,6sleep30-21swapper/309:50:023
31041222132,7sleep30-21swapper/308:40:513
30704082132,6sleep30-21swapper/308:10:013
30561032133,6sleep30-21swapper/307:55:403
30519802132,7sleep30-21swapper/307:50:483
30299752132,7sleep30-21swapper/307:25:553
33295542122,6sleep30-21swapper/312:30:453
33195322122,6sleep30-21swapper/312:20:413
33091092122,5sleep30-21swapper/312:10:023
32965032122,6sleep30-21swapper/311:55:463
32935512123,5sleep30-21swapper/311:50:553
32784272122,6sleep30-21swapper/311:35:563
32692592122,5sleep30-21swapper/311:30:013
32645712122,6sleep30-21swapper/311:25:363
32617312122,6sleep30-21swapper/311:20:473
32497502122,6sleep30-21swapper/311:10:393
32486802122,6sleep30-21swapper/311:05:543
32403382122,6sleep30-21swapper/311:00:433
32347812122,5sleep30-21swapper/310:55:033
32249432123,5sleep30-21swapper/310:45:403
32144572122,6sleep30-21swapper/310:35:003
32051602122,6sleep30-21swapper/310:25:413
32051602122,6sleep30-21swapper/310:25:403
31948272122,6sleep30-21swapper/310:15:013
31900792122,6sleep30-21swapper/310:10:403
31651022122,6sleep30-21swapper/309:45:363
31614492122,6sleep30-21swapper/309:40:473
31548412122,6sleep30-21swapper/309:33:533
31453222122,6sleep30-21swapper/309:25:373
31253202122,6sleep30-21swapper/309:05:403
31154592121,7sleep30-21swapper/308:55:403
31120762122,6sleep30-21swapper/308:50:473
30951822122,5sleep30-21swapper/308:35:023
30908612122,6sleep30-21swapper/308:30:453
30854092122,5sleep30-21swapper/308:25:023
30802152122,5sleep30-21swapper/308:20:013
30661952122,6sleep30-21swapper/308:05:453
30410672122,6sleep30-21swapper/307:40:413
30410672122,6sleep30-21swapper/307:40:413
30406512122,6sleep30-21swapper/307:39:523
30247872122,6sleep30-21swapper/307:20:543
30093352122,6sleep30-21swapper/307:10:423
33341422112,6sleep30-21swapper/312:35:103
32994332111,6sleep30-21swapper/312:00:393
32845382112,5sleep30-21swapper/311:45:023
32794492112,5sleep30-21swapper/311:40:413
32555422112,5sleep30-21swapper/311:15:443
32298682112,5sleep30-21swapper/310:50:373
32148152112,5sleep30-21swapper/310:35:403
32002042112,5sleep30-21swapper/310:20:443
31848512112,5sleep30-21swapper/310:05:153
31801982112,5sleep30-21swapper/310:00:403
31788042112,5sleep30-21swapper/309:55:523
31556212112,5sleep30-21swapper/309:35:413
31445272113,5sleep30-21swapper/309:21:253
31351542112,5sleep30-21swapper/309:15:033
31307772112,5sleep30-21swapper/309:10:443
31245922112,6sleep30-21swapper/309:00:583
31245922112,6sleep30-21swapper/309:00:583
30841302112,5sleep30-21swapper/308:20:493
30651372112,5sleep30-21swapper/308:00:593
30459412112,5sleep30-21swapper/307:45:383
30312822112,6sleep30-21swapper/307:30:413
30164672112,6sleep30-21swapper/307:15:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional