You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 00:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Mon Aug 31, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
309796022210,5sleep30-21swapper/309:32:463
29525962930,5chrt2952593-21latency_hist07:10:010
2952682995247,3cyclictest3222396-21kworker/u8:1+events_unbound11:40:001
2952675994940,6cyclictest3053850-21latency_hist08:50:000
2952675994940,6cyclictest3053850-21latency_hist08:50:000
2952682994842,4cyclictest2895586-21kworker/u8:0+flush-8:007:45:011
29907482470,5sleep00-21swapper/007:47:370
2952682994639,5cyclictest2974654-21kworker/u8:3+flush-8:007:57:321
2952682994531,10cyclictest275-21systemd-journal08:35:001
2952682994438,4cyclictest2154645-21kworker/u8:1+events_unbound09:12:331
2952682994336,5cyclictest3103528-21kworker/u8:3+flush-8:009:42:481
2952682994237,4cyclictest2154645-21kworker/u8:1+events_unbound08:40:001
2952682994237,3cyclictest2974654-21kworker/u8:3+events_unbound08:17:471
2952682994136,4cyclictest2154645-21kworker/u8:1+flush-8:007:52:491
2952682994136,3cyclictest2154645-21kworker/u8:1+events_unbound07:17:321
2952682994134,5cyclictest3103252-21latency_hist09:40:011
2952682994129,6cyclictest3162631-21kworker/u8:1+events_unbound11:07:311
29477512414,33sleep20-21swapper/207:05:542
2952682994034,4cyclictest3034269-21kworker/u8:2+flush-8:008:57:431
2952682994033,5cyclictest3103528-21kworker/u8:3+flush-8:010:02:301
2952682994033,5cyclictest2154645-21kworker/u8:1+flush-8:008:22:421
2952675994032,5cyclictest275-21systemd-journal11:25:000
2952682993934,4cyclictest3083687-21kworker/u8:0+flush-8:010:07:321
2952682993933,4cyclictest3198052-21kworker/u8:2+flush-8:011:32:431
2952682993933,4cyclictest3103528-21kworker/u8:3+events_unbound12:17:481
2952682993933,4cyclictest2154645-21kworker/u8:1+events_unbound09:25:011
2952682993932,5cyclictest3103528-21kworker/u8:3+flush-8:010:52:461
2952682993932,5cyclictest2895586-21kworker/u8:0+flush-8:008:07:481
2952682993832,4cyclictest3272787-21apt-get12:31:341
2952682993832,4cyclictest3198052-21kworker/u8:2+flush-8:011:22:391
2952682993832,4cyclictest2154645-21kworker/u8:1+flush-8:007:47:301
2952682993831,5cyclictest3266897-21kworker/u8:0+flush-8:012:27:421
31347932370,4sleep3471rcuc/310:12:353
2952682993731,4cyclictest3034269-21kworker/u8:2+events_unbound09:07:481
2952682993731,4cyclictest2895586-21kworker/u8:0+flush-8:008:42:331
2952682993729,5cyclictest3257083-21kworker/u8:4+flush-8:012:15:011
2952675993732,4cyclictest3118030-21kworker/u8:2+events_unbound10:17:350
2952682993628,6cyclictest2154645-21kworker/u8:1+flush-8:009:02:421
29477452364,9sleep10-21swapper/107:05:491
2952684993529,4cyclictest3257083-21kworker/u8:4+flush-8:012:22:492
2952682993530,4cyclictest2154645-21kworker/u8:1+events_unbound07:22:441
2952682993528,5cyclictest3048728-21kworker/u8:3+flush-8:008:55:001
2952682993527,6cyclictest3093785-21/usr/sbin/munin09:32:421
2952682993526,7cyclictest2970628-21irqrtprio07:27:361
2952675993526,6cyclictest275-21systemd-journal11:50:010
2952684993428,4cyclictest2974219-21unixbench_singl07:27:492
2952682993429,4cyclictest2895586-21kworker/u8:0+events_unbound07:32:461
2952682993429,3cyclictest3222396-21kworker/u8:1+flush-8:011:57:391
2952682993428,4cyclictest3083687-21kworker/u8:0+flush-8:009:57:571
2952682993328,4cyclictest3162631-21kworker/u8:1+events_unbound11:12:421
2952682993328,3cyclictest3252306-21idleruntime-cro12:10:001
2952682993324,6cyclictest275-21systemd-journal09:51:351
2952675993324,6cyclictest3227623-21latency_hist11:45:010
2952682993228,2cyclictest3031704-21kthreadcore08:27:391
2952682993226,4cyclictest3083687-21kworker/u8:0+events_unbound11:02:381
2952682993226,4cyclictest3048728-21kworker/u8:3+events_unbound08:47:491
2952682993226,4cyclictest3048728-21kworker/u8:3+events_unbound08:47:491
2952682993226,4cyclictest2974654-21kworker/u8:3+flush-8:008:12:411
2952682993225,5cyclictest3162805-21latency_hist10:40:011
2952675993227,3cyclictest3257913-21cpuspeed_turbos12:17:320
2952675993226,4cyclictest3018978-21apt-get08:15:000
295268499311,28cyclictest3038780-21unixbench_multi08:32:482
2952682993126,3cyclictest3222396-21kworker/u8:1+flush-8:011:52:411
2952682993125,5cyclictest3103528-21kworker/u8:3+flush-8:010:57:331
2952682993125,5cyclictest2154645-21kworker/u8:1+flush-8:009:27:351
2952682993124,5cyclictest3198052-21kworker/u8:2+flush-8:011:47:401
2952682993124,5cyclictest2895586-21kworker/u8:0+flush-8:008:02:421
2952675993126,3cyclictest3157898-21systemd-run10:35:000
2952675993123,6cyclictest3242431-21latency_hist12:00:000
2952675993121,8cyclictest2988552-21ntpq07:42:400
2952675993120,9cyclictest275-21systemd-journal08:40:000
2952682993025,4cyclictest3083687-21kworker/u8:0+events_unbound09:47:321
2952682993024,4cyclictest3198052-21kworker/u8:2+flush-8:011:17:391
2952682993024,4cyclictest275-21systemd-journal09:17:341
2952675993026,2cyclictest3162789-21cron10:40:000
31393992290,2sleep10-21swapper/110:17:351
2952682992924,4cyclictest3103528-21kworker/u8:3+flush-8:010:47:441
2952682992923,4cyclictest3103528-21kworker/u8:3+flush-8:012:02:441
2952682992923,4cyclictest3103528-21kworker/u8:3+flush-8:012:02:441
2952682992923,4cyclictest2984409-21systemd-run07:40:001
2952682992918,7cyclictest3103528-21kworker/u8:3+flush-8:010:27:301
2952675992925,3cyclictest3228275-21cpuspeed_turbos11:47:320
2952675992924,4cyclictest3276637-21needreboot12:32:410
2952675992922,5cyclictest3163230-21/usr/sbin/munin10:42:470
2952684992824,2cyclictest3028834-21unixbench_multi08:22:492
2952684992824,2cyclictest2953129-21aten2_r5power_c07:12:312
2952682992823,4cyclictest3103528-21kworker/u8:3+events_unbound10:22:441
2952682992823,4cyclictest3083687-21kworker/u8:0+flush-8:010:12:451
2952682992823,3cyclictest3263283-21irqcore12:22:361
2952682992822,4cyclictest3162631-21kworker/u8:1+events_unbound10:42:421
2952682992821,5cyclictest275-21systemd-journal11:44:341
2952675992823,3cyclictest2154645-21kworker/u8:1+flush-8:007:22:390
2952675992822,4cyclictest3269820-21sed12:27:370
2952675992822,4cyclictest3074022-21apt-get09:12:270
2952675992821,5cyclictest3083687-21kworker/u8:0+flush-8:009:46:050
2952675992821,4cyclictest1-21systemd09:01:340
2952675992819,4cyclictest2895586-21kworker/u8:0+flush-8:007:37:360
2952684992724,2cyclictest3074337-21fschecks_time09:12:332
2952684992723,2cyclictest3014032-21cron08:10:002
2952684992722,3cyclictest3243100-21grep12:02:312
2952684992722,3cyclictest3243100-21grep12:02:312
2952684992718,7cyclictest275-21systemd-journal11:15:002
2952682992722,3cyclictest3162631-21kworker/u8:1+events_unbound11:27:361
2952675992724,2cyclictest3248567-21irqrtprio12:07:360
2952675992724,2cyclictest3148646-21cpuspeed_turbos10:27:320
2952675992723,3cyclictest2154645-21kworker/u8:1+flush-8:007:17:400
2952675992722,4cyclictest3272027-21kworker/u8:1+flush-8:012:37:450
2952675992722,4cyclictest3013824-21unixbench_singl08:07:490
2952675992721,5cyclictest2895586-21kworker/u8:0+flush-8:007:27:330
2952675992721,4cyclictest3034269-21kworker/u8:2+flush-8:008:57:330
2952684992622,2cyclictest3177633-21cron10:55:002
2952684992621,4cyclictest3063688-21idleruntime-cro09:00:012
295268499261,23cyclictest3272249-21munin-run12:30:012
2952682992622,3cyclictest2895586-21kworker/u8:0+events_unbound07:12:441
2952682992621,4cyclictest3103528-21kworker/u8:3+flush-8:012:37:321
2952675992621,3cyclictest3178580-21fschecks_count10:57:340
2952675992620,4cyclictest401-21dbus-daemon08:34:590
2952684992522,2cyclictest3084158-21fschecks_count09:22:312
2952684992521,3cyclictest3112884-21unixbench_multi09:47:472
2952684992519,4cyclictest3207483-21unixbench_multi11:22:512
295267599252,22cyclictest2942608-21kworker/0:0+events08:42:420
295267599252,22cyclictest2942608-21kworker/0:0+events07:33:340
2952684992421,2cyclictest3218344-21cpuspeed_turbos11:37:322
2952684992421,2cyclictest3162531-21unixbench_multi10:37:502
2952684992421,2cyclictest3044503-21aten2_r5power_v08:42:302
2952684992420,2cyclictest3142759-21grep10:17:472
2952684992418,5cyclictest3238301-21uniq11:57:342
2952684992418,4cyclictest3212446-21unixbench_multi11:27:482
295267599242,21cyclictest3182854-21kworker/0:2+events12:12:460
295267599242,21cyclictest3123331-21kworker/0:1+events10:12:260
2952675992421,2cyclictest3173182-21aten2_r5power_e10:52:310
2952675992419,4cyclictest3083231-21unixbench_singl09:17:480
2952675992419,3cyclictest0-21swapper/009:22:320
2952675992417,5cyclictest3183730-21diskstats11:02:330
2952684992320,2cyclictest3252860-21aten2_r5power_v12:12:312
2952684992319,2cyclictest2964524-21cron07:20:002
2952684992318,3cyclictest3073319-21unixbench_multi09:07:502
2952684992317,4cyclictest2895586-21kworker/u8:0+events_unbound07:39:462
2952682992319,2cyclictest3154094-21irqrtprio10:32:351
295267599232,20cyclictest3182854-21kworker/0:2+events11:36:380
295267599232,18cyclictest0-21swapper/007:52:280
2952675992321,1cyclictest0-21swapper/008:52:480
2952675992319,3cyclictest3120942-21kthreadcore09:57:370
2952675992315,6cyclictest3098311-21latency_hist09:35:010
2952684992218,3cyclictest3049550-21cpuspeed_turbos08:47:322
2952684992218,3cyclictest3049550-21cpuspeed_turbos08:47:322
2952684992218,2cyclictest3004856-21fschecks_count08:02:332
2952684992218,2cyclictest0-21swapper/210:22:342
2952684992215,5cyclictest0-21swapper/209:37:352
295267599222,19cyclictest0-21swapper/011:17:440
2952675992219,2cyclictest3025310-21irqrtprio08:22:360
2952675992218,3cyclictest3104625-21kthreadcore09:42:380
2952675992218,3cyclictest2957785-21systemd07:15:010
2952675992218,2cyclictest849-21mta-sts-daemon11:32:470
2952675992218,2cyclictest0-21swapper/009:40:010
2952675992217,4cyclictest3024120-21idleruntime-cro08:20:000
2952675992217,3cyclictest0-21swapper/012:05:000
2952675992217,3cyclictest0-21swapper/012:05:000
2952675992216,4cyclictest3169826-21kthreadcore10:47:380
295267599220,21cyclictest2942608-21kworker/0:0+events08:02:530
2952684992118,2cyclictest3233070-21aten2_r5power_e11:52:302
2952684992117,2cyclictest3277172-21unixbench_multi12:32:502
2952684992117,2cyclictest0-21swapper/211:00:002
2952684992116,3cyclictest0-21swapper/209:45:002
2952675992118,2cyclictest3033316-21ntp_kernel_pll_08:27:440
2952675992117,3cyclictest0-21swapper/012:21:330
2952675992117,2cyclictest3212746-21systemd-run11:30:000
2952675992116,4cyclictest3092407-21wc09:27:360
2952675992114,5cyclictest3192912-21systemd-run11:10:000
295267599211,18cyclictest1-21systemd11:12:340
295268499202,2cyclictest0-21swapper/208:17:472
2952684992017,2cyclictest3079158-21cpuspeed_turbos09:17:312
2952684992016,2cyclictest3187750-21unixbench_singl11:02:492
2952684992016,2cyclictest2994950-21cpuspeed_turbos07:52:322
2952684992015,4cyclictest3202793-21idleruntime-cro11:19:592
2952684992013,5cyclictest3278107-21tr12:37:302
2952684992011,6cyclictest3019313-21mktemp08:15:012
2952675992016,3cyclictest0-21swapper/009:52:330
2952675992016,2cyclictest0-21swapper/010:22:350
2952675992016,2cyclictest0-21swapper/009:07:340
2952675992015,3cyclictest0-21swapper/010:02:480
2952684991916,2cyclictest3252038-21unixbench_multi12:07:482
2952684991916,2cyclictest2990032-21fschecks_count07:47:322
2952684991915,2cyclictest0-21swapper/211:32:342
2952684991915,2cyclictest0-21swapper/210:12:292
2952684991910,7cyclictest3092189-21tr09:27:362
2952675991914,4cyclictest3004149-21sendmail08:00:000
295268499182,11cyclictest2964992-21apt-get07:22:302
2952684991814,2cyclictest0-21swapper/209:32:312
2952684991814,2cyclictest0-21swapper/207:32:342
2952684991813,3cyclictest3004131-21latency_hist08:00:002
2952675991813,3cyclictest0-21swapper/010:07:300
29477922183,8sleep30-21swapper/307:06:283
295268499179,6cyclictest3115394-21tr09:52:382
295268499177,8cyclictest3261560-21seq12:17:452
295268499177,8cyclictest3065419-21tr09:02:382
2952684991713,3cyclictest3223316-21cpuspeed_turbos11:42:312
2952684991713,2cyclictest0-21swapper/210:27:442
2952684991712,4cyclictest0-21swapper/209:57:362
2952684991711,4cyclictest3192111-21ntpq11:07:402
295268499168,6cyclictest2985289-21if_enp4s0.307:42:352
295268499162,13cyclictest0-21swapper/210:47:112
295268499162,13cyclictest0-21swapper/208:52:452
2952684991613,2cyclictest0-21swapper/211:46:022
2952684991613,2cyclictest0-21swapper/210:32:252
2952684991613,2cyclictest0-21swapper/208:36:392
2952684991610,5cyclictest0-21swapper/210:40:162
295268499152,2cyclictest0-21swapper/210:06:392
295268499152,2cyclictest0-21swapper/210:02:452
2952684991511,2cyclictest0-21swapper/208:27:312
31887902142,8sleep30-21swapper/311:07:343
31670092142,8sleep30-21swapper/310:42:423
32685142132,7sleep30-21swapper/312:27:363
32018702132,7sleep30-21swapper/311:17:373
31604742132,7sleep30-21swapper/310:37:403
31524292130,2sleep3575-21kworker/3:2+events10:27:483
31282672132,6sleep30-21swapper/310:05:023
30749092132,7sleep30-21swapper/309:12:373
30728172132,7sleep30-21swapper/309:07:433
30161422132,6sleep30-21swapper/308:12:373
30100432133,7sleep30-21swapper/308:07:363
29944962132,6sleep30-21swapper/307:50:023
32784152122,6sleep30-21swapper/312:37:353
32622682122,6sleep30-21swapper/312:20:013
32488442123,5sleep30-21swapper/312:07:383
32421832122,6sleep30-21swapper/311:57:503
32339012122,7sleep30-21swapper/311:52:373
32240182122,7sleep30-21swapper/311:42:373
32127502122,5sleep30-21swapper/311:30:013
32041632122,6sleep30-21swapper/311:22:393
31686362122,6sleep30-21swapper/310:47:363
31530822122,6sleep30-21swapper/310:30:023
31440722122,6sleep30-21swapper/310:22:353
31140862122,6sleep30-21swapper/309:52:343
31123492123,6sleep30-21swapper/309:47:403
31032912122,6sleep30-21swapper/309:40:023
30987652122,6sleep30-21swapper/309:37:293
30928842122,6sleep30-21swapper/309:27:463
30785152122,6sleep30-21swapper/309:15:023
30597372122,6sleep30-21swapper/308:57:363
30491462122,6sleep30-21swapper/308:45:283
30491462122,6sleep30-21swapper/308:45:283
30488432124,5sleep30-21swapper/308:44:363
30397042122,6sleep30-21swapper/308:37:333
30380532122,6sleep30-21swapper/308:32:403
30244582122,6sleep30-21swapper/308:21:123
30041692122,5sleep30-21swapper/308:00:013
29852712122,6sleep30-21swapper/307:42:363
29793472122,5sleep30-21swapper/307:35:013
29695012122,6sleep30-21swapper/307:25:023
29572362122,6sleep30-21swapper/307:12:503
32731612112,6sleep30-21swapper/312:32:343
32575932112,6sleep30-21swapper/312:16:373
32525352112,6sleep30-21swapper/312:10:023
32428522112,5sleep30-21swapper/312:02:283
32428522112,5sleep30-21swapper/312:02:283
32278432112,5sleep30-21swapper/311:45:023
32180912113,5sleep30-21swapper/311:37:283
32081182112,6sleep30-21swapper/311:26:443
31932612113,5sleep30-21swapper/311:12:003
31832672112,5sleep30-21swapper/311:00:043
31781212112,6sleep30-21swapper/310:55:183
31736992112,5sleep30-21swapper/310:52:373
31384332112,6sleep30-21swapper/310:16:383
31235382112,6sleep30-21swapper/310:00:083
31225562112,5sleep30-21swapper/309:57:543
30837802113,5sleep30-21swapper/309:21:203
30643992112,5sleep30-21swapper/309:02:333
30540132112,5sleep30-21swapper/308:50:013
30291292112,5sleep30-21swapper/308:25:013
30194632112,6sleep30-21swapper/308:15:263
29994922112,6sleep30-21swapper/307:56:003
29900192112,5sleep30-21swapper/307:47:333
29797432112,6sleep30-21swapper/307:37:063
29681122112,5sleep30-21swapper/307:22:413
29604932112,5sleep30-21swapper/307:17:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional