You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-29 - 21:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri May 29, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35824612910,2chrt0-21swapper/109:55:391
3458615995747,8cyclictest3562104-21/usr/sbin/munin09:35:561
3458615995746,9cyclictest3581908-21apt-get09:55:001
3458615995746,9cyclictest3581908-21apt-get09:55:001
35588582550,4chrt0-21swapper/109:30:481
3458615995246,4cyclictest3572262-21kworker/u8:1+flush-8:010:27:031
3458611995040,8cyclictest3711728-21ntpq12:00:520
36701902480,5chrt0-21swapper/111:20:471
3458611994738,7cyclictest3666842-21ntpq11:15:490
3458611994638,6cyclictest3722463-21latency_hist12:15:000
3458615994537,6cyclictest2111821-21kworker/u8:1+flush-8:007:35:561
3458615994336,5cyclictest3607278-21apt-get10:20:381
3458611994335,6cyclictest3741482-21ntpq12:30:510
3458615994135,4cyclictest3653280-21apt-get11:05:391
3458615994132,6cyclictest3471588-21latency_hist07:30:011
35483602400,18sleep3451irq_work/309:20:463
3458611994030,8cyclictest3472754-21diskstats07:35:410
3458611993927,9cyclictest1704890-21systemd-journal10:41:480
3458611993833,3cyclictest3617492-21kworker/u8:2+flush-8:010:35:420
3458611993828,7cyclictest3653255-21/usr/sbin/munin11:05:540
3458611993828,7cyclictest3562380-21diskstats09:35:420
3458619993728,6cyclictest1704890-21systemd-journal10:45:012
3458615993730,5cyclictest3567154-21apt-get09:40:371
3458611993730,5cyclictest3637244-21ntpq10:45:520
3458611993728,7cyclictest3489565-21diskstats08:05:420
345861999367,16cyclictest3668081-21apt-get11:20:372
3458615993628,6cyclictest3541604-21cp09:14:591
3458611993628,6cyclictest3732450-21latency_hist12:25:010
3458611993626,7cyclictest1704890-21systemd-journal11:22:490
37047332350,2sleep3481ktimers/311:55:483
3458615993530,3cyclictest3723479-21irqrtprio12:15:431
3458615993530,3cyclictest3460990-21irqrtprio07:15:041
3458615993528,6cyclictest3510206-21kworker/u8:3+flush-8:009:00:581
34582922353,10sleep10-21swapper/107:08:101
3458615993428,5cyclictest3682295-21kworker/u8:0+flush-8:011:40:561
3458615993428,5cyclictest3582810-21kworker/u8:0+flush-8:010:10:561
3458611993430,2cyclictest3576970-21systemd-run09:50:000
3458611993428,4cyclictest3510206-21kworker/u8:3+flush-8:009:00:430
3458611993427,5cyclictest1704890-21systemd-journal07:55:000
3458611993427,5cyclictest1704890-21systemd-journal07:54:590
3458611993425,7cyclictest3716652-21ntpq12:05:510
345861999338,13cyclictest3556662-21apt-get09:30:022
3458611993329,2cyclictest3675707-21kthreadcore11:25:490
3458611993329,2cyclictest3675707-21kthreadcore11:25:480
3458611993326,5cyclictest1704890-21systemd-journal07:45:000
3458611993325,6cyclictest3697466-21latency_hist11:50:010
3458611993323,8cyclictest3707385-21apt-get12:00:000
3458615993227,4cyclictest3617492-21kworker/u8:2+flush-8:011:32:201
3458615993225,5cyclictest3551429-21kworker/u8:3+flush-8:009:45:561
3458611993228,2cyclictest3521744-21systemd-run08:55:000
3458611993227,3cyclictest3571798-21idleruntime-cro09:44:590
3458611993225,5cyclictest3494406-21tr08:10:400
3458611993222,8cyclictest3586225-21ntpq09:55:520
345861999318,12cyclictest3596222-21ntpq10:05:542
345861999317,10cyclictest3520820-21ntpq08:50:472
345861999316,12cyclictest3542036-21apt-get09:15:382
3458619993121,4cyclictest3607278-21apt-get10:20:402
3458615993127,3cyclictest3747413-21systemd12:38:001
3458615993124,5cyclictest3617492-21kworker/u8:2+flush-8:010:50:541
3458611993125,4cyclictest3581907-21latency_hist09:55:000
3458611993125,4cyclictest3581907-21latency_hist09:54:590
3458611993125,4cyclictest3572262-21kworker/u8:1+events_unbound10:26:330
3458611993125,4cyclictest3521748-21kworker/u8:0+events_unbound09:30:580
3458611993124,5cyclictest3551390-21apt-get09:21:500
345861999305,16cyclictest0-21swapper/210:40:012
3458619993024,4cyclictest3482422-21unixbench_singl07:46:002
3458619993021,5cyclictest3663146-21apt-get11:15:382
3458619993016,9cyclictest3466958-21apt-get07:25:392
3458615993021,6cyclictest3466660-21latency_hist07:25:001
3458615993021,6cyclictest1704890-21systemd-journal11:38:491
3458611993027,2cyclictest3499573-21sendmail08:20:010
3458611993025,4cyclictest3472168-21kworker/u8:0+flush-8:008:20:490
3458611993025,3cyclictest3532850-21kthreadcore09:05:460
3458611993025,3cyclictest1704890-21systemd-journal07:15:000
3458611993024,4cyclictest3551429-21kworker/u8:3+flush-8:009:25:550
3458611993024,4cyclictest3546703-21latency_hist09:20:010
3458611993021,6cyclictest1704890-21systemd-journal12:25:480
345861999298,5cyclictest3515299-21ntpq08:40:532
3458619992925,2cyclictest3727875-21aten2_r5power_v12:20:402
3458619992924,3cyclictest3712920-21aten2_r5power_c12:05:402
3458619992919,5cyclictest3707385-21apt-get12:00:022
3458619992915,9cyclictest3692828-21apt-get11:45:382
3458615992925,3cyclictest3697454-21cron11:50:011
3458615992925,2cyclictest3547607-21irqcore09:20:451
3458615992924,4cyclictest3617492-21kworker/u8:2+flush-8:011:29:541
3458615992924,4cyclictest3617492-21kworker/u8:2+flush-8:011:29:531
3458615992923,4cyclictest3642232-21kworker/u8:0+events_unbound11:10:461
3458615992922,5cyclictest3717821-21apt-get12:10:371
3458611992925,3cyclictest3537133-21cut09:10:440
3458611992925,3cyclictest3472168-21kworker/u8:0+flush-8:007:45:580
3458611992925,2cyclictest3591152-21needreboot10:00:500
3458611992922,6cyclictest3489039-21kworker/u8:1+flush-8:008:40:420
3458619992818,5cyclictest3577250-21apt-get09:50:432
3458619992818,5cyclictest3577250-21apt-get09:50:432
3458619992814,8cyclictest3504514-21apt-get08:25:022
3458615992824,3cyclictest3638123-21systemd-run10:50:011
3458615992824,2cyclictest3512197-21irqrtprio08:40:451
3458615992823,4cyclictest401-21dbus-daemon10:18:031
3458611992823,3cyclictest2111821-21kworker/u8:1+flush-8:007:24:200
3458611992819,7cyclictest3662029-21ntpq11:10:540
3458611992818,8cyclictest3622374-21ntpq10:30:550
3458611992818,8cyclictest3606032-21ntpq10:15:540
345861199281,24cyclictest3687469-21sshd11:38:490
345861999276,6cyclictest3652184-21ntp_states11:00:542
345861999276,5cyclictest3485796-21cut07:55:432
3458619992722,4cyclictest3562481-21fschecks_time09:35:422
3458619992716,8cyclictest3476506-21/usr/sbin/munin07:35:562
3458619992713,9cyclictest3572249-21apt-get09:45:022
345861599274,2cyclictest421rcuog/211:15:391
3458615992724,2cyclictest3733093-21cut12:25:421
3458615992723,2cyclictest3556674-21idleruntime-cro09:29:591
3458615992720,6cyclictest3482822-21kworker/u8:2+flush-8:007:55:531
3458611992723,2cyclictest0-21swapper/009:00:000
3458611992720,5cyclictest3647589-21grep10:55:570
345861999266,6cyclictest3537234-21grep09:10:442
3458619992622,2cyclictest3522366-21fschecks_time08:55:422
3458619992618,3cyclictest3677976-21apt-get11:30:372
3458619992614,9cyclictest3582420-21acpi09:55:362
3458619992614,8cyclictest3570994-21ntp_states09:40:552
3458619992612,8cyclictest3503093-21kthreadcore08:20:472
3458619992610,14cyclictest3613686-21cut10:25:472
3458615992622,2cyclictest3628244-21sendmail10:40:001
3458615992622,2cyclictest3510330-21systemd-run08:35:011
3458615992622,2cyclictest0-21swapper/108:10:001
3458615992621,4cyclictest3472168-21kworker/u8:0+flush-8:008:20:511
35422402250,5sleep3451irq_work/309:15:403
345861999256,5cyclictest3621033-21cut10:30:492
3458619992521,3cyclictest3465645-21unixbench_singl07:15:562
3458619992521,2cyclictest3677267-21unixbench_multi11:25:592
3458619992521,2cyclictest3677267-21unixbench_multi11:25:592
3458619992519,4cyclictest3653311-21aten2_r5power_c11:05:412
3458619992519,4cyclictest3489039-21kworker/u8:1+flush-8:008:45:202
3458619992516,4cyclictest3736525-21ntpq12:25:512
3458619992510,12cyclictest3697707-21chrt11:50:172
3458619992510,11cyclictest3706663-21processes11:55:562
3458615992520,4cyclictest3623479-21kworker/u8:1+events_unbound12:20:511
3458615992520,4cyclictest3522249-21cpuspeed_turbos08:55:401
3458615992513,9cyclictest1704890-21systemd-journal08:26:491
3458611992522,2cyclictest3702412-21cron11:55:010
3458611992521,3cyclictest0-21swapper/008:30:010
3458611992521,2cyclictest3511028-21apt-key08:40:000
3458611992521,2cyclictest0-21swapper/011:45:000
3458611992520,3cyclictest3623479-21kworker/u8:1+events_unbound12:15:480
3458611992518,5cyclictest3617492-21kworker/u8:2+events_unbound11:35:000
345861999245,5cyclictest3662161-21systemctl11:10:572
3458619992420,2cyclictest3506014-21fschecks_time08:30:432
3458619992413,8cyclictest3718079-21/usr/sbin/munin12:10:422
3458619992412,9cyclictest3477495-21seq07:40:272
3458615992421,2cyclictest3647976-21cron11:00:001
3458615992420,3cyclictest0-21swapper/108:40:011
3458615992420,2cyclictest0-21swapper/109:05:401
3458615992419,4cyclictest3489039-21kworker/u8:1+events_unbound09:15:401
3458615992419,3cyclictest3713610-21irqrtprio12:05:451
3458615992419,3cyclictest3623479-21kworker/u8:1+flush-8:010:40:581
3458615992419,3cyclictest0-21swapper/108:10:561
3458615992418,4cyclictest3648298-21apt-get11:00:381
3458611992419,3cyclictest413-21systemd-logind08:50:010
3458611992419,3cyclictest401-21dbus-daemon07:30:000
3458611992418,4cyclictest401-21dbus-daemon10:55:000
3458611992413,9cyclictest3648548-21diskstats11:00:430
345861999239,12cyclictest3591982-21chrt10:03:392
345861999239,11cyclictest3687833-21chrt11:40:142
345861999239,11cyclictest3499172-21chrt08:15:132
345861999239,11cyclictest3483136-21chrt07:51:332
345861999239,11cyclictest3483136-21chrt07:51:322
345861999239,10cyclictest3639351-21kthreadcore10:50:472
345861999238,12cyclictest3458901-21chrt07:12:092
345861999236,4cyclictest0-21swapper/211:35:442
345861999235,8cyclictest0-21swapper/209:25:562
3458619992320,2cyclictest3743130-21cpuspeed_turbos12:35:422
3458619992313,7cyclictest3647453-21/usr/sbin/munin10:55:582
3458619992312,7cyclictest3633656-21/usr/sbin/munin10:45:402
3458619992312,7cyclictest3602252-21/usr/sbin/munin10:15:412
3458619992311,9cyclictest3488807-21chrt08:02:292
3458615992319,2cyclictest0-21swapper/110:00:471
3458615992318,4cyclictest3472168-21kworker/u8:0+events_unbound07:45:561
3458615992318,3cyclictest0-21swapper/108:50:531
3458615992314,7cyclictest3702696-21/usr/sbin/munin11:55:501
3458611992318,4cyclictest3582810-21kworker/u8:0+flush-8:010:20:590
3458611992318,4cyclictest3536801-21kworker/u8:2+flush-8:010:08:200
3458611992315,7cyclictest3482822-21kworker/u8:2+flush-8:007:55:390
3458611992314,7cyclictest3743156-21diskstats12:35:430
34583932232,15sleep00-21swapper/007:09:310
345861999229,10cyclictest3466608-21chrt07:24:332
345861999228,12cyclictest3739194-21cat12:30:472
345861999228,12cyclictest3601683-21chrt10:11:462
345861999226,4cyclictest0-21swapper/208:10:392
345861999225,4cyclictest0-21swapper/208:36:052
345861999225,4cyclictest0-21swapper/208:05:412
3458619992213,7cyclictest3536009-21/usr/sbin/munin09:05:572
3458619992213,6cyclictest3723149-21/usr/sbin/munin12:15:412
3458619992211,8cyclictest3472336-21sed07:35:012
3458615992218,3cyclictest3489036-21systemd-run08:05:011
3458615992218,2cyclictest3499556-21sh08:20:011
3458615992218,2cyclictest0-21swapper/112:00:491
3458615992218,2cyclictest0-21swapper/111:55:011
3458615992218,2cyclictest0-21swapper/110:30:521
3458611992219,2cyclictest3461235-21irqcore07:15:060
3458611992218,2cyclictest0-21swapper/010:10:590
3458619992113,6cyclictest3547455-21/usr/sbin/munin09:20:442
3458619992112,6cyclictest3527241-21diskstats09:00:422
3458615992117,2cyclictest0-21swapper/112:30:471
3458615992116,3cyclictest3483572-21latency_hist07:55:011
3458615992116,3cyclictest3483572-21latency_hist07:55:001
3458615992113,6cyclictest3459128-21cron07:15:001
345861599209,3cyclictest0-21swapper/107:34:331
345861599206,5cyclictest0-21swapper/108:48:561
3458615992016,2cyclictest0-21swapper/110:05:421
3458615992011,7cyclictest3477850-21cron07:45:001
3458611992015,3cyclictest0-21swapper/008:30:400
345861199192,7cyclictest0-21swapper/008:04:290
34578172193,9sleep30-21swapper/307:05:563
3458611991813,3cyclictest3461293-21kworker/u8:2+flush-8:007:32:200
34537992174,9sleep20-21swapper/207:05:032
36070862160,2sleep3481ktimers/310:20:003
36680552152,8sleep30-21swapper/311:20:373
35763982156,5sleep30-21swapper/309:45:593
36636232144,6sleep30-21swapper/311:15:443
36581862145,5sleep30-21swapper/311:10:383
37088152131,8sleep30-21swapper/312:00:463
36776642132,6sleep30-21swapper/311:30:013
36776642132,6sleep30-21swapper/311:30:013
35676442132,7sleep30-21swapper/309:40:463
34702562133,6sleep30-21swapper/307:25:503
37429102122,6sleep30-21swapper/312:35:403
37380842122,6sleep30-21swapper/312:30:443
37327402122,6sleep30-21swapper/312:25:383
37132672122,6sleep30-21swapper/312:05:443
36519392122,6sleep30-21swapper/311:00:513
36433122122,6sleep30-21swapper/310:55:383
36427112122,6sleep30-21swapper/310:51:003
36334442123,5sleep30-21swapper/310:45:383
36289132122,6sleep30-21swapper/310:40:453
36165362122,6sleep30-21swapper/310:26:003
36078052122,6sleep30-21swapper/310:20:473
35877752122,6sleep30-21swapper/310:00:433
35826862122,6sleep30-21swapper/309:55:433
35640582122,6sleep30-21swapper/309:35:483
35577182122,6sleep30-21swapper/309:30:463
35175462122,6sleep30-21swapper/308:50:423
35114102122,6sleep30-21swapper/308:40:073
35099172122,6sleep30-21swapper/308:31:003
35030892122,6sleep30-21swapper/308:20:483
34778772122,5sleep30-21swapper/307:45:013
34731672122,6sleep30-21swapper/307:35:463
34618402122,6sleep30-21swapper/307:15:443
37323472112,6sleep30-21swapper/312:23:533
37227622112,5sleep30-21swapper/312:15:393
37177952112,5sleep30-21swapper/312:10:383
36981072112,5sleep30-21swapper/311:50:433
36929882112,5sleep30-21swapper/311:45:423
36916562112,6sleep30-21swapper/311:40:523
36829222112,6sleep30-21swapper/311:35:423
36784652112,5sleep30-21swapper/311:30:443
36532842112,5sleep30-21swapper/311:05:403
36239162112,6sleep30-21swapper/310:35:433
36224432112,6sleep30-21swapper/310:30:573
35972822112,5sleep30-21swapper/310:10:393
35964872112,5sleep30-21swapper/310:05:583
35524342112,5sleep30-21swapper/309:25:453
35371182112,5sleep30-21swapper/309:10:443
35318572112,5sleep30-21swapper/309:05:023
35274142112,5sleep30-21swapper/309:00:443
35229062112,5sleep30-21swapper/308:55:483
35107422112,5sleep30-21swapper/308:37:503
35045352110,6sleep30-21swapper/308:25:023
34991522112,5sleep30-21swapper/308:15:033
34975362112,5sleep30-21swapper/308:10:483
34930722112,5sleep30-21swapper/308:05:523
34887012113,5sleep30-21swapper/308:01:063
34857242112,5sleep30-21swapper/307:55:433
34834032112,5sleep30-21swapper/307:55:003
34834032112,5sleep30-21swapper/307:55:003
34720972112,5sleep30-21swapper/307:33:493
34665022112,6sleep30-21swapper/307:23:103
34589072112,6sleep30-21swapper/307:12:143
35772832101,5sleep30-21swapper/309:50:453
35772832101,5sleep30-21swapper/309:50:443
35163652102,5sleep30-21swapper/308:45:033
34775272102,6sleep30-21swapper/307:40:523
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional