You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 21:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sun Aug 30, 2026 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
329165021780,3sleep30-21swapper/307:52:403
35054192630,6chrt0-21swapper/211:27:372
3247808995950,7cyclictest3246951-21kworker/u8:2+flush-8:007:37:360
34234292540,1chrt3423430-21unixbench_singl10:02:510
3247808995039,9cyclictest3334851-21diskstats08:37:330
3247814994931,16cyclictest3264583-21gpgv07:25:002
3247814994923,8cyclictest3523751-21diskstats11:47:332
3247808994736,8cyclictest275-21systemd-journal12:40:010
3247814994638,5cyclictest275-21systemd-journal07:45:002
3247814994638,5cyclictest275-21systemd-journal07:45:002
3247808994535,8cyclictest2253105-21kworker/u8:1+flush-8:007:15:060
3247808994535,7cyclictest275-21systemd-journal12:07:320
3247814994327,3cyclictest3325038-21fschecks_time08:27:332
3247812994334,7cyclictest3478043-21latency_hist11:00:011
3247812994225,6cyclictest3389941-21irqrtprio09:32:371
34059682410,4sleep10-21swapper/109:47:391
3247808994032,5cyclictest3557625-21latency_hist12:20:010
3247812993914,16cyclictest3463486-21taskset10:45:161
3247812993913,16cyclictest3508415-21taskset11:30:021
3247812993912,15cyclictest3448692-21runrttasks10:31:521
3247812993833,3cyclictest3384984-21irqrtprio09:27:391
3247812993814,14cyclictest3453625-21taskset10:36:131
3247812993814,12cyclictest3528231-21taskset11:50:131
3247812993813,14cyclictest3289397-21runrttasks07:49:111
3247812993813,14cyclictest3289397-21runrttasks07:49:111
3247812993812,16cyclictest3348895-21runrttasks08:49:021
3247808993830,6cyclictest3467906-21grep10:47:500
3247808993830,6cyclictest275-21systemd-journal10:22:070
324781299379,15cyclictest3354597-21df_inode08:57:321
3247812993714,14cyclictest3319237-21taskset08:18:561
3247812993714,10cyclictest3463087-21runrttasks10:43:081
3247812993712,13cyclictest3523349-21runrttasks11:45:521
3247812993712,11cyclictest3353055-21missed_timers08:52:401
3247812993710,10cyclictest3371422-21kthreadcore09:12:391
3247808993728,6cyclictest275-21systemd-journal07:57:320
3247814993628,5cyclictest275-21systemd-journal09:32:002
3247812993623,5cyclictest161rcu_preempt10:20:011
3247812993612,15cyclictest3418282-21runrttasks09:58:011
3247812993612,15cyclictest3329517-21taskset08:31:161
3247812993612,14cyclictest3513441-21taskset11:36:121
3247812993612,14cyclictest3408792-21runrttasks09:50:101
3247812993612,14cyclictest3408792-21runrttasks09:50:101
3247812993612,13cyclictest3319599-21runrttasks08:20:211
3247808993626,7cyclictest3438437-21latency_hist10:20:000
3247814993526,7cyclictest275-21systemd-journal10:33:322
324781299359,15cyclictest3268736-21memory07:27:401
324781299359,13cyclictest3543208-21/usr/sbin/munin12:07:331
324781299359,13cyclictest3340124-21sed08:42:371
3247812993513,9cyclictest3299889-21runrttasks08:00:391
3247812993513,8cyclictest3573007-21runrttasks12:37:011
3247812993513,13cyclictest3488066-21taskset11:08:521
3247812993513,12cyclictest3548098-21runrttasks12:11:401
3247812993511,10cyclictest3567381-21runrttasks12:28:491
3247812993511,10cyclictest3559612-21kthreadcore12:22:381
3247812993510,9cyclictest3277108-21kthreadcore07:37:391
3247812993510,15cyclictest3494214-21if_enp4s0.211:17:351
3247812993510,11cyclictest3252495-21head07:12:501
3247808993530,4cyclictest3246951-21kworker/u8:2+flush-8:007:47:350
3247808993530,4cyclictest3246951-21kworker/u8:2+flush-8:007:47:350
3247808993529,4cyclictest3513567-21apt-get11:37:300
324781299349,10cyclictest3294647-21taskset07:55:141
324781299348,16cyclictest3263742-21ntpq07:22:421
324781299348,12cyclictest3378111-21ld09:17:431
3247812993413,12cyclictest3482447-21taskset11:02:421
3247812993413,10cyclictest573-21runrttasks09:01:081
3247812993412,9cyclictest3468503-21taskset10:51:221
3247812993412,13cyclictest3448240-21runrttasks10:29:031
3247812993411,9cyclictest3539538-21kthreadcore12:02:371
3247812993411,9cyclictest3539538-21kthreadcore12:02:371
3247812993411,7cyclictest3568150-21cpuspeed_turbos12:32:321
3247812993411,10cyclictest3364496-21/usr/sbin/munin09:07:401
3247812993410,10cyclictest3535770-21kthreadcore11:57:391
3247812993410,10cyclictest3535770-21kthreadcore11:57:391
3247812993410,10cyclictest3506262-21kthreadcore11:27:371
3247808993429,4cyclictest3246951-21kworker/u8:2+flush-8:008:07:340
3247814993327,4cyclictest3468929-21fschecks_time10:52:332
324781299339,9cyclictest3489718-21cut11:12:371
324781299339,14cyclictest3442649-21ld10:22:411
324781299339,14cyclictest3335072-21cat08:37:361
324781299338,14cyclictest3429008-21apt-get10:12:301
3247812993311,9cyclictest3274288-21timerwakeupswit07:32:501
3247812993310,8cyclictest3502573-21gcc11:22:461
3247808993329,3cyclictest3195856-21kworker/u8:3+events_unbound07:12:480
3247808993326,5cyclictest2253105-21kworker/u8:1+flush-8:007:22:420
324780899330,31cyclictest3418529-21munin-run10:00:000
324781299329,9cyclictest3553536-21if_enp4s012:17:341
324781299329,9cyclictest3283862-21gcc07:42:451
324781299329,9cyclictest3283862-21gcc07:42:451
324781299329,13cyclictest3328440-21collect208:27:411
324781299329,10cyclictest3309742-21runrttasks08:10:301
3247812993210,8cyclictest3420357-21kthreadcore10:02:401
3247812993210,8cyclictest3383844-21munin-run09:25:001
3247808993228,3cyclictest3271980-21kthreadcore07:32:390
324780899321,29cyclictest1-21systemd09:09:320
32475712324,10sleep20-21swapper/207:09:302
324781299319,13cyclictest3394626-21if_enp4s0.209:37:361
324781299319,12cyclictest3247864-21latency_hist07:10:011
324781299318,9cyclictest3399083-21runrttasks09:42:111
324781299318,9cyclictest3253072-21irqcore07:15:011
324781299318,10cyclictest3518528-21runrttasks11:42:181
3247812993113,7cyclictest3294340-21taskset07:54:191
3247812993110,12cyclictest3427804-21ntpq10:07:421
324781299309,7cyclictest1-21systemd08:10:011
3247808993026,3cyclictest3246951-21kworker/u8:2+flush-8:008:32:350
3247808993025,3cyclictest3294191-21unixbench_singl07:52:510
3247808993024,5cyclictest3195856-21kworker/u8:3+flush-8:008:27:330
3247814992924,3cyclictest3358603-21unixbench_multi08:57:492
3247814992920,7cyclictest275-21systemd-journal10:30:012
3247814992920,7cyclictest275-21systemd-journal08:25:012
3247808992924,3cyclictest3483256-21systemd-run11:05:000
3247808992924,3cyclictest3354584-21cpuspeed_turbos08:57:320
3247808992923,5cyclictest2253105-21kworker/u8:1+flush-8:010:35:010
3247808992923,4cyclictest3463233-21cron10:45:000
3247808992922,5cyclictest3349394-21/usr/sbin/munin08:52:400
3247808992922,5cyclictest3246951-21kworker/u8:2+flush-8:008:42:460
3247814992822,4cyclictest3290150-21cpuspeed_turbos07:52:332
3247814992818,8cyclictest275-21systemd-journal07:35:322
3247808992820,6cyclictest3402851-21ntpq09:42:410
3247808992818,8cyclictest3468867-21diskstats10:52:320
35614782270,2sleep3481ktimers/312:22:393
34399932270,3sleep3451irq_work/310:22:373
3247814992723,2cyclictest3558393-21fschecks_time12:22:332
3247814992722,4cyclictest3304296-21unixbench_singl08:02:502
3247814992717,8cyclictest3518110-21cat11:40:002
3247808992724,2cyclictest3552401-21tail12:12:510
3247808992722,3cyclictest3428300-21unixbench_multi10:07:490
3247808992722,3cyclictest3413743-21kworker/u8:0+flush-8:012:00:000
3247808992722,3cyclictest3413743-21kworker/u8:0+flush-8:012:00:000
3247814992623,2cyclictest3498940-21cpuspeed_turbos11:22:332
3247814992620,3cyclictest3483223-21cron11:05:002
324780899262,23cyclictest0-21swapper/011:12:470
3247808992622,2cyclictest0-21swapper/009:05:000
3247808992621,3cyclictest0-21swapper/007:45:000
3247808992621,3cyclictest0-21swapper/007:45:000
3247814992519,4cyclictest275-21systemd-journal09:35:322
3247814992516,7cyclictest3269860-21cat07:30:012
324780899252,22cyclictest0-21swapper/008:12:480
3247808992520,4cyclictest3567285-21unixbench_singl12:27:490
3247808992515,8cyclictest3518564-21apt-get11:42:290
34868192240,4sleep00-21swapper/011:07:400
3247814992420,2cyclictest3339585-21aten2_r5power_c08:42:312
324780899242,21cyclictest0-21swapper/011:27:460
324780899242,21cyclictest0-21swapper/008:22:460
324780899242,1cyclictest0-21swapper/010:27:470
3247808992421,2cyclictest3373979-21systemd-run09:15:000
3247808992420,3cyclictest2253105-21kworker/u8:1+events_unbound10:12:280
3247808992420,2cyclictest0-21swapper/008:02:500
34675012230,2sleep3481ktimers/310:47:453
3247814992319,2cyclictest3310009-21aten2_r5power_p08:12:322
3247814992317,5cyclictest20823-21cron10:45:002
3247814992316,5cyclictest3572506-21gpgv12:35:012
3247808992319,2cyclictest0-21swapper/009:50:000
3247808992318,4cyclictest600-21sshd09:28:320
3247808992318,3cyclictest3532928-21systemd-run11:55:000
3247808992318,3cyclictest3344654-21cpuspeed08:47:320
3247808992315,5cyclictest3527998-21latency_hist11:50:010
3247808992313,7cyclictest3413517-21latency_hist09:55:000
3247808992313,7cyclictest3413517-21latency_hist09:55:000
3247814992219,2cyclictest3333885-21unixbench_multi08:32:502
3247814992218,2cyclictest3418503-21apt-config10:00:002
3247814992218,2cyclictest3409227-21cpuspeed_turbos09:52:322
3247814992218,2cyclictest3409227-21cpuspeed_turbos09:52:322
3247814992218,2cyclictest3309215-21unixbench_multi08:07:492
3247814992217,3cyclictest0-21swapper/210:40:002
3247814992214,6cyclictest275-21systemd-journal09:25:002
3247808992219,2cyclictest3572408-21idleruntime-cro12:35:000
3247808992217,3cyclictest2253105-21kworker/u8:1+flush-8:009:20:000
3247808992217,3cyclictest0-21swapper/010:40:000
3247808992216,4cyclictest3246951-21kworker/u8:2+flush-8:007:27:430
3247808992215,5cyclictest3538364-21cut12:02:310
3247808992215,5cyclictest3538364-21cut12:02:310
3247808992214,6cyclictest2253105-21kworker/u8:1+flush-8:009:22:290
3247808992214,4cyclictest0-21swapper/010:57:300
3247808992214,1cyclictest0-21swapper/008:17:290
3247808992213,5cyclictest3389219-21apt-get09:32:310
3247808992212,2cyclictest0-21swapper/011:32:310
3247814992118,2cyclictest3537831-21cron12:00:002
3247814992118,2cyclictest3537831-21cron12:00:002
3247814992118,2cyclictest3255138-21aten2_r5power_p07:17:322
3247814992117,2cyclictest3439189-21fschecks_count10:22:332
3247814992116,3cyclictest3547486-21unixbench_multi12:07:532
3247808992119,1cyclictest0-21swapper/012:22:470
3247808992117,2cyclictest0-21swapper/011:22:400
3247808992116,3cyclictest0-21swapper/011:17:340
3247814992016,2cyclictest0-21swapper/208:50:002
3247814992014,4cyclictest3478087-21gpgv11:00:002
3247814992013,5cyclictest3252874-21latency_hist07:15:012
3247814992011,7cyclictest3400851-21cat09:42:382
32469142201,11sleep03246949-21ntp_states07:07:430
3247814991915,3cyclictest3548245-21aten2_r5power_e12:12:302
3247814991915,2cyclictest0-21swapper/208:00:012
3247814991914,3cyclictest3554006-21sed12:17:372
3247814991911,6cyclictest3513114-21cron11:35:002
3247814991911,6cyclictest3408434-21sshd09:48:322
3247814991911,6cyclictest3378090-21awk09:17:432
3247814991911,6cyclictest3351143-21tr08:52:372
324781499190,17cyclictest3528600-21cpuspeed11:52:312
35734472180,6chrt0-21swapper/212:37:352
3247814991815,2cyclictest3493877-21aten2_r5power_v11:17:322
3247814991813,3cyclictest0-21swapper/211:10:002
3247814991813,3cyclictest0-21swapper/210:17:372
3247814991813,3cyclictest0-21swapper/210:02:412
324781499181,12cyclictest3364521-21apt-get09:07:302
324781499181,11cyclictest3463684-21apt-get10:47:312
3247808991813,4cyclictest3383470-21kworker/u8:0+events_unbound09:37:330
32431192182,9sleep30-21swapper/307:06:543
324781499177,7cyclictest3337708-21tr08:37:402
3247814991713,2cyclictest3285247-21fschecks_count07:47:342
3247814991713,2cyclictest3285247-21fschecks_count07:47:342
3247814991713,2cyclictest0-21swapper/209:12:322
3247814991713,2cyclictest0-21swapper/208:17:392
3247814991712,3cyclictest0-21swapper/212:27:372
3247814991712,3cyclictest0-21swapper/212:05:002
3247814991712,3cyclictest0-21swapper/212:05:002
324781499167,7cyclictest3488651-21cut11:12:292
324781499167,7cyclictest3431111-21tr10:12:382
324781499162,2cyclictest0-21swapper/209:02:342
324781499162,13cyclictest0-21swapper/210:06:512
3247814991613,2cyclictest0-21swapper/207:31:342
3247814991612,2cyclictest0-21swapper/211:42:292
3247814991510,3cyclictest0-21swapper/209:27:422
35643482145,5sleep30-21swapper/312:27:383
35477362132,6sleep30-21swapper/312:10:003
34982412132,7sleep30-21swapper/311:20:003
34533262132,6sleep30-21swapper/310:35:023
34435762132,6sleep30-21swapper/310:25:023
33681542132,7sleep30-21swapper/309:07:403
33530132132,7sleep30-21swapper/308:52:403
33193772132,6sleep30-21swapper/308:20:023
35683072122,6sleep30-21swapper/312:32:363
35526852122,6sleep30-21swapper/312:15:023
35337702122,6sleep30-21swapper/311:57:363
35337702122,6sleep30-21swapper/311:57:363
35322812122,6sleep30-21swapper/311:52:473
35223762122,6sleep30-21swapper/311:42:443
35087912122,6sleep30-21swapper/311:32:323
35033762122,5sleep30-21swapper/311:25:023
34836762122,6sleep30-21swapper/311:07:323
34684012122,5sleep30-21swapper/310:50:023
34341832122,6sleep30-21swapper/310:17:323
34333192123,5sleep30-21swapper/310:12:503
34227362122,6sleep30-21swapper/310:02:433
34040392122,6sleep30-21swapper/309:47:303
33802562123,6sleep30-21swapper/309:22:383
33743322122,6sleep30-21swapper/309:17:003
33595812122,6sleep30-21swapper/309:02:323
33552432122,6sleep30-21swapper/308:57:383
33447452123,6sleep30-21swapper/308:47:353
33296122122,6sleep30-21swapper/308:32:303
33253302122,6sleep30-21swapper/308:27:363
33153092121,7sleep30-21swapper/308:17:373
33020432122,6sleep30-21swapper/308:02:393
32841092122,6sleep30-21swapper/307:42:503
32841092122,6sleep30-21swapper/307:42:503
32790122122,6sleep30-21swapper/307:37:483
32698722122,6sleep30-21swapper/307:30:103
32644602120,8sleep30-21swapper/307:25:003
32485282122,6sleep30-21swapper/307:12:363
35731262112,5sleep30-21swapper/312:37:333
35487142111,6sleep30-21swapper/312:12:373
35378832112,5sleep30-21swapper/312:00:013
35378832112,5sleep30-21swapper/312:00:013
35233172112,6sleep30-21swapper/311:45:273
35131422112,5sleep30-21swapper/311:35:013
34985112112,6sleep30-21swapper/311:20:123
34885692112,5sleep30-21swapper/311:12:223
34781872110,6sleep30-21swapper/311:00:023
34733892112,6sleep30-21swapper/310:55:443
34585942112,6sleep30-21swapper/310:41:083
34485882112,5sleep30-21swapper/310:30:323
34239132113,5sleep30-21swapper/310:05:443
34183452112,6sleep30-21swapper/309:58:503
34127772112,5sleep30-21swapper/309:52:443
34127772112,5sleep30-21swapper/309:52:433
33990352112,6sleep30-21swapper/309:41:363
33939602112,5sleep30-21swapper/309:35:023
33891932112,5sleep30-21swapper/309:32:293
33844992112,5sleep30-21swapper/309:27:363
33692572112,5sleep30-21swapper/309:10:303
33395272112,5sleep30-21swapper/308:42:293
33389152112,5sleep30-21swapper/308:37:523
33116632112,5sleep30-21swapper/308:12:393
33049432112,6sleep30-21swapper/308:07:303
32947602112,5sleep30-21swapper/307:56:423
32847732112,6sleep30-21swapper/307:45:103
32847732112,6sleep30-21swapper/307:45:103
32649342112,5sleep30-21swapper/307:25:043
32590382112,5sleep30-21swapper/307:17:503
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional