You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 15:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Mon Mar 23, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
584814995546,6cyclictest800849-21latency_hist10:45:011
584814995444,6cyclictest280-21systemd-journal07:46:341
6441762530,2sleep239-21ksoftirqd/208:06:412
584814995245,6cyclictest761419-21kworker/u8:3+events_unbound10:16:431
584818995141,7cyclictest910318-21awk12:35:002
584818994840,5cyclictest706904-21kworker/u8:0+flush-8:009:21:432
584818994840,5cyclictest706904-21kworker/u8:0+flush-8:009:21:432
584814994842,4cyclictest584683-21kworker/u8:3+events_unbound08:05:011
584814994839,6cyclictest795897-21latency_hist10:40:011
584814994741,4cyclictest584659-21latency_hist07:10:011
584814994738,6cyclictest636727-21latency_hist08:00:011
584810994738,6cyclictest781022-21latency_hist10:25:010
584814994335,6cyclictest280-21systemd-journal11:46:421
584814994231,8cyclictest280-21systemd-journal07:38:371
584814994231,8cyclictest280-21systemd-journal07:38:371
584814994129,9cyclictest280-21systemd-journal09:33:421
584810994133,6cyclictest756224-21latency_hist10:00:010
584814994032,5cyclictest860710-21latency_hist11:45:011
584814994031,6cyclictest280-21systemd-journal12:22:421
584814993935,3cyclictest3954619-21kworker/u8:0+flush-8:008:36:331
584814993931,6cyclictest696880-21/usr/sbin/munin09:01:421
584814993931,5cyclictest741364-21latency_hist09:45:011
584814993828,8cyclictest814895-21ntpq10:56:421
584814993828,8cyclictest814895-21ntpq10:56:421
584814993729,4cyclictest3954619-21kworker/u8:0+flush-8:008:31:431
584810993728,6cyclictest611704-21latency_hist07:35:000
584818993632,3cyclictest755453-21kworker/u8:1+flush-8:009:56:472
584814993631,3cyclictest647689-21irqrtprio08:11:371
584814993630,4cyclictest584683-21kworker/u8:3+events_unbound08:46:381
584818993531,3cyclictest699066-21kworker/u8:3+flush-8:009:51:422
584818993529,4cyclictest696228-21unixbench_singl08:56:502
584814993523,9cyclictest695687-21ntpq08:56:431
584814993429,3cyclictest656507-21munin-run08:20:001
584814993428,4cyclictest584683-21kworker/u8:3+flush-8:007:41:481
584814993428,4cyclictest584683-21kworker/u8:3+flush-8:007:41:481
584810993426,6cyclictest621691-21latency_hist07:45:000
584810993426,6cyclictest621691-21latency_hist07:45:000
584818993328,4cyclictest800096-21kworker/u8:2+events_unbound10:51:462
584814993328,3cyclictest721892-21apt-get09:26:281
584814993328,3cyclictest716561-21cat09:20:001
584814993327,4cyclictest824829-21kworker/u8:2+events_unbound11:26:431
584814993327,4cyclictest1-21systemd12:10:001
584814993326,5cyclictest755453-21kworker/u8:1+events_unbound10:00:011
584814993224,5cyclictest601590-21latency_hist07:25:011
584810993225,5cyclictest280-21systemd-journal07:56:360
584810993222,7cyclictest790940-21latency_hist10:35:010
584818993122,7cyclictest606746-21cp07:30:002
584818993122,7cyclictest280-21systemd-journal11:50:002
584814993126,4cyclictest810495-21kworker/u8:3+flush-8:012:11:451
584814993126,3cyclictest679042-21kthreadcore08:41:391
584814993122,7cyclictest851147-21/usr/sbin/munin11:36:441
584810993127,2cyclictest1-21systemd08:15:000
584810993125,4cyclictest840737-21unin-run11:25:010
584810993124,5cyclictest791351-21grep10:36:290
58481099310,29cyclictest1-21systemd11:15:010
5844502313,3sleep00-21swapper/007:07:280
584818993025,4cyclictest815735-21kworker/u8:1+flush-8:011:21:482
584814993024,4cyclictest864868-21kworker/u8:0+flush-8:012:02:421
584814993024,4cyclictest706649-21apt-key09:10:001
584814993023,5cyclictest815735-21kworker/u8:1+events_unbound12:31:471
584814993020,8cyclictest745503-21ntpq09:46:431
584810993026,3cyclictest699066-21kworker/u8:3+events_unbound09:26:400
584810993026,3cyclictest691329-21kworker/u8:1+events_unbound09:01:390
584810993025,4cyclictest815732-21systemd-run11:00:000
584810993025,4cyclictest815732-21systemd-run11:00:000
584810993021,6cyclictest835737-21latency_hist11:20:010
584814992924,4cyclictest810495-21kworker/u8:3+flush-8:012:26:421
584814992924,3cyclictest874583-21missed_timers11:56:421
584814992924,3cyclictest589835-21cat07:15:011
584814992918,8cyclictest280-21systemd-journal12:15:421
584810992926,2cyclictest672503-21irqcore08:36:360
584810992925,3cyclictest864868-21kworker/u8:0+flush-8:012:36:380
7355022280,9sleep1291ktimers/109:36:401
584818992824,2cyclictest622365-21aten2_r5power_p07:46:312
584814992824,3cyclictest864868-21kworker/u8:0+events_unbound11:51:421
584814992824,2cyclictest790700-21sshd10:32:421
584814992823,3cyclictest778583-21kthreadcore10:21:381
584814992822,4cyclictest845374-21kworker/u8:0+flush-8:011:31:391
584814992820,6cyclictest821010-21apt-get11:06:281
584810992819,7cyclictest280-21systemd-journal08:35:000
584810992817,3cyclictest0-21swapper/008:19:420
584814992722,4cyclictest3954619-21kworker/u8:0+events_unbound07:31:331
584814992722,2cyclictest0-21swapper/108:51:331
584814992721,4cyclictest815735-21kworker/u8:1+events_unbound11:21:431
584814992721,4cyclictest815735-21kworker/u8:1+events_unbound11:15:011
584814992718,7cyclictest280-21systemd-journal10:06:431
584810992723,3cyclictest810763-21systemd-run10:55:000
584810992722,3cyclictest763176-21cut10:06:380
584810992717,8cyclictest900823-21diskstats12:26:310
584810992717,7cyclictest631790-21latency_hist07:55:010
584818992622,2cyclictest766799-21fschecks_count10:11:362
584818992621,3cyclictest676141-21unixbench_multi08:36:492
584818992616,8cyclictest731441-21cron09:35:002
584814992622,2cyclictest910968-21cut12:36:331
584814992621,3cyclictest664202-21kthreadcore08:26:381
584814992621,2cyclictest0-21swapper/110:46:341
584810992622,3cyclictest696567-21systemd-run09:00:000
584810992622,3cyclictest0-21swapper/009:40:000
584810992620,4cyclictest880156-21unixbench_multi12:01:470
584810992619,5cyclictest885111-21grep12:06:500
584810992617,7cyclictest280-21systemd-journal09:20:000
584810992616,8cyclictest661552-21cp08:25:010
584810992610,14cyclictest886013-21df_inode12:11:300
584818992521,2cyclictest791559-21fschecks_count10:36:332
584814992521,2cyclictest7674292sleep110:11:401
584814992521,2cyclictest717166-21cpuspeed_turbos09:21:331
584814992521,2cyclictest717166-21cpuspeed_turbos09:21:331
584814992520,4cyclictest3954619-21kworker/u8:0+events_unbound07:55:011
584814992519,4cyclictest820319-21unixbench_multi11:01:501
584814992518,5cyclictest0-21swapper/110:51:341
584810992522,2cyclictest895304-21idleruntime-cro12:20:000
584810992522,2cyclictest800840-21sh10:45:000
584810992520,4cyclictest711287-21unixbench_singl09:11:500
584810992519,5cyclictest401-21dbus-daemon10:30:000
584810992519,4cyclictest845290-21unixbench_multi11:26:480
584818992420,2cyclictest894987-21unixbench_singl12:16:482
584818992420,2cyclictest846248-21aten2_r5power_c11:31:312
584818992419,4cyclictest3954619-21kworker/u8:0+flush-8:008:50:362
584818992417,5cyclictest280-21systemd-journal08:03:422
584818992415,7cyclictest661884-21cat08:25:012
584818992413,8cyclictest831158-21apt-get11:16:292
584814992420,2cyclictest0-21swapper/108:21:331
584814992419,4cyclictest584683-21kworker/u8:3+events_unbound08:06:331
584814992419,2cyclictest0-21swapper/109:11:401
584814992413,7cyclictest0-21swapper/110:26:301
58481099247,10cyclictest0-21swapper/011:56:320
58481099242,21cyclictest0-21swapper/009:06:470
584810992421,2cyclictest0-21swapper/010:20:000
584810992420,2cyclictest0-21swapper/011:10:010
584810992418,4cyclictest681467-21latency_hist08:45:010
584810992417,5cyclictest741048-21grep09:41:490
584818992320,2cyclictest821274-21fschecks_count11:06:322
584818992319,3cyclictest3954619-21kworker/u8:0+events_unbound07:51:482
584818992318,4cyclictest800096-21kworker/u8:2+flush-8:010:41:482
584818992315,6cyclictest706527-21cp09:10:002
584818992311,4cyclictest0-21swapper/208:45:022
584814992316,5cyclictest824829-21kworker/u8:2+flush-8:011:16:431
584810992319,3cyclictest746321-21systemd-run09:50:010
584810992319,3cyclictest666644-21systemd-run08:30:000
584810992318,3cyclictest0-21swapper/010:01:380
584818992219,2cyclictest875218-21unixbench_singl11:56:512
584818992218,3cyclictest584683-21kworker/u8:3+flush-8:008:31:482
584818992218,2cyclictest731892-21aten2_r5power_p09:36:302
584818992218,2cyclictest0-21swapper/209:20:002
584818992217,4cyclictest656140-21unixbench_multi08:16:482
584818992215,5cyclictest280-21systemd-journal09:12:012
58481899220,5cyclictest9052162systemctl12:30:002
584814992218,2cyclictest0-21swapper/110:01:461
584814992217,3cyclictest699066-21kworker/u8:3+events_unbound09:51:501
584814992217,3cyclictest0-21swapper/107:26:321
584810992219,2cyclictest637635-21irqcore08:01:360
584810992218,2cyclictest876-21mta-sts-daemon09:32:180
584810992217,4cyclictest810495-21kworker/u8:3+flush-8:011:41:130
584810992217,4cyclictest686335-21unixbench_singl08:46:490
584810992217,3cyclictest0-21swapper/012:35:000
584810992212,2cyclictest0-21swapper/007:49:440
584814992117,2cyclictest0-21swapper/107:16:351
58481099219,10cyclictest0-21swapper/011:51:400
584810992117,3cyclictest849984-21ntp_kernel_pll_11:31:420
584810992117,3cyclictest691603-21latency_hist08:55:000
584810992117,2cyclictest0-21swapper/007:16:380
584810992116,3cyclictest0-21swapper/011:46:390
584810992116,3cyclictest0-21swapper/008:06:430
584810992115,4cyclictest0-21swapper/011:36:380
584810992113,6cyclictest805785-21seq10:49:550
584810992113,6cyclictest280-21systemd-journal07:11:260
584810992111,8cyclictest0-21swapper/009:51:330
58481899202,12cyclictest612060-21apt-get07:36:312
58481899202,12cyclictest612060-21apt-get07:36:312
584818992016,3cyclictest845791-21latency_hist11:30:012
584818992016,3cyclictest815735-21kworker/u8:1+events_unbound11:41:472
584818992016,3cyclictest699066-21kworker/u8:3+flush-8:009:01:532
584818992016,2cyclictest0-21swapper/211:15:012
584818992015,3cyclictest0-21swapper/207:45:002
584818992015,3cyclictest0-21swapper/207:45:002
584810992017,2cyclictest0-21swapper/011:01:500
584810992016,2cyclictest0-21swapper/007:21:310
5843932204,9sleep20-21swapper/207:06:502
58481899196,7cyclictest39-21ksoftirqd/208:26:332
58481899193,12cyclictest879691-21ntpq12:01:422
584818991915,2cyclictest776665-21fschecks_count10:21:332
584818991915,2cyclictest756813-21cpuspeed_turbos10:01:302
584818991915,2cyclictest0-21swapper/212:40:002
584818991913,4cyclictest805492-21unixbench_singl10:46:482
584818991912,5cyclictest0-21swapper/209:46:382
584818991911,6cyclictest681825-21find08:45:012
584818991910,7cyclictest854180-21tr11:36:392
58481099192,1cyclictest0-21swapper/012:21:480
58481099191,7cyclictest768360-21kthreadcore10:11:410
584810991915,2cyclictest0-21swapper/007:36:310
584810991915,2cyclictest0-21swapper/007:36:310
58481899188,8cyclictest812865-21tr10:56:372
58481899188,8cyclictest812865-21tr10:56:372
58481899182,12cyclictest632151-21taskset07:56:292
584818991813,4cyclictest746056-21kworker/u8:0+events_unbound11:02:062
584818991813,3cyclictest0-21swapper/210:06:372
58481899181,12cyclictest771441-21apt-get10:16:302
584818991810,6cyclictest896435-21sed12:21:372
58481099182,15cyclictest0-21swapper/007:26:460
5800782185,7sleep30-21swapper/307:06:153
58481899178,7cyclictest609612-21tr07:31:402
58481899177,8cyclictest886405-21sed12:11:342
58481899172,11cyclictest600755-21ntpq07:21:422
584818991713,2cyclictest591075-21kthreadcore07:15:032
584818991713,2cyclictest0-21swapper/212:06:492
584818991712,3cyclictest785167-21ntpq10:26:442
584818991712,3cyclictest0-21swapper/209:41:482
584818991711,2cyclictest0-21swapper/210:31:482
584818991710,5cyclictest648158-21cut08:11:382
58481899170,11cyclictest585886-21irqrtprio07:11:372
584810991710,5cyclictest717682-21cut09:21:370
584810991710,5cyclictest717682-21cut09:21:370
58481899169,5cyclictest867487-21cut11:51:382
584818991611,3cyclictest0-21swapper/209:26:372
6083852145,5sleep30-21swapper/307:31:393
5974632144,6sleep30-21swapper/307:21:363
9106812136,4sleep30-21swapper/312:36:293
8782132130,2sleep375-21kworker/3:1-mm_percpu_wq12:01:373
8408782132,6sleep30-21swapper/311:25:023
8255962130,7sleep30-21swapper/311:10:013
8148092132,7sleep30-21swapper/310:56:413
8148092132,7sleep30-21swapper/310:56:413
6858282132,7sleep30-21swapper/308:46:433
6629302134,5sleep30-21swapper/308:26:373
9097882122,6sleep30-21swapper/312:31:483
9002662122,5sleep30-21swapper/312:25:013
8983412122,6sleep30-21swapper/312:21:403
8808462123,5sleep30-21swapper/312:06:313
8713102122,6sleep30-21swapper/311:56:363
8565432122,6sleep30-21swapper/311:41:353
8508312122,5sleep30-21swapper/311:35:013
8502492122,6sleep30-21swapper/311:31:483
8403492122,6sleep30-21swapper/311:21:493
8316372122,6sleep30-21swapper/311:16:353
8009072122,5sleep30-21swapper/310:45:013
7911602122,5sleep30-21swapper/310:35:023
7863762122,6sleep30-21swapper/310:31:333
7807032122,6sleep30-21swapper/310:21:503
7414982122,6sleep30-21swapper/309:45:023
7351662122,6sleep30-21swapper/309:36:393
7218662122,6sleep30-21swapper/309:26:283
7006572122,6sleep30-21swapper/309:01:443
6961712122,6sleep30-21swapper/308:56:513
6765342122,5sleep30-21swapper/308:40:013
6752862122,6sleep30-21swapper/308:36:403
6669842122,6sleep30-21swapper/308:31:313
6515772122,5sleep30-21swapper/308:15:013
6359072122,6sleep30-21swapper/307:56:433
6312962122,6sleep30-21swapper/307:51:503
6222532122,6sleep30-21swapper/307:46:283
5940422122,6sleep30-21swapper/307:16:393
8905722112,5sleep30-21swapper/312:15:023
8861622112,5sleep30-21swapper/312:11:333
8658602112,5sleep30-21swapper/311:50:023
8646542112,5sleep30-21swapper/311:46:413
8260832112,6sleep30-21swapper/311:10:173
8159902112,5sleep30-21swapper/311:00:423
8098492112,5sleep30-21swapper/310:51:393
7961792112,6sleep30-21swapper/310:40:363
7817582112,5sleep30-21swapper/310:26:353
7714132112,6sleep30-21swapper/310:16:283
7663692112,5sleep30-21swapper/310:10:023
7653892112,5sleep30-21swapper/310:06:453
7573012112,6sleep30-21swapper/310:01:353
7512932112,5sleep30-21swapper/309:55:013
7502282112,5sleep30-21swapper/309:51:403
7376602112,5sleep30-21swapper/309:41:373
7267642112,6sleep30-21swapper/309:30:423
7206722112,5sleep30-21swapper/309:21:433
7206722112,5sleep30-21swapper/309:21:433
7122062112,6sleep30-21swapper/309:16:333
7070282112,6sleep30-21swapper/309:11:313
7015242112,5sleep30-21swapper/309:05:023
6910712112,5sleep30-21swapper/308:51:493
6573182112,6sleep30-21swapper/308:21:353
6469702111,6sleep30-21swapper/308:11:323
6418062112,5sleep30-21swapper/308:05:023
6406922112,5sleep30-21swapper/308:01:413
6211972112,5sleep30-21swapper/307:41:513
6211972112,5sleep30-21swapper/307:41:513
6165502112,5sleep30-21swapper/307:38:383
6165502112,5sleep30-21swapper/307:38:383
6016282112,5sleep30-21swapper/307:25:013
5896032112,5sleep30-21swapper/307:14:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional