You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 14:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Tue Mar 24, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33716522540,8sleep2371rcuc/207:06:372
5843772860,3chrt75-21kworker/3:1+events11:16:313
4281002780,3sleep375-21kworker/3:1+events08:36:363
3860882680,5sleep20-21swapper/207:56:342
4609182610,3chrt371rcuc/209:11:342
3891522520,4sleep30-21swapper/307:56:393
338909995142,6cyclictest574087-21latency_hist11:05:001
338909995142,6cyclictest574087-21latency_hist11:05:001
338909994639,4cyclictest564153-21base6410:55:001
338909994337,4cyclictest345990-21kworker/u8:1+flush-8:007:16:321
3492262420,2sleep3471rcuc/307:16:383
338909994134,5cyclictest345990-21kworker/u8:1+flush-8:008:01:341
338909994131,7cyclictest280-21systemd-journal10:20:001
338909994032,5cyclictest280-21systemd-journal11:14:401
338909994030,8cyclictest280-21systemd-journal08:37:421
338909994029,8cyclictest280-21systemd-journal09:59:401
338909993933,4cyclictest514900-21apt-get10:06:271
338904993830,5cyclictest529594-21kworker/u8:0+flush-8:011:25:000
338904993730,5cyclictest280-21systemd-journal11:26:400
338912993628,6cyclictest280-21systemd-journal11:25:012
338909993627,6cyclictest663818-21latency_hist12:35:011
338904993631,4cyclictest479727-21kworker/u8:1+flush-8:009:46:330
338904993631,3cyclictest345990-21kworker/u8:1+events_unbound07:31:360
338904993628,6cyclictest614122-21latency_hist11:45:010
338909993529,4cyclictest544548-21apt-get10:36:281
338904993525,7cyclictest479073-21ntpq09:26:410
338904993525,7cyclictest479073-21ntpq09:26:410
4823112340,5sleep00-21swapper/009:31:380
338909993429,3cyclictest603716-21cron11:35:001
338909993428,4cyclictest307244-21kworker/u8:3+flush-8:009:31:461
338904993428,4cyclictest494450-21grep09:41:480
338912993324,7cyclictest469703-21head09:16:502
338909993327,4cyclictest606478-21kthreadcore11:36:381
338909993324,6cyclictest280-21systemd-journal07:37:421
338904993326,5cyclictest370690-21kworker/u8:2+flush-8:009:16:340
4564172320,5sleep3451irq_work/309:06:373
33890999329,9cyclictest401368-21cut08:11:361
338909993228,3cyclictest575167-21irqrtprio11:06:361
338909993226,4cyclictest495171-21apt-get09:46:291
338909993220,9cyclictest280-21systemd-journal12:37:401
338904993228,2cyclictest338911-21latency_hist07:10:010
338909993127,2cyclictest522004-21kthreadcore10:11:381
338909993127,2cyclictest514529-21cron10:05:001
338909993124,5cyclictest653648-21unixbench_singl12:21:481
338909993122,7cyclictest549478-21/usr/sbin/munin10:41:461
338912993021,7cyclictest280-21systemd-journal09:05:002
338909993024,4cyclictest456249-21irqrtprio09:06:371
338909993022,6cyclictest339231-21aten2_r5power_p07:11:311
338909993014,3cyclictest0-21swapper/109:16:401
338904993025,4cyclictest370690-21kworker/u8:2+events_unbound09:21:350
338904993021,6cyclictest544186-21latency_hist10:35:010
338912992925,2cyclictest520149-21fschecks_time10:11:332
338909992926,2cyclictest565310-21irqrtprio10:56:371
338909992923,5cyclictest609375-21kworker/u8:0+flush-8:012:01:411
338909992921,6cyclictest559021-21cron10:50:001
338904992922,5cyclictest464741-21grep09:11:480
338904992920,7cyclictest435492-21/usr/sbin/munin08:46:410
33890499290,25cyclictest619566-21sshd11:50:400
3464872280,2sleep2371rcuc/207:16:332
338912992823,3cyclictest343515-21unixbench_singl07:11:492
338912992821,6cyclictest360556-21cron07:30:002
338909992825,2cyclictest452720-21cut09:01:381
338909992824,2cyclictest464764-21unixbench_singl09:11:481
338909992823,3cyclictest440106-21cron08:50:001
338909992821,5cyclictest384991-21unixbench_singl07:51:481
338909992821,5cyclictest280-21systemd-journal10:31:411
338909992820,6cyclictest644020-21cron12:15:001
338909992820,6cyclictest361042-21aten2_r5power_v07:31:301
338909992818,8cyclictest648970-21latency_hist12:20:011
338904992825,2cyclictest648969-21basename12:20:000
338904992825,2cyclictest538965-21unixbench_singl10:26:490
338904992825,2cyclictest479727-21kworker/u8:1+flush-8:009:56:320
338904992822,5cyclictest649215-21kworker/u8:0+flush-8:012:36:410
338904992822,4cyclictest529594-21kworker/u8:0+flush-8:011:01:390
338904992822,4cyclictest529594-21kworker/u8:0+flush-8:011:01:390
338904992819,8cyclictest345990-21kworker/u8:1+flush-8:008:16:340
338904992819,7cyclictest629517-21/usr/sbin/munin12:01:390
33890499280,24cyclictest658000-21sshd12:26:410
338912992723,3cyclictest534944-21fschecks_count10:26:332
338912992721,4cyclictest543876-21unixbench_singl10:31:482
338912992718,7cyclictest459759-21unixbench_multi09:06:492
338909992723,3cyclictest588892-21cron11:20:001
338909992722,4cyclictest596359-21kworker/u8:1+flush-8:012:06:481
338909992721,4cyclictest355357-21unixbench_singl07:21:481
338909992719,6cyclictest592957-21needreboot11:21:401
338904992723,2cyclictest429986-21cron08:40:000
338904992721,5cyclictest307244-21kworker/u8:3+events_unbound09:51:420
338904992721,4cyclictest3710656-21kworker/u8:0+flush-8:007:21:420
338904992720,5cyclictest529594-21kworker/u8:0+events_unbound10:41:410
338912992623,2cyclictest604635-21fschecks_time11:36:332
338912992622,3cyclictest384974-21unixbench_singl07:51:482
338912992621,4cyclictest395172-21cron08:05:002
338912992621,3cyclictest470440-21aten2_r5power_e09:21:302
338909992622,3cyclictest658857-21apt12:30:001
338909992622,3cyclictest479908-21cron09:30:011
338909992622,3cyclictest479908-21cron09:30:001
338909992621,4cyclictest307244-21kworker/u8:3+flush-8:008:30:311
338909992621,3cyclictest615446-21irqrtprio11:46:331
338909992621,3cyclictest489549-21unixbench_singl09:36:481
338909992621,3cyclictest0-21swapper/109:41:431
338909992620,4cyclictest534308-21cron10:25:001
338909992620,4cyclictest370690-21kworker/u8:2+flush-8:008:29:461
338909992618,6cyclictest504307-21unixbench_multi09:51:481
338904992621,4cyclictest449868-21unixbench_multi08:56:480
338904992621,3cyclictest529340-21sendmail10:20:000
338904992620,4cyclictest370690-21kworker/u8:2+events_unbound07:51:460
338904992618,6cyclictest533532-21ntpq10:21:420
338904992616,8cyclictest638263-21ntpq12:06:420
6118962250,6sleep3451irq_work/311:41:393
338912992521,2cyclictest658499-21unixbench_multi12:26:482
338912992520,4cyclictest430011-21idleruntime-cro08:40:002
338912992520,3cyclictest360961-21aten2_r5power_c07:31:302
338912992520,3cyclictest0-21swapper/211:35:002
338909992521,2cyclictest0-21swapper/107:56:361
338909992520,3cyclictest628861-21unixbench_singl11:56:461
338909992519,5cyclictest345990-21kworker/u8:1+flush-8:007:46:321
338909992519,5cyclictest345990-21kworker/u8:1+flush-8:007:46:321
338909992519,4cyclictest620578-21kthreadcore11:51:351
338909992519,4cyclictest449297-21needreboot08:56:401
338909992519,3cyclictest609746-21cpuspeed_turbos11:41:331
338909992518,6cyclictest396120-21fschecks_time08:06:351
338904992521,3cyclictest564227-21apt-key10:55:000
338904992521,2cyclictest0-21swapper/008:05:010
338904992520,4cyclictest307244-21kworker/u8:3+flush-8:010:05:010
338904992520,3cyclictest548666-21timerandwakeup10:36:470
338904992520,3cyclictest520000-21cpuspeed10:11:310
338904992519,5cyclictest3710656-21kworker/u8:0+flush-8:007:36:330
338904992519,4cyclictest529594-21kworker/u8:0+flush-8:010:56:340
338904992518,5cyclictest585214-21cut11:16:370
338904992517,6cyclictest415164-21latency_hist08:25:010
338904992516,7cyclictest400699-21/usr/sbin/munin08:11:400
338912992418,4cyclictest553209-21needreboot10:41:402
338909992420,2cyclictest876-21mta-sts-daemon07:41:421
338909992417,5cyclictest405667-21aten2_r5power_c08:16:311
338909992417,5cyclictest360223-21unixbench_multi07:26:471
338909992416,6cyclictest594314-21aten2_r5power_p11:26:301
33890499247,16cyclictest559066-21kworker/0:1+events11:11:380
338904992418,4cyclictest529594-21kworker/u8:0+flush-8:010:46:460
338904992417,5cyclictest345990-21kworker/u8:1+flush-8:009:06:370
338904992415,6cyclictest400017-21grep08:06:500
338904992414,7cyclictest390243-21latency_hist08:00:010
338912992320,2cyclictest619766-21aten2_r5power_v11:51:292
338912992320,2cyclictest415557-21aten2_r5power_c08:26:302
338912992319,2cyclictest659251-21aten2_r5power_c12:31:322
338912992318,3cyclictest499441-21unixbench_singl09:46:492
338912992317,4cyclictest430602-21cpuspeed_turbos08:41:312
338912992317,4cyclictest415155-21cron08:25:002
338912992316,6cyclictest529025-21unixbench_singl10:16:482
338912992314,7cyclictest440113-21apt-get08:50:002
33891299230,14cyclictest529954-21tr10:21:312
338909992319,2cyclictest0-21swapper/108:41:311
338909992318,3cyclictest414220-21missed_timers08:21:431
338909992318,3cyclictest0-21swapper/109:21:371
338904992319,3cyclictest574737-21fschecks_count11:06:330
338904992319,2cyclictest374391-21latency07:41:380
338904992314,7cyclictest489093-21ntpq09:36:430
33890499231,11cyclictest415597-21aten2_r5power_p08:26:300
338912992218,3cyclictest400942-21cpuspeed_turbos08:11:312
338912992218,2cyclictest480494-21cpuspeed_turbos09:31:322
338912992217,3cyclictest479601-21unixbench_singl09:26:482
338912992217,3cyclictest479601-21unixbench_singl09:26:482
338912992217,3cyclictest440928-21cpuspeed_turbos08:51:302
338912992216,4cyclictest618934-21unixbench_multi11:46:452
338912992215,5cyclictest614388-21gpgv11:45:012
338912992212,8cyclictest598434-21unixbench_multi11:26:482
338909992217,3cyclictest0-21swapper/108:51:391
338904992218,2cyclictest344187-21cpuspeed07:15:010
338904992218,2cyclictest0-21swapper/012:11:320
338904992217,3cyclictest515206-21tune2fs10:06:320
338904992217,2cyclictest0-21swapper/011:40:000
338904992214,6cyclictest649215-21kworker/u8:0+flush-8:012:21:420
338904992214,5cyclictest280-21systemd-journal08:35:000
338904992213,7cyclictest603733-21apt-get11:35:010
3340802224,11sleep10-21swapper/107:05:131
338912992118,2cyclictest509998-21aten2_r5power_c10:01:302
338912992117,3cyclictest400065-21unixbench_singl08:06:502
338912992117,2cyclictest579733-21fschecks_time11:11:342
338912992116,3cyclictest0-21swapper/212:16:382
338912992112,7cyclictest564154-21cat10:55:002
338909992112,5cyclictest407-21mta-sts-daemon10:25:051
338904992116,3cyclictest440765-21tr08:51:300
338904992116,3cyclictest435138-21latency_hist08:45:010
338904992116,3cyclictest0-21swapper/009:01:330
338912992017,2cyclictest410220-21munin-run08:20:002
338912992015,4cyclictest574666-21cpuspeed_turbos11:06:312
338912992015,4cyclictest529594-21kworker/u8:0+flush-8:010:36:452
338912992015,3cyclictest0-21swapper/212:00:002
338912992013,4cyclictest0-21swapper/210:10:012
338912992012,6cyclictest377395-21tr07:46:362
338912992012,6cyclictest377395-21tr07:46:362
338904992013,5cyclictest3717018-21kworker/u8:2+events_unbound07:11:380
33891299198,3cyclictest161rcu_preempt11:16:402
338912991916,2cyclictest634829-21fschecks_time12:06:332
338912991915,2cyclictest494460-21unixbench_multi09:41:482
338904991916,1cyclictest0-21swapper/007:30:010
338904991915,2cyclictest0-21swapper/012:35:000
338904991915,2cyclictest0-21swapper/007:46:400
338904991915,2cyclictest0-21swapper/007:46:400
33891299182,12cyclictest503823-21ntpq09:51:412
338912991813,3cyclictest0-21swapper/210:56:482
338912991812,4cyclictest0-21swapper/209:56:372
338912991811,5cyclictest640124-21sed12:11:352
33891299181,12cyclictest351061-21apt-get07:21:302
338912991810,6cyclictest486307-21tr09:36:362
338912991810,6cyclictest420486-21cut08:31:312
338904991813,3cyclictest618993-21unixbench_singl11:46:460
338904991811,4cyclictest609375-21kworker/u8:0+events_unbound11:56:410
3377362183,8sleep30-21swapper/307:06:393
33891299179,6cyclictest445929-21fschecks_count08:56:332
338912991713,2cyclictest0-21swapper/210:46:472
338912991712,3cyclictest0-21swapper/212:21:332
338912991711,4cyclictest0-21swapper/211:01:382
338912991711,4cyclictest0-21swapper/211:01:382
33891299171,13cyclictest666527-21kthreadcore12:36:372
338912991711,3cyclictest366207-21fschecks_time07:36:322
338912991612,2cyclictest0-21swapper/207:41:482
338912991611,3cyclictest0-21swapper/212:01:322
6686462157,5sleep30-21swapper/312:39:113
6080692132,7sleep30-21swapper/311:36:433
5947232132,7sleep30-21swapper/311:26:353
5781352132,7sleep30-21swapper/311:06:413
5386162132,7sleep30-21swapper/310:26:483
5319482132,7sleep30-21swapper/310:21:383
5037902132,7sleep30-21swapper/309:51:413
4790262132,7sleep30-21swapper/309:26:413
4790262132,7sleep30-21swapper/309:26:413
4380462132,7sleep30-21swapper/308:46:403
3795172132,7sleep30-21swapper/307:46:413
3795172132,7sleep30-21swapper/307:46:413
6536112122,6sleep30-21swapper/312:21:493
6433262121,7sleep30-21swapper/312:11:463
6141292123,6sleep30-21swapper/311:45:023
5996392122,6sleep30-21swapper/311:31:373
5935992122,6sleep30-21swapper/311:21:503
5796922123,5sleep30-21swapper/311:11:343
5713332122,6sleep30-21swapper/311:01:393
5713332122,6sleep30-21swapper/311:01:393
5605342122,6sleep30-21swapper/310:51:403
5396162123,5sleep30-21swapper/310:31:303
5244152122,7sleep30-21swapper/310:15:003
5186482122,6sleep30-21swapper/310:06:423
5101292122,6sleep30-21swapper/310:01:323
5073542122,6sleep30-21swapper/309:56:383
4989342122,6sleep30-21swapper/309:46:433
4858112122,6sleep30-21swapper/309:36:363
4659872122,6sleep30-21swapper/309:16:373
4648442122,6sleep30-21swapper/309:12:403
4307442122,6sleep30-21swapper/308:41:343
4213502122,6sleep30-21swapper/308:31:393
4165092122,6sleep30-21swapper/308:26:373
4118152122,6sleep30-21swapper/308:21:403
4047812122,6sleep30-21swapper/308:11:493
3827942122,6sleep30-21swapper/307:51:383
3748782122,6sleep30-21swapper/307:41:473
3644552122,6sleep30-21swapper/307:31:403
6591492112,6sleep30-21swapper/312:30:563
6541672112,5sleep30-21swapper/312:25:023
6448612112,5sleep30-21swapper/312:16:353
6344512112,6sleep30-21swapper/312:06:283
6246142112,5sleep30-21swapper/311:56:293
6240152113,5sleep30-21swapper/311:52:083
5645582112,5sleep30-21swapper/310:56:303
5543212112,5sleep30-21swapper/310:45:023
5493912113,5sleep30-21swapper/310:40:243
5478662112,5sleep30-21swapper/310:36:393
5257162112,5sleep30-21swapper/310:16:373
4905452112,5sleep30-21swapper/309:41:333
4802032112,6sleep30-21swapper/309:30:543
4732282112,5sleep30-21swapper/309:21:393
4512912112,5sleep30-21swapper/309:01:373
4460472112,5sleep30-21swapper/308:56:353
4407092112,5sleep30-21swapper/308:51:293
4052992112,4sleep30-21swapper/308:15:023
3960202112,5sleep30-21swapper/308:06:353
3905982112,5sleep30-21swapper/308:01:293
3672862112,5sleep30-21swapper/307:36:373
3557282112,5sleep30-21swapper/307:25:023
3509852112,6sleep30-21swapper/307:20:483
3437002112,5sleep30-21swapper/307:13:423
6294032102,5sleep30-21swapper/312:00:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional