You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 21:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sun Jun 14, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25401921210,3chrt451irq_work/308:15:283
3835192830,3chrt0-21swapper/110:25:321
187044997656,16cyclictest307421-21ntpq09:05:390
187049997162,7cyclictest191952-21apt-get07:15:011
187044996443,18cyclictest462183-21latency_hist11:45:000
187049996352,8cyclictest361748-21ntpq10:00:391
187049996350,10cyclictest192225-21apt-key07:15:011
187044996338,22cyclictest452799-21diskstats11:35:280
187044996255,5cyclictest259202-21apt-get08:20:250
187044996242,17cyclictest204057-21latency_hist07:25:000
187049996156,4cyclictest366968-21kworker/u8:0+events_unbound11:30:331
187049996054,5cyclictest186913-21kworker/u8:3+flush-8:009:20:451
187049996053,4cyclictest427547-21kworker/u8:3+events_unbound12:05:301
187049996051,7cyclictest273615-21kworker/u8:2+flush-8:008:40:411
3066972580,3sleep2371rcuc/209:05:342
187049995851,4cyclictest366968-21kworker/u8:0+events_unbound11:05:451
187053995748,6cyclictest258787-21base6408:20:002
187049995746,9cyclictest267867-21ntpq08:25:391
187044995736,18cyclictest356820-21ntpq09:55:390
187049995648,6cyclictest366968-21kworker/u8:0+events_unbound12:15:371
187049995643,10cyclictest1704890-21systemd-journal10:15:011
187049995550,3cyclictest3555851-21kworker/u8:0+flush-8:008:20:301
187049995544,8cyclictest461306-21ntpq11:40:401
187044995535,17cyclictest422343-21apt-get11:05:000
187049995447,5cyclictest186913-21kworker/u8:3+flush-8:007:40:421
187044995412,30cyclictest431592-21ld11:10:390
187049995348,4cyclictest273615-21kworker/u8:2+flush-8:008:35:311
187049995345,6cyclictest3555851-21kworker/u8:0+flush-8:008:05:471
187044995347,4cyclictest244149-21apt-get08:05:260
187044995332,18cyclictest229030-21latency_hist07:50:010
187044995245,4cyclictest417346-21latency_hist11:00:010
187044995242,8cyclictest327192-21ntpq09:25:390
187053995144,4cyclictest1704890-21systemd-journal12:09:592
187044995142,7cyclictest426687-21ntpq11:05:400
187049995041,6cyclictest382645-21base6410:25:001
187044995038,9cyclictest1704890-21systemd-journal07:55:010
187049994944,4cyclictest3555851-21kworker/u8:0+events_unbound08:30:451
187049994941,6cyclictest1704890-21systemd-journal11:05:011
187049994940,6cyclictest427547-21kworker/u8:3+flush-8:011:50:451
187049994841,5cyclictest351935-21ntpq09:50:401
187049994743,3cyclictest186913-21kworker/u8:3+flush-8:007:50:311
187049994740,5cyclictest3555851-21kworker/u8:0+flush-8:008:00:311
187049994738,6cyclictest516527-21latency_hist12:40:011
187049994738,6cyclictest516527-21latency_hist12:40:011
187044994740,5cyclictest1704890-21systemd-journal11:30:250
187044994725,19cyclictest406524-21ntpq10:45:400
187053994639,5cyclictest298715-21apt-get09:00:242
187049994642,3cyclictest333259-21kworker/u8:1+flush-8:009:45:431
187049994642,3cyclictest273615-21kworker/u8:2+flush-8:008:50:311
187049994640,4cyclictest186913-21kworker/u8:3+flush-8:009:10:311
187049994639,4cyclictest312384-21kworker/u8:1+events_unbound09:15:301
187044994638,6cyclictest273615-21kworker/u8:2+flush-8:008:50:430
187049994540,4cyclictest407672-21kworker/u8:2+events_unbound11:10:431
187049994539,4cyclictest3555851-21kworker/u8:0+flush-8:008:15:421
187049994539,4cyclictest186913-21kworker/u8:3+flush-8:007:35:361
187049994536,7cyclictest447315-21latency_hist11:30:001
187044994535,8cyclictest472575-21diskstats11:55:290
187044994522,16cyclictest161rcu_preempt10:40:320
187044994517,20cyclictest0-21swapper/011:25:340
187044994515,20cyclictest0-21swapper/009:10:470
187049994440,3cyclictest427547-21kworker/u8:3+events_unbound12:10:381
187049994440,3cyclictest407672-21kworker/u8:2+events_unbound10:50:451
187049994439,3cyclictest377513-21kworker/u8:1+flush-8:010:35:261
187049994437,5cyclictest332152-21ntpq09:30:401
187049994437,5cyclictest332152-21ntpq09:30:391
187049994437,5cyclictest283870-21/usr/sbin/munin08:45:361
187049994436,6cyclictest353093-21apt-get09:55:261
187044994423,18cyclictest282689-21ntpq08:40:370
18704499441,33cyclictest314413-21/usr/sbin/munin09:15:330
187044994413,22cyclictest0-21swapper/010:54:160
187049994339,3cyclictest186913-21kworker/u8:3+flush-8:010:55:301
187049994337,5cyclictest273615-21kworker/u8:2+events_unbound09:25:441
187049994337,4cyclictest427547-21kworker/u8:3+flush-8:011:15:261
187053994237,4cyclictest273615-21kworker/u8:2+flush-8:008:55:432
187049994236,4cyclictest427547-21kworker/u8:3+events_unbound11:35:261
187044994236,4cyclictest467393-21apt-get11:50:260
187044994233,6cyclictest491783-21latency_hist12:15:010
18704499420,32cyclictest363042-21tr10:05:280
18678824227,9sleep10-21swapper/107:09:081
187053994131,8cyclictest1704890-21systemd-journal12:40:002
187053994131,8cyclictest1704890-21systemd-journal12:40:002
187049994137,3cyclictest3557282-21kworker/u8:1+flush-8:007:30:311
187049994133,6cyclictest501974-21apt-get12:25:261
187044994123,17cyclictest3557282-21kworker/u8:1+flush-8:007:30:260
187044994123,16cyclictest191561-21unixbench_singl07:10:460
187044994113,21cyclictest194579-21cpuspeed07:15:270
187049994037,2cyclictest3555851-21kworker/u8:0+flush-8:007:20:471
187049994036,3cyclictest333259-21kworker/u8:1+flush-8:009:35:461
187049994036,3cyclictest186913-21kworker/u8:3+events_unbound10:45:481
187049994034,4cyclictest462461-21apt-get11:45:241
187049994033,5cyclictest186913-21kworker/u8:3+flush-8:009:00:411
187049994031,6cyclictest362956-21apt-get10:05:251
187049994031,6cyclictest298419-21latency_hist09:00:011
187049993935,3cyclictest3555851-21kworker/u8:0+events_unbound07:55:411
187049993935,3cyclictest3555851-21kworker/u8:0+events_unbound07:45:281
187044993930,7cyclictest1704890-21systemd-journal12:04:590
187044993921,16cyclictest218691-21unixbench_multi07:35:460
187044993920,17cyclictest382981-21/usr/sbin/munin10:25:370
187049993830,6cyclictest372845-21/usr/sbin/munin10:15:381
187044993832,4cyclictest333259-21kworker/u8:1+flush-8:009:40:450
187044993818,16cyclictest367894-21apt-get10:10:300
187049993732,4cyclictest481593-21kworker/u8:2+events_unbound12:20:441
187049993732,4cyclictest333259-21kworker/u8:1+flush-8:009:40:401
187049993729,6cyclictest442375-21latency_hist11:25:011
187049993725,9cyclictest1704890-21systemd-journal07:29:461
18704499373,23cyclictest0-21swapper/008:13:420
187044993729,5cyclictest303372-21latency_hist09:05:000
18704499372,22cyclictest0-21swapper/012:22:280
187044993719,16cyclictest441994-21unixbench_singl11:20:450
4332262360,2chrt75-21kworker/3:1+events11:15:293
187053993627,6cyclictest427528-21cat11:10:002
187049993627,6cyclictest402535-21latency_hist10:45:001
18704499368,20cyclictest482435-21sh12:05:290
18704499363,27cyclictest0-21swapper/008:55:260
187044993632,2cyclictest186913-21kworker/u8:3+flush-8:008:25:420
187044993629,5cyclictest490945-21kworker/u8:1+flush-8:012:15:300
18704499362,23cyclictest0-21swapper/008:45:210
18704499362,21cyclictest0-21swapper/008:39:120
187044993621,13cyclictest0-21swapper/010:40:000
18704499360,23cyclictest388054-21aten2_r5power_p10:30:290
187049993530,4cyclictest3555851-21kworker/u8:0+flush-8:008:10:481
187049993530,3cyclictest366968-21kworker/u8:0+events_unbound10:30:481
18704499352,25cyclictest0-21swapper/009:50:260
187044993517,16cyclictest208593-21unixbench_singl07:25:460
187044993513,19cyclictest223287-21ntpq07:40:420
18704499351,26cyclictest187046-21latency_hist07:10:000
18704499351,23cyclictest589-21runrttasks09:22:580
18704499342,25cyclictest0-21swapper/011:45:250
18704499342,25cyclictest0-21swapper/010:15:260
18704499342,23cyclictest0-21swapper/012:28:220
18704499342,15cyclictest3332112date09:35:000
18704499342,15cyclictest3332112date09:35:000
18704499341,20cyclictest589-21runrttasks12:34:160
18704499341,20cyclictest589-21runrttasks12:34:150
187049993327,4cyclictest186913-21kworker/u8:3+flush-8:009:05:481
18704499333,23cyclictest0-21swapper/012:35:240
18704499333,23cyclictest0-21swapper/012:35:230
18704499333,23cyclictest0-21swapper/009:35:270
18704499332,23cyclictest0-21swapper/008:16:200
18704499332,22cyclictest0-21swapper/008:32:210
187044993319,12cyclictest0-21swapper/009:45:260
18704499331,18cyclictest436516-21taskset11:15:370
18704499330,20cyclictest589-21runrttasks10:02:340
187053993221,8cyclictest318199-21awk09:20:002
18704499322,24cyclictest0-21swapper/007:55:250
18704499322,23cyclictest0-21swapper/008:00:270
18704499312,24cyclictest377839-21apt-get10:20:260
187053993025,4cyclictest481593-21kworker/u8:2+events_unbound12:25:382
187053993025,3cyclictest327710-21unixbench_singl09:25:462
187053993019,8cyclictest422698-21cat11:05:012
187049993026,3cyclictest427547-21kworker/u8:3+flush-8:012:00:291
187049993025,4cyclictest451943-21kworker/u8:1+flush-8:011:55:401
187049993023,5cyclictest506928-21apt-get12:30:241
187049993023,5cyclictest506928-21apt-get12:30:231
187053992925,2cyclictest199433-21aten2_r5power_e07:20:282
187053992824,2cyclictest237639-21kthreadcore07:55:362
187053992722,4cyclictest451943-21kworker/u8:1+events_unbound12:00:452
187053992621,4cyclictest407672-21kworker/u8:2+flush-8:011:25:402
187053992621,3cyclictest233574-21unixbench_singl07:50:472
187053992620,4cyclictest392252-21unixbench_singl10:30:482
2256262250,2sleep375-21kworker/3:1+events07:45:333
187053992521,2cyclictest264199-21aten2_r5power_p08:25:282
187053992519,4cyclictest437441-21idleruntime-cro11:19:592
187053992517,6cyclictest382599-21gpgv10:25:012
187053992421,2cyclictest269109-21aten2_r5power_e08:30:282
187053992421,2cyclictest205258-21kthreadcore07:25:342
187053992419,4cyclictest186913-21kworker/u8:3+flush-8:010:05:452
187053992418,4cyclictest278939-21apt-get08:40:262
187053992417,5cyclictest214128-21turbostat.cron07:35:002
187053992413,8cyclictest219131-21awk07:40:002
4750442230,3sleep30-21swapper/311:55:353
187053992319,2cyclictest333396-21aten2_r5power_p09:35:272
187053992314,7cyclictest192360-21awk07:15:002
187053992313,8cyclictest511585-21awk12:35:002
187053992313,8cyclictest511585-21awk12:34:592
187053992313,7cyclictest1704890-21systemd-journal09:20:462
18705399229,3cyclictest161rcu_preempt10:25:312
18705399228,9cyclictest343220-21apt-get09:45:262
187053992217,4cyclictest186913-21kworker/u8:3+events_unbound10:00:442
4872992210,5chrt0-21swapper/312:10:283
4437062210,2sleep3471rcuc/311:25:343
187053992118,2cyclictest199097-21sendmail07:20:012
187053992118,2cyclictest0-21swapper/212:15:432
187053992117,2cyclictest353407-21fschecks_time09:55:312
187053992116,4cyclictest501688-21idleruntime-cro12:24:592
187053992116,3cyclictest467504-21aten2_r5power_v11:50:292
187053992116,3cyclictest407065-21unixbench_singl10:45:472
187053992112,7cyclictest453466-21cut11:35:322
18705399202,13cyclictest308590-21apt-get09:10:282
187053992017,2cyclictest472676-21fschecks_time11:55:302
187053992017,2cyclictest274043-21aten2_r5power_e08:35:282
187053992016,3cyclictest490945-21kworker/u8:1+flush-8:012:10:462
187053992016,2cyclictest219732-21fschecks_time07:40:302
1820232203,8sleep30-21swapper/307:05:023
187053991914,3cyclictest0-21swapper/210:55:002
187053991914,2cyclictest0-21swapper/210:35:412
1862322194,8sleep20-21swapper/207:05:452
4406662180,2sleep20-21swapper/211:20:352
18705399182,6cyclictest3689642kthreadcore10:10:382
187053991815,2cyclictest352384-21tail09:50:442
187053991815,2cyclictest224664-21fschecks_count07:45:292
187053991814,3cyclictest0-21swapper/208:50:442
187053991814,2cyclictest0-21swapper/208:10:092
187053991812,4cyclictest1704890-21systemd-journal11:15:002
187053991812,4cyclictest0-21swapper/209:40:342
51146421710,4sleep30-21swapper/312:33:373
51146421710,4sleep30-21swapper/312:33:373
187053991714,2cyclictest328485-21aten2_r5power_v09:30:282
187053991714,2cyclictest328485-21aten2_r5power_v09:30:282
187053991713,3cyclictest0-21swapper/208:00:352
187053991713,2cyclictest0-21swapper/211:30:362
187053991712,4cyclictest462186-21latency_hist11:45:002
187053991712,3cyclictest0-21swapper/211:45:342
187053991712,3cyclictest0-21swapper/208:45:332
187053991712,3cyclictest0-21swapper/208:20:342
18705399168,6cyclictest373220-21fschecks_time10:15:312
18705399167,7cyclictest399677-21cut10:40:322
187053991613,2cyclictest0-21swapper/208:08:592
3743852155,6sleep30-21swapper/310:15:363
187053991510,3cyclictest0-21swapper/210:55:342
2739882142,8sleep30-21swapper/308:35:263
2429422142,8sleep30-21swapper/308:00:393
2130962142,8sleep30-21swapper/307:30:373
4770762132,6sleep30-21swapper/312:00:023
3927072132,6sleep30-21swapper/310:35:023
3715332132,8sleep30-21swapper/310:10:413
3429562132,6sleep30-21swapper/309:45:023
2628952134,6sleep30-21swapper/308:20:383
5164582122,6sleep30-21swapper/312:39:233
5164582122,6sleep30-21swapper/312:39:223
5027862120,2sleep3481ktimers/312:25:323
4966312122,6sleep30-21swapper/312:18:483
4830792122,6sleep30-21swapper/312:05:353
4712192122,6sleep30-21swapper/311:50:423
4619192122,6sleep30-21swapper/311:41:483
4522962122,5sleep30-21swapper/311:35:013
4480132122,6sleep30-21swapper/311:30:323
4275422122,5sleep30-21swapper/311:10:023
4175512122,6sleep30-21swapper/311:00:013
4014002122,6sleep30-21swapper/310:40:363
3845762122,6sleep30-21swapper/310:25:343
3813632122,6sleep30-21swapper/310:20:383
3668172122,6sleep30-21swapper/310:05:453
3622312122,6sleep30-21swapper/310:00:473
3575412122,6sleep30-21swapper/309:57:333
3519112122,6sleep30-21swapper/309:50:403
3414162122,6sleep30-21swapper/309:40:373
3251292122,6sleep30-21swapper/309:25:353
3178602123,6sleep30-21swapper/309:16:053
3121922122,6sleep30-21swapper/309:10:383
3082242122,6sleep30-21swapper/309:09:103
3032632122,6sleep30-21swapper/309:03:493
2935572122,5sleep30-21swapper/308:55:023
2842182122,6sleep30-21swapper/308:45:313
2687952122,5sleep30-21swapper/308:30:023
2641192122,6sleep30-21swapper/308:25:283
2534462122,6sleep30-21swapper/308:11:483
2484522122,6sleep30-21swapper/308:05:503
2379882122,6sleep30-21swapper/307:55:393
2338612125,5sleep30-21swapper/307:53:583
2234542122,6sleep30-21swapper/307:40:463
1952782122,6sleep30-21swapper/307:15:333
1875382122,6sleep30-21swapper/307:10:323
4972722112,5sleep30-21swapper/312:20:283
4625492112,5sleep30-21swapper/311:45:293
4417982112,5sleep30-21swapper/311:20:453
4266562112,6sleep30-21swapper/311:05:403
4131782112,5sleep30-21swapper/310:55:333
4080352112,5sleep30-21swapper/310:50:313
4028982112,5sleep30-21swapper/310:45:293
3879422112,6sleep30-21swapper/310:30:133
3341972112,5sleep30-21swapper/309:35:343
3281082112,5sleep30-21swapper/309:30:013
3281082112,5sleep30-21swapper/309:30:013
3225192112,6sleep30-21swapper/309:20:463
2887712114,5sleep30-21swapper/308:50:193
2829662112,5sleep30-21swapper/308:40:453
2144162112,5sleep30-21swapper/307:35:283
2043372112,5sleep30-21swapper/307:25:293
2036472112,5sleep30-21swapper/307:20:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional