You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 03:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Tue Jun 02, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
84879321050,2chrt371rcuc/222:55:392
6875902700,3sleep10-21swapper/120:10:441
622185995638,15cyclictest872344-21ntpq23:15:501
622185995636,17cyclictest812938-21ntpq22:15:491
6489692550,2chrt75-21kworker/3:1+events19:30:553
7630762520,3sleep375-21kworker/3:1+events21:25:463
8960462510,2sleep3481ktimers/323:40:453
622185994825,8cyclictest857610-21ntpq23:00:491
622185994640,4cyclictest689740-21kworker/u8:0+flush-8:020:25:001
622185994640,4cyclictest689740-21kworker/u8:0+flush-8:020:24:591
622185994636,8cyclictest842579-21ntpq22:45:491
622183994640,4cyclictest863409-21latency_hist23:10:010
8082942450,1chrt808295-21cat22:10:550
622183994436,6cyclictest709741-21kworker/u8:0+flush-8:020:40:400
622189994336,5cyclictest913042-40logrotate00:00:002
622183994336,5cyclictest709741-21kworker/u8:0+flush-8:021:25:400
622183994332,8cyclictest645000-21diskstats19:30:390
622185994235,5cyclictest753279-21ntpq21:15:481
622183994237,4cyclictest809042-21kworker/u8:2+flush-8:022:35:540
622183994237,4cyclictest809042-21kworker/u8:2+flush-8:022:35:530
622185994132,7cyclictest1704890-21systemd-journal21:05:001
622183994133,6cyclictest798022-21ntpq22:00:480
622183994131,7cyclictest698479-21ntpq20:20:500
622183994131,7cyclictest698479-21ntpq20:20:500
622183994031,6cyclictest848620-21/usr/sbin/munin22:55:510
622183994030,8cyclictest739383-21kworker/u8:2+flush-8:021:35:490
622183993927,9cyclictest713577-21ntpq20:35:500
6237222380,7sleep3471rcuc/319:10:433
622183993828,7cyclictest783048-21ntpq21:45:520
62153723815,13sleep1617256-21/usr/sbin/munin19:05:561
622183993731,3cyclictest3409660-21kworker/u8:2+flush-8:019:15:050
622185993631,3cyclictest1704890-21systemd-journal23:40:521
622183993627,6cyclictest622009-21kworker/u8:3+flush-8:019:20:470
9220842350,3sleep20-21swapper/200:05:492
622183993528,5cyclictest612332-21kworker/u8:1+flush-8:019:45:530
622183993429,3cyclictest738413-21needreboot21:00:490
622183993428,4cyclictest659593-21kworker/u8:3+flush-8:021:05:400
622183993427,4cyclictest838117-21grep22:40:560
622183993427,4cyclictest838117-21grep22:40:560
622185993327,4cyclictest823688-21kworker/u8:3+flush-8:000:00:411
622185993324,7cyclictest942995-21apt-get00:30:361
622185993324,7cyclictest913028-21latency_hist00:00:011
622183993328,3cyclictest729267-21idleruntime-cro20:55:010
622183993326,4cyclictest888626-21apt-get23:35:360
622183993326,4cyclictest878340-21kworker/u8:1+flush-8:000:05:390
622183993322,9cyclictest936847-21ntpq00:20:480
622183993319,10cyclictest1704890-21systemd-journal19:40:500
622185993221,9cyclictest862559-21ntpq23:05:491
622183993225,5cyclictest823688-21kworker/u8:3+events_unbound00:05:010
622183993223,7cyclictest853806-21/usr/sbin/munin23:00:470
622183993223,6cyclictest883378-21latency_hist23:30:010
6666412310,7sleep20-21swapper/219:50:482
622185993127,2cyclictest838475-21cron22:45:001
622185993127,2cyclictest838475-21cron22:45:001
622185993124,5cyclictest679635-21apt-get20:05:361
622183993126,4cyclictest823688-21kworker/u8:3+flush-8:023:30:400
622183993126,3cyclictest659593-21kworker/u8:3+flush-8:021:55:450
622183993125,4cyclictest778902-21cron21:45:000
622183993120,8cyclictest1704890-21systemd-journal22:35:000
622185993024,4cyclictest659593-21kworker/u8:3+flush-8:020:25:561
622185993024,4cyclictest659593-21kworker/u8:3+flush-8:020:25:551
622185993021,7cyclictest1704890-21systemd-journal21:11:501
622185993020,8cyclictest922088-21ntpq00:05:491
622185993018,2cyclictest421rcuog/221:40:041
622183993021,6cyclictest809042-21kworker/u8:2+flush-8:023:45:360
622183993020,8cyclictest689322-21store20:15:000
622189992923,4cyclictest903672-21cpuspeed_turbos23:50:412
622185992925,3cyclictest816229-21kthreadcore22:20:451
622185992925,2cyclictest0-21swapper/123:39:591
622185992922,5cyclictest1704890-21systemd-journal22:02:521
622185992920,7cyclictest628756-21ntpq19:15:031
622183992923,4cyclictest705047-21cpuspeed_turbos20:30:360
622183992920,6cyclictest3409660-21kworker/u8:2+flush-8:020:15:520
622183992920,6cyclictest3409660-21kworker/u8:2+flush-8:020:15:520
622183992918,8cyclictest1704890-21systemd-journal00:18:520
622189992825,2cyclictest678963-21unixbench_singl20:00:562
622189992823,4cyclictest878340-21kworker/u8:1+flush-8:023:25:572
622189992823,3cyclictest828181-21unixbench_multi22:30:572
622185992821,5cyclictest708627-21ntpq20:30:471
622185992821,5cyclictest1704890-21systemd-journal21:29:531
622185992820,6cyclictest878732-21apt-get23:25:351
622183992823,3cyclictest622720-21fschecks_count19:10:390
622183992822,4cyclictest878340-21kworker/u8:1+events_unbound00:15:010
622183992820,6cyclictest912191-21ntpq23:55:510
622183992818,8cyclictest758251-21ntpq21:20:530
622183992818,7cyclictest1704890-21systemd-journal21:20:000
6321732270,5sleep3451irq_work/319:15:463
622189992723,3cyclictest709502-21cron20:34:592
622189992723,2cyclictest888849-21cpuspeed_turbos23:35:392
622189992723,2cyclictest854634-21irqrtprio23:00:432
622189992717,8cyclictest878205-21turbostat.cron23:25:002
62218999271,13cyclictest663618-21ntpq19:45:492
622185992723,2cyclictest952599-21sendmail00:40:001
622185992722,3cyclictest808837-21systemd-run22:15:001
622185992721,5cyclictest754734-21cpuspeed_turbos21:20:421
622185992719,3cyclictest0-21swapper/121:35:401
622183992721,4cyclictest942304-21unixbench_multi00:25:560
622183992721,4cyclictest644656-21apt-key19:30:010
622189992623,2cyclictest934076-21kthreadcore00:20:452
622189992622,2cyclictest942695-21cron00:29:592
622189992621,3cyclictest947293-21unixbench_singl00:30:572
622189992618,6cyclictest1704890-21systemd-journal21:56:512
62218999261,10cyclictest7176442cut20:40:472
622185992623,2cyclictest679342-21cron20:05:001
622185992623,2cyclictest665056-21cut19:50:421
622185992622,2cyclictest0-21swapper/121:50:011
622185992619,5cyclictest634625-21apt-get19:20:341
622183992622,2cyclictest814302-21cpuspeed_turbos22:20:380
622183992621,3cyclictest823688-21kworker/u8:3+events_unbound23:20:570
622183992621,3cyclictest812813-21needreboot22:15:460
622183992621,3cyclictest1-21systemd20:00:010
622189992521,3cyclictest639780-21cpuspeed_turbos19:25:372
622189992521,2cyclictest829241-21fschecks_time22:35:412
622189992521,2cyclictest829241-21fschecks_time22:35:402
622189992521,2cyclictest814434-21fschecks_time22:20:412
622189992520,3cyclictest869141-21irqcore23:15:442
62218999250,9cyclictest713517-21awk20:35:482
622185992521,3cyclictest649421-21systemd-run19:35:001
622185992521,2cyclictest942701-21cron00:29:591
622185992521,2cyclictest729646-21latency_hist20:55:021
622185992520,3cyclictest829611-21irqrtprio22:35:441
622185992520,3cyclictest829611-21irqrtprio22:35:431
622185992520,3cyclictest823688-21kworker/u8:3+flush-8:023:49:071
622185992520,3cyclictest612332-21kworker/u8:1+flush-8:019:25:541
622185992520,3cyclictest0-21swapper/122:30:001
622185992520,3cyclictest0-21swapper/121:55:431
622185992518,5cyclictest798651-21kworker/u8:0+flush-8:022:05:391
622185992516,7cyclictest709741-21kworker/u8:0+flush-8:020:40:541
622183992520,3cyclictest678936-21unixbench_multi20:00:560
622183992519,3cyclictest0-21swapper/022:25:420
622183992518,4cyclictest809042-21kworker/u8:2+events_unbound22:50:540
62218999248,11cyclictest629438-21apt-get19:15:362
62218999245,8cyclictest0-21swapper/222:53:372
622189992421,2cyclictest700237-21fschecks_time20:25:412
622189992421,2cyclictest700237-21fschecks_time20:25:412
622189992420,2cyclictest754569-21aten2_r5power_e21:20:402
622189992418,4cyclictest673955-21unixbench_multi19:55:562
622189992414,7cyclictest694379-21awk20:20:002
622189992414,7cyclictest694379-21awk20:20:002
62218999240,9cyclictest680415-21cut20:05:442
622185992421,2cyclictest925402-21kthreadcore00:10:451
622185992419,4cyclictest699889-21kworker/u8:1+flush-8:020:38:211
622185992419,3cyclictest659593-21kworker/u8:3+events_unbound21:05:451
622185992419,3cyclictest0-21swapper/122:55:411
622185992418,4cyclictest867436-21ntpq23:10:501
622185992418,4cyclictest723970-21unixbench_singl20:45:571
622183992420,2cyclictest0-21swapper/021:30:370
622183992419,3cyclictest653986-21unixbench_singl19:35:540
622183992418,4cyclictest788668-21unixbench_singl21:50:570
622183992416,6cyclictest948847-21kthreadcore00:35:450
62218399241,10cyclictest9056002kthreadcore23:50:470
62218999237,5cyclictest0-21swapper/222:05:482
622189992320,2cyclictest764386-21aten2_r5power_c21:30:382
622189992320,2cyclictest371rcuc/200:14:512
622189992319,2cyclictest804281-21aten2_r5power_v22:10:372
62218999231,6cyclictest883669-21apt-get23:30:372
622189992315,6cyclictest734440-21cat21:00:012
622185992319,2cyclictest0-21swapper/100:15:571
622185992318,3cyclictest709741-21kworker/u8:0+flush-8:020:55:551
622185992317,4cyclictest768997-21munin-plugin-st21:35:001
622185992316,5cyclictest887981-21unixbench_singl23:30:561
622185992314,7cyclictest669700-21/usr/sbin/munin19:55:481
622183992318,3cyclictest873258-21turbostat.cron23:20:000
622183992317,4cyclictest843043-21unixbench_multi22:45:550
9484302220,6sleep20-21swapper/200:35:432
622189992218,3cyclictest893892-21fschecks_time23:40:412
622189992218,2cyclictest684893-21fschecks_time20:10:402
622189992218,2cyclictest645102-21fschecks_time19:30:392
622189992217,3cyclictest744836-21cpuspeed_turbos21:10:402
62218999220,6cyclictest723771-21sed20:45:572
622185992219,2cyclictest873830-21cut23:20:401
622185992217,3cyclictest0-21swapper/121:50:461
622185992215,5cyclictest583-21snmpd00:20:471
622185992213,7cyclictest653560-21ntpq19:35:501
62218599221,19cyclictest828622-21unin-run22:35:001
622183992218,2cyclictest0-21swapper/022:09:590
622183992217,3cyclictest0-21swapper/020:25:480
622183992217,3cyclictest0-21swapper/020:25:470
622183992217,3cyclictest0-21swapper/000:30:370
622183992216,4cyclictest665007-21grep19:50:400
622183992213,6cyclictest1704890-21systemd-journal20:09:590
62218999216,4cyclictest0-21swapper/221:45:382
62218999215,5cyclictest0-21swapper/221:55:012
62218999214,5cyclictest0-21swapper/223:10:392
62218999212,9cyclictest0-21swapper/219:10:042
62218999212,5cyclictest0-21swapper/221:25:402
62218999212,4cyclictest0-21swapper/219:35:502
62218999212,4cyclictest0-21swapper/200:15:442
62218999212,4cyclictest0-21swapper/200:00:412
622189992117,2cyclictest769638-21fschecks_time21:35:382
622189992113,6cyclictest842468-21grep22:45:472
622189992112,2cyclictest161rcu_preempt22:25:482
622185992117,3cyclictest623381-21sort19:10:441
622185992117,2cyclictest0-21swapper/123:50:471
622185992117,2cyclictest0-21swapper/119:40:361
622183992115,4cyclictest0-21swapper/021:10:450
622183992112,6cyclictest734005-21grep20:55:550
6217852212,14sleep00-21swapper/019:09:100
62218999207,2cyclictest161rcu_preempt19:40:432
62218999206,4cyclictest0-21swapper/222:16:502
622189992017,2cyclictest0-21swapper/220:55:012
622189992016,2cyclictest0-21swapper/222:40:482
622189992016,2cyclictest0-21swapper/222:40:482
622189992011,8cyclictest381ktimers/223:45:402
62218999200,7cyclictest39-21ksoftirqd/221:00:442
62218999200,6cyclictest749678-21grep21:15:382
62218999200,4cyclictest794517-21df22:00:392
622185992015,4cyclictest662189-21kthreadcore19:45:461
622185992014,4cyclictest0-21swapper/120:15:541
622185992014,4cyclictest0-21swapper/120:15:541
622183992013,5cyclictest719957-21grep20:45:420
6170892204,9sleep20-21swapper/219:05:012
9455012190,3sleep3481ktimers/300:30:453
62218999196,11cyclictest743192-21tr21:05:452
62218999195,4cyclictest0-21swapper/221:43:112
622189991915,2cyclictest634683-21aten2_r5power_e19:20:372
622189991911,6cyclictest696189-21tr20:20:452
622189991911,6cyclictest696189-21tr20:20:442
622185991913,4cyclictest0-21swapper/122:50:561
62218399199,7cyclictest898225-21latency_hist23:45:010
622183991913,4cyclictest823688-21kworker/u8:3+events_unbound23:10:530
6217262193,9sleep30-21swapper/319:08:243
62218999182,4cyclictest0-21swapper/223:05:522
8305182144,7sleep30-21swapper/322:35:463
8305182144,7sleep30-21swapper/322:35:463
9033262132,6sleep30-21swapper/323:50:023
8880192133,6sleep30-21swapper/323:31:083
8244662132,7sleep30-21swapper/322:30:443
7543822132,6sleep30-21swapper/321:20:023
7393502132,6sleep30-21swapper/321:05:023
7144332132,6sleep30-21swapper/320:40:013
7094972132,7sleep30-21swapper/320:35:003
9377882122,5sleep30-21swapper/300:25:013
9369252122,6sleep30-21swapper/300:20:523
9325002122,6sleep30-21swapper/300:15:573
9188062122,6sleep30-21swapper/300:05:433
9130652122,5sleep30-21swapper/300:00:013
8923662123,5sleep30-21swapper/323:35:503
8784162121,6sleep30-21swapper/323:25:013
8732392121,7sleep30-21swapper/323:20:013
8679272122,6sleep30-21swapper/323:10:583
8590732122,6sleep30-21swapper/323:05:403
8538352122,6sleep30-21swapper/323:00:383
8523322122,6sleep30-21swapper/322:55:493
8405842122,6sleep30-21swapper/322:45:463
8338392122,6sleep30-21swapper/322:40:363
8338392122,6sleep30-21swapper/322:40:353
8236472120,7sleep30-21swapper/322:30:013
8177972122,6sleep30-21swapper/322:20:503
8134322122,6sleep30-21swapper/322:15:563
8030822122,6sleep30-21swapper/322:05:533
7890592122,5sleep30-21swapper/321:55:013
7843002122,6sleep30-21swapper/321:50:043
7792062122,6sleep30-21swapper/321:45:393
7739172122,6sleep30-21swapper/321:40:013
7449952122,6sleep30-21swapper/321:10:433
7384472122,6sleep30-21swapper/321:00:523
7295132122,5sleep30-21swapper/320:55:023
7200652122,6sleep30-21swapper/320:45:433
6951642122,6sleep30-21swapper/320:20:433
6951642122,6sleep30-21swapper/320:20:423
6901272122,6sleep30-21swapper/320:15:423
6901272122,6sleep30-21swapper/320:15:413
6882832122,6sleep30-21swapper/320:10:483
6792372124,5sleep30-21swapper/320:03:493
6743522122,5sleep30-21swapper/320:00:013
6645372122,5sleep30-21swapper/319:50:023
6552772122,6sleep30-21swapper/319:40:433
6515512122,6sleep30-21swapper/319:35:453
6392962122,5sleep30-21swapper/319:25:013
6383612122,6sleep30-21swapper/319:20:483
9478832112,6sleep30-21swapper/300:35:213
9235472112,5sleep30-21swapper/300:10:413
9083532112,5sleep30-21swapper/323:55:353
8999222112,5sleep30-21swapper/323:45:453
8740782112,5sleep30-21swapper/323:20:453
8437382112,5sleep30-21swapper/322:50:383
8041012112,5sleep30-21swapper/322:10:013
7947572112,6sleep30-21swapper/322:00:433
7754072112,5sleep30-21swapper/321:40:443
7640772112,5sleep30-21swapper/321:30:023
7504472112,5sleep30-21swapper/321:15:453
7251322110,7sleep30-21swapper/320:50:443
7150242112,6sleep30-21swapper/320:40:423
6795662112,5sleep30-21swapper/320:05:023
6598262112,6sleep30-21swapper/319:45:323
7001372100,6sleep30-21swapper/320:25:413
7001372100,6sleep30-21swapper/320:25:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional