You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-08 - 08:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Mon Jun 08, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
386605621650,4sleep375-21kworker/3:1-events23:50:403
386605621650,4sleep375-21kworker/3:1-events23:50:393
36335072710,4sleep375-21kworker/3:1-events19:55:403
3584077995649,5cyclictest3625717-21latency_hist19:50:011
3584077995649,5cyclictest3531218-21kworker/u8:2+events_unbound23:15:501
3584073995443,9cyclictest3664532-21ntpq20:25:450
3584077995243,7cyclictest1704890-21systemd-journal23:35:001
3584078995147,3cyclictest3724930-21kworker/u8:3+events_unbound21:30:342
3584077995144,5cyclictest3873612-21kworker/u8:3+flush-8:000:20:461
3584073995145,3cyclictest3531218-21kworker/u8:2+events_unbound22:55:330
3584073994943,4cyclictest3730176-21kworker/u8:0+events_unbound22:10:340
3584078994843,3cyclictest3705501-21kworker/u8:1+events_unbound21:10:332
3584077994841,5cyclictest3531218-21kworker/u8:2+events_unbound20:00:461
3584077994836,9cyclictest3700015-21apt-get21:05:011
3584077994741,4cyclictest3873612-21kworker/u8:3+events_unbound00:10:461
3584073994740,5cyclictest3531218-21kworker/u8:2+flush-8:019:50:470
3584073994740,4cyclictest2741928-21kworker/u8:0+flush-8:020:05:370
36325082460,7sleep20-21swapper/219:55:392
3584078994641,4cyclictest3531218-21kworker/u8:2+events_unbound00:25:402
3584078994638,6cyclictest3631029-21base6419:55:012
3584077994642,3cyclictest2741928-21kworker/u8:0+flush-8:019:35:481
3584077994634,9cyclictest3893411-21ntpq00:15:451
3584077994634,9cyclictest1704890-21systemd-journal22:48:571
3584078994541,3cyclictest3531218-21kworker/u8:2+events_unbound00:15:482
3584077994537,5cyclictest3680287-21latency_hist20:45:011
3584073994539,4cyclictest3578692-21kworker/u8:3+events_unbound19:20:480
3584073994535,8cyclictest3823488-21ntpq23:05:440
3584077994439,4cyclictest3531218-21kworker/u8:2+events_unbound21:20:341
3584077994437,5cyclictest3764186-21kworker/u8:3+flush-8:022:20:451
3584077994436,6cyclictest3531218-21kworker/u8:2+flush-8:022:40:461
3584077994337,4cyclictest3531218-21kworker/u8:2+events_unbound19:50:461
3584077994334,7cyclictest3873545-21ntpq23:55:441
3584077994332,8cyclictest3774062-21ntpq22:15:451
3584077994237,4cyclictest2741928-21kworker/u8:0+events_unbound20:14:591
3584077994235,5cyclictest3578692-21kworker/u8:3+flush-8:019:25:461
3584077994235,5cyclictest2741928-21kworker/u8:0+events_unbound20:45:451
3584078994132,6cyclictest3589104-21cat19:15:002
3584077994135,4cyclictest1704890-21systemd-journal23:20:581
3584073994136,4cyclictest3531218-21kworker/u8:2+flush-8:020:30:370
3584077994035,4cyclictest3899080-21kworker/u8:1+events_unbound00:31:571
3584077994033,5cyclictest2741928-21kworker/u8:0+events_unbound20:05:521
3584077994032,5cyclictest3531218-21kworker/u8:2+flush-8:021:25:511
3584077994031,6cyclictest3750254-21latency_hist21:55:021
3584077993935,3cyclictest3730176-21kworker/u8:0+events_unbound23:40:421
3584077993934,3cyclictest3705501-21kworker/u8:1+events_unbound21:45:481
3584077993933,4cyclictest3730176-21kworker/u8:0+events_unbound22:30:451
3584077993933,4cyclictest2741928-21kworker/u8:0+events_unbound20:15:431
3584077993932,5cyclictest3730176-21kworker/u8:0+events_unbound23:05:481
3584078993834,3cyclictest3578692-21kworker/u8:3+events_unbound20:35:372
3584077993831,5cyclictest3787823-21kworker/u8:1+flush-8:022:35:451
3584077993831,5cyclictest3531218-21kworker/u8:2+events_unbound23:10:491
3584077993831,4cyclictest3730176-21kworker/u8:0+flush-8:022:50:491
3584078993733,3cyclictest3899080-21kworker/u8:1+events_unbound00:35:422
3584077993732,4cyclictest3730176-21kworker/u8:0+flush-8:022:10:321
3584073993731,4cyclictest2741928-21kworker/u8:0+flush-8:020:15:350
3584073993727,8cyclictest3839416-21latency_hist23:25:000
3584073993726,9cyclictest1704890-21systemd-journal23:30:370
3584077993631,3cyclictest3635243-21/usr/sbin/munin19:55:491
3584077993628,6cyclictest3531218-21kworker/u8:2+flush-8:023:50:451
3584077993628,6cyclictest3531218-21kworker/u8:2+flush-8:023:50:441
3584077993627,6cyclictest3531218-21kworker/u8:2+flush-8:000:35:471
3584073993631,4cyclictest3705501-21kworker/u8:1+flush-8:021:45:340
3584073993631,4cyclictest2741928-21kworker/u8:0+events_unbound20:10:480
3584073993626,8cyclictest3863412-21ntpq23:45:440
3584073993626,8cyclictest3863412-21ntpq23:45:440
3584077993530,3cyclictest3764186-21kworker/u8:3+events_unbound22:10:011
3584077993529,4cyclictest3705501-21kworker/u8:1+events_unbound21:30:421
3584077993529,4cyclictest3531218-21kworker/u8:2+events_unbound19:30:471
3584077993528,5cyclictest3730176-21kworker/u8:0+flush-8:022:00:361
3584077993527,6cyclictest3705501-21kworker/u8:1+flush-8:021:40:461
3584077993527,6cyclictest3531218-21kworker/u8:2+flush-8:022:55:461
358407799350,33cyclictest1-21systemd19:15:011
3584073993526,7cyclictest3601283-21/usr/sbin/munin19:25:430
3584077993427,5cyclictest3531218-21kworker/u8:2+flush-8:023:00:461
3584073993426,5cyclictest3779924-21latency_hist22:25:010
3584073993425,7cyclictest3854755-21/usr/sbin/munin23:40:420
3584078993326,5cyclictest1704890-21systemd-journal19:25:002
3584077993327,4cyclictest3730176-21kworker/u8:0+events_unbound23:35:321
3584077993326,5cyclictest3578692-21kworker/u8:3+flush-8:020:55:351
3584077993324,7cyclictest1704890-21systemd-journal21:05:581
3584077993323,8cyclictest1704890-21systemd-journal21:13:571
3584077993322,8cyclictest3594982-21ntpq19:15:461
3584073993329,3cyclictest3531218-21kworker/u8:2+flush-8:020:22:000
3584073993329,3cyclictest3531218-21kworker/u8:2+flush-8:020:21:590
3584073993327,4cyclictest3578692-21kworker/u8:3+flush-8:020:40:370
3584073993325,6cyclictest3789791-21latency_hist22:35:000
3584073993325,6cyclictest2741928-21kworker/u8:0+flush-8:019:10:440
3584078993225,5cyclictest3829712-21cp23:15:002
3584077993227,4cyclictest3705501-21kworker/u8:1+events_unbound21:40:011
3584077993226,4cyclictest3873612-21kworker/u8:3+flush-8:000:00:381
3584077993226,4cyclictest3873612-21kworker/u8:3+flush-8:000:00:371
3584077993226,4cyclictest3531218-21kworker/u8:2+flush-8:020:30:471
3584073993227,3cyclictest3635817-21apt20:00:000
3584077993127,3cyclictest3764186-21kworker/u8:3+flush-8:022:25:361
3584077993126,3cyclictest3901671-21kthreadcore00:25:411
3584077993124,5cyclictest3578692-21kworker/u8:3+flush-8:020:50:371
3584077993123,6cyclictest3616131-21apt-get19:40:291
3584073993125,4cyclictest2741928-21kworker/u8:0+events_unbound19:39:590
3584073993124,5cyclictest3705501-21kworker/u8:1+events_unbound21:40:330
3584073993122,6cyclictest1704890-21systemd-journal23:15:030
3584078993024,4cyclictest885-21mta-sts-daemon22:05:392
3584077993026,3cyclictest3531218-21kworker/u8:2+events_unbound23:45:501
3584077993026,3cyclictest3531218-21kworker/u8:2+events_unbound23:45:501
3584073993026,2cyclictest3764615-21unixbench_multi22:05:510
3584073993024,4cyclictest3730176-21kworker/u8:0+flush-8:023:10:450
3584073992923,4cyclictest3730176-21kworker/u8:0+flush-8:022:00:510
3584073992922,5cyclictest3873612-21kworker/u8:3+flush-8:000:10:510
3584078992824,3cyclictest3873612-21kworker/u8:3+events_unbound00:30:022
3584078992824,3cyclictest3787823-21kworker/u8:1+events_unbound22:39:042
3584077992823,3cyclictest3531218-21kworker/u8:2+events_unbound21:55:351
3584077992822,4cyclictest3578692-21kworker/u8:3+events_unbound20:25:431
3584077992821,5cyclictest3655877-21apt-get20:20:311
3584077992821,5cyclictest3655877-21apt-get20:20:311
3584077992820,5cyclictest3531218-21kworker/u8:2+flush-8:021:15:441
3584073992824,3cyclictest401-21dbus-daemon19:20:010
3584073992823,4cyclictest3578692-21kworker/u8:3+flush-8:020:35:470
3584073992819,7cyclictest3700019-21latency_hist21:05:010
3584073992819,7cyclictest3685220-21latency_hist20:50:020
358407899270,7cyclictest3714255-21ntpq21:15:462
3584077992722,3cyclictest3531218-21kworker/u8:2+flush-8:023:25:401
3584073992724,2cyclictest3869297-21apt-key23:55:000
3584073992724,2cyclictest3869297-21apt-key23:54:590
358407399272,24cyclictest0-21swapper/021:30:490
3584073992721,4cyclictest3620418-21unixbench_singl19:40:500
38281532260,2chrt75-21kworker/3:1-events23:10:433
358407899268,2cyclictest38876152tr00:10:432
3584078992623,2cyclictest3805185-21fschecks_count22:50:362
3584078992620,4cyclictest3859019-21unixbench_singl23:40:512
3584078992620,4cyclictest3595886-21unin-run19:20:012
3584078992619,5cyclictest1704890-21systemd-journal21:25:012
3584078992612,6cyclictest161rcu_preempt21:00:512
3584077992620,3cyclictest0-21swapper/100:05:551
3584073992622,3cyclictest3531218-21kworker/u8:2+flush-8:022:15:350
3584073992621,4cyclictest3531218-21kworker/u8:2+events_unbound22:55:000
3584073992621,3cyclictest3874017-21unixbench_multi23:55:510
3584073992616,8cyclictest3719423-21python321:20:510
35836922262,5sleep00-21swapper/019:07:090
358407899256,3cyclictest3601293-21acpi19:25:302
3584078992522,2cyclictest3864710-21aten2_r5power_p23:50:332
3584078992522,2cyclictest3864710-21aten2_r5power_p23:50:322
3584078992522,2cyclictest3750759-21cpuspeed_turbos21:55:342
3584078992521,3cyclictest3531218-21kworker/u8:2+flush-8:000:05:002
3584078992521,3cyclictest3531218-21kworker/u8:2+flush-8:000:04:592
3584078992520,4cyclictest3705216-21munin-plugin-st21:10:012
358407899250,7cyclictest3664227-21cut20:25:422
358407899250,15cyclictest3782371-21cut22:25:402
358407899250,15cyclictest3640737-21idleruntime-cro20:04:592
358407899250,12cyclictest3869793-21apt-get23:55:322
3584077992521,3cyclictest3578692-21kworker/u8:3+events_unbound20:35:481
3584073992523,1cyclictest0-21swapper/023:00:510
3584073992518,6cyclictest3578692-21kworker/u8:3+flush-8:020:56:220
3584078992420,3cyclictest371rcuc/219:35:002
358407899241,5cyclictest0-21swapper/221:45:392
358407899240,5cyclictest3834034-21grep23:15:522
358407899240,14cyclictest3849886-21cut23:35:322
358407899240,13cyclictest3740145-21latency_hist21:45:012
358407899240,12cyclictest3894588-21apt-get00:20:322
3584077992418,4cyclictest3578692-21kworker/u8:3+flush-8:019:20:451
358407399244,19cyclictest3884083-21sshd00:05:570
3584073992419,4cyclictest3640383-21unixbench_singl20:00:510
3584073992417,5cyclictest3909109-21latency_hist00:35:020
3584073992413,9cyclictest3745850-21diskstats21:50:340
358407899234,4cyclictest0-21swapper/222:00:532
358407899232,14cyclictest3879743-21apt-get00:05:352
3584078992319,2cyclictest3775360-21aten2_r5power_v22:20:332
3584078992318,4cyclictest3620400-21unixbench_singl19:40:492
3584078992311,2cyclictest161rcu_preempt20:45:282
3584078992310,2cyclictest161rcu_preempt19:36:022
358407899230,9cyclictest3659564-21needreboot20:20:432
358407899230,9cyclictest3659564-21needreboot20:20:432
358407899230,9cyclictest3622522-21cut19:45:402
358407899230,8cyclictest39-21ksoftirqd/223:45:422
358407899230,8cyclictest39-21ksoftirqd/223:45:422
358407899230,10cyclictest3680279-21cron20:45:002
3584073992320,2cyclictest3584067-21cyclictest23:25:390
3584073992317,4cyclictest3851979-21kthreadcore23:35:390
3584073992313,8cyclictest3704339-21ntpq21:05:450
358407899226,2cyclictest161rcu_preempt21:38:182
358407899224,10cyclictest3819959-21seq23:05:342
358407899223,5cyclictest0-21swapper/220:55:412
358407899222,5cyclictest0-21swapper/221:25:392
3584078992217,3cyclictest381ktimers/223:25:002
3584078992210,2cyclictest161rcu_preempt22:42:302
358407899220,8cyclictest3811199-21tr22:55:392
358407899220,6cyclictest3766011-21sed22:10:402
358407899220,6cyclictest3653902-21kthreadcore20:15:402
3584073992217,4cyclictest3781123-21kthreadcore22:25:390
3584073992213,7cyclictest3714160-21ntpq21:15:440
35792512224,11sleep10-21swapper/119:05:011
36907592210,2sleep375-21kworker/3:1+events20:55:353
358407899212,9cyclictest0-21swapper/222:50:012
358407899212,5cyclictest0-21swapper/223:30:382
3584078992117,3cyclictest371rcuc/223:05:002
358407899211,5cyclictest0-21swapper/220:30:322
358407899211,5cyclictest0-21swapper/220:05:412
358407899210,8cyclictest3687648-21sort20:50:402
358407899210,7cyclictest3771395-21tr22:15:402
3584073992119,1cyclictest0-21swapper/020:50:490
3584073992118,2cyclictest3610863-21idleruntime-cro19:35:000
3584073992117,3cyclictest3725250-21cron21:30:000
3584073992117,3cyclictest3709552-21switchtime21:10:490
3584073992112,5cyclictest13-21ksoftirqd/000:15:330
35834902214,10sleep20-21swapper/219:05:522
358407899209,2cyclictest161rcu_preempt23:25:432
358407899205,2cyclictest0-21swapper/222:30:452
358407899200,8cyclictest3646052-21aten2_r5power_p20:10:332
358407899200,11cyclictest3748880-21cut21:50:412
358407399202,17cyclictest0-21swapper/021:55:500
3584073992017,2cyclictest3804305-21runrttasks22:45:550
3584073992016,3cyclictest3913697-21unixbench_singl00:35:510
3584073992016,3cyclictest3873612-21kworker/u8:3+flush-8:000:00:540
3584073992016,3cyclictest3873612-21kworker/u8:3+flush-8:000:00:530
3584073992016,3cyclictest3799838-21latency_hist22:45:010
3584073992016,2cyclictest3873612-21kworker/u8:3+events_unbound00:20:350
3584073992016,2cyclictest0-21swapper/021:35:450
3584073992015,4cyclictest3625353-21unixbench_singl19:45:510
38731142190,4sleep3481ktimers/323:55:413
358407399192,1cyclictest0-21swapper/022:35:500
35793162193,9sleep30-21swapper/319:05:333
37877902180,3sleep375-21kworker/3:1+events22:30:423
3584073991814,3cyclictest3531218-21kworker/u8:2+events_unbound00:25:330
38994752162,9sleep30-21swapper/300:25:323
36695352155,6sleep30-21swapper/320:30:473
38147822142,8sleep30-21swapper/323:00:323
39134272132,6sleep30-21swapper/300:35:503
38448062132,6sleep30-21swapper/323:30:013
38195622132,6sleep30-21swapper/323:05:023
37947932132,6sleep30-21swapper/322:40:013
37453312132,6sleep30-21swapper/321:50:013
37142262132,7sleep30-21swapper/321:15:473
37041532132,7sleep30-21swapper/321:05:443
36429532132,7sleep30-21swapper/320:05:443
38943222122,6sleep30-21swapper/300:20:013
38898612122,6sleep30-21swapper/300:15:373
38759422122,6sleep30-21swapper/300:00:443
38759422122,6sleep30-21swapper/300:00:433
38361012123,5sleep30-21swapper/323:20:393
38292912122,5sleep30-21swapper/323:15:003
37846572122,6sleep30-21swapper/322:27:573
37707102122,6sleep30-21swapper/322:15:383
37691762123,6sleep30-21swapper/322:10:483
37413902122,6sleep30-21swapper/321:45:403
37309072122,6sleep30-21swapper/321:35:363
37294022122,6sleep30-21swapper/321:30:483
37153652122,6sleep30-21swapper/321:20:313
36950962122,5sleep30-21swapper/321:00:013
36860842122,6sleep30-21swapper/320:50:393
36757232122,6sleep30-21swapper/320:40:353
36734062122,6sleep30-21swapper/320:35:423
36612692122,6sleep30-21swapper/320:25:393
36553242122,6sleep30-21swapper/320:17:003
36458032122,5sleep30-21swapper/320:10:023
36208062122,5sleep30-21swapper/319:45:013
36165002122,6sleep30-21swapper/319:40:363
36111282122,6sleep30-21swapper/319:35:313
35963552122,6sleep30-21swapper/319:20:343
35895432122,6sleep30-21swapper/319:15:043
35845142122,6sleep30-21swapper/319:10:343
39048382112,5sleep30-21swapper/300:30:373
38847552112,5sleep30-21swapper/300:10:353
38799852112,5sleep30-21swapper/300:05:373
38601822112,6sleep30-21swapper/323:45:393
38601822112,6sleep30-21swapper/323:45:383
38552332112,5sleep30-21swapper/323:40:373
38501432112,5sleep30-21swapper/323:35:363
38442592111,6sleep30-21swapper/323:25:533
38097922112,5sleep30-21swapper/322:55:023
38062892112,5sleep30-21swapper/322:50:413
37999842112,5sleep30-21swapper/322:45:323
37939372112,5sleep30-21swapper/322:35:493
37752232112,5sleep30-21swapper/322:20:323
37603612112,5sleep30-21swapper/322:05:023
37591782112,5sleep30-21swapper/322:00:453
37505102112,5sleep30-21swapper/321:55:323
37354372112,5sleep30-21swapper/321:40:033
37206672112,6sleep30-21swapper/321:25:343
37059532112,5sleep30-21swapper/321:10:373
36844112112,5sleep30-21swapper/320:45:483
36555582112,5sleep30-21swapper/320:20:013
36555582112,5sleep30-21swapper/320:20:013
36360562112,5sleep30-21swapper/320:00:013
36297172112,5sleep30-21swapper/319:50:433
36071262112,5sleep30-21swapper/319:30:403
36012822112,5sleep30-21swapper/319:25:313
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional