You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 11:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Mar 18, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40226772670,1sleep1281rcuc/122:41:381
3811100996256,4cyclictest3991848-21kworker/u8:1+events_unbound23:15:010
3811105995445,6cyclictest4016795-21latency_hist22:35:011
3811105995347,4cyclictest3897893-21kworker/u8:1+events_unbound20:45:011
41310072500,2sleep239-21ksoftirqd/200:30:012
40474862480,1sleep04047487-21if_err_enp4s023:06:410
39607352480,4chrt371rcuc/221:36:432
3811105994738,7cyclictest280-21systemd-journal20:32:221
3811100994737,7cyclictest3917365-21latency_hist20:55:010
3811107994638,5cyclictest280-21systemd-journal20:25:002
3811105994437,5cyclictest280-21systemd-journal21:00:541
41091382420,2sleep3471rcuc/300:06:433
3811105994234,5cyclictest280-21systemd-journal22:21:531
3811105994135,4cyclictest4091604-21/usr/sbin/munin23:51:511
3811105994135,4cyclictest4091604-21/usr/sbin/munin23:51:511
3811105994131,8cyclictest3837595-21latency_hist19:35:001
3811105994131,8cyclictest3837595-21latency_hist19:35:001
3811105994030,8cyclictest3866651-21ntpq20:01:451
3811107993931,6cyclictest4101154-21cat00:00:002
3811107993931,6cyclictest4101154-21cat00:00:002
3811105993629,5cyclictest4115244-21ntpq00:11:461
3811100993631,3cyclictest4125944-21systemd-run00:25:010
3811100993630,4cyclictest4091282-21kworker/u8:3+flush-8:000:00:050
3811100993627,7cyclictest3867473-21latency_hist20:05:010
3811105993529,5cyclictest3917593-21kworker/u8:2+flush-8:021:11:381
3811105993529,4cyclictest280-21systemd-journal00:16:541
3811105993528,5cyclictest3823130-21apt-get19:21:321
3811105993528,5cyclictest280-21systemd-journal19:54:541
3811105993527,5cyclictest4036749-21latency_hist22:55:011
3811105993526,6cyclictest3997010-21latency_hist22:15:011
3811100993526,7cyclictest280-21systemd-journal21:35:540
3811105993429,3cyclictest3455665-21kworker/u8:3+flush-8:020:16:371
3811105993423,8cyclictest4070631-21ntpq23:26:471
3811100993423,9cyclictest3846919-21ntpq19:41:460
3811100993327,4cyclictest3991848-21kworker/u8:1+flush-8:022:36:380
3811100993327,4cyclictest3892785-21apt-get20:31:330
3811100993326,5cyclictest3852378-21grep19:46:520
3811100993325,5cyclictest3842790-21latency_hist19:40:000
3811100993324,6cyclictest4086312-21latency_hist23:45:000
3811100993324,6cyclictest3891564-21ntpq20:26:440
3811100993227,3cyclictest401-21dbus-daemon20:50:000
3811100993226,4cyclictest3947363-21kworker/u8:3+flush-8:021:51:490
3811105993127,3cyclictest401-21dbus-daemon00:05:001
3811105993127,3cyclictest3968208-21irqrtprio21:46:391
3811105993124,5cyclictest3991848-21kworker/u8:1+flush-8:022:46:381
3811105993123,6cyclictest3851828-21ntpq19:46:451
3811105993123,6cyclictest3815915-21latency_hist19:15:001
3811105993122,6cyclictest4121356-21apt-get00:21:321
3811100993124,5cyclictest3818231-21tr19:16:330
3811100993119,8cyclictest280-21systemd-journal23:57:540
3811100993119,8cyclictest280-21systemd-journal23:57:540
3811107993025,3cyclictest3932489-21ls21:10:002
3811105993021,6cyclictest3822742-21latency_hist19:20:021
3811100993026,2cyclictest4031810-21cron22:50:000
3811100993025,3cyclictest4140747-21sendmail00:40:000
3811100993022,6cyclictest3917730-21apt-get20:56:320
3811107992923,4cyclictest3837599-21apt-get19:35:002
3811107992923,4cyclictest3837599-21apt-get19:35:002
3811105992925,3cyclictest4047344-21cut23:06:371
3811100992925,2cyclictest3872392-21cron20:10:000
3811107992824,2cyclictest3852315-21unixbench_multi19:46:522
3811107992821,5cyclictest280-21systemd-journal00:05:002
3811105992824,2cyclictest4076096-21unixbench_multi23:31:511
3811105992824,2cyclictest0-21swapper/121:40:001
3811100992823,4cyclictest3759096-21kworker/u8:0+flush-8:019:51:360
3811100992822,4cyclictest3927552-21kworker/u8:1+flush-8:021:06:530
40868912270,4sleep130-21ksoftirqd/123:46:341
3811105992723,3cyclictest4066222-21kworker/u8:0+flush-8:023:40:241
3811100992723,3cyclictest3917593-21kworker/u8:2+flush-8:022:11:390
3811100992722,4cyclictest3917593-21kworker/u8:2+flush-8:022:41:360
3811100992721,3cyclictest0-21swapper/000:26:380
3811100992720,5cyclictest3990966-21ntpq22:06:460
3811100992720,5cyclictest1-21systemd22:05:000
3811100992718,6cyclictest4066109-21grep23:21:530
3811107992623,2cyclictest4017471-21fschecks_time22:36:382
3811107992621,4cyclictest4016799-21munin-run22:35:002
3811107992621,3cyclictest4081769-21aten2_r5power_c23:41:352
3811107992616,8cyclictest3997621-21diskstats22:16:372
3811105992622,2cyclictest0-21swapper/120:15:011
3811105992620,4cyclictest3892204-21kworker/u8:0+flush-8:021:19:591
3811105992616,8cyclictest3901793-21ntpq20:36:471
3811105992614,6cyclictest280-21systemd-journal21:21:541
381110099263,16cyclictest4032189-21chrt22:51:320
3811100992622,2cyclictest4077707-21kthreadcore23:36:410
3811100992622,2cyclictest3981594-21unixbench_multi21:56:520
3811100992621,4cyclictest3947363-21kworker/u8:3+flush-8:022:33:250
3811100992621,3cyclictest4096243-21systemd-run23:55:000
3811100992621,3cyclictest4096243-21systemd-run23:55:000
3811107992521,3cyclictest3917947-21cpuspeed_turbos20:56:352
3811107992521,2cyclictest3862956-21aten2_r5power_e20:01:342
3811107992521,2cyclictest3843457-21fschecks_count19:41:362
3811107992521,2cyclictest0-21swapper/222:10:012
3811107992519,4cyclictest4036402-21unixbench_multi22:51:512
381110799250,12cyclictest4116397-21apt-get00:16:322
381110599252,9cyclictest39519742unixbench_multi21:26:511
381110599252,9cyclictest39519742unixbench_multi21:26:511
3811105992521,3cyclictest4130850-21cron00:30:001
3811105992521,2cyclictest0-21swapper/100:31:361
3811105992520,3cyclictest4056260-21unixbench_singl23:11:521
3811105992520,3cyclictest3842499-21unixbench_singl19:36:511
3811105992519,4cyclictest4010938-21needreboot22:26:421
3811105992519,4cyclictest3886616-21needreboot20:21:451
3811105992517,6cyclictest3947363-21kworker/u8:3+flush-8:021:31:401
381110099252,14cyclictest3831955-21chrt19:26:480
3811100992521,3cyclictest3833574-21irqcore19:31:400
3811100992521,3cyclictest3833574-21irqcore19:31:400
3811100992520,4cyclictest4091282-21kworker/u8:3+flush-8:000:16:590
3811100992520,3cyclictest4071502-21systemd-run23:30:000
3811100992520,3cyclictest0-21swapper/019:15:000
3811100992518,5cyclictest4071849-21apt-get23:31:310
3811100992516,5cyclictest0-21swapper/000:11:330
381110799248,4cyclictest0-21swapper/222:26:372
3811107992420,3cyclictest3937453-21sh21:15:002
3811107992420,2cyclictest4047212-21cpuspeed_turbos23:06:362
381110799241,13cyclictest4135801-21/usr/sbin/munin00:35:002
3811107992410,9cyclictest4042068-21apt-get23:01:332
381110799240,7cyclictest4076624-21sed23:35:012
381110799240,12cyclictest3996274-21ntp_states22:11:502
3811105992420,2cyclictest4140716-21cron00:40:001
3811105992420,2cyclictest3917593-21kworker/u8:2-ext4-rsv-conversion21:55:001
3811105992419,3cyclictest0-21swapper/119:56:411
3811105992418,4cyclictest3872060-21unixbench_multi20:06:531
3811105992417,5cyclictest3916633-21ntpq20:51:481
3811100992420,3cyclictest3887167-21unixbench_multi20:21:530
3811100992419,4cyclictest3455665-21kworker/u8:3+flush-8:020:11:490
3811100992419,4cyclictest20977-21cron23:05:000
3811100992419,3cyclictest3882563-21systemd-run20:20:000
3811100992418,3cyclictest3947059-21unixbench_singl21:21:500
3811100992415,7cyclictest4060683-21ntpq23:16:460
38063382243,3sleep00-21swapper/019:05:580
39492742230,2sleep3471rcuc/321:26:403
39492742230,2sleep3471rcuc/321:26:403
3811107992320,2cyclictest4061190-21unixbench_singl23:16:522
3811107992319,2cyclictest3977419-21aten2_r5power_p21:56:342
3811107992317,4cyclictest3917015-21unixbench_multi20:51:512
3811107992312,9cyclictest280-21systemd-journal22:43:532
381110799230,13cyclictest3927104-21sed21:01:522
3811105992320,2cyclictest3847764-21apt19:45:001
3811105992319,2cyclictest0-21swapper/123:36:391
3811105992319,2cyclictest0-21swapper/120:28:541
3811105992318,4cyclictest3917593-21kworker/u8:2+flush-8:020:56:521
3811105992315,6cyclictest280-21systemd-journal00:00:011
3811105992315,6cyclictest280-21systemd-journal00:00:001
3811100992318,3cyclictest0-21swapper/020:41:380
3811100992317,4cyclictest4039270-21sed22:56:400
3811100992317,4cyclictest3823394-21fschecks_count19:21:370
3811100992315,5cyclictest3970682-21kthreadcore21:46:420
3811100992314,7cyclictest3936604-21ntpq21:11:450
381110799226,5cyclictest0-21swapper/223:26:412
381110799226,5cyclictest0-21swapper/220:36:392
3811107992217,3cyclictest3938036-21cpuspeed_turbos21:16:352
381110799220,6cyclictest3975333-21cut21:51:422
381110799220,5cyclictest3896665-21ld20:31:492
381110799220,11cyclictest3888751-21irqstats20:26:402
381110799220,11cyclictest3877956-21apt-get20:16:332
381110799220,10cyclictest4136577-21awk00:36:402
3811105992218,2cyclictest0-21swapper/123:16:311
3811105992218,2cyclictest0-21swapper/123:01:401
3811105992218,2cyclictest0-21swapper/122:40:001
3811105992218,2cyclictest0-21swapper/122:01:491
381110099223,12cyclictest407-21mta-sts-daemon00:31:320
3811100992217,4cyclictest3947363-21kworker/u8:3+flush-8:022:26:470
3811100992217,4cyclictest3892204-21kworker/u8:0+flush-8:021:41:540
3811100992216,4cyclictest3862222-21unixbench_singl19:56:520
381110099221,18cyclictest3956550-21ps21:31:470
381110799215,5cyclictest0-21swapper/219:26:462
381110799213,6cyclictest0-21swapper/220:12:492
381110799212,9cyclictest0-21swapper/219:16:432
381110799212,4cyclictest0-21swapper/222:48:422
381110799210,5cyclictest4005292-21cut22:21:412
381110799210,5cyclictest3815389-21cat19:11:522
381110799210,4cyclictest3911653-21ntpq20:46:452
381110799210,11cyclictest3967152-21munin-run21:45:012
3811105992117,3cyclictest3908471-21sort20:46:371
3811105992117,2cyclictest0-21swapper/122:05:541
3811105992117,2cyclictest0-21swapper/121:56:431
3811105992117,2cyclictest0-21swapper/121:41:331
3811105992117,2cyclictest0-21swapper/119:26:341
3811105992117,2cyclictest0-21swapper/100:06:391
3811100992116,4cyclictest3923864-21sed21:01:410
3811100992116,3cyclictest4090943-21unixbench_multi23:46:520
38063282219,9sleep20-21swapper/219:05:522
38062922214,11sleep10-21swapper/119:05:231
381110799206,5cyclictest0-21swapper/200:12:022
381110799206,2cyclictest161rcu_preempt23:35:052
381110799205,4cyclictest0-21swapper/222:56:492
381110799202,9cyclictest0-21swapper/223:46:392
381110799202,7cyclictest0-21swapper/200:20:592
381110799202,4cyclictest0-21swapper/219:50:262
381110799202,4cyclictest0-21swapper/200:06:272
3811107992017,2cyclictest371rcuc/219:55:442
381110799201,5cyclictest3948431-21ps21:26:392
381110799201,5cyclictest3948431-21ps21:26:392
3811107992012,3cyclictest3906712-21ntpq20:41:472
381110799200,5cyclictest3967940-21awk21:46:382
381110799200,10cyclictest3942741-21awk21:21:302
3811105992016,2cyclictest3932518-21systemd-run21:10:001
3811105992016,2cyclictest0-21swapper/123:21:411
3811105992016,2cyclictest0-21swapper/122:15:541
3811100992016,2cyclictest0-21swapper/022:21:330
3811100992016,2cyclictest0-21swapper/022:20:000
3811100992012,6cyclictest3941564-21ntpq21:16:460
3811100992011,7cyclictest280-21systemd-journal00:10:010
38107282206,8sleep30-21swapper/319:07:453
381110799193,4cyclictest0-21swapper/221:30:382
381110799192,9cyclictest0-21swapper/222:00:342
3811107991915,2cyclictest0-21swapper/219:40:002
3811107991913,4cyclictest0-21swapper/223:51:362
3811107991913,4cyclictest0-21swapper/223:51:362
3811105991913,4cyclictest0-21swapper/122:56:351
381110099194,4cyclictest3900454-21grep20:36:420
3811100991914,3cyclictest3951785-21switchtime21:26:520
3811100991914,3cyclictest3951785-21switchtime21:26:510
381110799184,3cyclictest0-21swapper/220:06:372
381110799184,2cyclictest161rcu_preempt23:11:502
381110799182,5cyclictest0-21swapper/219:20:432
40965872172,9sleep30-21swapper/323:56:333
40965872172,9sleep30-21swapper/323:56:333
381110799172,3cyclictest0-21swapper/223:21:162
40519552155,6sleep30-21swapper/323:11:343
40816232146,5sleep30-21swapper/323:40:233
41157672132,7sleep30-21swapper/300:11:533
40932182130,3sleep3471rcuc/323:51:433
40932182130,3sleep3471rcuc/323:51:423
40904352132,7sleep30-21swapper/323:46:453
40270382132,6sleep30-21swapper/322:45:023
38280602132,6sleep30-21swapper/319:26:323
41348082123,5sleep30-21swapper/300:31:443
41259422122,5sleep30-21swapper/300:25:023
41015562122,6sleep30-21swapper/300:01:343
40766432122,5sleep30-21swapper/323:35:023
40707392122,6sleep30-21swapper/323:26:513
40615382122,5sleep30-21swapper/323:20:013
40605482122,6sleep30-21swapper/323:16:443
40469682122,7sleep30-21swapper/323:06:333
40367672122,5sleep30-21swapper/322:55:013
40360202122,6sleep30-21swapper/322:51:483
40118472122,5sleep30-21swapper/322:30:013
40072632122,6sleep30-21swapper/322:26:323
40057082122,6sleep30-21swapper/322:21:433
39868982122,5sleep30-21swapper/322:05:013
39834022122,6sleep30-21swapper/322:01:403
39771942122,5sleep30-21swapper/321:55:023
39622072122,6sleep30-21swapper/321:40:023
39529092122,6sleep30-21swapper/321:31:353
39427532122,6sleep30-21swapper/321:21:323
39378212122,6sleep30-21swapper/321:16:343
39223632122,5sleep30-21swapper/321:00:013
39182022122,6sleep30-21swapper/320:56:403
39128092122,6sleep30-21swapper/320:51:343
39124062122,6sleep30-21swapper/320:49:543
39068222122,6sleep30-21swapper/320:41:513
39017172122,6sleep30-21swapper/320:36:473
38927892122,6sleep30-21swapper/320:31:363
38876672122,5sleep30-21swapper/320:25:023
38823542122,6sleep30-21swapper/320:17:563
38723882122,5sleep30-21swapper/320:10:013
38680242123,6sleep30-21swapper/320:06:363
38532742122,6sleep30-21swapper/319:51:353
38497862122,6sleep30-21swapper/319:46:423
38470142124,5sleep30-21swapper/319:41:483
38372252122,6sleep30-21swapper/319:31:533
38372252122,6sleep30-21swapper/319:31:533
38229372122,6sleep30-21swapper/319:20:023
38184242122,6sleep30-21swapper/319:16:363
38113492121,6sleep30-21swapper/319:11:353
41361652112,5sleep30-21swapper/300:36:373
41212372113,5sleep30-21swapper/300:20:203
41162592112,5sleep30-21swapper/300:15:023
40721942112,5sleep30-21swapper/323:31:373
40420422112,5sleep30-21swapper/323:01:313
40221122112,5sleep30-21swapper/322:41:333
40175232112,5sleep30-21swapper/322:36:403
40009632112,5sleep30-21swapper/322:16:453
39940052112,6sleep30-21swapper/322:11:443
39726722112,5sleep30-21swapper/321:51:373
39674532112,5sleep30-21swapper/321:46:243
39574892112,6sleep30-21swapper/321:35:243
39327782112,5sleep30-21swapper/321:10:483
39282552112,5sleep30-21swapper/321:06:393
38828872112,5sleep30-21swapper/320:21:333
38626622112,5sleep30-21swapper/320:00:023
38617892112,5sleep30-21swapper/319:56:493
38380902112,5sleep30-21swapper/319:35:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional