You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 12:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Mar 20, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
360627321910,3sleep375-21kworker/3:1+events22:16:393
36035692600,4sleep00-21swapper/022:11:430
3418912995447,4cyclictest3644186-21latency_hist22:55:011
35365842480,4sleep00-21swapper/021:06:380
35365842480,4sleep00-21swapper/021:06:380
3418912994638,6cyclictest3721949-21kworker/u8:3+events_unbound00:16:471
3418910994338,4cyclictest3599861-21kworker/u8:1+flush-8:022:21:510
3418910994132,6cyclictest3743831-21latency_hist00:35:000
3418912994033,5cyclictest3639253-21kworker/u8:3+flush-8:022:56:351
3418912994031,7cyclictest3499954-21cp20:30:001
3418912994030,7cyclictest280-21systemd-journal00:31:541
3418912993935,3cyclictest3460040-21kworker/u8:0+flush-8:020:01:481
3418912993933,4cyclictest2077298-21kworker/u8:2+flush-8:020:11:441
3418912993927,9cyclictest280-21systemd-journal22:07:551
3418912993833,3cyclictest3619635-21kworker/u8:0+flush-8:023:26:501
3418912993833,3cyclictest280-21systemd-journal21:10:001
3418912993833,3cyclictest280-21systemd-journal21:10:001
3418912993732,3cyclictest3560019-21kworker/u8:0+events_unbound21:46:481
3418912993731,4cyclictest3609217-21kworker/u8:3+flush-8:022:36:351
3418912993630,4cyclictest3431032-21apt-get19:21:301
3418912993624,9cyclictest3738686-21latency_hist00:30:001
3418910993626,7cyclictest3673815-21latency_hist23:25:010
3418912993529,4cyclictest3514177-21kworker/u8:0+flush-8:021:21:501
3418912993529,4cyclictest3418768-21kworker/u8:1+flush-8:019:41:481
3418912993528,5cyclictest3748821-21latency_hist00:40:011
3418912993528,5cyclictest3748821-21latency_hist00:40:001
3418912993429,4cyclictest3599861-21kworker/u8:1+events_unbound22:21:511
3418912993428,4cyclictest3634004-21kworker/u8:2+flush-8:023:46:351
3418912993428,4cyclictest3619635-21kworker/u8:0+flush-8:022:46:351
3418912993428,4cyclictest3418768-21kworker/u8:1+flush-8:019:51:451
3418912993427,4cyclictest3460040-21kworker/u8:0+flush-8:019:50:011
3418912993423,9cyclictest3489123-21ntpq20:16:451
3418912993328,3cyclictest3649745-21cut23:01:351
3418912993327,4cyclictest3718050-21grep00:06:541
3418912993326,5cyclictest3634280-21latency_hist22:45:001
3418912993326,5cyclictest3634280-21latency_hist22:45:001
3418912993325,6cyclictest3634004-21kworker/u8:2+flush-8:023:56:431
3418912993324,6cyclictest280-21systemd-journal00:20:551
3418910993325,6cyclictest3510441-21aten2_r5power_c20:41:320
3418910993324,6cyclictest3688717-21latency_hist23:40:010
3418916993223,7cyclictest3722780-21ntpq00:11:452
3418912993225,5cyclictest3445834-21apt-get19:36:291
3418912993223,7cyclictest3465590-21/usr/sbin/munin19:56:411
3418910993227,3cyclictest880-21mta-sts-daemon22:01:500
3418910993223,7cyclictest3723561-21latency_hist00:15:000
341387023215,12sleep10-21swapper/119:05:011
3418912993126,3cyclictest3572237-21kthreadcore21:41:411
3418912993125,5cyclictest2077298-21kworker/u8:2+flush-8:020:41:351
3418912993123,6cyclictest3540322-21apt-get21:11:311
3418912993123,6cyclictest3540322-21apt-get21:11:311
3418912993122,6cyclictest280-21systemd-journal20:06:551
3418910993119,9cyclictest3475777-21diskstats20:06:360
3418916993024,4cyclictest3539750-21gpgv21:10:002
3418916993024,4cyclictest3539750-21gpgv21:10:002
3418912993025,4cyclictest3555037-21kworker/u8:3+flush-8:021:56:381
3418912993025,4cyclictest3555037-21kworker/u8:3+events_unbound22:01:351
3418912993023,5cyclictest3619635-21kworker/u8:0+flush-8:000:11:351
3418912993022,6cyclictest3538940-21kworker/u8:2+events_unbound22:16:451
3418912993022,5cyclictest3519920-21latency_hist20:50:011
3418912993019,7cyclictest280-21systemd-journal23:36:551
3418910993023,5cyclictest280-21systemd-journal20:45:550
3418916992924,3cyclictest3614842-21aten2_r5power_c22:26:332
3418916992921,6cyclictest3565680-21tr21:36:392
3418912992924,3cyclictest3683747-21systemd-run23:35:001
3418912992924,3cyclictest3634004-21kworker/u8:2+events_unbound23:06:381
3418912992923,4cyclictest3639253-21kworker/u8:3+flush-8:023:11:501
3418912992922,5cyclictest3514177-21kworker/u8:0-ext4-rsv-conversion21:05:001
3418912992922,5cyclictest3514177-21kworker/u8:0-ext4-rsv-conversion21:05:001
3418910992925,3cyclictest2077298-21kworker/u8:2+events_unbound19:26:490
3418910992924,3cyclictest3545497-21cpuspeed_turbos21:16:340
3418910992923,4cyclictest3659347-21apt-get23:11:300
3418910992922,6cyclictest3698319-21unixbench_singl23:46:500
3418910992921,6cyclictest3738780-21cp00:30:000
3418910992921,6cyclictest280-21systemd-journal20:15:560
3418910992917,2cyclictest0-21swapper/023:41:430
3418916992824,2cyclictest3609165-21unixbench_singl22:16:512
341891699281,25cyclictest3738379-21unixbench_singl00:26:512
3418912992824,2cyclictest3421336-21kthreadcore19:11:401
3418912992823,3cyclictest3538940-21kworker/u8:2+flush-8:022:26:521
3418912992823,3cyclictest3409178-21kworker/u8:0+events_unbound19:15:021
3418912992822,5cyclictest3538940-21kworker/u8:2+events_unbound22:11:441
3418912992822,5cyclictest3418768-21kworker/u8:1+flush-8:020:36:461
3418910992819,7cyclictest280-21systemd-journal19:20:000
3418916992724,2cyclictest3540380-21aten2_r5power_e21:11:332
3418916992724,2cyclictest3540380-21aten2_r5power_e21:11:332
3418916992723,2cyclictest3514966-21latency_hist20:45:002
3418916992723,2cyclictest3505752-21fschecks_time20:36:372
3418916992723,2cyclictest3461008-21fschecks_time19:51:352
3418916992722,3cyclictest3644777-21cpuspeed_turbos22:56:332
3418912992722,4cyclictest2077298-21kworker/u8:2+events_unbound20:31:401
3418912992722,3cyclictest3555037-21kworker/u8:3+flush-8:021:26:411
3418912992721,5cyclictest3519680-21kworker/u8:1+events_unbound20:51:481
3418912992719,6cyclictest3634004-21kworker/u8:2+flush-8:023:21:431
3418910992724,2cyclictest3435612-21idleruntime-cro19:25:000
3418910992722,3cyclictest3615530-21irqrtprio22:26:390
341891099271,24cyclictest3569427-21sshd21:36:550
3418916992623,2cyclictest3445124-21unixbench_multi19:31:512
3418916992622,3cyclictest3629330-21sendmail22:40:002
3418916992621,3cyclictest3435292-21unixbench_singl19:21:512
3418916992620,4cyclictest3450056-21unixbench_multi19:36:492
3418912992620,4cyclictest3634004-21kworker/u8:2+flush-8:023:41:401
3418912992620,4cyclictest3569684-21latency_hist21:40:011
3418912992620,3cyclictest0-21swapper/121:51:481
3418910992623,2cyclictest3624412-21systemd-run22:35:000
3418910992621,4cyclictest3674073-21kworker/u8:3+events_unbound23:26:390
3418910992621,3cyclictest3449190-21kthreadcore19:36:400
3418910992620,4cyclictest3654046-21cron23:05:000
3418910992620,4cyclictest3645275-21tr22:56:370
3418910992620,3cyclictest0-21swapper/020:05:010
3418916992522,2cyclictest3699178-21cpuspeed_turbos23:51:342
3418916992522,2cyclictest3624040-21unixbench_multi22:31:522
3418916992521,2cyclictest3525552-21fschecks_count20:56:362
3418916992521,2cyclictest3474860-21unixbench_singl20:01:502
3418916992519,4cyclictest3718618-21cp00:10:002
3418916992517,6cyclictest3455385-21cat19:44:592
3418916992517,5cyclictest3594430-21turbostat.cron22:05:002
3418912992521,3cyclictest3634004-21kworker/u8:2+flush-8:023:16:511
3418912992521,3cyclictest3609217-21kworker/u8:3+flush-8:022:30:311
3418912992520,4cyclictest3538940-21kworker/u8:2+events_unbound21:31:351
3418912992519,4cyclictest3674073-21kworker/u8:3+flush-8:023:51:361
3418912992515,7cyclictest280-21systemd-journal20:24:551
3418910992521,3cyclictest3540911-21sort21:11:390
3418910992521,3cyclictest3540911-21sort21:11:380
3418910992521,2cyclictest280-21systemd-journal23:35:000
3418910992521,2cyclictest0-21swapper/000:00:000
3418910992520,4cyclictest2077298-21kworker/u8:2+flush-8:020:26:350
3418910992520,3cyclictest3575255-21cpuspeed_turbos21:46:340
3418910992520,3cyclictest3445150-21unixbench_multi19:31:510
3418910992519,4cyclictest3655131-21tr23:06:380
3418910992515,8cyclictest3744177-21/usr/sbin/munin00:36:490
3418910992515,8cyclictest3744177-21/usr/sbin/munin00:36:490
341891699246,3cyclictest36035702cat22:11:432
3418916992419,3cyclictest3733741-21cron00:25:002
3418916992416,6cyclictest3599597-21turbostat.cron22:10:002
3418916992414,8cyclictest3584521-21awk21:55:002
3418916992411,9cyclictest3629705-21apt-get22:41:322
3418916992411,9cyclictest3629705-21apt-get22:41:322
341891699240,19cyclictest3685492-21cut23:36:392
3418912992420,3cyclictest3409178-21kworker/u8:0+events_unbound19:31:351
3418910992420,2cyclictest3710774-21kthreadcore00:01:410
3418910992420,2cyclictest0-21swapper/020:40:000
3418910992419,3cyclictest280-21systemd-journal21:00:000
3418910992418,4cyclictest3454441-21wc19:41:410
3418910992417,5cyclictest401-21dbus-daemon20:55:000
3418910992415,6cyclictest3465256-21latency_hist19:55:010
35444202230,2sleep3471rcuc/321:11:513
35444202230,2sleep3471rcuc/321:11:513
341891699232,15cyclictest3515324-21apt-get20:46:332
3418916992319,2cyclictest3490413-21aten2_r5power_p20:21:342
3418916992319,2cyclictest3436188-21cpuspeed_turbos19:26:322
3418916992319,2cyclictest3419283-21aten2_r5power_v19:11:332
3418916992313,8cyclictest3584858-21munin-node21:56:302
3418916992311,9cyclictest3668893-21awk23:20:002
3418912992319,2cyclictest0-21swapper/121:16:501
3418912992319,2cyclictest0-21swapper/120:56:521
3418910992319,2cyclictest876-21mta-sts-daemon22:51:390
3418910992318,3cyclictest3718381-21cron00:10:000
3418910992315,6cyclictest3628521-21ntpq22:36:440
3418910992315,6cyclictest280-21systemd-journal19:50:000
3418910992313,7cyclictest3504263-21ntpq20:31:460
341891699222,19cyclictest3635562-21grep22:46:392
3418916992218,2cyclictest3570289-21cpuspeed_turbos21:41:342
3418916992218,2cyclictest0-21swapper/220:20:002
3418916992213,7cyclictest3671405-21kthreadcore23:21:392
3418910992218,3cyclictest3418768-21kworker/u8:1+flush-8:020:21:430
3418910992217,3cyclictest3728794-21systemd-run00:20:000
3418910992216,4cyclictest3595825-21irqrtprio22:06:390
3418910992216,4cyclictest3534788-21turbostat.cron21:05:000
3418910992216,4cyclictest3534788-21turbostat.cron21:05:000
3418910992215,5cyclictest280-21systemd-journal19:13:350
3418916992118,2cyclictest3654727-21fschecks_time23:06:352
3418916992117,2cyclictest3689380-21fschecks_count23:41:352
3418916992117,2cyclictest3579295-21unixbench_singl21:46:512
3418916992116,3cyclictest3470212-21idleruntime-cro20:00:002
341891299212,7cyclictest3708861-21apt-get00:01:331
3418912992117,3cyclictest2077298-21kworker/u8:2+flush-8:019:26:381
3418910992117,3cyclictest3664259-21acpi23:16:300
3418910992117,3cyclictest3574363-21unixbench_singl21:41:520
3418910992117,2cyclictest0-21swapper/019:56:410
3418910992116,4cyclictest3582094-21kthreadcore21:51:410
3418910992116,3cyclictest0-21swapper/022:16:390
3418910992116,3cyclictest0-21swapper/021:26:420
3418910992114,5cyclictest280-21systemd-journal21:34:030
34876652200,2sleep3481ktimers/320:16:413
341891699202,12cyclictest3724150-21apt-get00:16:312
3418916992017,2cyclictest0-21swapper/220:30:002
3418916992016,2cyclictest3708974-21aten2_r5power_v00:01:352
3418916992016,2cyclictest3649566-21aten2_r5power_p23:01:332
341891099206,11cyclictest3729485-21fschecks_time00:21:360
3418910992015,4cyclictest3699878-21kthreadcore23:51:400
3418910992015,3cyclictest3635032-21idleruntime22:46:360
341891699199,8cyclictest3682874-21ntpq23:31:432
3418916991915,2cyclictest3639627-21aten2_r5power_c22:51:322
3418910991916,2cyclictest3588569-21needreboot21:56:420
3418910991913,4cyclictest3551807-21kthreadcore21:21:390
34181152193,9sleep30-21swapper/319:06:483
341891699189,7cyclictest3708105-21unixbench_multi23:56:502
341891699186,8cyclictest3559397-21cat21:26:512
3418916991814,2cyclictest0-21swapper/223:46:472
3418916991814,2cyclictest0-21swapper/221:25:012
3418916991814,2cyclictest0-21swapper/220:35:002
341891699181,12cyclictest3520284-21taskset20:51:312
341891699180,6cyclictest3659613-21fschecks_count23:11:342
341891699180,16cyclictest3478842-21tr20:06:432
3418910991813,3cyclictest0-21swapper/020:11:500
34186182184,9sleep20-21swapper/219:08:362
341891699178,7cyclictest3456502-21sed19:46:372
341891699172,11cyclictest3674173-21apt-get23:26:322
3418916991713,2cyclictest0-21swapper/221:01:362
3418916991713,2cyclictest0-21swapper/221:01:362
3418916991713,2cyclictest0-21swapper/220:11:432
3418916991713,2cyclictest0-21swapper/200:31:332
3418910991713,2cyclictest3630294-21irqcore22:41:390
3418910991713,2cyclictest3630294-21irqcore22:41:380
34143222172,9sleep03414452-21df_inode19:06:330
341891699166,8cyclictest3547436-21kthreadcore21:16:412
341891699162,2cyclictest0-21swapper/222:22:572
3418916991613,2cyclictest0-21swapper/221:31:392
3418916991610,4cyclictest0-21swapper/200:36:412
3418916991610,4cyclictest0-21swapper/200:36:412
341891699160,7cyclictest34277011kthreadcore19:16:392
37438242144,6sleep30-21swapper/300:35:003
36845322145,5sleep30-21swapper/323:36:373
36297082141,8sleep30-21swapper/322:41:323
36297082141,8sleep30-21swapper/322:41:323
36200202142,7sleep30-21swapper/322:31:373
35944202142,8sleep30-21swapper/322:05:003
37238212132,6sleep30-21swapper/300:15:023
37097792132,7sleep30-21swapper/300:01:413
36890652132,7sleep30-21swapper/323:41:313
36183802132,7sleep30-21swapper/322:26:433
35689092132,7sleep30-21swapper/321:36:483
34908342132,7sleep30-21swapper/320:21:403
34450612132,7sleep30-21swapper/319:31:523
37341182122,6sleep30-21swapper/300:26:333
37298442122,6sleep30-21swapper/300:21:403
37213732122,6sleep30-21swapper/300:11:403
37038422122,6sleep30-21swapper/323:55:553
36778122122,6sleep30-21swapper/323:26:423
36598032122,6sleep30-21swapper/323:11:373
36547592122,6sleep30-21swapper/323:06:363
36491432122,6sleep30-21swapper/323:00:023
36449882122,6sleep30-21swapper/322:56:373
36433272123,5sleep30-21swapper/322:51:433
36384502122,6sleep30-21swapper/322:46:463
36095162122,5sleep30-21swapper/322:20:013
35845412122,5sleep30-21swapper/321:55:013
35836402122,6sleep30-21swapper/321:51:443
35714412122,6sleep30-21swapper/321:41:413
35640062122,6sleep30-21swapper/321:31:503
35544442122,6sleep30-21swapper/321:21:513
35467402122,6sleep30-21swapper/321:16:413
35257342122,6sleep30-21swapper/320:56:393
35202852122,6sleep30-21swapper/320:51:333
35155692122,6sleep30-21swapper/320:46:363
34659932122,6sleep30-21swapper/319:56:363
34603212122,5sleep30-21swapper/319:50:023
34557622122,6sleep30-21swapper/319:46:333
34546722122,6sleep30-21swapper/319:41:473
34362142122,6sleep30-21swapper/319:26:343
34263012121,7sleep30-21swapper/319:16:353
34191762122,6sleep30-21swapper/319:11:343
37442062112,5sleep30-21swapper/300:36:323
37442062112,5sleep30-21swapper/300:36:323
37142642112,5sleep30-21swapper/300:06:393
36989892112,6sleep30-21swapper/323:51:343
36940292112,5sleep30-21swapper/323:46:333
36829922112,5sleep30-21swapper/323:31:483
36692652112,5sleep30-21swapper/323:21:333
36642572110,7sleep30-21swapper/323:16:313
36246772112,5sleep30-21swapper/322:35:543
35998222112,5sleep30-21swapper/322:10:023
35950342112,5sleep30-21swapper/322:06:343
35748822112,5sleep30-21swapper/321:45:023
35554192112,5sleep30-21swapper/321:26:363
35349912112,5sleep30-21swapper/321:05:013
35349912112,5sleep30-21swapper/321:05:013
35310992112,5sleep30-21swapper/321:01:413
35310992112,5sleep30-21swapper/321:01:403
35101462112,5sleep30-21swapper/320:40:023
35053642112,5sleep30-21swapper/320:35:563
35009122112,5sleep30-21swapper/320:31:393
34956852112,5sleep30-21swapper/320:26:373
34803582112,6sleep30-21swapper/320:10:323
34759812112,5sleep30-21swapper/320:06:393
34706762112,5sleep30-21swapper/320:01:333
34458082112,5sleep30-21swapper/319:36:293
34310362112,5sleep30-21swapper/319:21:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional