You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 08:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Thu May 21, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
345230123440,3sleep375-21kworker/3:1-events00:31:063
312628499192176,14cyclictest0-21swapper/021:10:000
315124021820,5sleep3451irq_work/319:30:543
312628999130126,2cyclictest3247639-21gpgv21:10:012
3126287999996,1cyclictest0-21swapper/121:10:011
32882202770,3sleep00-21swapper/021:50:520
3126287996044,13cyclictest3286958-21latency_hist21:50:001
3126287996044,13cyclictest3286958-21latency_hist21:49:591
3126284995948,7cyclictest3301997-21apt-get22:05:010
3126287995134,13cyclictest1704890-21systemd-journal21:06:431
3126284995044,4cyclictest2221485-21kworker/u8:0+events_unbound20:35:580
3126289994940,7cyclictest3286954-21apt-get21:50:002
3126289994940,7cyclictest3286954-21apt-get21:50:002
32779892480,3chrt481ktimers/321:40:563
3126287994840,6cyclictest3402848-21apt-get23:45:451
3126287994832,14cyclictest3187963-21/usr/sbin/munin20:11:001
3126284994838,7cyclictest1704890-21systemd-journal23:00:000
3126284994837,8cyclictest3246351-21ntpq21:06:010
3126289994739,5cyclictest3227609-21cp20:50:002
3126284994738,6cyclictest3406590-21ntpq23:45:560
3126284994641,4cyclictest3072456-21kworker/u8:1+flush-8:019:55:480
3126284994639,5cyclictest3192614-21latency_hist20:15:000
3126287994538,5cyclictest3447944-21apt-get00:30:451
3126287994525,17cyclictest3296192-21ntpq21:55:581
3126284994536,7cyclictest3276171-21ntpq21:36:030
3126284994536,6cyclictest3272115-21latency_hist21:35:010
3126284994535,8cyclictest3396777-21ntpq23:36:000
3126287994427,14cyclictest3186557-21ntpq20:05:591
3126284994439,4cyclictest3182183-21kworker/u8:2+flush-8:020:46:070
3126289994330,10cyclictest3392842-21cp23:35:012
3126287994335,6cyclictest3327504-21apt-get22:30:471
3126287994334,6cyclictest1704890-21systemd-journal23:08:431
3126287994332,8cyclictest1704890-21systemd-journal20:25:431
3126287994332,8cyclictest1704890-21systemd-journal20:25:421
3126287994327,14cyclictest3298079-21irqrtprio22:00:521
3126284994334,7cyclictest3316179-21ntpq22:15:590
3126287994233,6cyclictest3417451-21cp00:00:001
3126284994232,7cyclictest3427431-21latency_hist00:10:010
3126284994232,7cyclictest3167670-21latency_hist19:50:010
3126284994232,7cyclictest3072456-21kworker/u8:1+flush-8:019:35:570
3126284994231,8cyclictest3377911-21diskstats23:20:520
3126287994124,15cyclictest0-21swapper/100:15:011
3126284994135,4cyclictest2221485-21kworker/u8:0+flush-8:020:40:490
3126289994030,7cyclictest1704890-21systemd-journal22:00:012
3126284994035,3cyclictest3307366-21kworker/u8:2+flush-8:023:26:030
3126284994032,6cyclictest3307366-21kworker/u8:2+events_unbound00:35:560
3126284994032,6cyclictest3307366-21kworker/u8:2+events_unbound00:35:550
3126284994031,7cyclictest1704890-21systemd-journal22:20:010
33251492390,6sleep3451irq_work/322:25:543
3126287993921,3cyclictest3142283-21mailstats19:21:031
3126284993930,7cyclictest3432344-21latency_hist00:15:010
3126287993820,3cyclictest0-21swapper/100:20:001
3126284993833,4cyclictest3407517-21kworker/u8:1+events_unbound00:20:020
3126284993832,5cyclictest3072456-21kworker/u8:1+events_unbound21:21:060
312600823827,6sleep10-21swapper/119:09:031
312600823827,6sleep10-21swapper/119:09:031
3126289993726,9cyclictest1704890-21systemd-journal00:06:432
3126287993729,6cyclictest3382804-21apt-get23:25:451
3126287993728,6cyclictest3242252-21latency_hist21:05:011
3126284993733,3cyclictest3272135-21kworker/u8:3+events_unbound22:00:010
3126284993728,6cyclictest3412434-21latency_hist23:55:010
3126284993727,7cyclictest3182491-21latency_hist20:05:010
3126287993615,3cyclictest0-21swapper/122:20:521
3126284993630,4cyclictest2221485-21kworker/u8:0+events_unbound22:41:040
3126284993629,6cyclictest3307366-21kworker/u8:2+events_unbound00:26:020
3126289993524,9cyclictest1704890-21systemd-journal21:17:422
3126287993525,7cyclictest3196645-21ntpq20:15:571
3126284993530,4cyclictest3182183-21kworker/u8:2+flush-8:020:20:500
3126284993530,3cyclictest3331191-21needreboot22:30:580
3126284993529,4cyclictest3151956-21ntpq19:30:590
3126284993525,8cyclictest3256381-21ntpq21:15:590
3126287993427,5cyclictest3337101-21http22:40:011
3126287993418,2cyclictest3362083-21systemd-run23:05:001
3126284993429,4cyclictest3072456-21kworker/u8:1+flush-8:020:31:020
3126284993428,4cyclictest3407517-21kworker/u8:1+flush-8:023:55:580
3126284993428,4cyclictest3282029-21latency_hist21:45:010
3126284993427,5cyclictest3367192-21cron23:10:000
3126287993324,6cyclictest1704890-21systemd-journal20:51:431
3126284993326,5cyclictest2221485-21kworker/u8:0+flush-8:020:16:040
3126287993225,5cyclictest3392111-21journal-offline23:31:331
3126287993225,5cyclictest3272421-21apt-get21:35:441
3126287993222,8cyclictest3137123-21ntpq19:15:541
3126287993215,7cyclictest3367742-21apt-get23:10:451
3126284993227,3cyclictest3418027-21cpuspeed_turbos00:00:490
3126284993226,5cyclictest3182183-21kworker/u8:2+flush-8:020:55:580
3126284993225,5cyclictest3142941-21cron19:25:010
3126284993225,5cyclictest2221485-21kworker/u8:0+flush-8:022:36:050
3126289993126,3cyclictest3148308-21aten2_r5power_v19:30:472
3126289993122,7cyclictest2221485-21kworker/u8:0+flush-8:020:16:022
3126287993125,4cyclictest3267462-21apt-get21:30:431
3126287993122,6cyclictest3347192-21latency_hist22:50:001
3126284993127,3cyclictest3126158-21kworker/u8:2+events_unbound19:26:050
3126284993126,3cyclictest3131299-21systemctl19:15:010
3126284993125,5cyclictest3072456-21kworker/u8:1+flush-8:020:06:060
3126284993123,6cyclictest3383177-21kworker/u8:0+events_unbound23:40:590
3126284993120,8cyclictest3287055-21cp21:50:000
3126284993120,8cyclictest3287055-21cp21:50:000
3126287993026,3cyclictest3126158-21kworker/u8:2+flush-8:019:30:141
3126287993024,4cyclictest3224719-21grep20:46:021
3126289992919,8cyclictest3362469-21cp23:05:012
3126289992919,8cyclictest1704890-21systemd-journal22:55:432
3126287992923,5cyclictest401-21dbus-daemon20:45:001
3126287992922,5cyclictest3407517-21kworker/u8:1+flush-8:000:25:491
3126284992925,3cyclictest0-21swapper/023:35:000
3126284992923,4cyclictest3317508-21kworker/u8:1+flush-8:023:16:060
3126284992921,6cyclictest2221485-21kworker/u8:0+flush-8:022:50:580
32064052280,3sleep00-21swapper/020:25:580
32064052280,3sleep00-21swapper/020:25:580
3126289992825,2cyclictest3351709-21unixbench_multi22:51:062
3126289992824,2cyclictest3337738-21aten2_r5power_v22:40:482
3126289992823,3cyclictest0-21swapper/222:40:002
3126289992821,5cyclictest3437541-21apt-get00:20:042
3126287992824,3cyclictest3407517-21kworker/u8:1+flush-8:000:20:351
3126287992824,2cyclictest3165212-21kthreadcore19:45:561
3126287992822,4cyclictest3427091-21unixbench_singl00:06:051
3126287992820,6cyclictest3211522-21ntpq20:30:591
3126287992816,9cyclictest3317031-21apt-get22:20:011
3126284992824,3cyclictest2221485-21kworker/u8:0+flush-8:019:51:030
3126284992823,3cyclictest2221485-21kworker/u8:0+events_unbound22:26:010
3126289992723,2cyclictest3342872-21fschecks_count22:45:492
3126287992717,8cyclictest3336221-21ntpq22:35:591
3126284992722,3cyclictest2221485-21kworker/u8:0+events_unbound19:15:010
3126284992722,3cyclictest0-21swapper/023:05:000
3126289992622,2cyclictest3317874-21fschecks_count22:20:492
3126289992622,2cyclictest3212966-21fschecks_count20:35:492
3126289992620,4cyclictest3311683-21unixbench_multi22:11:062
3126289992618,6cyclictest1704890-21systemd-journal00:02:432
3126289992618,5cyclictest1704890-21systemd-journal23:32:432
3126289992616,7cyclictest1704890-21systemd-journal19:26:452
3126287992621,3cyclictest3253390-21irqrtprio21:15:541
3126287992620,4cyclictest3397213-21unixbench_multi23:36:051
3126287992616,7cyclictest3376483-21ntpq23:16:001
3126284992621,4cyclictest2221485-21kworker/u8:0+events_unbound21:00:480
3126284992621,3cyclictest3407517-21kworker/u8:1+events_unbound00:15:500
3126284992620,4cyclictest3072456-21kworker/u8:1+events_unbound20:50:580
3126289992521,2cyclictest3161226-21kthreadcore19:40:572
3126289992520,4cyclictest2221485-21kworker/u8:0+flush-8:019:20:012
3126289992519,4cyclictest3187467-21gpgv20:10:002
3126287992521,2cyclictest0-21swapper/123:25:001
312628499258,16cyclictest3322260-21kworker/0:2+events23:11:070
3126284992521,2cyclictest3347193-21latency_hist22:50:000
3126284992521,2cyclictest0-21swapper/022:10:580
3126284992519,4cyclictest2221485-21kworker/u8:0+events_unbound19:41:010
32897052240,6sleep20-21swapper/221:50:542
3126289992421,2cyclictest3153349-21cpuspeed_turbos19:35:472
3126289992420,2cyclictest3322600-21aten2_r5power_e22:25:472
3126289992416,6cyclictest3301998-21awk22:05:002
3126289992415,7cyclictest3201503-21grep20:20:572
3126287992419,3cyclictest3302815-21cut22:05:491
3126289992319,3cyclictest3362928-21fschecks_time23:05:512
3126289992313,8cyclictest3247181-21apt-get21:10:002
3126287992319,3cyclictest3177130-21unixbench_multi19:56:041
3126287992318,3cyclictest1-21systemd19:15:001
3126287992314,6cyclictest1704890-21systemd-journal21:27:431
312628499238,13cyclictest1721456-21kworker/0:1+events21:26:200
3126287992218,2cyclictest0-21swapper/122:11:051
3126287992217,3cyclictest3282022-21turbostat.cron21:45:001
3126287992217,3cyclictest0-21swapper/122:30:011
3126287992217,3cyclictest0-21swapper/100:40:011
3126287992217,3cyclictest0-21swapper/100:40:011
3126287992216,4cyclictest401-21dbus-daemon20:25:001
3126287992215,5cyclictest3411577-21ntpq23:51:001
3126287992214,6cyclictest3072456-21kworker/u8:1+flush-8:019:35:491
3126284992214,6cyclictest3302488-21seq22:05:370
3126289992118,2cyclictest3272651-21cpuspeed_turbos21:35:532
3126289992117,3cyclictest3372898-21cpuspeed_turbos23:15:492
3126289992117,3cyclictest0-21swapper/223:24:592
3126289992117,2cyclictest0-21swapper/223:40:532
3126289992116,4cyclictest2221485-21kworker/u8:0+flush-8:019:56:012
3126289992115,4cyclictest3231995-21unixbench_singl20:51:052
312628799218,4cyclictest0-21swapper/121:23:551
312628799212,9cyclictest0-21swapper/122:50:531
3126287992118,2cyclictest0-21swapper/119:50:481
3126287992116,4cyclictest3162420-21unixbench_singl19:41:061
3126287992115,4cyclictest2221485-21kworker/u8:0+flush-8:020:35:551
3126287992113,5cyclictest0-21swapper/123:41:001
3126284992117,3cyclictest3307366-21kworker/u8:2+events_unbound00:30:470
31258512212,12sleep30-21swapper/319:07:013
31258512212,12sleep30-21swapper/319:07:003
3126289992017,2cyclictest3402961-21aten2_r5power_v23:45:482
3126289992017,2cyclictest3327722-21cpuspeed_turbos22:30:492
3126289992017,2cyclictest3242253-21cron21:04:592
3126289992017,2cyclictest3126728-21fschecks_count19:10:462
3126289992016,3cyclictest3182481-21cron20:04:592
3126289992016,2cyclictest0-21swapper/200:15:012
3126289992015,3cyclictest3138638-21fschecks_count19:20:492
3126289992014,4cyclictest3417417-21idleruntime-cro00:00:002
3126289992012,6cyclictest3278144-21sed21:40:572
3126287992016,3cyclictest3291485-21mailstats21:51:031
3126287992016,2cyclictest0-21swapper/120:00:511
3126287992015,3cyclictest3145549-21kthreadcore19:25:551
3126287992010,7cyclictest3352427-21apt-get22:55:461
312628799200,18cyclictest1-21systemd21:00:011
312628999192,12cyclictest3367201-21apt-get23:10:032
312628999192,12cyclictest3257619-21apt-get21:20:482
3126289991916,2cyclictest3232776-21aten2_r5power_v20:55:462
3126289991915,3cyclictest3452955-21aten2_r5power_c00:35:472
3126289991915,3cyclictest3452955-21aten2_r5power_c00:35:462
3126289991915,3cyclictest3208268-21irqcore20:30:522
3126289991915,2cyclictest3452229-21grep00:31:052
3126289991913,5cyclictest3172236-21unixbench_singl19:51:052
3126287991915,2cyclictest0-21swapper/100:05:011
31218122193,9sleep20-21swapper/219:05:472
31218122193,9sleep20-21swapper/219:05:472
320486921814,2sleep2371rcuc/220:25:572
320486921814,2sleep2371rcuc/220:25:572
3126289991815,2cyclictest3408072-21fschecks_count23:50:502
3126289991813,4cyclictest0-21swapper/222:16:042
34567102177,6sleep30-21swapper/300:36:003
34567102177,6sleep30-21swapper/300:36:003
33474972177,6sleep30-21swapper/322:50:463
3126289991714,2cyclictest3267146-21cron21:30:002
3126289991713,2cyclictest0-21swapper/222:05:492
3126289991712,3cyclictest0-21swapper/220:10:562
3126284991712,3cyclictest3126311-21latency_hist19:10:010
3126284991712,3cyclictest3126311-21latency_hist19:10:010
32869432165,7sleep30-21swapper/321:50:003
32869432165,7sleep30-21swapper/321:49:593
312628999168,6cyclictest3221819-21sed20:41:052
3126289991613,2cyclictest0-21swapper/219:45:072
3126289991612,2cyclictest0-21swapper/221:30:472
3126289991612,2cyclictest0-21swapper/200:15:562
312628999161,11cyclictest3382270-21apt-get23:25:032
312628999159,4cyclictest3446698-21cut00:25:552
34075242132,6sleep30-21swapper/323:50:023
33073282132,6sleep30-21swapper/322:10:023
32672992132,6sleep30-21swapper/321:30:023
32648422132,6sleep30-21swapper/321:25:573
31717112132,7sleep30-21swapper/319:50:593
34438132122,6sleep30-21swapper/300:25:523
34380652122,6sleep30-21swapper/300:20:443
34346722120,8sleep30-21swapper/300:15:543
34226752122,6sleep30-21swapper/300:05:033
34178592122,6sleep30-21swapper/300:00:493
34064132122,6sleep30-21swapper/323:45:573
33994772122,6sleep30-21swapper/323:40:553
33906012122,6sleep30-21swapper/323:30:563
33839452122,6sleep30-21swapper/323:25:543
33526692122,6sleep30-21swapper/322:55:493
33376312122,6sleep30-21swapper/322:40:483
33170642122,5sleep30-21swapper/322:20:023
33159072122,6sleep30-21swapper/322:15:563
33060932122,6sleep30-21swapper/322:05:573
33017332123,6sleep30-21swapper/322:01:513
32967072122,6sleep30-21swapper/321:56:063
32912922122,6sleep30-21swapper/321:51:003
32578632122,6sleep30-21swapper/321:20:503
32548102123,5sleep30-21swapper/321:15:573
32476962122,6sleep30-21swapper/321:10:443
32423272122,6sleep30-21swapper/321:05:023
32370272122,6sleep30-21swapper/320:56:433
32265652122,7sleep30-21swapper/320:46:123
32173502122,6sleep30-21swapper/320:40:023
32122562122,6sleep30-21swapper/320:33:433
32068142122,6sleep30-21swapper/320:26:063
32068142122,6sleep30-21swapper/320:26:063
31982992122,6sleep30-21swapper/320:20:513
31827652122,6sleep30-21swapper/320:05:423
31775802122,5sleep30-21swapper/320:00:023
31728792122,6sleep30-21swapper/319:55:443
31657712122,6sleep30-21swapper/319:45:573
31624912122,6sleep30-21swapper/319:41:443
31528402122,5sleep30-21swapper/319:35:023
31477722122,6sleep30-21swapper/319:28:443
31315912122,6sleep30-21swapper/319:15:023
31264352122,6sleep30-21swapper/319:10:423
34276612112,5sleep30-21swapper/300:10:073
34127052112,6sleep30-21swapper/323:55:393
33929082112,5sleep30-21swapper/323:35:453
33786332112,5sleep30-21swapper/323:20:563
33729352112,5sleep30-21swapper/323:15:513
33720972112,6sleep30-21swapper/323:11:383
33663062112,6sleep30-21swapper/323:05:593
33573012112,5sleep30-21swapper/323:00:023
33422932112,5sleep30-21swapper/322:45:013
33323532112,5sleep30-21swapper/322:35:023
33313942112,5sleep30-21swapper/322:31:053
32743332112,6sleep30-21swapper/321:35:593
32375802112,6sleep30-21swapper/321:00:373
32279572112,5sleep30-21swapper/320:50:503
31928372112,5sleep30-21swapper/320:15:023
31882402112,5sleep30-21swapper/320:10:533
31385972112,5sleep30-21swapper/319:20:493
32125972102,5sleep30-21swapper/320:35:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional