You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 13:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Thu Jun 11, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32502812750,4chrt0-21swapper/123:35:361
2982887996240,20cyclictest3227216-21ntpq23:10:400
2982887996036,21cyclictest3083455-21ntpq20:45:410
30944472580,5chrt0-21swapper/021:00:010
2982889995747,7cyclictest3104355-21kworker/u8:1+flush-8:021:25:431
2982889995746,7cyclictest3009492-21kworker/u8:1+flush-8:019:45:421
2982887995534,18cyclictest3193472-21latency_hist22:40:010
2982889995346,5cyclictest2999896-21kworker/u8:0+events_unbound19:40:431
2982889995245,5cyclictest2999896-21kworker/u8:0+flush-8:020:45:441
2982889995146,4cyclictest3104355-21kworker/u8:1+flush-8:021:15:471
2982889995141,7cyclictest2999896-21kworker/u8:0+flush-8:021:05:451
2982889994942,5cyclictest1606356-21kworker/u8:0+events_unbound19:10:411
2982889994941,6cyclictest3069531-21kworker/u8:2+flush-8:021:00:411
29890492470,3sleep375-21kworker/3:1-events19:15:023
2982889994742,4cyclictest2972922-21kworker/u8:3+flush-8:023:55:411
2982889994742,3cyclictest3069531-21kworker/u8:2+flush-8:020:35:421
2982889994741,5cyclictest2972922-21kworker/u8:3+flush-8:020:55:411
2982889994738,7cyclictest3132957-21ntpq21:35:401
2982889994641,4cyclictest2972922-21kworker/u8:3+events_unbound23:20:441
2982889994639,5cyclictest3242717-21kworker/u8:2+events_unbound00:35:421
2982889994639,5cyclictest3242717-21kworker/u8:2+events_unbound00:35:411
2982889994634,9cyclictest1704890-21systemd-journal22:15:531
2982887994636,8cyclictest3272028-21ntpq23:55:410
2982889994540,3cyclictest3166137-21kworker/u8:1+events_unbound22:40:311
2982889994539,4cyclictest3272906-21kworker/u8:1+events_unbound00:05:411
2982889994539,4cyclictest3272906-21kworker/u8:1+events_unbound00:05:401
2982889994538,5cyclictest3242717-21kworker/u8:2+flush-8:000:20:431
2982889994537,6cyclictest3272906-21kworker/u8:1+events_unbound00:30:431
2982889994537,6cyclictest3009492-21kworker/u8:1+flush-8:020:20:311
2982889994534,8cyclictest3013858-21ntpq19:35:421
2982887994534,9cyclictest2986795-21ntpq19:10:400
298288799451,41cyclictest583-21snmpd22:05:420
2982889994440,3cyclictest3009492-21kworker/u8:1+events_unbound19:50:471
2982889994440,3cyclictest3009492-21kworker/u8:1+events_unbound19:50:471
2982889994439,4cyclictest3113724-21kworker/u8:2+flush-8:021:40:321
2982889994439,4cyclictest3113724-21kworker/u8:2+flush-8:021:40:321
2982889994439,4cyclictest2999896-21kworker/u8:0+events_unbound20:05:511
2982889994439,4cyclictest2972922-21kworker/u8:3+flush-8:022:00:301
2982889994436,6cyclictest3198124-21kworker/u8:0+flush-8:023:05:421
2982889994434,8cyclictest3173727-21/usr/sbin/munin22:20:431
2982889994339,3cyclictest2972922-21kworker/u8:3+flush-8:022:10:321
2982887994333,7cyclictest3064355-21apt-get20:30:010
298288799430,24cyclictest3108888-21sshd21:12:530
2982889994235,5cyclictest3198124-21kworker/u8:0+events_unbound23:00:411
2982889994234,6cyclictest3152789-21ntpq21:55:411
2982889994136,4cyclictest3198124-21kworker/u8:0+events_unbound23:15:441
2982889994135,4cyclictest3166137-21kworker/u8:1+events_unbound22:35:411
2982887994131,7cyclictest3014731-21latency_hist19:40:010
2982889994035,4cyclictest2972922-21kworker/u8:3+events_unbound23:40:401
2982889994035,3cyclictest3113724-21kworker/u8:2+flush-8:021:45:421
2982889994034,4cyclictest3242717-21kworker/u8:2+events_unbound23:30:491
2982889994034,4cyclictest2999896-21kworker/u8:0+events_unbound20:10:471
2982889994034,4cyclictest2972922-21kworker/u8:3+events_unbound22:50:451
2982889994032,6cyclictest3286884-21ntpq00:10:421
2982887994019,18cyclictest1704890-21systemd-journal19:45:000
2982889993933,4cyclictest3166137-21kworker/u8:1+flush-8:022:30:471
2982889993932,5cyclictest2972922-21kworker/u8:3+flush-8:023:50:441
2982889993932,5cyclictest2972922-21kworker/u8:3+flush-8:020:30:371
2982887993920,17cyclictest3100068-21sed21:05:350
2982887993919,17cyclictest3238288-21apt-config23:25:000
2982889993832,4cyclictest3113724-21kworker/u8:2+flush-8:021:30:411
2982889993832,4cyclictest3113724-21kworker/u8:2+events_unbound21:20:421
2982889993828,8cyclictest3108159-21ntpq21:10:431
298288799372,29cyclictest2987935-21kworker/0:1+events20:00:290
298288799372,10cyclictest3278183-21taskset00:05:290
298288799372,10cyclictest3278183-21taskset00:05:280
2982887993720,15cyclictest3055319-21irqcore20:20:350
2982887993720,15cyclictest2989807-21cut19:15:040
2982887993718,2cyclictest0-21swapper/022:35:000
2982887993718,17cyclictest3098821-21grep21:00:480
2982887993717,2cyclictest0-21swapper/021:40:390
2982887993717,2cyclictest0-21swapper/021:40:390
2982887993715,3cyclictest0-21swapper/019:34:530
31604962360,2sleep3481ktimers/322:05:373
2982889993632,3cyclictest3009492-21kworker/u8:1+events_unbound20:00:361
2982889993631,4cyclictest3198124-21kworker/u8:0+events_unbound22:55:361
2982889993630,4cyclictest3242717-21kworker/u8:2+events_unbound00:25:431
2982889993630,4cyclictest2972922-21kworker/u8:3+flush-8:020:15:431
298288799362,9cyclictest589-21runrttasks22:00:280
2982887993626,8cyclictest3266993-21ntpq23:50:420
2982887993619,15cyclictest3088953-21unixbench_singl20:50:490
2982887993617,3cyclictest3029835-21systemd-run19:55:000
2982887993617,3cyclictest3029835-21systemd-run19:55:000
2982887993617,2cyclictest0-21swapper/020:30:380
2982887993616,8cyclictest3048688-21ntpq20:10:400
2982887993616,2cyclictest3203384-21turbostat.cron22:50:000
2982887993615,3cyclictest0-21swapper/021:37:530
2982889993530,3cyclictest3207482-21kworker/u8:1+events_unbound23:10:321
2982889993529,4cyclictest3273199-21apt-get00:00:291
2982887993526,7cyclictest3114603-21diskstats21:20:320
2982887993517,3cyclictest0-21swapper/000:10:310
2982889993430,3cyclictest3166137-21kworker/u8:1+flush-8:022:25:311
2982889993430,3cyclictest2999896-21kworker/u8:0+events_unbound20:00:001
2982889993427,5cyclictest3242717-21kworker/u8:2+flush-8:000:15:421
2982889993427,5cyclictest3242717-21kworker/u8:2+flush-8:000:15:411
2982887993415,3cyclictest0-21swapper/000:00:070
2982887993414,2cyclictest0-21swapper/023:15:370
2982889993331,1cyclictest3207482-21kworker/u8:1+flush-8:023:25:451
2982889993329,3cyclictest2999896-21kworker/u8:0+events_unbound20:40:291
2982889993329,3cyclictest2990143-21kworker/u8:2+events_unbound19:25:351
2982887993323,8cyclictest3078559-21ntpq20:40:410
2982887993316,2cyclictest3243660-21cpuspeed23:30:320
2982887993314,4cyclictest3053897-21switchtime20:15:480
2982889993227,4cyclictest2972922-21kworker/u8:3+flush-8:022:05:371
2982889993227,3cyclictest2951310-21kworker/u8:1+events_unbound19:15:041
2982889993224,6cyclictest3063433-21ntpq20:25:401
2982887993214,4cyclictest3294518-21kthreadcore00:20:370
2982887993213,2cyclictest0-21swapper/021:30:010
29826682324,9sleep20-21swapper/219:09:492
2982889993125,4cyclictest2972922-21kworker/u8:3+events_unbound20:50:421
2982887993122,7cyclictest3217314-21ntpq23:00:410
298288799311,28cyclictest3178447-21true22:25:010
2982887993112,6cyclictest3044791-21ls20:10:020
2982889993026,3cyclictest3203407-21systemd-run22:50:011
2982889993021,7cyclictest3147847-21ntpq21:50:421
2982887993020,8cyclictest3003928-21ntpq19:25:400
2982887993011,5cyclictest3221533-21tr23:05:380
31490512290,2sleep3481ktimers/321:55:303
298288799297,17cyclictest3287709-21kworker/0:0+events00:40:010
298288799297,17cyclictest3287709-21kworker/0:0+events00:40:010
2982887992922,5cyclictest3308047-21latency_hist00:35:000
2982887992919,8cyclictest3257126-21ntpq23:40:410
2982892992825,2cyclictest3293323-21aten2_r5power_e00:20:302
2982892992821,5cyclictest1704890-21systemd-journal23:40:002
2982889992822,5cyclictest2972922-21kworker/u8:3+events_unbound19:30:301
2982887992823,4cyclictest3069531-21kworker/u8:2+flush-8:020:35:580
2982887992818,8cyclictest3208875-21diskstats22:55:330
30721472270,2sleep3471rcuc/320:35:353
30548862270,6sleep20-21swapper/220:20:292
2982892992721,4cyclictest2988256-21apt-key19:15:022
2982892992716,8cyclictest3015179-21cat19:40:002
2982892992623,2cyclictest3199021-21fschecks_count22:45:322
2982889992622,3cyclictest3242717-21kworker/u8:2+events_unbound23:45:341
2982887992621,3cyclictest20977-21cron00:20:010
2982887992621,3cyclictest20977-21cron00:20:000
2982887992619,5cyclictest3302870-21apt-get00:30:000
32475942250,3sleep375-21kworker/3:1+events23:30:483
31680462250,2sleep3481ktimers/322:10:463
2982892992522,2cyclictest3144366-21fschecks_count21:50:312
2982892992521,2cyclictest3203777-21aten2_r5power_v22:50:292
2982892992521,2cyclictest3089696-21aten2_r5power_p20:55:302
2982892992518,5cyclictest3298812-21sed00:25:342
2982892992517,6cyclictest3167513-21grep22:10:392
2982892992517,6cyclictest3122991-21grep21:25:392
298288799258,15cyclictest3109104-21kworker/0:0+events21:45:440
298288799257,17cyclictest3213318-21kworker/0:1+events23:50:010
298288799252,11cyclictest3168771-21apt-get22:15:280
2982892992421,2cyclictest3173783-21aten2_r5power_c22:20:302
2982892992421,2cyclictest3109382-21aten2_r5power_c21:15:302
2982892992421,2cyclictest3034356-21unixbench_singl19:55:482
2982892992421,2cyclictest3029421-21unixbench_singl19:50:492
2982892992421,2cyclictest3029421-21unixbench_singl19:50:482
2982889992420,3cyclictest2990143-21kworker/u8:2+events_unbound19:20:321
298288799245,18cyclictest2977825-21kworker/0:2+events19:10:010
2982887992419,3cyclictest3030684-21irqcore19:55:340
2982887992418,4cyclictest0-21swapper/021:30:270
2982887992416,6cyclictest3023989-21ntpq19:45:420
2982892992320,2cyclictest3208738-21aten2_r5power_v22:55:302
2982892992320,2cyclictest3139412-21fschecks_count21:45:332
2982892992319,3cyclictest3040216-21cpuspeed_turbos20:05:322
2982892992319,2cyclictest0-21swapper/220:30:012
2982892992318,4cyclictest1704890-21systemd-journal19:15:022
2982892992318,3cyclictest3282388-21unixbench_multi00:05:482
2982892992318,3cyclictest3282388-21unixbench_multi00:05:482
2982887992319,2cyclictest0-21swapper/022:45:010
2982887992318,3cyclictest3238014-21apt-get23:25:030
2982887992316,3cyclictest0-21swapper/021:15:290
2982892992219,2cyclictest3308613-21fschecks_count00:35:322
2982892992219,2cyclictest3308613-21fschecks_count00:35:312
2982892992219,2cyclictest3104504-21aten2_r5power_v21:10:322
2982892992218,2cyclictest0-21swapper/200:00:002
2982892992216,4cyclictest3188299-21gpgv22:35:012
2982892992210,4cyclictest0-21swapper/200:00:292
298288799227,14cyclictest3213318-21kworker/0:1+events23:37:260
2982887992217,3cyclictest3164757-21sed22:10:350
298289299216,2cyclictest31942392iwlist22:40:352
2982892992118,2cyclictest3005409-21fschecks_count19:30:322
2982892992116,3cyclictest0-21swapper/223:25:012
2982887992117,3cyclictest3153263-21unixbench_multi21:55:480
2982887992117,2cyclictest0-21swapper/021:55:010
29823782214,11sleep10-21swapper/119:06:021
2982892992016,2cyclictest3163116-21unixbench_multi22:05:472
2982892992016,2cyclictest0-21swapper/223:15:382
2982892992016,2cyclictest0-21swapper/200:20:012
2982892992016,2cyclictest0-21swapper/200:20:012
2982892992014,5cyclictest3198124-21kworker/u8:0+flush-8:023:25:252
2982892992013,5cyclictest0-21swapper/223:40:352
2982892992010,2cyclictest0-21swapper/220:45:442
2982887992016,3cyclictest0-21swapper/019:20:360
29818832203,9sleep30-21swapper/319:05:433
298289299197,4cyclictest0-21swapper/219:40:022
2982892991915,3cyclictest3079462-21idleruntime-cro20:45:002
2982892991915,2cyclictest0-21swapper/200:10:342
2982892991914,4cyclictest3054581-21sort20:20:012
2982892991914,3cyclictest0-21swapper/221:40:302
2982892991914,3cyclictest0-21swapper/221:40:292
2982892991911,6cyclictest3220388-21tr23:05:382
30858632180,2chrt75-21kworker/3:1+events20:50:373
298289299183,3cyclictest31935932sed22:40:002
298289299182,15cyclictest0-21swapper/221:39:312
2982892991814,2cyclictest0-21swapper/223:03:592
2982892991814,2cyclictest0-21swapper/222:15:442
2982892991814,2cyclictest0-21swapper/221:00:362
2982892991814,2cyclictest0-21swapper/219:30:002
2982892991810,6cyclictest0-21swapper/222:25:302
31210032177,6sleep30-21swapper/321:25:363
30673222170,2sleep20-21swapper/220:30:382
298289299172,11cyclictest3124246-21apt-get21:30:282
2982892991713,2cyclictest0-21swapper/223:10:272
2982892991713,2cyclictest0-21swapper/220:35:452
2982892991713,2cyclictest0-21swapper/219:45:312
2982892991712,3cyclictest0-21swapper/222:00:012
2982892991712,3cyclictest0-21swapper/220:54:592
298288799178,6cyclictest3182472-21chrt22:25:410
298288799171,12cyclictest0-21swapper/022:50:290
33028592164,8sleep30-21swapper/300:30:013
32234422162,9sleep30-21swapper/323:10:263
298289299168,6cyclictest2997615-21tr19:20:382
298289299167,7cyclictest3243758-21sort23:30:332
2982892991613,2cyclictest0-21swapper/223:50:112
2982892991613,2cyclictest0-21swapper/222:03:222
2982892991613,2cyclictest0-21swapper/221:08:482
2982892991612,2cyclictest0-21swapper/220:00:392
2982892991611,4cyclictest0-21swapper/221:20:322
2982892991611,3cyclictest0-21swapper/220:10:362
2982892991610,4cyclictest0-21swapper/223:45:392
31291832152,9sleep30-21swapper/321:35:293
2982892991511,2cyclictest0-21swapper/200:30:312
32778812132,6sleep30-21swapper/300:05:003
32391182131,8sleep30-21swapper/323:25:363
32033692130,8sleep30-21swapper/322:50:013
31247302132,7sleep30-21swapper/321:30:353
30954292132,7sleep30-21swapper/321:00:373
30337832134,6sleep30-21swapper/319:55:403
33117312122,6sleep30-21swapper/300:35:393
33117312122,6sleep30-21swapper/300:35:383
32975642122,6sleep30-21swapper/300:20:503
32889562122,6sleep30-21swapper/300:15:363
32889562122,6sleep30-21swapper/300:15:363
32721222122,6sleep30-21swapper/323:55:463
32524672122,6sleep30-21swapper/323:35:473
32332882122,6sleep30-21swapper/323:20:023
32283852122,6sleep30-21swapper/323:15:283
32084172122,6sleep30-21swapper/322:55:013
32040102122,6sleep30-21swapper/322:50:333
31890362122,6sleep30-21swapper/322:35:323
31760442122,6sleep30-21swapper/322:20:393
31449632122,6sleep30-21swapper/321:50:363
31418332122,6sleep30-21swapper/321:45:403
31183502122,6sleep30-21swapper/321:20:483
31132562122,6sleep30-21swapper/321:15:463
31040872123,6sleep30-21swapper/321:10:003
30935962122,6sleep30-21swapper/320:55:473
30828442122,6sleep30-21swapper/320:45:413
30752832122,6sleep30-21swapper/320:40:353
30556462122,6sleep30-21swapper/320:20:353
30486642122,6sleep30-21swapper/320:10:413
30412672122,6sleep30-21swapper/320:05:393
30273682123,6sleep30-21swapper/319:50:383
30273682123,6sleep30-21swapper/319:50:383
30199532122,5sleep30-21swapper/319:45:013
30099672122,6sleep30-21swapper/319:35:013
29841242122,6sleep30-21swapper/319:10:383
33058552112,5sleep30-21swapper/300:30:373
32835292112,6sleep30-21swapper/300:10:333
32819932112,5sleep30-21swapper/300:05:453
32819932112,5sleep30-21swapper/300:05:453
32676172112,6sleep30-21swapper/323:51:123
32582842112,5sleep30-21swapper/323:45:013
32579712112,6sleep30-21swapper/323:44:023
32182182112,5sleep30-21swapper/323:05:013
32170522112,5sleep30-21swapper/323:00:403
31940332112,5sleep30-21swapper/322:40:333
31834462112,5sleep30-21swapper/322:30:023
31824382112,5sleep30-21swapper/322:25:403
31690212112,5sleep30-21swapper/322:15:333
31576532112,5sleep30-21swapper/322:00:413
31341302112,6sleep30-21swapper/321:40:063
31341302112,6sleep30-21swapper/321:40:053
31044082112,6sleep30-21swapper/321:10:323
30648412112,5sleep30-21swapper/320:30:283
30601392112,5sleep30-21swapper/320:25:343
30497952112,5sleep30-21swapper/320:15:033
30360082112,6sleep30-21swapper/320:00:383
30152402112,5sleep30-21swapper/319:40:283
30050832112,6sleep30-21swapper/319:30:203
30001022112,5sleep30-21swapper/319:25:033
29988182112,5sleep30-21swapper/319:20:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional