You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 23:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Jul 15, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
365310821740,2sleep3584-21kworker/3:2+events09:17:313
3526041996556,7cyclictest3672127-21kworker/u8:3+events_unbound09:42:420
3526041996457,6cyclictest3657044-21kworker/u8:0+events_unbound09:25:000
3526041996255,5cyclictest3785476-21kworker/u8:1+events_unbound11:30:000
3526045996054,5cyclictest3691500-21kworker/u8:3+events_unbound11:32:411
3526041995953,4cyclictest3547698-21kworker/u8:3+events_unbound08:40:000
3526041995853,4cyclictest3801312-21kworker/u8:1+flush-8:012:32:430
3526041995852,4cyclictest3553012-21kworker/u8:0+events_unbound07:45:000
3526041995852,4cyclictest3553012-21kworker/u8:0+events_unbound07:45:000
3526045995753,3cyclictest3716521-21kworker/u8:4+events_unbound10:25:001
35319472560,5sleep3481ktimers/307:15:023
3526045995345,6cyclictest3855710-21latency_hist12:40:011
3526041995349,3cyclictest3701395-21kworker/u8:0+events_unbound10:17:430
3526041995347,5cyclictest3691500-21kworker/u8:3+events_unbound11:20:010
3526041995347,4cyclictest3691500-21kworker/u8:3+flush-8:012:07:330
3526041995347,4cyclictest3691500-21kworker/u8:3+flush-8:012:07:330
3526041995341,4cyclictest3647130-21kworker/u8:1+events_unbound09:52:290
3526041995247,4cyclictest3751727-21kworker/u8:4+flush-8:011:02:440
3526041995246,4cyclictest3511205-21kworker/u8:2+events_unbound07:27:420
3526041995245,6cyclictest3791095-21kworker/u8:0+flush-8:011:42:450
3526041995045,3cyclictest3641975-21kworker/u8:2+events_unbound09:32:270
3526041995045,3cyclictest3562613-21kworker/u8:1+events_unbound08:27:430
3526041995043,6cyclictest3751727-21kworker/u8:4+flush-8:011:22:440
36555502490,2chrt371rcuc/209:17:342
3526041994843,3cyclictest3547698-21kworker/u8:3+events_unbound07:32:320
3526041994843,3cyclictest3511205-21kworker/u8:2+flush-8:007:22:350
3526045994742,4cyclictest3511205-21kworker/u8:2+flush-8:007:27:291
3526041994741,5cyclictest3791095-21kworker/u8:0+events_unbound11:55:000
3526041994739,6cyclictest3637646-21/usr/sbin/munin09:02:440
3526041994642,3cyclictest3547698-21kworker/u8:3+events_unbound07:47:420
3526041994637,7cyclictest3622184-21latency_hist08:45:010
3526041994637,3cyclictest3547698-21kworker/u8:3+events_unbound08:34:530
37194692450,4sleep3584-21kworker/3:2-events10:22:353
3526045994540,4cyclictest3612041-21kworker/u8:0+flush-8:008:37:391
3526045994540,4cyclictest3612041-21kworker/u8:0+events_unbound09:07:261
3526045994539,5cyclictest3647130-21kworker/u8:1+flush-8:009:17:291
3526041994542,2cyclictest3572506-21kworker/u8:2+events_unbound08:45:530
3526041994540,4cyclictest3657044-21kworker/u8:0+flush-8:009:37:280
3526041994540,3cyclictest3691500-21kworker/u8:3+events_unbound11:37:290
3526041994535,5cyclictest3278130-21kworker/u8:1+events_unbound07:12:430
3526041994440,3cyclictest3801312-21kworker/u8:1+flush-8:012:25:030
3526041994440,3cyclictest3647130-21kworker/u8:1+flush-8:009:27:440
3526041994440,3cyclictest3572506-21kworker/u8:2+events_unbound08:15:020
3526041994440,3cyclictest3562613-21kworker/u8:1+events_unbound08:07:310
3526041994439,3cyclictest3791095-21kworker/u8:0+events_unbound11:47:320
3526041994438,4cyclictest3612041-21kworker/u8:0+events_unbound09:00:000
3526041994437,5cyclictest3801312-21kworker/u8:1+events_unbound12:37:390
3526041994435,3cyclictest3691500-21kworker/u8:3+events_unbound11:06:230
3526041994339,3cyclictest3731470-21kworker/u8:1+events_unbound10:37:250
3526041994339,3cyclictest3572506-21kworker/u8:2+events_unbound08:12:280
3526041994338,3cyclictest3641975-21kworker/u8:2+events_unbound09:07:310
3526045994237,4cyclictest3547698-21kworker/u8:3+flush-8:008:57:311
3526041994237,4cyclictest3716521-21kworker/u8:4+flush-8:010:32:440
3526041994236,4cyclictest3691500-21kworker/u8:3+events_unbound12:02:310
3526041994236,4cyclictest3562613-21kworker/u8:1+events_unbound07:52:410
3526041994233,3cyclictest3691500-21kworker/u8:3+events_unbound11:57:350
3526041994232,3cyclictest3681609-21kworker/u8:2+events_unbound10:02:320
3526041994231,4cyclictest3681609-21kworker/u8:2+events_unbound09:47:380
3526050994135,4cyclictest3647130-21kworker/u8:1+flush-8:009:12:372
3526045994137,3cyclictest3691500-21kworker/u8:3+flush-8:011:12:351
3526045994137,3cyclictest3691500-21kworker/u8:3+flush-8:011:12:351
3526045994134,5cyclictest3657460-21apt-get09:22:241
3526045994133,6cyclictest3548079-21/usr/sbin/munin07:32:421
3526045994133,4cyclictest3691500-21kworker/u8:3+events_unbound10:07:291
3526041994137,3cyclictest3766353-21kworker/u8:1+flush-8:011:12:470
3526041994137,3cyclictest3766353-21kworker/u8:1+flush-8:011:12:470
3526041994137,3cyclictest3681609-21kworker/u8:2+flush-8:010:07:440
3526041994137,3cyclictest3547698-21kworker/u8:3+events_unbound07:36:540
3526041994136,3cyclictest3647130-21kworker/u8:1+events_unbound09:17:270
3526041994129,4cyclictest3547698-21kworker/u8:3+events_unbound08:22:000
3526041994036,3cyclictest3826359-21kworker/u8:2+flush-8:012:12:300
3526041994036,3cyclictest3751727-21kworker/u8:4+flush-8:010:57:450
3526041994035,4cyclictest3547698-21kworker/u8:3+flush-8:008:02:390
3526041994034,5cyclictest3835144-21kworker/u8:0+events_unbound12:22:410
3526041994031,3cyclictest3716521-21kworker/u8:4+events_unbound10:22:420
3526045993934,4cyclictest3612041-21kworker/u8:0+flush-8:008:52:301
3526045993931,5cyclictest281-21systemd-journal08:47:521
3526041993935,3cyclictest3731470-21kworker/u8:1+events_unbound10:42:520
3526041993933,4cyclictest3612041-21kworker/u8:0+events_unbound08:54:530
3526045993831,5cyclictest281-21systemd-journal10:57:521
3526045993830,6cyclictest3716521-21kworker/u8:4+events_unbound10:32:391
3526041993834,3cyclictest3731470-21kworker/u8:1+flush-8:010:52:530
3526041993833,4cyclictest3681609-21kworker/u8:2+flush-8:010:12:440
3526041993828,4cyclictest3701395-21kworker/u8:0+events_unbound10:27:350
3526050993729,6cyclictest281-21systemd-journal10:21:512
3526050993728,7cyclictest281-21systemd-journal09:40:012
3526045993733,3cyclictest3647130-21kworker/u8:1+events_unbound09:57:331
3526045993733,3cyclictest3547698-21kworker/u8:3+flush-8:009:02:291
3526045993726,9cyclictest3587333-21apt-get08:10:011
3526041993732,3cyclictest3511205-21kworker/u8:2+events_unbound07:17:370
3526041993728,6cyclictest3731470-21kworker/u8:1+events_unbound10:47:280
3526045993632,3cyclictest3278130-21kworker/u8:1+events_unbound07:15:011
3526045993531,3cyclictest3553012-21kworker/u8:0+flush-8:007:37:451
3526045993530,4cyclictest3791095-21kworker/u8:0+events_unbound11:47:281
3526045993530,4cyclictest3511205-21kworker/u8:2+flush-8:007:17:391
3526045993528,5cyclictest3672127-21kworker/u8:3+flush-8:009:42:441
3526050993425,7cyclictest281-21systemd-journal08:25:002
3526045993428,4cyclictest3836308-21apt-get12:22:251
3526045993427,5cyclictest3647130-21kworker/u8:1+events_unbound09:52:331
3526045993426,6cyclictest3761818-21/usr/sbin/munin11:07:351
3526041993428,4cyclictest3647130-21kworker/u8:1+events_unbound09:57:270
3526045993327,5cyclictest3641975-21kworker/u8:2+flush-8:009:32:391
3526045993327,4cyclictest3766353-21kworker/u8:1+flush-8:011:17:301
3526045993325,5cyclictest281-21systemd-journal11:25:521
3526045993228,3cyclictest3691500-21kworker/u8:3+flush-8:010:40:311
3526045993227,4cyclictest3731470-21kworker/u8:1+events_unbound10:47:301
3526045993227,3cyclictest3547698-21kworker/u8:3+flush-8:008:24:041
3526045993226,5cyclictest3701395-21kworker/u8:0+events_unbound10:17:331
3526045993224,3cyclictest3681609-21kworker/u8:2+events_unbound10:15:001
3526045993223,7cyclictest3747671-21irqrtprio10:52:321
3526041993228,3cyclictest3547698-21kworker/u8:3+events_unbound07:55:460
3526041993227,4cyclictest3691500-21kworker/u8:3+flush-8:012:15:200
3526041993225,5cyclictest3526044-21latency_hist07:10:010
352537923226,3sleep13525540-21timerwakeupswit07:07:431
3526050993126,4cyclictest3691500-21kworker/u8:3+events_unbound09:55:012
3526045993125,5cyclictest3681609-21kworker/u8:2+flush-8:010:00:311
3526045993121,8cyclictest3596663-21ntpq08:17:381
3526045993118,5cyclictest3547698-21kworker/u8:3+events_unbound07:47:461
3526041993123,3cyclictest3641975-21kworker/u8:2+events_unbound09:10:510
3526050993025,4cyclictest3741298-21unixbench_multi10:42:462
3526050993022,6cyclictest3702025-21cat10:05:012
3526050993021,7cyclictest3542452-21unixbench_multi07:22:462
3526045993026,3cyclictest3681609-21kworker/u8:2+events_unbound09:47:321
3526045993025,3cyclictest3846811-21irqcore12:32:321
3526045993025,3cyclictest3674458-21kthreadcore09:37:331
3526045993024,5cyclictest3691500-21kworker/u8:3+flush-8:011:37:351
3526045993023,5cyclictest3731470-21kworker/u8:1+flush-8:010:37:371
3526041993022,3cyclictest3751727-21kworker/u8:4+events_unbound11:33:430
3526050992925,3cyclictest3766353-21kworker/u8:1+flush-8:011:17:352
3526050992925,2cyclictest3816765-21cpuspeed_turbos12:02:282
3526050992925,2cyclictest3786153-21cron11:30:002
3526045992925,3cyclictest3691500-21kworker/u8:3+flush-8:012:07:361
3526045992925,3cyclictest3691500-21kworker/u8:3+flush-8:012:07:351
3526045992925,3cyclictest3511205-21kworker/u8:2+flush-8:007:22:451
3526045992925,2cyclictest3590143-21kthreadcore08:12:351
3526045992924,4cyclictest3562613-21kworker/u8:1+events_unbound08:27:281
3526045992922,5cyclictest3611501-21ntpq08:32:381
3526045992919,5cyclictest3641975-21kworker/u8:2+events_unbound09:12:351
3526045992912,9cyclictest0-21swapper/109:25:061
3526050992824,2cyclictest3806717-21aten2_r5power_e11:52:272
3526050992824,2cyclictest3632248-21cron08:55:012
3526050992823,4cyclictest3661484-21switchtime09:22:452
3526045992824,3cyclictest3751727-21kworker/u8:4+flush-8:011:03:201
3526045992823,3cyclictest3791095-21kworker/u8:0+flush-8:011:52:491
3526045992822,5cyclictest3562613-21kworker/u8:1+flush-8:007:57:391
3526050992724,2cyclictest3846511-21fschecks_count12:32:292
3526050992724,2cyclictest3732393-21fschecks_time10:37:272
3526050992724,2cyclictest3637783-21aten2_r5power_v09:02:272
3526050992724,2cyclictest3626822-21unixbench_multi08:47:452
3526045992723,3cyclictest3791095-21kworker/u8:0+events_unbound11:57:411
3526045992721,4cyclictest3826359-21kworker/u8:2+events_unbound12:12:321
3526045992721,4cyclictest281-21systemd-journal11:40:531
3526045992619,5cyclictest3691500-21kworker/u8:3+flush-8:012:02:401
3526045992618,5cyclictest3781233-21latency_hist11:25:011
3526050992522,2cyclictest3677379-21aten2_r5power_v09:42:282
3526050992522,2cyclictest3578211-21fschecks_count08:02:302
3526050992521,3cyclictest3553012-21kworker/u8:0+events_unbound07:37:452
3526050992521,2cyclictest3612875-21cpuspeed_turbos08:37:252
352604599257,5cyclictest0-21swapper/112:26:121
3526045992522,2cyclictest3562613-21kworker/u8:1+events_unbound07:52:331
3526045992521,3cyclictest3553012-21kworker/u8:0+flush-8:007:42:331
3526045992521,3cyclictest3553012-21kworker/u8:0+flush-8:007:42:331
3526045992520,4cyclictest3691500-21kworker/u8:3+flush-8:012:17:381
3526045992520,4cyclictest3612041-21kworker/u8:0+flush-8:008:42:491
3526050992421,2cyclictest3646879-21unixbench_singl09:07:452
3526050992418,5cyclictest3746281-21unixbench_singl10:47:472
3526050992418,4cyclictest3711792-21munin-run10:15:002
3526045992419,4cyclictest3726450-21unixbench_singl10:27:441
3526050992319,3cyclictest3526689-21fschecks_time07:12:312
3526050992318,4cyclictest3821674-21cpuspeed_turbos12:07:282
3526050992318,4cyclictest3821674-21cpuspeed_turbos12:07:282
3526050992219,2cyclictest3835621-21unixbench_singl12:17:442
3526050992217,4cyclictest3716521-21kworker/u8:4+events_unbound10:17:482
3526045992218,3cyclictest3562613-21kworker/u8:1+flush-8:008:00:321
35213012229,9sleep20-21swapper/207:06:192
3526050992117,3cyclictest3632729-21aten2_r5power_c08:57:292
3526050992115,4cyclictest3701395-21kworker/u8:0+flush-8:010:27:342
3526050992115,4cyclictest281-21systemd-journal11:15:012
3526050992115,4cyclictest281-21systemd-journal11:15:002
3526050992112,7cyclictest3815125-21grep11:57:342
3526050992111,8cyclictest3548340-21df07:32:272
352605099210,19cyclictest3533487-21tr07:17:272
352605099210,11cyclictest3797010-21df_inode11:42:282
38023572200,2sleep20-21swapper/211:47:322
37366232200,3sleep3481ktimers/310:40:003
352605099207,4cyclictest0-21swapper/209:57:272
352605099202,12cyclictest3826415-21apt-get12:12:262
3526050992016,3cyclictest3558361-21fschecks_count07:42:302
3526050992016,3cyclictest3558361-21fschecks_count07:42:302
3526050992016,2cyclictest0-21swapper/212:37:352
3526050992016,2cyclictest0-21swapper/210:32:412
3526050992010,8cyclictest3567321-21head07:47:452
35444692190,7sleep23545486-21cut07:27:342
352605099192,9cyclictest0-21swapper/210:52:352
352605099192,9cyclictest0-21swapper/209:27:332
352605099192,12cyclictest3617638-21apt-get08:42:272
352605099191,8cyclictest3761962-21wc11:07:262
3526050991915,2cyclictest0-21swapper/212:27:382
3526050991915,2cyclictest0-21swapper/212:22:262
3526050991911,6cyclictest3608674-21cut08:32:322
3526050991911,6cyclictest3603218-21awk08:27:302
3526050991911,6cyclictest3573220-21cut07:57:292
3526050991910,7cyclictest3668013-21sed09:32:322
37757312180,3sleep3584-21kworker/3:2+events11:17:443
352605099183,7cyclictest0-21swapper/211:25:012
3526050991810,6cyclictest3792802-21cut11:37:352
3526050991810,6cyclictest3757601-21sed11:02:342
35213542183,9sleep30-21swapper/307:07:013
352605099179,5cyclictest3582982-21grep08:07:272
352605099172,3cyclictest0-21swapper/210:57:412
3526050991714,2cyclictest3572263-21grep07:52:452
3526050991713,2cyclictest0-21swapper/208:12:152
3526050991712,3cyclictest3597436-21sendmail08:20:002
3526050991710,5cyclictest3705595-21cut10:07:352
3526050991710,5cyclictest0-21swapper/211:35:012
37469272162,9sleep30-21swapper/310:52:253
3526050991611,3cyclictest0-21swapper/209:47:322
38462262134,6sleep30-21swapper/312:32:273
38259682132,6sleep30-21swapper/312:10:013
37673802132,7sleep30-21swapper/311:12:353
37673802132,7sleep30-21swapper/311:12:353
37614252132,6sleep30-21swapper/311:05:013
37521942132,7sleep30-21swapper/310:57:313
37366232132,6sleep30-21swapper/310:40:013
36570492132,6sleep30-21swapper/309:20:013
35526472132,6sleep30-21swapper/307:35:013
35263472135,5sleep30-21swapper/307:12:263
38515022122,6sleep30-21swapper/312:37:293
38401322123,6sleep30-21swapper/312:22:403
38349362122,6sleep30-21swapper/312:17:353
37956012122,6sleep30-21swapper/311:37:473
37866022122,6sleep30-21swapper/311:32:253
37816702122,6sleep30-21swapper/311:27:283
37770802122,6sleep30-21swapper/311:22:303
37613062122,6sleep30-21swapper/311:03:523
37309802122,6sleep30-21swapper/310:32:433
37159452122,6sleep30-21swapper/310:17:383
37022422122,6sleep30-21swapper/310:06:553
36949302124,5sleep30-21swapper/309:57:363
36915892122,6sleep30-21swapper/309:53:593
36772722122,6sleep30-21swapper/309:42:283
36480382122,6sleep30-21swapper/309:12:353
36429522122,6sleep30-21swapper/309:07:293
36331712122,6sleep30-21swapper/308:57:343
36282382122,6sleep30-21swapper/308:52:333
36226222122,6sleep30-21swapper/308:47:273
36172272122,6sleep30-21swapper/308:40:013
36026552122,6sleep30-21swapper/308:25:533
36022612121,7sleep30-21swapper/308:23:523
35925002122,6sleep30-21swapper/308:15:013
35866932122,6sleep30-21swapper/308:07:433
35679892122,6sleep30-21swapper/307:52:283
35579132122,6sleep30-21swapper/307:40:443
35579132122,6sleep30-21swapper/307:40:433
35431752122,6sleep30-21swapper/307:27:283
38410732112,6sleep30-21swapper/312:25:173
38213272113,5sleep30-21swapper/312:06:043
38213272113,5sleep30-21swapper/312:06:033
38164472112,5sleep30-21swapper/312:01:303
38153212112,5sleep30-21swapper/311:57:383
38064792112,6sleep30-21swapper/311:50:273
38012792112,5sleep30-21swapper/311:45:013
37972532112,5sleep30-21swapper/311:42:333
37418482112,6sleep30-21swapper/310:45:353
37217672111,5sleep30-21swapper/310:25:013
37071422112,6sleep30-21swapper/310:11:303
36967202112,5sleep30-21swapper/310:00:013
36820622112,6sleep30-21swapper/309:45:413
36723472112,5sleep30-21swapper/309:37:263
36672292113,5sleep30-21swapper/309:31:083
36621862113,5sleep30-21swapper/309:25:033
36374662112,6sleep30-21swapper/309:00:073
36126612112,5sleep30-21swapper/308:37:243
36077382112,6sleep30-21swapper/308:32:273
35884512112,6sleep30-21swapper/308:12:333
35814522112,5sleep30-21swapper/308:02:383
35727182112,6sleep30-21swapper/307:55:073
35667402112,5sleep30-21swapper/307:47:373
35480362112,6sleep30-21swapper/307:31:523
35380992112,6sleep30-21swapper/307:20:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional