You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 22:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sat Aug 15, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
37159932800,2sleep3481ktimers/311:02:513
3480689996963,4cyclictest3571141-21kworker/u8:2+events_unbound09:20:010
3480689996546,11cyclictest3645165-21kworker/u8:0+flush-8:009:57:470
3480694995950,6cyclictest275-21systemd-journal10:02:581
37437822560,2sleep3481ktimers/311:32:483
3480689995548,5cyclictest3696734-21kworker/u8:1+events_unbound12:37:570
3480689995449,4cyclictest3239059-21kworker/u8:0+flush-8:007:42:550
3480694995246,4cyclictest3239059-21kworker/u8:0+flush-8:007:20:001
3480689995245,4cyclictest3696734-21kworker/u8:1+flush-8:010:50:010
3480689995245,4cyclictest3239059-21kworker/u8:0+flush-8:008:35:010
3480689995142,6cyclictest3742171-21kworker/u8:2+events_unbound11:35:010
3480689995142,6cyclictest3742171-21kworker/u8:2+events_unbound11:35:010
38087192500,3sleep3575-21kworker/3:2+events12:37:493
3480694995044,4cyclictest3631930-21latency_hist09:40:021
3480694994943,4cyclictest3712030-21latency_hist11:00:011
3480689994944,4cyclictest3676758-21kworker/u8:0+flush-8:010:25:010
3480694994844,3cyclictest3676758-21kworker/u8:0+events_unbound10:42:441
3480689994843,3cyclictest3681685-21kworker/u8:2+events_unbound10:32:590
3480689994842,4cyclictest3581476-21kworker/u8:0+flush-8:009:32:570
3480689994841,5cyclictest3681685-21kworker/u8:2+flush-8:010:38:000
3480689994840,6cyclictest3697007-21base6410:45:000
3480689994737,8cyclictest3741158-21ntpq11:27:520
3480689994640,4cyclictest2680058-21kworker/u8:4+flush-8:007:12:440
3480698994538,5cyclictest3571751-21apt-get08:40:002
3480694994538,5cyclictest3239059-21kworker/u8:0+flush-8:007:57:461
3480694994536,7cyclictest3611411-21ntpq09:17:551
3480689994540,4cyclictest3681685-21kworker/u8:2+flush-8:011:02:590
3480694994436,6cyclictest3571141-21kworker/u8:2+flush-8:009:07:441
3480689994439,4cyclictest3696734-21kworker/u8:1+flush-8:011:25:000
3480689994438,3cyclictest3571141-21kworker/u8:2+events_unbound08:45:000
3480689994437,5cyclictest3731599-21kworker/u8:0+events_unbound11:20:000
3480694994335,5cyclictest3796848-21latency_hist12:25:011
3480689994338,3cyclictest3742171-21kworker/u8:2+flush-8:012:05:360
3480689994336,5cyclictest3652139-21kworker/u8:3+flush-8:010:28:000
348068999432,37cyclictest3746958-21munin-run11:35:000
3480689994237,4cyclictest3581476-21kworker/u8:0+events_unbound09:02:570
3480689994235,5cyclictest3239059-21kworker/u8:0+events_unbound08:12:560
3480694994135,4cyclictest3766558-21kworker/u8:3+events_unbound12:37:451
3480694994132,6cyclictest275-21systemd-journal11:35:581
3480694994132,6cyclictest275-21systemd-journal11:35:581
3480689994137,3cyclictest3702534-21kworker/u8:0+flush-8:010:52:590
3480694994034,4cyclictest3696734-21kworker/u8:1+events_unbound11:32:581
3480694994034,4cyclictest3517795-21apt-get07:47:391
3480689994034,4cyclictest3601967-21apt-get09:10:020
3480689994032,6cyclictest3571141-21kworker/u8:2+flush-8:010:07:580
3480689994031,7cyclictest3726055-21ntpq11:12:530
3480689994028,4cyclictest3239059-21kworker/u8:0+events_unbound07:32:550
3480694993932,5cyclictest275-21systemd-journal08:26:571
3480694993929,7cyclictest3596985-21latency_hist09:05:011
3480694993929,7cyclictest275-21systemd-journal11:09:581
3480689993934,3cyclictest3645165-21kworker/u8:0+flush-8:009:52:550
3480689993933,4cyclictest3239059-21kworker/u8:0+events_unbound07:37:540
3480689993932,5cyclictest3475509-21kworker/u8:2+flush-8:007:48:000
36394942380,2sleep3471rcuc/309:47:513
3480698993832,4cyclictest3681855-21gpgv10:30:002
3480689993834,3cyclictest3475509-21kworker/u8:2+flush-8:007:52:490
3480689993834,3cyclictest3475509-21kworker/u8:2+flush-8:007:52:490
3480689993833,3cyclictest3532335-21latency_hist08:00:000
3480689993832,4cyclictest3571141-21kworker/u8:2+flush-8:009:47:560
3480698993733,3cyclictest3571141-21kworker/u8:2+events_unbound09:52:502
3480698993731,4cyclictest3661565-21journal-offline10:08:012
3480694993730,5cyclictest3583304-21journal-offline08:52:481
3480694993729,6cyclictest3502725-21kworker/u8:1+flush-8:008:02:451
3480694993728,7cyclictest3757432-21/usr/sbin/munin11:47:591
3480689993732,4cyclictest3702534-21kworker/u8:0+events_unbound10:57:480
3480689993732,4cyclictest3239059-21kworker/u8:0+flush-8:008:23:040
3480689993729,6cyclictest3757270-21kworker/u8:0+flush-8:011:47:420
3480689993726,8cyclictest3656891-21latency_hist10:05:010
3480698993631,4cyclictest3736786-21systemd-run11:25:002
3480694993624,10cyclictest3681830-21apt-get10:30:001
3480689993631,4cyclictest3502725-21kworker/u8:1+flush-8:009:20:290
3480689993630,5cyclictest3801626-21kworker/u8:0+flush-8:012:32:530
3480698993530,4cyclictest3571141-21kworker/u8:2+flush-8:008:47:562
3480698993527,6cyclictest3546984-21turbostat.cron08:15:002
3480694993529,4cyclictest3766558-21kworker/u8:3+flush-8:011:58:001
3480694993528,5cyclictest3712489-21apt-get11:02:391
3480694993527,6cyclictest3737440-21apt-get11:27:401
347584123523,6sleep10-21swapper/107:06:431
3480694993428,4cyclictest3696734-21kworker/u8:1+events_unbound11:52:591
3480694993428,4cyclictest3581476-21kworker/u8:0+flush-8:009:35:001
3480694993426,6cyclictest3616395-21ntpq09:22:531
3480694993426,6cyclictest3507391-21latency_hist07:35:011
3480694993426,5cyclictest275-21systemd-journal10:13:031
3480689993429,4cyclictest3475509-21kworker/u8:2+events_unbound07:20:560
3480689993425,7cyclictest275-21systemd-journal08:27:420
34757552344,10sleep20-21swapper/207:05:352
3480694993326,5cyclictest3502725-21kworker/u8:1+flush-8:009:12:441
3480694993326,5cyclictest3475509-21kworker/u8:2+events_unbound07:42:571
3480694993325,6cyclictest3687054-21latency_hist10:35:011
3480689993329,3cyclictest3696734-21kworker/u8:1+flush-8:011:42:450
3480689993329,3cyclictest3541868-21kworker/u8:3+events_unbound08:17:430
3480689993328,3cyclictest2680058-21kworker/u8:4+flush-8:007:18:000
3480689993327,4cyclictest3571141-21kworker/u8:2+flush-8:010:17:590
3480689993326,5cyclictest3239059-21kworker/u8:0+flush-8:007:27:510
3480689993325,6cyclictest3766558-21kworker/u8:3+flush-8:012:02:540
3480698993226,4cyclictest3537767-21cpuspeed_turbos08:07:442
3480698993223,7cyclictest3757747-21fschecks_count11:47:452
3480689993227,4cyclictest3696734-21kworker/u8:1+events_unbound12:18:010
3480689993225,5cyclictest3581476-21kworker/u8:0+flush-8:008:52:410
3480694993126,3cyclictest3562566-21cpuspeed_turbos08:32:431
3480694993124,5cyclictest3696734-21kworker/u8:1+events_unbound12:12:521
3480689993127,3cyclictest3681685-21kworker/u8:2+events_unbound11:08:340
3480689993126,4cyclictest3652139-21kworker/u8:3+events_unbound10:12:570
3480689993125,4cyclictest3766558-21kworker/u8:3+flush-8:012:27:590
3480689993124,5cyclictest3601967-21apt-get09:10:000
3480689993124,5cyclictest3502725-21kworker/u8:1+flush-8:008:02:540
3480689993119,8cyclictest275-21systemd-journal12:00:000
3480698993025,4cyclictest3681685-21kworker/u8:2+events_unbound11:15:002
3480698993025,4cyclictest3652139-21kworker/u8:3+flush-8:010:02:542
3480698993025,3cyclictest3512972-21aten2_r5power_v07:42:432
3480698993021,7cyclictest3642223-21cp09:50:012
3480694993026,2cyclictest850-21mta-sts-daemon08:57:451
3480694993026,2cyclictest3632990-21irqcore09:42:471
3480694993026,2cyclictest3578228-21irqcore08:47:481
3480694993025,4cyclictest3661885-21kworker/u8:1+events_unbound10:22:591
3480694993024,5cyclictest3541868-21kworker/u8:3+events_unbound08:37:441
3480694993024,4cyclictest3571141-21kworker/u8:2+flush-8:010:07:571
3480689993025,4cyclictest3742171-21kworker/u8:2+events_unbound11:50:350
3480689993024,4cyclictest3581476-21kworker/u8:0+events_unbound08:50:000
3480689993021,7cyclictest3696734-21kworker/u8:1+flush-8:012:22:410
3480698992926,2cyclictest3528587-21kthreadcore07:57:492
3480698992925,2cyclictest3622551-21aten2_r5power_p09:32:442
3480698992924,3cyclictest3485431-21unixbench_multi07:12:592
3480694992923,4cyclictest3239059-21kworker/u8:0+flush-8:007:37:481
3480689992925,3cyclictest3786778-21apt-key12:15:000
3480689992925,3cyclictest3239059-21kworker/u8:0+events_unbound08:07:580
3480689992924,3cyclictest3612403-21kworker/u8:3+events_unbound09:42:430
3480689992923,4cyclictest3627400-21/usr/sbin/munin09:38:000
3480689992923,4cyclictest3612403-21kworker/u8:3+events_unbound09:25:590
3480689992923,4cyclictest3612403-21kworker/u8:3+events_unbound09:25:590
3480689992923,4cyclictest3571141-21kworker/u8:2+events_unbound08:57:490
34797792293,17sleep03475919-21/usr/sbin/munin07:07:580
3480698992823,4cyclictest3742171-21kworker/u8:2+flush-8:012:22:592
3480698992823,3cyclictest3748513-21kthreadcore11:37:492
3480698992823,3cyclictest3748513-21kthreadcore11:37:492
3480694992824,2cyclictest3698521-21ps10:47:481
3480694992824,2cyclictest3500094-21kthreadcore07:27:501
3480694992822,5cyclictest3541868-21kworker/u8:3+flush-8:008:40:021
3480694992822,4cyclictest3727250-21apt-get11:17:411
3480694992822,4cyclictest3702813-21cpuspeed_turbos10:52:431
3480698992722,4cyclictest3725075-21kworker/u8:3+events_unbound11:32:452
3480698992722,4cyclictest3681685-21kworker/u8:2+events_unbound11:18:022
3480698992722,3cyclictest3772660-21fschecks_time12:02:442
3480698992722,3cyclictest3672666-21fschecks_count10:22:442
3480698992722,3cyclictest3557668-21fschecks_count08:27:452
3480698992721,4cyclictest3647639-21cpuspeed_turbos09:57:432
3480698992721,4cyclictest3502725-21kworker/u8:1+flush-8:009:05:052
3480694992720,5cyclictest3766558-21kworker/u8:3+flush-8:012:02:581
3480698992622,3cyclictest3696734-21kworker/u8:1+flush-8:011:07:562
3480698992621,3cyclictest3572763-21fschecks_time08:42:462
3480694992621,3cyclictest3524896-21kthreadcore07:52:501
3480694992621,3cyclictest3524896-21kthreadcore07:52:501
3480694992616,8cyclictest3791130-21ntpq12:17:531
3480689992621,3cyclictest3568021-21irqrtprio08:37:480
3480698992521,3cyclictest3681685-21kworker/u8:2+flush-8:011:02:492
3480698992520,4cyclictest3571141-21kworker/u8:2+flush-8:009:27:592
3480698992520,4cyclictest3571141-21kworker/u8:2+flush-8:009:27:592
3480698992516,7cyclictest3711282-21ntpq10:57:542
3480698992516,7cyclictest3551985-21awk08:20:002
3480694992521,2cyclictest0-21swapper/109:50:011
3480694992520,4cyclictest3645165-21kworker/u8:0+flush-8:009:57:581
3480694992520,3cyclictest275-21systemd-journal08:20:001
3480694992520,3cyclictest0-21swapper/111:12:541
3480694992519,4cyclictest3696734-21kworker/u8:1+flush-8:011:42:551
3480694992518,5cyclictest2680058-21kworker/u8:4+flush-8:007:12:501
348069899249,10cyclictest3552444-21apt-get08:22:432
3480698992421,2cyclictest3522863-21aten2_r5power_v07:52:432
3480698992421,2cyclictest3522863-21aten2_r5power_v07:52:432
3480698992419,4cyclictest20823-21cron12:35:002
3480698992418,4cyclictest3652139-21kworker/u8:3+flush-8:010:40:072
3480698992418,4cyclictest3508084-21cpuspeed_turbos07:37:432
3480694992421,2cyclictest3646752-21grep09:53:001
3480694992419,3cyclictest3731599-21kworker/u8:0+flush-8:011:22:291
3480694992417,5cyclictest3801068-21ntpq12:27:551
3480694992416,6cyclictest3801626-21kworker/u8:0+flush-8:012:32:551
3480698992319,2cyclictest3691711-21unixbench_multi10:38:002
3480694992318,4cyclictest3475509-21kworker/u8:2+flush-8:007:22:451
3480694992317,5cyclictest3239059-21kworker/u8:0+events_unbound08:07:561
3480698992219,2cyclictest3781552-21unixbench_singl12:08:012
3480698992218,2cyclictest3757012-21idleruntime-cro11:45:002
3480694992217,4cyclictest3546276-21ntp_kernel_pll_08:12:551
3480694992217,4cyclictest3239059-21kworker/u8:0+events_unbound08:23:021
3480694992216,5cyclictest3742171-21kworker/u8:2+flush-8:012:07:551
3480694992213,7cyclictest3691965-21latency_hist10:40:011
348069899213,6cyclictest0-21swapper/210:16:452
3480698992117,3cyclictest3571141-21kworker/u8:2+flush-8:009:22:482
3480698992116,4cyclictest3771886-21sendmail12:00:002
3480698992116,4cyclictest0-21swapper/209:00:012
3480698992116,2cyclictest0-21swapper/208:02:582
3480698992113,6cyclictest0-21swapper/207:35:002
3480694992113,6cyclictest275-21systemd-journal10:15:011
348069899202,13cyclictest3807168-21apt-get12:37:422
348069899202,12cyclictest3702580-21apt-get10:52:422
3480698992016,2cyclictest3596190-21needreboot09:02:522
3480698992016,2cyclictest0-21swapper/209:42:582
3480698992015,3cyclictest0-21swapper/209:37:502
3480698992014,4cyclictest3786450-21unixbench_multi12:12:592
3480698992011,7cyclictest3697612-21cut10:47:422
3480698992011,7cyclictest3686602-21sed10:32:582
3480698992010,8cyclictest3518484-21sed07:47:462
3480694992012,6cyclictest3617550-21apt-get09:27:401
3480694992012,6cyclictest3617550-21apt-get09:27:401
348069899199,7cyclictest3797757-21if_enp4s0.312:27:472
3480698991916,2cyclictest3662572-21aten2_r5power_p10:12:432
3480698991916,2cyclictest3493292-21fschecks_count07:22:452
3480698991916,2cyclictest3488420-21fschecks_time07:17:442
3480698991914,3cyclictest0-21swapper/208:33:002
3480698991911,6cyclictest3584252-21tr08:52:492
3480698991910,7cyclictest3765172-21cut11:52:512
348069899189,6cyclictest3608019-21if_enp4s009:17:462
348069899181,4cyclictest3737686-21diskstats11:27:432
3480698991810,6cyclictest3498623-21cut07:27:482
34761912183,8sleep30-21swapper/307:07:453
348069899178,7cyclictest3787482-21cut12:17:432
3480698991713,2cyclictest0-21swapper/209:12:192
37624792160,2sleep3575-21kworker/3:2+events11:52:423
37318002132,6sleep30-21swapper/311:20:013
36513732132,7sleep30-21swapper/309:57:593
36343442133,7sleep30-21swapper/309:42:513
36035732134,5sleep30-21swapper/309:12:493
35920432132,6sleep30-21swapper/309:00:013
35769362132,7sleep30-21swapper/308:45:003
34933482132,7sleep30-21swapper/307:22:463
38022062122,6sleep30-21swapper/312:32:403
37894412122,6sleep30-21swapper/312:17:513
37859722122,6sleep30-21swapper/312:12:543
37777832122,6sleep30-21swapper/312:07:483
37719222122,6sleep30-21swapper/312:00:023
37613432122,6sleep30-21swapper/311:47:583
37566002122,6sleep30-21swapper/311:43:003
37379342122,6sleep30-21swapper/311:27:473
37310742122,6sleep30-21swapper/311:17:563
37071022122,5sleep30-21swapper/310:55:013
37025542122,6sleep30-21swapper/310:52:403
36973142122,5sleep30-21swapper/310:45:023
36919462122,6sleep30-21swapper/310:40:003
36721242122,6sleep30-21swapper/310:20:023
36711912122,6sleep30-21swapper/310:17:533
36630042122,6sleep30-21swapper/310:12:483
36569162122,5sleep30-21swapper/310:05:013
36565162122,6sleep30-21swapper/310:03:013
36438122121,7sleep30-21swapper/309:52:503
36268832122,6sleep30-21swapper/309:34:043
36179242122,6sleep30-21swapper/309:27:473
36179242122,6sleep30-21swapper/309:27:463
36169232122,6sleep30-21swapper/309:23:003
36073232122,6sleep30-21swapper/309:15:023
35981652122,6sleep30-21swapper/309:07:473
35916542122,6sleep30-21swapper/308:58:003
35845542122,6sleep30-21swapper/308:52:513
35783592122,6sleep30-21swapper/308:47:493
35676032122,6sleep30-21swapper/308:37:463
35569622122,6sleep30-21swapper/308:25:023
35530852122,6sleep30-21swapper/308:22:493
35326702122,6sleep30-21swapper/308:02:433
35267272122,6sleep30-21swapper/307:53:003
35267272122,6sleep30-21swapper/307:53:003
35215852122,6sleep30-21swapper/307:47:543
35076152122,5sleep30-21swapper/307:35:023
35017192123,6sleep30-21swapper/307:27:573
37971152112,6sleep30-21swapper/312:25:383
37921792113,5sleep30-21swapper/312:20:363
37671482112,6sleep30-21swapper/311:55:243
37475952112,5sleep30-21swapper/311:37:433
37475952112,5sleep30-21swapper/311:37:433
37221062112,5sleep30-21swapper/311:10:023
37177772112,5sleep30-21swapper/311:07:453
36923332112,5sleep30-21swapper/310:41:453
36824042112,6sleep30-21swapper/310:31:303
36771682112,6sleep30-21swapper/310:25:323
36278072112,5sleep30-21swapper/309:37:493
35622262112,6sleep30-21swapper/308:31:363
35479342110,6sleep30-21swapper/308:17:483
35428292112,5sleep30-21swapper/308:12:463
35373462112,6sleep30-21swapper/308:05:243
35282472112,5sleep30-21swapper/307:57:493
35126722112,6sleep30-21swapper/307:40:363
35065662112,5sleep30-21swapper/307:32:533
34878652112,6sleep30-21swapper/307:15:243
34809342112,6sleep30-21swapper/307:10:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional