You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 01:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Fri Mar 13, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
273149221800,5sleep30-21swapper/312:16:383
27246092780,5chrt0-21swapper/112:06:451
26752552640,4sleep00-21swapper/011:16:520
26327002610,5chrt0-21swapper/010:36:440
2425982996150,9cyclictest2430852-21latency_hist07:15:000
2425982995647,6cyclictest2472424-21latency_hist07:55:010
2425986995343,7cyclictest2656152-21latency_hist11:00:001
25249112460,5sleep30-21swapper/308:46:453
2425986994538,5cyclictest2606449-21apt-get10:10:001
2425986994536,7cyclictest2680902-21latency_hist11:25:011
2425982994541,3cyclictest2616852-21kworker/u8:0+flush-8:010:30:000
2425986994335,6cyclictest2557150-21kworker/u8:1+flush-8:009:21:401
2425982994336,5cyclictest2746336-21apt-get12:31:360
2425986993932,5cyclictest2576733-21latency_hist09:40:001
2425982993933,5cyclictest2517419-21kworker/u8:2+flush-8:008:46:490
2425982993933,4cyclictest2557150-21kworker/u8:1+events_unbound09:21:380
2425988993830,6cyclictest2482530-21apt-get08:05:012
2425982993832,4cyclictest2416254-21kworker/u8:3+events_unbound10:31:460
2425986993727,8cyclictest2551127-21ntpq09:11:471
2425986993627,7cyclictest2666410-21apt-get11:11:351
2425986993626,7cyclictest2686069-21latency_hist11:30:011
2425982993630,4cyclictest2416254-21kworker/u8:3+flush-8:009:11:470
2425982993629,5cyclictest280-21systemd-journal11:40:000
2425982993628,5cyclictest2726262-21/usr/sbin/munin12:11:460
2425986993530,4cyclictest2416254-21kworker/u8:3+flush-8:007:11:391
2425982993531,3cyclictest2462551-21kworker/u8:2+flush-8:007:46:530
2425982993530,4cyclictest2462551-21kworker/u8:2+flush-8:008:01:510
2425988993426,5cyclictest2736252-21cat12:20:012
2425986993429,4cyclictest2416254-21kworker/u8:3+events_unbound09:30:001
2425986993426,6cyclictest2596907-21/usr/sbin/munin10:01:471
2425982993429,3cyclictest2486960-21kworker/u8:0+flush-8:008:51:530
2425982993426,6cyclictest2716063-21gpgv12:00:000
242598299341,29cyclictest2606499-21munin-run10:10:010
2425986993328,4cyclictest944134-21kworker/u8:1+flush-8:007:31:411
2425986993328,3cyclictest2472414-21cron07:55:001
2425986993325,6cyclictest2527657-21apt-get08:51:361
2425982993327,4cyclictest2517419-21kworker/u8:2+events_unbound09:46:380
2425982993326,5cyclictest2661763-21cut11:06:380
24255562333,10sleep20-21swapper/207:07:012
27505412320,3sleep10-21swapper/112:31:561
2425986993228,3cyclictest2486960-21kworker/u8:0+flush-8:008:56:411
2425986993228,2cyclictest2453678-21irqrtprio07:36:411
2425986993227,4cyclictest2416254-21kworker/u8:3+flush-8:008:31:411
2425986993226,4cyclictest2416254-21kworker/u8:3+flush-8:010:41:521
2425982993228,3cyclictest2616852-21kworker/u8:0+events_unbound10:21:450
2425982993226,4cyclictest280-21systemd-journal12:21:170
2425982993225,5cyclictest2562500-21diskstats09:26:400
24211922323,9sleep10-21swapper/107:05:521
2425988993126,3cyclictest2681103-21latency_hist11:25:012
2425986993127,2cyclictest2648807-21kthreadcore10:51:451
2425986993126,4cyclictest2416254-21kworker/u8:3+flush-8:011:46:401
2425986993126,3cyclictest2553053-21irqrtprio09:16:421
2425986993124,5cyclictest2607056-21apt-get10:11:361
2425982993127,3cyclictest2517419-21kworker/u8:2+flush-8:008:41:420
2425982993126,4cyclictest2635624-21kworker/u8:1+flush-8:010:51:530
2425982993126,3cyclictest2746281-21kworker/u8:2+flush-8:012:36:400
2425982993124,4cyclictest2490244-21kthreadcore08:11:440
2425982993123,4cyclictest0-21swapper/009:51:380
2425982993121,8cyclictest2680903-21apt-get11:25:010
2425988993025,3cyclictest2576442-21unixbench_singl09:36:552
2425986993026,3cyclictest2486960-21kworker/u8:0+flush-8:009:01:401
2425986993026,3cyclictest2416254-21kworker/u8:3+events_unbound10:46:451
2425986993025,4cyclictest2517419-21kworker/u8:2+flush-8:008:46:401
2425986993025,4cyclictest2462551-21kworker/u8:2+events_unbound08:01:541
2425982993026,3cyclictest2416254-21kworker/u8:3+flush-8:009:56:480
2425982993024,4cyclictest2462551-21kworker/u8:2+events_unbound07:56:470
2425988992925,2cyclictest2681564-21aten2_r5power_e11:26:362
2425986992925,3cyclictest2416254-21kworker/u8:3+events_unbound10:31:521
2425986992924,4cyclictest2666056-21kworker/u8:2+flush-8:011:31:531
2425986992924,3cyclictest2416254-21kworker/u8:3+flush-8:010:16:541
2425986992919,8cyclictest280-21systemd-journal11:56:451
2425986992918,8cyclictest2487691-21latency_hist08:10:011
2425982992921,7cyclictest2486960-21kworker/u8:0+flush-8:009:16:500
2425982992919,7cyclictest280-21systemd-journal11:46:450
2425986992824,2cyclictest2579293-21kthreadcore09:41:431
2425986992824,2cyclictest2579293-21kthreadcore09:41:431
2425986992823,3cyclictest2617080-21aten2_r5power_p10:21:361
2425986992821,6cyclictest2406253-21kworker/u8:2+flush-8:007:26:481
2425986992820,6cyclictest280-21systemd-journal08:42:461
2425986992818,8cyclictest2700182-21ntpq11:41:511
2425982992824,3cyclictest2635624-21kworker/u8:1+flush-8:012:16:390
2425982992824,3cyclictest2596808-21kworker/u8:2+events_unbound10:11:530
2425982992824,3cyclictest2517419-21kworker/u8:2+flush-8:009:41:470
2425982992824,3cyclictest2517419-21kworker/u8:2+flush-8:009:41:470
2425982992824,3cyclictest2447598-21turbostat.cron07:29:590
2425982992823,3cyclictest2502532-21cron08:25:000
2425982992822,4cyclictest2635624-21kworker/u8:1+events_unbound12:00:010
2425982992822,4cyclictest2635624-21kworker/u8:1+events_unbound12:00:010
2425982992820,6cyclictest2416254-21kworker/u8:3+flush-8:011:31:480
26298062270,5sleep20-21swapper/210:31:452
2425988992722,3cyclictest2498330-21fschecks_time08:21:402
2425986992723,2cyclictest2751881-21irqcore12:36:421
2425986992723,2cyclictest2657259-21irqrtprio11:01:421
2425986992722,3cyclictest2588241-21kthreadcore09:51:461
2425986992721,3cyclictest2517419-21kworker/u8:2+events_unbound09:46:421
2425982992722,3cyclictest2646281-21awk10:50:000
2425982992722,3cyclictest2452578-21cron07:35:000
2425982992721,4cyclictest2517419-21kworker/u8:2+events_unbound09:36:480
2425982992720,5cyclictest944134-21kworker/u8:1+events_unbound07:36:370
2425982992720,3cyclictest0-21swapper/011:26:350
2425982992716,9cyclictest2436867-21ntpq07:16:460
2425988992622,3cyclictest2700591-21unixbench_multi11:41:552
2425988992622,2cyclictest2753449-21tr12:36:442
2425988992622,2cyclictest2492350-21grep08:11:542
2425988992619,5cyclictest280-21systemd-journal08:26:452
2425986992622,3cyclictest2635624-21kworker/u8:1+events_unbound11:06:381
2425986992622,2cyclictest885-21mta-sts-daemon07:46:441
2425986992621,3cyclictest944134-21kworker/u8:1+flush-8:008:20:011
2425986992616,8cyclictest2735860-21apt-get12:20:011
2425982992621,3cyclictest2671021-21munin-run11:15:010
2425982992620,4cyclictest2725934-21kworker/u8:3+flush-8:012:26:390
2425982992620,4cyclictest2635624-21kworker/u8:1+events_unbound11:01:520
2425982992619,5cyclictest2416254-21kworker/u8:3+events_unbound08:31:390
2425982992617,3cyclictest2486960-21kworker/u8:0+events_unbound08:56:410
2425988992522,2cyclictest2467919-21aten2_r5power_e07:51:372
2425988992521,2cyclictest2746555-21cpuspeed_turbos12:31:392
2425988992521,2cyclictest2582142-21aten2_r5power_e09:46:372
2425988992521,2cyclictest2472907-21aten2_r5power_v07:56:372
2425988992521,2cyclictest2431012-21latency_hist07:15:002
2425986992521,3cyclictest2635624-21kworker/u8:1+flush-8:011:36:531
2425986992520,4cyclictest2416254-21kworker/u8:3+flush-8:010:36:401
2425986992520,4cyclictest2416254-21kworker/u8:3+events_unbound08:21:481
2425986992518,5cyclictest2461722-21ntpq07:41:481
2425982992523,1cyclictest2416254-21kworker/u8:3+events_unbound11:41:540
2425982992521,3cyclictest2486960-21kworker/u8:0+flush-8:009:01:550
2425982992521,2cyclictest2438323-21cpuspeed_turbos07:21:370
2425982992521,2cyclictest2438323-21cpuspeed_turbos07:21:370
2425982992520,4cyclictest944134-21kworker/u8:1+flush-8:007:41:540
2425982992519,4cyclictest2416254-21kworker/u8:3+events_unbound08:06:550
2425982992519,3cyclictest0-21swapper/008:36:460
2425982992519,3cyclictest0-21swapper/008:36:460
2425988992421,2cyclictest2641024-21unixbench_multi10:41:542
2425988992420,2cyclictest2711430-21cpuspeed_turbos11:56:382
2425988992420,2cyclictest2665699-21unixbench_multi11:06:542
2425988992420,2cyclictest2651664-21aten2_r5power_e10:56:362
2425988992420,2cyclictest2547654-21tr09:11:372
2425988992420,2cyclictest2507966-21aten2_r5power_v08:31:392
2425988992418,4cyclictest2695617-21unixbench_multi11:36:542
2425986992420,3cyclictest2675987-21sendmail11:20:011
2425986992420,2cyclictest2505069-21kthreadcore08:26:431
2425986992419,4cyclictest2486960-21kworker/u8:0+flush-8:008:36:391
2425986992419,4cyclictest2486960-21kworker/u8:0+flush-8:008:36:391
2425986992416,6cyclictest280-21systemd-journal12:30:001
2425986992416,6cyclictest2542459-21apt-get09:06:361
2425986992415,7cyclictest2740758-21unixbench_singl12:21:551
242598299243,15cyclictest583-21snmpd10:41:350
2425982992420,3cyclictest2635624-21kworker/u8:1+events_unbound11:51:440
2425982992420,3cyclictest2517419-21kworker/u8:2+events_unbound09:06:390
2425982992416,4cyclictest0-21swapper/012:06:360
2425988992320,2cyclictest2443256-21cpuspeed_turbos07:26:362
2425988992318,3cyclictest2597459-21irqcore10:01:432
2425986992319,3cyclictest2635624-21kworker/u8:1+events_unbound12:01:381
2425986992319,3cyclictest2635624-21kworker/u8:1+events_unbound12:01:381
2425986992319,2cyclictest0-21swapper/107:21:521
2425986992319,2cyclictest0-21swapper/107:21:521
2425986992319,2cyclictest0-21swapper/107:16:351
2425986992318,3cyclictest2715534-21kworker/u8:0+flush-8:012:11:421
2425986992316,5cyclictest2416254-21kworker/u8:3+flush-8:010:26:531
2425986992316,5cyclictest0-21swapper/111:51:421
2425982992318,3cyclictest2416254-21kworker/u8:3+flush-8:009:31:450
2425982992318,3cyclictest0-21swapper/010:16:540
2425988992219,2cyclictest2448010-21aten2_r5power_c07:31:382
2425986992217,4cyclictest2462551-21kworker/u8:2+events_unbound07:56:421
2425986992217,3cyclictest0-21swapper/109:31:511
2425982992218,3cyclictest2416254-21kworker/u8:3+flush-8:008:25:360
2425982992217,3cyclictest2635624-21kworker/u8:1+flush-8:010:56:420
242598299221,14cyclictest2600718-21chrt10:01:490
24212362222,14sleep00-21swapper/007:06:270
242598899219,9cyclictest2512784-21apt-get08:36:352
242598899219,9cyclictest2512784-21apt-get08:36:352
242598899219,4cyclictest0-21swapper/208:56:562
242598899212,5cyclictest27246122kthreadcore12:06:452
242598899212,18cyclictest0-21swapper/210:21:522
2425988992118,2cyclictest2726553-21fschecks_count12:11:382
2425988992117,3cyclictest2542078-21cron09:05:002
2425988992116,3cyclictest2557379-21aten2_r5power_p09:21:382
2425986992117,2cyclictest0-21swapper/108:11:391
2425986992115,4cyclictest2416254-21kworker/u8:3+flush-8:009:56:441
2425982992116,3cyclictest0-21swapper/008:16:420
24210042213,9sleep30-21swapper/307:05:023
25759202200,3chrt75-21kworker/3:1+events09:36:483
2425988992017,2cyclictest2741506-21aten2_r5power_v12:26:362
2425988992016,2cyclictest2552551-21cpuspeed_turbos09:16:382
2425988992015,3cyclictest0-21swapper/207:46:552
2425988992011,2cyclictest0-21swapper/208:16:352
242598899192,16cyclictest0-21swapper/211:34:112
2425988991916,2cyclictest2592302-21fschecks_time09:56:392
2425988991916,2cyclictest0-21swapper/212:01:452
2425988991916,2cyclictest0-21swapper/212:01:452
2425988991915,3cyclictest0-21swapper/210:10:002
2425988991915,2cyclictest2622153-21cpuspeed_turbos10:26:372
2425988991915,2cyclictest0-21swapper/211:01:372
2425988991915,2cyclictest0-21swapper/209:51:482
2425988991915,2cyclictest0-21swapper/208:41:512
242598899190,9cyclictest26752562awk11:16:522
26950652180,3chrt75-21kworker/3:1-events11:36:453
242598899189,7cyclictest2667165-21sed11:11:422
242598899182,15cyclictest0-21swapper/208:46:532
2425988991815,2cyclictest0-21swapper/207:21:492
2425988991815,2cyclictest0-21swapper/207:21:492
2425988991814,2cyclictest2707179-21kthreadcore11:51:462
2425988991814,2cyclictest2577355-21tr09:41:362
2425988991814,2cyclictest2577355-21tr09:41:362
2425988991814,2cyclictest0-21swapper/208:51:382
2425988991814,2cyclictest0-21swapper/207:16:392
242598899172,14cyclictest0-21swapper/210:11:532
2425988991713,2cyclictest0-21swapper/207:36:522
2425988991712,3cyclictest0-21swapper/212:25:002
2425988991711,4cyclictest0-21swapper/210:36:442
2425988991710,5cyclictest2568614-21cut09:31:432
25127822162,9sleep30-21swapper/308:36:353
25127822162,9sleep30-21swapper/308:36:343
242598899168,6cyclictest2485604-21tr08:06:442
242598899162,2cyclictest0-21swapper/211:47:532
242598899162,13cyclictest0-21swapper/207:43:552
242598899162,10cyclictest2646651-21apt-get10:51:372
2425988991613,2cyclictest0-21swapper/210:45:072
2425988991613,2cyclictest0-21swapper/209:26:152
2425988991612,2cyclictest0-21swapper/210:16:372
2425988991611,3cyclictest0-21swapper/209:06:452
26716162153,9sleep30-21swapper/311:16:403
24544522154,8sleep30-21swapper/307:36:443
26223182147,4sleep30-21swapper/310:26:413
27410362132,6sleep30-21swapper/312:25:013
27012952132,7sleep30-21swapper/311:46:373
26759442133,5sleep30-21swapper/311:20:023
26367632133,6sleep30-21swapper/310:41:373
25666512130,2sleep3471rcuc/309:27:453
25559562132,7sleep30-21swapper/309:16:473
25372002132,6sleep30-21swapper/309:00:023
24583352134,5sleep30-21swapper/307:41:413
27363362122,6sleep30-21swapper/312:20:043
27267652121,7sleep30-21swapper/312:11:413
27162432122,6sleep30-21swapper/312:00:023
27162432122,6sleep30-21swapper/312:00:023
27101222122,6sleep30-21swapper/311:51:553
26640232122,6sleep30-21swapper/311:06:463
26515792122,6sleep30-21swapper/310:56:343
26509322122,6sleep30-21swapper/310:51:563
26424972122,6sleep30-21swapper/310:46:433
26353982122,6sleep30-21swapper/310:36:483
26265912122,5sleep30-21swapper/310:30:023
26125252122,6sleep30-21swapper/310:16:413
26018892122,6sleep30-21swapper/310:06:343
25922012122,6sleep30-21swapper/309:56:393
25714372122,6sleep30-21swapper/309:31:563
25581772122,6sleep30-21swapper/309:21:443
25281142122,6sleep30-21swapper/308:51:433
25074632122,6sleep30-21swapper/308:30:003
24968702122,6sleep30-21swapper/308:16:523
24856612122,6sleep30-21swapper/308:06:453
24782562122,6sleep30-21swapper/308:01:403
24724502122,6sleep30-21swapper/307:55:013
24627562122,5sleep30-21swapper/307:45:023
24483992122,6sleep30-21swapper/307:31:423
24435162122,6sleep30-21swapper/307:26:413
24389882122,6sleep30-21swapper/307:21:443
24389882122,6sleep30-21swapper/307:21:433
24336352122,6sleep30-21swapper/307:16:423
24262382122,6sleep30-21swapper/307:11:363
27512952112,5sleep30-21swapper/312:36:373
27489392112,5sleep30-21swapper/312:31:473
27213002112,5sleep30-21swapper/312:06:153
26962922112,6sleep30-21swapper/311:41:083
26879492112,5sleep30-21swapper/311:31:453
26824352112,5sleep30-21swapper/311:26:433
26661722112,5sleep30-21swapper/311:10:023
26572602110,6sleep30-21swapper/311:01:433
26179232112,5sleep30-21swapper/310:21:433
26069512112,6sleep30-21swapper/310:10:363
25972192112,5sleep30-21swapper/310:01:423
25869962112,6sleep30-21swapper/309:51:223
25858442112,5sleep30-21swapper/309:46:483
25769762112,5sleep30-21swapper/309:40:023
25769762112,5sleep30-21swapper/309:40:023
25473272112,5sleep30-21swapper/309:10:453
25423132113,5sleep30-21swapper/309:05:033
25324542112,6sleep30-21swapper/308:55:283
25176582112,6sleep30-21swapper/308:40:363
25077032112,6sleep30-21swapper/308:30:043
24976322112,5sleep30-21swapper/308:20:013
24879152112,5sleep30-21swapper/308:10:023
24717032112,5sleep30-21swapper/307:51:523
27110612102,5sleep30-21swapper/311:55:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional