You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 21:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Mar 14, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2270452996453,8cyclictest280-21systemd-journal07:15:010
25206202560,3sleep3481ktimers/311:20:013
2270452995545,6cyclictest280-21systemd-journal07:31:400
2270452995239,11cyclictest2386412-21kworker/u8:1+flush-8:009:26:480
2270452995239,11cyclictest2386412-21kworker/u8:1+flush-8:009:26:480
2270454995141,7cyclictest2270268-21latency_hist07:10:001
2270452995141,3cyclictest2346591-21kworker/u8:0+events_unbound09:06:520
2270452995044,4cyclictest2250922-21kworker/u8:1+flush-8:007:30:010
2270452994943,4cyclictest2361651-21kworker/u8:2+events_unbound08:51:470
2270454994739,6cyclictest2361651-21kworker/u8:2+flush-8:008:56:391
2270452994740,5cyclictest2531839-21kworker/u8:0+events_unbound12:01:460
2270454994639,4cyclictest2327035-21kworker/u8:3+flush-8:008:11:401
2270452994641,3cyclictest2250922-21kworker/u8:1+events_unbound07:16:390
2270452994640,3cyclictest2327035-21kworker/u8:3+flush-8:008:16:540
2270452994638,6cyclictest2580072-21kworker/u8:3+flush-8:012:21:530
25510292450,2sleep3471rcuc/311:51:353
2270458994536,7cyclictest280-21systemd-journal08:26:462
2270452994535,8cyclictest2445264-21ntpq10:01:510
2270452994441,2cyclictest2391602-21kworker/u8:2+flush-8:009:11:540
2270454994338,3cyclictest2386412-21kworker/u8:1+events_unbound10:46:411
2270454994334,7cyclictest280-21systemd-journal07:55:001
2270452994339,3cyclictest2475919-21kworker/u8:3+flush-8:010:56:400
2270452994338,3cyclictest2250922-21kworker/u8:1+events_unbound07:51:390
2270452994236,4cyclictest2580072-21kworker/u8:3+events_unbound12:36:410
2270452994230,4cyclictest2327035-21kworker/u8:3+events_unbound09:01:470
2270454994131,7cyclictest280-21systemd-journal09:35:451
2270452994138,2cyclictest2386412-21kworker/u8:1+events_unbound11:20:010
2270454994032,5cyclictest2565541-21latency_hist12:05:011
2270452994036,3cyclictest2386412-21kworker/u8:1+events_unbound11:21:470
2270452994035,4cyclictest2531839-21kworker/u8:0+flush-8:011:56:540
2270452994035,2cyclictest2391602-21kworker/u8:2+events_unbound09:41:440
2270454993933,4cyclictest2425478-21kworker/u8:3+flush-8:009:46:511
2270454993930,7cyclictest280-21systemd-journal11:47:441
2270452993934,3cyclictest2475919-21kworker/u8:3+events_unbound11:26:370
2270452993934,3cyclictest2386412-21kworker/u8:1+events_unbound11:06:560
2270452993934,3cyclictest2346591-21kworker/u8:0+events_unbound09:36:430
2270452993933,4cyclictest2386412-21kworker/u8:1+flush-8:010:31:490
2270452993933,4cyclictest2386412-21kworker/u8:1+flush-8:010:31:490
2270452993933,4cyclictest2327035-21kworker/u8:3+events_unbound08:11:390
2270452993932,5cyclictest2386412-21kworker/u8:1+flush-8:009:56:490
2270454993830,5cyclictest280-21systemd-journal10:11:451
2270454993829,7cyclictest2421632-21/usr/sbin/munin09:41:491
2270452993834,3cyclictest2250922-21kworker/u8:1+flush-8:008:36:550
2270452993833,4cyclictest2525444-21kworker/u8:2+events_unbound12:06:490
2270452993833,2cyclictest2585513-21kworker/u8:1+events_unbound12:31:430
2270452993832,4cyclictest2525444-21kworker/u8:2+events_unbound12:30:010
2270452993826,4cyclictest2386412-21kworker/u8:1+events_unbound11:01:400
2270452993731,4cyclictest2386412-21kworker/u8:1+flush-8:011:31:430
2270452993731,4cyclictest2386412-21kworker/u8:1+flush-8:009:21:490
2270454993632,3cyclictest2346591-21kworker/u8:0+flush-8:009:15:011
2270454993629,5cyclictest280-21systemd-journal07:34:371
2270452993633,2cyclictest2525444-21kworker/u8:2+events_unbound12:16:520
2270452993631,3cyclictest2250922-21kworker/u8:1+events_unbound08:06:370
2270452993631,3cyclictest2250922-21kworker/u8:1+events_unbound08:00:000
2270452993625,8cyclictest2416074-21apt-get09:35:000
25147352350,3sleep375-21kworker/3:1+events11:11:503
2270454993530,3cyclictest2475919-21kworker/u8:3+events_unbound10:51:441
2270454993529,4cyclictest2327035-21kworker/u8:3+flush-8:008:16:391
2270454993529,4cyclictest1595475-21kworker/u8:0+events_unbound08:01:401
2270454993528,5cyclictest2250922-21kworker/u8:1+events_unbound07:46:491
2270452993532,2cyclictest2386412-21kworker/u8:1+flush-8:010:27:040
2270452993529,4cyclictest2250922-21kworker/u8:1+flush-8:007:36:470
2270452993529,4cyclictest2250922-21kworker/u8:1+events_unbound07:46:400
2270452993529,4cyclictest2250922-21kworker/u8:1+events_unbound07:21:500
2270452993528,4cyclictest2292122-21kworker/u8:3+flush-8:007:41:560
2270454993429,4cyclictest2361651-21kworker/u8:2+flush-8:008:41:401
2270454993427,5cyclictest2460595-21journal-offline10:17:021
2270454993426,6cyclictest2575710-21/usr/sbin/munin12:16:461
2270452993429,3cyclictest2475919-21kworker/u8:3+events_unbound11:36:380
2270452993429,3cyclictest2425478-21kworker/u8:3+events_unbound09:51:420
2270452993429,3cyclictest2391602-21kworker/u8:2+events_unbound09:16:360
2270452993427,5cyclictest280-21systemd-journal12:12:150
2270452993427,5cyclictest2525444-21kworker/u8:2+events_unbound11:51:470
2270452993427,5cyclictest2475919-21kworker/u8:3+events_unbound11:11:520
22656652344,10sleep20-21swapper/207:05:412
2270454993326,5cyclictest2250922-21kworker/u8:1+flush-8:007:56:401
2270452993328,3cyclictest2425478-21kworker/u8:3+events_unbound09:46:470
2270452993327,4cyclictest2386412-21kworker/u8:1+flush-8:010:45:010
2270452993327,4cyclictest2346591-21kworker/u8:0+flush-8:010:06:400
2270454993225,5cyclictest280-21systemd-journal11:31:371
2270452993226,4cyclictest2346591-21kworker/u8:0+events_unbound10:21:490
2270454993127,2cyclictest2505369-21cron11:05:001
2270454993124,5cyclictest2356826-21apt-get08:36:351
2270454993123,5cyclictest2595177-21latency_hist12:35:011
2270452993127,3cyclictest2361651-21kworker/u8:2+flush-8:008:41:520
2270452993127,3cyclictest2250922-21kworker/u8:1+flush-8:008:31:430
2270452993127,3cyclictest1595475-21kworker/u8:0+flush-8:008:01:540
2270452993126,3cyclictest2386412-21kworker/u8:1+events_unbound10:16:520
2270458993026,2cyclictest2321544-21grep07:56:552
2270458993017,11cyclictest280-21systemd-journal10:21:452
2270454993026,3cyclictest2352604-21ps08:31:421
2270454993025,4cyclictest2386412-21kworker/u8:1+flush-8:009:56:411
2270454993023,5cyclictest2475919-21kworker/u8:3+flush-8:011:26:551
2270454993022,6cyclictest2415285-21ntpq09:31:481
2270452993027,2cyclictest2525444-21kworker/u8:2+flush-8:011:41:550
2270452993026,3cyclictest2475919-21kworker/u8:3+flush-8:010:51:500
2270452993026,3cyclictest2475919-21kworker/u8:3+flush-8:010:36:540
2270452993022,3cyclictest2250922-21kworker/u8:1+events_unbound08:27:470
2270458992924,3cyclictest2581042-21fschecks_time12:21:382
2270458992923,4cyclictest280-21systemd-journal10:00:452
2270454992923,4cyclictest2585513-21kworker/u8:1+flush-8:012:26:451
2270452992924,4cyclictest2327035-21kworker/u8:3+events_unbound08:21:520
2270452992922,5cyclictest2361651-21kworker/u8:2+flush-8:008:46:400
25428532280,5sleep3481ktimers/311:41:433
2270454992824,3cyclictest2250922-21kworker/u8:1+events_unbound08:06:451
2270454992824,2cyclictest2383984-21kthreadcore09:01:441
2270454992824,2cyclictest0-21swapper/112:40:001
2270454992822,4cyclictest280-21systemd-journal10:27:451
227045499280,26cyclictest1-21systemd11:20:001
2270458992724,2cyclictest2455551-21unixbench_multi10:11:542
2270458992723,2cyclictest2541224-21fschecks_time11:41:392
2270458992723,2cyclictest2506065-21aten2_r5power_p11:06:382
2270458992719,6cyclictest2505365-21cron11:05:002
227045899271,23cyclictest2436742-21fschecks_count09:56:382
2270454992723,2cyclictest0-21swapper/108:50:001
2270454992722,4cyclictest2525444-21kworker/u8:2+flush-8:011:36:491
2270458992622,3cyclictest2287889-21fschecks_time07:26:402
2270458992622,2cyclictest2560979-21aten2_r5power_e12:01:352
2270458992622,2cyclictest2421880-21cpuspeed_turbos09:41:402
2270458992622,2cyclictest2411855-21fschecks_time09:31:392
2270458992622,2cyclictest2376878-21aten2_r5power_c08:56:362
2270458992622,2cyclictest0-21swapper/209:40:002
2270458992621,4cyclictest0-21swapper/207:55:002
2270454992622,3cyclictest2391377-21systemd-run09:10:001
2270454992619,5cyclictest280-21systemd-journal11:50:011
2270454992618,6cyclictest2475919-21kworker/u8:3+flush-8:010:41:541
2270452992620,4cyclictest2549964-21wc11:46:540
22657352263,4sleep00-21swapper/007:06:350
2270458992521,2cyclictest2471150-21aten2_r5power_c10:31:362
2270458992521,2cyclictest2471150-21aten2_r5power_c10:31:362
2270458992521,2cyclictest2302634-21cpuspeed_turbos07:41:392
2270454992522,2cyclictest2450992-21systemd-run10:10:001
2270454992521,3cyclictest2386412-21kworker/u8:1+events_unbound09:25:011
2270454992521,3cyclictest0-21swapper/109:20:001
2270454992520,3cyclictest0-21swapper/107:20:001
2270454992519,4cyclictest2525444-21kworker/u8:2+flush-8:011:41:501
2270454992519,4cyclictest2411145-21munin-plugin-st09:30:001
2270454992519,4cyclictest2411145-21munin-plugin-st09:30:001
2270454992516,7cyclictest280-21systemd-journal12:25:011
2270452992521,3cyclictest2441296-21kworker/u8:2+flush-8:010:47:070
2270458992421,2cyclictest2600102-21cron12:40:002
2270458992421,2cyclictest2480355-21unixbench_singl10:36:552
2270458992420,2cyclictest2459951-21needreboot10:16:442
2270458992420,2cyclictest2410788-21unixbench_multi09:26:552
2270458992420,2cyclictest2410788-21unixbench_multi09:26:552
2270458992420,2cyclictest2386816-21aten2_r5power_e09:06:362
2270458992420,2cyclictest2366949-21cpuspeed_turbos08:46:382
2270458992420,2cyclictest2282620-21aten2_r5power_e07:21:372
2270454992421,2cyclictest0-21swapper/108:51:421
2270454992420,3cyclictest0-21swapper/111:56:371
2270454992419,3cyclictest2386412-21kworker/u8:1+flush-8:011:06:411
2270454992419,3cyclictest2342242-21grep08:21:391
2270454992419,3cyclictest0-21swapper/111:25:011
2270454992416,6cyclictest280-21systemd-journal07:26:391
2270452992420,3cyclictest2361651-21kworker/u8:2+events_unbound08:55:070
2270458992320,2cyclictest2495887-21aten2_r5power_c10:56:372
2270458992319,2cyclictest2551323-21fschecks_time11:51:372
2270458992319,2cyclictest2481093-21aten2_r5power_e10:41:382
2270458992317,4cyclictest2575064-21unixbench_singl12:11:542
227045499232,20cyclictest0-21swapper/107:11:541
2270454992318,4cyclictest2531839-21kworker/u8:0+events_unbound12:11:441
2270454992318,3cyclictest0-21swapper/112:06:471
2270458992218,3cyclictest2595164-21cron12:35:002
2270458992217,3cyclictest2446948-21cut10:06:442
2270454992218,3cyclictest2303008-21irqcore07:41:431
2270454992213,6cyclictest2436112-21latency_hist09:55:011
2270452992217,3cyclictest2386412-21kworker/u8:1+events_unbound10:11:360
227045899212,2cyclictest0-21swapper/211:46:532
2270458992118,2cyclictest2301718-21unixbench_singl07:36:542
2270458992117,2cyclictest2531172-21cpuspeed_turbos11:31:372
2270458992117,2cyclictest2430836-21unixbench_multi09:46:542
2270458992117,2cyclictest0-21swapper/208:36:502
2270458992110,4cyclictest0-21swapper/211:58:052
2270454992118,2cyclictest2471336-21cpuspeed_turbos10:31:371
2270454992118,2cyclictest2471336-21cpuspeed_turbos10:31:371
2270454992117,2cyclictest0-21swapper/111:11:391
2270454992117,2cyclictest0-21swapper/110:21:401
2270454992117,2cyclictest0-21swapper/107:36:441
2270454992117,2cyclictest0-21swapper/107:21:541
2270454992116,3cyclictest0-21swapper/110:56:391
2270454992115,4cyclictest0-21swapper/108:26:431
2270454992114,5cyclictest0-21swapper/110:01:351
2270458992016,3cyclictest2316914-21kworker/u8:2+events_unbound08:25:002
2270458992016,2cyclictest2520142-21unixbench_singl11:16:532
2270458992016,2cyclictest0-21swapper/211:36:422
2270458992012,6cyclictest2432520-21seq09:51:432
2270458992012,6cyclictest2296156-21grep07:31:472
2270458991916,2cyclictest2402560-21kthreadcore09:21:432
2270458991915,2cyclictest2381910-21aten2_r5power_p09:01:372
2270458991915,2cyclictest0-21swapper/208:41:472
2270458991915,2cyclictest0-21swapper/208:16:472
2270458991914,4cyclictest2470742-21cron10:30:002
2270458991914,3cyclictest0-21swapper/212:10:002
2270458991914,3cyclictest0-21swapper/211:21:372
2270454991913,4cyclictest2478107-21kthreadcore10:36:451
23596762180,5sleep3451irq_work/308:36:463
227045899189,7cyclictest2492648-21tr10:51:442
2270458991815,2cyclictest0-21swapper/211:11:542
2270458991814,3cyclictest0-21swapper/211:30:012
2270458991814,2cyclictest2327230-21aten2_r5power_e08:06:362
2270458991810,6cyclictest2325494-21tr08:01:462
227045899180,16cyclictest2276296-21cut07:15:032
22656412183,8sleep30-21swapper/307:05:223
23024192172,10sleep30-21swapper/307:41:383
227045899179,6cyclictest280-21systemd-journal10:47:452
227045899179,6cyclictest2393750-21tr09:11:452
2270458991713,3cyclictest2376471-21cron08:55:002
2270458991713,2cyclictest0-21swapper/207:11:402
2270458991712,3cyclictest0-21swapper/212:16:422
2270458991613,2cyclictest2396897-21cpuspeed_turbos09:16:372
2270458991613,2cyclictest0-21swapper/212:26:292
2270458991612,2cyclictest0-21swapper/207:46:382
2270458991611,3cyclictest0-21swapper/208:11:452
2270458991511,3cyclictest2352603-21irqrtprio08:31:422
24630762143,6sleep30-21swapper/310:21:433
25856962132,7sleep30-21swapper/312:26:383
24463882132,7sleep30-21swapper/310:06:353
24312032132,6sleep30-21swapper/309:50:023
24012352132,7sleep30-21swapper/309:20:003
23207372133,7sleep30-21swapper/307:56:463
22921972132,6sleep30-21swapper/307:30:023
22912872132,7sleep30-21swapper/307:26:493
22781142132,7sleep30-21swapper/307:16:423
22744462132,7sleep30-21swapper/307:11:483
25952012122,5sleep30-21swapper/312:35:013
25912172120,8sleep30-21swapper/312:31:443
25704732122,5sleep30-21swapper/312:10:013
25372862122,6sleep30-21swapper/311:36:433
25267012123,6sleep30-21swapper/311:26:443
25217112122,6sleep30-21swapper/311:21:423
25072512123,6sleep30-21swapper/311:06:463
25016932120,8sleep30-21swapper/311:01:443
24769422122,6sleep30-21swapper/310:36:443
24559282122,5sleep30-21swapper/310:15:013
24513392122,6sleep30-21swapper/310:11:363
24368602122,6sleep30-21swapper/309:56:403
24198042122,6sleep30-21swapper/309:36:453
24118782122,6sleep30-21swapper/309:31:403
23913792122,5sleep30-21swapper/309:10:013
23871372122,6sleep30-21swapper/309:06:403
23663742122,5sleep30-21swapper/308:45:013
23660972122,6sleep30-21swapper/308:41:563
23474572122,6sleep30-21swapper/308:26:443
23424282122,6sleep30-21swapper/308:21:423
23370442122,6sleep30-21swapper/308:16:373
23268212122,5sleep30-21swapper/308:05:013
23260652123,6sleep30-21swapper/308:01:523
23011912122,6sleep30-21swapper/307:36:483
22825342122,6sleep30-21swapper/307:21:353
25806652112,5sleep30-21swapper/312:21:333
25759882112,5sleep30-21swapper/312:16:393
25661462112,5sleep30-21swapper/312:06:403
25607322112,5sleep30-21swapper/312:00:023
25490742112,5sleep30-21swapper/311:46:463
25308402112,5sleep30-21swapper/311:30:293
24955552112,5sleep30-21swapper/310:55:023
24909262112,5sleep30-21swapper/310:51:373
24863782112,5sleep30-21swapper/310:46:393
24809702112,6sleep30-21swapper/310:41:063
24716272112,5sleep30-21swapper/310:31:433
24716272112,5sleep30-21swapper/310:31:433
24662162112,5sleep30-21swapper/310:26:373
24414402112,5sleep30-21swapper/310:01:373
24264482112,6sleep30-21swapper/309:45:043
24220352112,5sleep30-21swapper/309:41:433
24064862112,6sleep30-21swapper/309:26:063
24064862112,6sleep30-21swapper/309:26:063
24016402112,5sleep30-21swapper/309:21:373
23816802112,5sleep30-21swapper/309:00:023
23769342112,5sleep30-21swapper/308:56:373
23729702112,5sleep30-21swapper/308:51:433
23522642111,6sleep30-21swapper/308:31:413
23325862112,5sleep30-21swapper/308:11:433
23123312112,5sleep30-21swapper/307:51:383
23111932112,5sleep30-21swapper/307:46:513
25599652101,5sleep30-21swapper/311:56:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional