You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-21 - 01:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Jul 20, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
259788322790,3sleep3584-21kworker/3:2-events08:37:283
277382321650,3sleep3584-21kworker/3:2-events11:32:303
2510557996052,5cyclictest2750544-21cp11:10:001
2510553995954,3cyclictest2458827-21kworker/u8:3+flush-8:007:20:000
2510553995950,7cyclictest2720805-21latency_hist10:40:020
2510561995853,3cyclictest2780260-21kworker/u8:1+events_unbound12:15:012
2510557995849,6cyclictest2740583-21latency_hist11:00:011
2510557995749,6cyclictest2780260-21kworker/u8:1+flush-8:012:02:401
2510553995749,6cyclictest2839767-21latency_hist12:40:010
2510557995651,4cyclictest2705943-21kworker/u8:3+events_unbound11:17:411
2510557995646,7cyclictest2690834-21apt-get10:10:001
2510557995642,10cyclictest281-21systemd-journal08:47:251
2510553995648,5cyclictest2561931-21latency_hist08:00:010
2510557995546,6cyclictest2675999-21latency_hist09:55:011
2510557995545,7cyclictest281-21systemd-journal11:30:011
2510553995547,5cyclictest2556998-21latency_hist07:55:010
2510561995448,4cyclictest2566906-21kworker/u8:1+events_unbound08:12:232
25882652530,2sleep3584-21kworker/3:2+mm_percpu_wq08:27:293
2510553995343,7cyclictest2656236-21latency_hist09:35:010
2510561995246,4cyclictest2735844-21kworker/u8:0+events_unbound11:32:282
2510557995247,3cyclictest2490843-21kworker/u8:2+flush-8:007:47:341
2510561995147,3cyclictest2566906-21kworker/u8:1+flush-8:008:07:402
2510557995146,3cyclictest2780260-21kworker/u8:1+flush-8:012:17:261
26732632490,6chrt0-21swapper/209:52:302
2510557994943,4cyclictest2631747-21kworker/u8:2+flush-8:009:17:411
2510557994740,4cyclictest2735844-21kworker/u8:0+flush-8:011:57:411
2510553994739,6cyclictest2706329-21/usr/sbin/munin10:27:380
2510557994640,4cyclictest2626759-21kworker/u8:1+flush-8:009:07:261
2510557994640,4cyclictest2566906-21kworker/u8:1+flush-8:008:12:381
2510557994638,6cyclictest2626759-21kworker/u8:1+flush-8:010:02:231
2510557994634,9cyclictest2546433-21ntpq07:42:351
2510561994539,4cyclictest2735844-21kworker/u8:0+events_unbound11:50:092
2510557994539,4cyclictest2735844-21kworker/u8:0+flush-8:012:22:391
2510561994439,4cyclictest2705943-21kworker/u8:3+events_unbound11:22:452
2510557994436,5cyclictest2621347-21kworker/u8:3+flush-8:009:02:341
2510561994339,3cyclictest2576591-21kworker/u8:2+events_unbound08:47:392
2510561994338,4cyclictest2780260-21kworker/u8:1+events_unbound12:15:042
2510561994338,4cyclictest2705943-21kworker/u8:3+events_unbound11:27:392
2510557994338,4cyclictest2458827-21kworker/u8:3+flush-8:007:12:391
2510557994338,4cyclictest2458827-21kworker/u8:3+flush-8:007:12:391
2510557994336,5cyclictest2686167-21kworker/u8:2+flush-8:010:42:341
2510561994239,2cyclictest2656048-21kworker/u8:0+events_unbound10:17:272
2510561994237,4cyclictest2830209-21kworker/u8:2+flush-8:012:37:422
2510561994237,4cyclictest2542439-21kworker/u8:0+events_unbound08:52:342
2510557994237,3cyclictest2705943-21kworker/u8:3+flush-8:010:47:301
2510557994136,4cyclictest2705943-21kworker/u8:3+flush-8:012:27:381
2510557994136,4cyclictest2705943-21kworker/u8:3+flush-8:012:27:381
2510557994134,5cyclictest2755077-21kworker/u8:2+flush-8:011:37:371
2510553994132,6cyclictest2750451-21apt-get11:10:000
2510561994035,3cyclictest2705943-21kworker/u8:3+events_unbound11:12:392
2510557994035,4cyclictest2500611-21kworker/u8:1+flush-8:007:17:251
2510557994034,4cyclictest2711316-21apt-get10:32:221
2510561993935,3cyclictest2490843-21kworker/u8:2+events_unbound07:37:422
2510561993933,4cyclictest2705943-21kworker/u8:3+events_unbound12:32:092
2510553993930,6cyclictest2755664-21latency_hist11:15:000
2510553993928,9cyclictest2739794-21ntpq10:57:330
2510553993829,6cyclictest281-21systemd-journal08:37:230
2510553993712,23cyclictest2810167-21kworker/0:0+events12:17:350
2510561993631,4cyclictest2626759-21kworker/u8:1+flush-8:009:22:422
2510557993630,4cyclictest2641142-21kworker/u8:3+flush-8:009:57:411
2510557993629,5cyclictest2705943-21kworker/u8:3+events_unbound10:37:301
2510557993629,5cyclictest2626759-21kworker/u8:1+flush-8:010:22:371
2510557993629,5cyclictest2626759-21kworker/u8:1+flush-8:010:22:371
2510557993628,6cyclictest2522740-21/usr/sbin/munin07:22:401
2510557993626,8cyclictest2744816-21ntpq11:02:361
251055399363,32cyclictest2760968-21kworker/0:3+events11:44:110
251055399362,32cyclictest2701025-21kworker/0:2+events10:32:370
2510561993529,4cyclictest2735844-21kworker/u8:0+events_unbound12:05:052
2510557993530,3cyclictest2542439-21kworker/u8:0+flush-8:008:27:241
2510557993528,5cyclictest2735600-21latency_hist10:55:011
2510557993528,5cyclictest2705943-21kworker/u8:3+events_unbound12:32:241
2510557993528,5cyclictest2631747-21kworker/u8:2+events_unbound09:12:371
2510557993524,8cyclictest2605982-21ntpq08:42:351
2510553993529,4cyclictest2621347-21kworker/u8:3+events_unbound09:02:300
250587123525,4sleep00-21swapper/007:06:450
2510557993430,3cyclictest2542439-21kworker/u8:0+events_unbound08:52:361
2510557993429,3cyclictest2576591-21kworker/u8:2+events_unbound08:17:391
2510557993429,3cyclictest2576591-21kworker/u8:2+events_unbound08:17:391
2510557993429,3cyclictest2542439-21kworker/u8:0+flush-8:007:52:321
2510557993428,4cyclictest2626759-21kworker/u8:1+flush-8:010:12:301
2510557993427,5cyclictest2542439-21kworker/u8:0+flush-8:007:57:351
2510557993427,5cyclictest2490843-21kworker/u8:2+events_unbound07:27:351
251055399342,30cyclictest2701025-21kworker/0:2+events10:52:350
251055399342,30cyclictest2490847-21kworker/0:1+events07:42:230
251055399341,31cyclictest2656275-21kworker/0:0+events10:00:350
251055399341,31cyclictest2490847-21kworker/0:1+events07:47:310
2510561993327,4cyclictest2705943-21kworker/u8:3+events_unbound11:05:012
2510557993328,4cyclictest2656048-21kworker/u8:0+flush-8:009:47:311
2510557993326,5cyclictest2656048-21kworker/u8:0+flush-8:009:37:331
2510553993327,4cyclictest2780260-21kworker/u8:1+flush-8:012:12:300
251055399332,30cyclictest2490847-21kworker/0:1+events08:29:510
251055399331,31cyclictest2760968-21kworker/0:3+events11:28:070
2510561993227,3cyclictest2542439-21kworker/u8:0+events_unbound08:00:012
2510557993228,3cyclictest2705943-21kworker/u8:3+flush-8:011:42:391
2510557993227,4cyclictest2458827-21kworker/u8:3+flush-8:008:30:311
2510557993226,4cyclictest2567319-21apt-get08:07:201
2510557993224,6cyclictest2542439-21kworker/u8:0+flush-8:008:22:361
2510557993222,8cyclictest2655456-21ntpq09:32:331
251055399328,22cyclictest2701025-21kworker/0:2+events10:47:350
251055399323,27cyclictest2490847-21kworker/0:1+events07:37:350
251055399322,29cyclictest2656275-21kworker/0:0+events09:52:310
251055399322,29cyclictest2490847-21kworker/0:1+events08:17:350
251055399322,29cyclictest2490847-21kworker/0:1+events08:17:350
251055399322,29cyclictest2490847-21kworker/0:1+events08:04:010
251055399322,28cyclictest2760968-21kworker/0:3+events11:37:250
251055399321,29cyclictest2829892-21kworker/0:1+events12:32:250
251055399321,29cyclictest2490847-21kworker/0:1+events09:17:210
25058682323,9sleep20-21swapper/207:06:432
2510561993127,3cyclictest2705943-21kworker/u8:3+flush-8:011:37:462
2510561993120,8cyclictest281-21systemd-journal11:01:082
2510557993126,4cyclictest2735844-21kworker/u8:0+flush-8:011:32:291
251055399319,18cyclictest2760968-21kworker/0:3+events11:30:270
251055399314,26cyclictest2800281-21kworker/0:1+events12:03:430
2510553993126,3cyclictest2756326-21cpuspeed_turbos11:17:250
251055399312,28cyclictest2490847-21kworker/0:1+events07:27:270
251055399312,27cyclictest2810167-21kworker/0:0+events12:27:330
251055399312,27cyclictest2810167-21kworker/0:0+events12:27:330
251055399312,27cyclictest2656275-21kworker/0:0+events10:07:330
251055399312,27cyclictest2656275-21kworker/0:0+events09:42:210
2510557993026,3cyclictest2626759-21kworker/u8:1+events_unbound09:22:251
2510557993026,3cyclictest2611447-21kworker/u8:1+events_unbound08:57:381
2510557993025,3cyclictest2705943-21kworker/u8:3+events_unbound11:47:371
2510557993024,4cyclictest2755077-21kworker/u8:2+events_unbound11:22:241
2510557993024,4cyclictest2705943-21kworker/u8:3+events_unbound12:37:251
251055399307,18cyclictest2490847-21kworker/0:1+events08:55:270
251055399302,26cyclictest2490847-21kworker/0:1+events08:22:350
251055399301,28cyclictest2490847-21kworker/0:1+events08:42:330
251055399301,27cyclictest2490847-21kworker/0:1+events09:37:270
2510561992921,6cyclictest2586802-21gpgv08:25:002
2510557992923,4cyclictest2641142-21kworker/u8:3+flush-8:009:42:281
2510557992922,5cyclictest389-21systemd-logind08:40:001
2510557992921,6cyclictest2814286-21ntpq12:12:341
251055399298,20cyclictest2760968-21kworker/0:3+events11:56:590
2510553992924,4cyclictest2705943-21kworker/u8:3+flush-8:011:47:300
251055399292,26cyclictest2656275-21kworker/0:0+events09:46:130
251055399292,26cyclictest2490847-21kworker/0:1+events09:12:210
2510553992922,5cyclictest281-21systemd-journal09:22:310
251055399292,25cyclictest2760968-21kworker/0:3+events11:22:350
251055399291,27cyclictest2656275-21kworker/0:0+events10:12:330
251055399291,26cyclictest2490847-21kworker/0:1+events08:47:310
2510553992910,18cyclictest2490847-21kworker/0:1+events08:12:270
251055399290,28cyclictest2490847-21kworker/0:1+events07:22:300
251055399290,27cyclictest2656275-21kworker/0:0+events10:17:270
2510561992825,2cyclictest2795848-21aten2_r5power_v11:57:232
2510561992824,3cyclictest2621347-21kworker/u8:3+flush-8:009:10:242
2510561992823,3cyclictest2735844-21kworker/u8:0+events_unbound11:45:102
2510561992823,3cyclictest2685616-21unixbench_multi10:02:402
2510557992823,3cyclictest2458827-21kworker/u8:3+flush-8:007:37:291
2510557992822,4cyclictest2490843-21kworker/u8:2+events_unbound07:32:231
251055399287,20cyclictest2810167-21kworker/0:0+events12:20:070
251055399287,19cyclictest2490847-21kworker/0:1+events09:28:090
251055399286,18cyclictest2490847-21kworker/0:1+events07:10:120
251055399286,18cyclictest2490847-21kworker/0:1+events07:10:110
2510553992810,16cyclictest2800281-21kworker/0:1+events12:07:390
27219852270,2sleep20-21swapper/210:42:302
2510561992723,3cyclictest2656881-21cpuspeed_turbos09:37:232
2510557992722,4cyclictest2641142-21kworker/u8:3+flush-8:009:27:231
2510557992722,4cyclictest2542439-21kworker/u8:0+flush-8:008:02:391
251055399279,16cyclictest2701025-21kworker/0:2+events11:02:370
251055399279,16cyclictest2490847-21kworker/0:1+events08:07:350
251055399278,17cyclictest2490847-21kworker/0:1+events09:05:240
2510561992622,2cyclictest2804914-21unixbench_multi12:02:422
2510561992621,3cyclictest2636962-21aten2_r5power_p09:17:232
2510557992619,5cyclictest2700974-21latency_hist10:20:001
251055399269,16cyclictest2760968-21kworker/0:3+events11:52:250
251055399267,17cyclictest2490847-21kworker/0:1+events07:31:330
251055399262,21cyclictest2656275-21kworker/0:0+events09:55:050
2510553992621,3cyclictest2615768-21needreboot08:52:340
2510553992611,14cyclictest2701025-21kworker/0:2+events10:22:290
2510553992611,14cyclictest2701025-21kworker/0:2+events10:22:290
2510553992610,14cyclictest2701025-21kworker/0:2+events10:42:370
2510561992522,1cyclictest2726510-21cut10:47:262
2510561992521,2cyclictest2557693-21fschecks_count07:57:252
2510561992520,3cyclictest2829576-21unixbench_multi12:27:392
2510561992520,3cyclictest2829576-21unixbench_multi12:27:392
2510561992518,6cyclictest2531985-21unixbench_singl07:27:412
2510557992518,5cyclictest2735844-21kworker/u8:0+flush-8:011:12:271
2510557992518,5cyclictest2626759-21kworker/u8:1+events_unbound10:29:591
2510561992421,2cyclictest2736320-21fschecks_count10:57:252
2510561992421,2cyclictest2647142-21fschecks_time09:27:252
2510561992420,3cyclictest2705943-21kworker/u8:3+events_unbound10:31:222
2510561992420,3cyclictest2686167-21kworker/u8:2+events_unbound10:06:262
2510557992418,4cyclictest2780260-21kworker/u8:1+events_unbound12:07:231
251055399242,21cyclictest0-21swapper/008:32:410
26620692230,5sleep20-21swapper/209:42:272
2510561992320,2cyclictest2587447-21aten2_r5power_p08:27:232
25103512232,14sleep12510375-21munin-run07:10:001
28260362220,2sleep3471rcuc/312:27:273
28260362220,2sleep3471rcuc/312:27:273
2510561992219,2cyclictest2666891-21fschecks_time09:47:262
2510561992217,4cyclictest2760366-21unixbench_singl11:17:422
251056199215,4cyclictest39-21ksoftirqd/207:40:182
2510561992118,2cyclictest2706441-21aten2_r5power_p10:27:242
2510561992015,4cyclictest2621276-21unixbench_singl08:57:402
251056199200,18cyclictest2536542-21grep07:32:362
251056199200,11cyclictest1-21systemd10:15:002
2510557992015,3cyclictest2780260-21kworker/u8:1+events_unbound11:52:241
251056199194,2cyclictest161rcu_preempt07:47:412
251056199193,8cyclictest0-21swapper/209:57:282
2510561991915,2cyclictest0-21swapper/207:25:012
251056199191,1cyclictest0-21swapper/208:32:312
251056199190,10cyclictest2517795-21/usr/sbin/munin07:17:202
251056199183,2cyclictest0-21swapper/209:02:242
251056199182,8cyclictest0-21swapper/210:22:382
251056199182,8cyclictest0-21swapper/210:22:382
2510561991814,3cyclictest2601536-21unixbench_singl08:37:412
2510561991814,3cyclictest0-21swapper/207:15:012
2510561991814,3cyclictest0-21swapper/207:15:002
2510561991814,2cyclictest2651944-21cpuspeed_turbos09:32:232
2510561991812,1cyclictest421rcuog/210:51:142
251056199180,10cyclictest371rcuc/212:22:302
25102162183,8sleep30-21swapper/307:08:133
27850392170,2chrt584-21kworker/3:2+events11:42:413
251056199177,7cyclictest2783079-21tr11:42:302
251056199172,3cyclictest0-21swapper/210:37:282
2510561991613,2cyclictest0-21swapper/208:40:052
2510561991611,3cyclictest0-21swapper/208:17:302
2510561991611,3cyclictest0-21swapper/208:17:302
2510561991611,3cyclictest0-21swapper/207:52:302
27611032152,8sleep30-21swapper/311:22:243
251056199152,12cyclictest0-21swapper/209:06:112
26764232142,8sleep30-21swapper/309:57:213
28298552132,6sleep30-21swapper/312:30:023
28051822132,6sleep30-21swapper/312:05:013
27549512133,6sleep30-21swapper/311:12:373
26999882132,7sleep30-21swapper/310:17:323
26743282132,7sleep30-21swapper/309:52:323
25619752132,6sleep30-21swapper/308:00:023
28391132122,6sleep30-21swapper/312:37:393
28160802122,6sleep30-21swapper/312:17:293
28109412122,6sleep30-21swapper/312:12:273
27957382126,4sleep30-21swapper/311:57:223
27912952122,6sleep30-21swapper/311:52:293
27778572122,6sleep30-21swapper/311:37:323
27696502122,6sleep30-21swapper/311:27:333
27557302122,5sleep30-21swapper/311:15:023
27408322122,6sleep30-21swapper/311:00:093
27365022122,6sleep30-21swapper/310:57:283
27289342122,6sleep30-21swapper/310:47:333
27102682122,6sleep30-21swapper/310:27:393
26813802122,6sleep30-21swapper/310:02:243
26571522122,6sleep30-21swapper/309:37:273
26515292122,6sleep30-21swapper/309:30:093
26265462122,6sleep30-21swapper/309:05:013
26125472122,6sleep30-21swapper/308:52:293
25923212122,6sleep30-21swapper/308:32:233
25846062122,6sleep30-21swapper/308:22:323
25673352122,6sleep30-21swapper/308:07:233
25607542122,6sleep30-21swapper/307:57:323
25528692122,6sleep30-21swapper/307:52:273
25462122122,6sleep30-21swapper/307:42:323
25326152122,6sleep30-21swapper/307:32:093
25281902122,6sleep30-21swapper/307:27:273
25223582122,5sleep30-21swapper/307:20:013
25151352122,6sleep30-21swapper/307:12:433
25151352122,6sleep30-21swapper/307:12:433
28206792112,6sleep30-21swapper/312:22:263
28055572112,6sleep30-21swapper/312:06:493
27863492112,6sleep30-21swapper/311:47:273
27463852112,6sleep30-21swapper/311:07:273
27314382112,5sleep30-21swapper/310:52:263
27212772112,5sleep30-21swapper/310:42:233
27111922112,5sleep30-21swapper/310:31:083
27040812112,5sleep30-21swapper/310:22:293
27040812112,5sleep30-21swapper/310:22:293
26918732112,5sleep30-21swapper/310:12:263
26862902112,5sleep30-21swapper/310:07:083
26668382112,5sleep30-21swapper/309:47:273
26615712112,5sleep30-21swapper/309:41:493
26469052112,5sleep30-21swapper/309:27:243
26420812112,5sleep30-21swapper/309:22:273
26371192111,6sleep30-21swapper/309:17:253
26319192112,5sleep30-21swapper/309:12:233
26219412112,5sleep30-21swapper/309:02:203
26169612112,6sleep30-21swapper/308:57:033
26115672112,6sleep30-21swapper/308:49:243
26024932112,6sleep30-21swapper/308:42:263
25810552112,6sleep30-21swapper/308:17:393
25810552112,6sleep30-21swapper/308:17:393
25721362112,6sleep30-21swapper/308:10:573
25518752112,6sleep30-21swapper/307:47:463
25378572112,5sleep30-21swapper/307:37:263
25166802112,5sleep30-21swapper/307:15:033
27160712102,5sleep30-21swapper/310:35:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional