You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 00:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sun Jul 19, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28171172760,2sleep3471rcuc/308:47:393
2715973996238,21cyclictest2956403-21latency_hist11:10:010
2715973995834,21cyclictest3030921-21latency_hist12:25:010
2715973995526,21cyclictest2935780-21needreboot10:47:330
2715973995526,21cyclictest2935780-21needreboot10:47:330
2715977995447,4cyclictest281-21systemd-journal08:37:401
2715977995446,6cyclictest2783331-21/usr/sbin/munin08:17:401
2715973995411,29cyclictest0-21swapper/010:32:230
2715977995345,6cyclictest3006081-21latency_hist12:00:011
2715973995323,20cyclictest0-21swapper/009:17:230
2715977995145,4cyclictest2691670-21kworker/u8:4+flush-8:008:27:381
2715973995142,6cyclictest3011034-21latency_hist12:05:000
2715973995040,7cyclictest2862530-21latency_hist09:35:000
2715977994942,5cyclictest2732950-40mandb07:25:011
2715977994939,7cyclictest3015987-21kworker/u8:2+flush-8:012:22:401
2715973994939,7cyclictest2881537-21ntpq09:52:360
2715977994841,5cyclictest1882543-21kworker/u8:2+flush-8:008:02:271
2715977994839,6cyclictest2691670-21kworker/u8:4+flush-8:007:37:261
2715973994839,6cyclictest2842516-21latency_hist09:15:010
2715977994742,3cyclictest2691670-21kworker/u8:4+flush-8:008:22:251
2715973994737,7cyclictest2807648-21apt-get08:40:010
271597399469,27cyclictest2742134-21ntpq07:32:350
2715973994620,16cyclictest161rcu_preempt07:27:350
2715982994540,3cyclictest2837575-21kworker/u8:1+flush-8:009:57:392
2715973994523,16cyclictest2990499-21needreboot11:42:310
2715973994517,19cyclictest0-21swapper/010:30:000
2715982994440,3cyclictest2837575-21kworker/u8:1+flush-8:010:37:312
2715977994436,6cyclictest1882543-21kworker/u8:2+flush-8:007:27:431
2715977994337,4cyclictest2766958-21ntpq07:57:371
2715977994336,5cyclictest2941793-21kworker/u8:4+events_unbound11:10:021
2715977994336,5cyclictest2808327-21apt-get08:42:201
2715973994323,13cyclictest0-21swapper/011:52:330
2715973994317,24cyclictest2850534-21kthreadcore09:22:320
2715973994317,21cyclictest0-21swapper/007:57:230
2715973994315,21cyclictest1-21systemd11:00:010
271565324329,9sleep10-21swapper/107:08:201
2715973994236,4cyclictest2887681-21apt-get10:02:220
2715973994232,8cyclictest2732177-21ntpq07:22:350
2715973994229,10cyclictest281-21systemd-journal10:42:250
2715977994135,4cyclictest2748065-21kworker/u8:0+flush-8:010:32:261
2715973994126,13cyclictest2720921-21systemd-run07:15:000
2715973994121,17cyclictest281-21systemd-journal09:05:000
2715973994114,19cyclictest0-21swapper/012:07:360
2715973994112,21cyclictest2937290-21sh10:52:250
2715982994034,4cyclictest2748065-21kworker/u8:0+events_unbound09:37:392
2715977994034,5cyclictest2748065-21kworker/u8:0+flush-8:010:02:391
2715977994032,6cyclictest2906192-21ntpq10:17:341
2715977994031,7cyclictest281-21systemd-journal07:53:401
2715977994031,6cyclictest2847456-21latency_hist09:20:011
271597399408,22cyclictest2896437-21ntp_states10:07:370
2715973994024,14cyclictest2816952-21needreboot08:47:340
2715973994012,20cyclictest0-21swapper/008:12:330
2715982993934,4cyclictest3030705-21kworker/u8:0+events_unbound12:25:012
2715982993933,4cyclictest1882543-21kworker/u8:2+flush-8:007:22:272
2715977993935,3cyclictest2691670-21kworker/u8:4+events_unbound07:12:281
2715977993934,4cyclictest2748065-21kworker/u8:0+flush-8:010:27:261
2715973993923,14cyclictest2981376-21cron11:35:000
271597399387,18cyclictest0-21swapper/007:17:250
2715973993819,17cyclictest2772318-21unixbench_multi08:02:420
271597399381,25cyclictest585-21runrttasks09:45:400
2715977993729,5cyclictest2812580-21kworker/u8:2+flush-8:008:52:401
2715977993726,8cyclictest281-21systemd-journal07:35:001
271597399378,19cyclictest0-21swapper/008:22:340
271597399373,24cyclictest0-21swapper/012:32:240
271597399373,19cyclictest0-21swapper/012:17:230
2715973993726,9cyclictest2911188-21ntpq10:22:350
2715973993720,15cyclictest0-21swapper/009:57:390
2715973993711,17cyclictest0-21swapper/008:57:380
271597399370,26cyclictest3020428-21/usr/sbin/munin12:12:390
2715982993630,4cyclictest2941793-21kworker/u8:4+flush-8:011:35:012
2715977993631,4cyclictest2951274-21kworker/u8:1+flush-8:011:12:581
2715977993631,4cyclictest2748065-21kworker/u8:0+flush-8:010:57:571
2715977993626,7cyclictest2951449-21latency_hist11:05:011
271597399366,16cyclictest0-21swapper/011:24:030
2715973993621,13cyclictest0-21swapper/007:40:000
2715973993618,16cyclictest2957066-21cpuspeed_turbos11:12:240
271597399360,23cyclictest585-21runrttasks08:32:540
2715982993528,5cyclictest2837575-21kworker/u8:1+flush-8:010:47:262
2715982993528,5cyclictest2837575-21kworker/u8:1+flush-8:010:47:262
2715982993528,5cyclictest2837575-21kworker/u8:1+events_unbound09:52:412
2715982993527,5cyclictest2747803-21cat07:40:002
2715977993530,4cyclictest2691670-21kworker/u8:4+flush-8:008:07:261
2715977993528,5cyclictest2748254-21apt-get07:42:211
2715977993527,6cyclictest2911735-21kworker/u8:3+flush-8:011:17:251
271597399353,23cyclictest0-21swapper/012:28:380
271597399353,20cyclictest2773017-21apt-get08:07:230
271597399351,23cyclictest0-21swapper/008:51:480
271597399350,24cyclictest2787767-21sshd08:18:400
271597399350,20cyclictest2951466-21/usr/sbin/munin11:05:010
2715977993429,4cyclictest2782743-21systemd-run08:15:001
2715977993429,4cyclictest2748065-21kworker/u8:0+flush-8:010:07:261
271597399348,14cyclictest2812013-21head08:42:330
271597399343,21cyclictest0-21swapper/009:40:390
271597399343,21cyclictest0-21swapper/009:26:350
271597399343,21cyclictest0-21swapper/009:26:350
271597399341,23cyclictest3041741-21/usr/sbin/munin12:37:290
271597399341,21cyclictest0-21swapper/009:06:280
271597399341,19cyclictest2748271-21aten2_r5power_c07:42:230
271597399341,18cyclictest2975792-21ntpq11:27:380
271597399340,22cyclictest585-21runrttasks10:10:120
271597399340,20cyclictest2867672-21sed09:40:010
2715982993323,8cyclictest2807648-21apt-get08:40:002
2715977993328,4cyclictest2691670-21kworker/u8:4+flush-8:007:15:061
2715977993326,5cyclictest2822505-21kworker/u8:3+events_unbound09:12:251
2715977993324,6cyclictest2911735-21kworker/u8:3+events_unbound11:47:381
2715982993227,4cyclictest2748065-21kworker/u8:0+events_unbound08:47:352
2715977993228,3cyclictest2748065-21kworker/u8:0+flush-8:007:47:391
2715977993226,4cyclictest2941793-21kworker/u8:4+events_unbound11:32:261
2715977993226,4cyclictest2862533-21munin-run09:34:591
2715977993226,4cyclictest2748065-21kworker/u8:0+events_unbound09:22:251
2715977993225,5cyclictest2862556-21kworker/u8:2+flush-8:009:42:271
2715977993223,6cyclictest2832618-21latency_hist09:05:011
271597399323,21cyclictest421rcuog/207:46:160
2715973993227,3cyclictest2906151-21needreboot10:17:330
271597399322,21cyclictest0-21swapper/011:36:180
271597399321,18cyclictest585-21runrttasks08:28:330
271597399320,17cyclictest2961704-21runrttasks11:16:320
2715977993124,5cyclictest2951274-21kworker/u8:1+flush-8:011:52:271
271597399318,20cyclictest2926052-21ntpq10:37:390
271597399311,28cyclictest2761990-21ntpq07:52:370
271597399311,22cyclictest0-21swapper/011:47:100
295581923019,6sleep30-21swapper/311:07:393
2715982993025,4cyclictest2986599-21kworker/u8:0+flush-8:012:02:392
2715982993025,4cyclictest2911735-21kworker/u8:3+flush-8:010:57:362
2715982993025,4cyclictest2748065-21kworker/u8:0+events_unbound10:22:402
2715982993025,4cyclictest1882543-21kworker/u8:2+events_unbound07:32:302
2715977993025,4cyclictest2911735-21kworker/u8:3+events_unbound11:37:261
2715977993024,4cyclictest2941793-21kworker/u8:4+events_unbound11:27:251
2715977993023,5cyclictest2837575-21kworker/u8:1+flush-8:009:57:231
2715977993022,6cyclictest2837575-21kworker/u8:1+flush-8:010:42:361
2715977993020,7cyclictest281-21systemd-journal12:12:391
2715982992925,2cyclictest2721138-21apt-key07:15:012
2715982992924,4cyclictest3035850-21apt12:30:002
2715982992924,3cyclictest2748366-21aten2_r5power_v07:42:242
2715977992924,3cyclictest3011812-21cut12:07:251
2715977992923,5cyclictest2748065-21kworker/u8:0+flush-8:008:57:251
2715977992922,6cyclictest3030705-21kworker/u8:0+events_unbound12:27:381
2715973992912,15cyclictest3002187-21irqcore11:57:290
2715982992823,4cyclictest2822505-21kworker/u8:3+flush-8:008:57:432
2715977992823,3cyclictest2837575-21kworker/u8:1+events_unbound10:52:301
271597399281,22cyclictest2715804-21latency_hist07:10:010
2715982992724,2cyclictest2778245-21aten2_r5power_e08:12:262
2715982992723,2cyclictest2858381-21fschecks_time09:32:262
2715982992723,2cyclictest2853184-21aten2_r5power_v09:27:242
2715982992723,2cyclictest2853184-21aten2_r5power_v09:27:242
2715982992722,3cyclictest2912578-21cpuspeed_turbos10:27:252
2715982992722,3cyclictest2812580-21kworker/u8:2+flush-8:008:50:312
2715982992717,8cyclictest281-21systemd-journal11:15:402
2715977992721,4cyclictest2897782-21tr10:12:241
2715977992720,5cyclictest3030705-21kworker/u8:0+events_unbound12:32:391
2715977992720,5cyclictest2941793-21kworker/u8:4+events_unbound11:22:241
2715982992621,3cyclictest2972027-21aten2_r5power_p11:27:242
2715982992621,3cyclictest2872520-21latency_hist09:45:012
2715977992621,3cyclictest3007116-21irqcore12:02:281
2715977992620,4cyclictest2867248-21unixbench_singl09:37:421
2715977992620,4cyclictest2822505-21kworker/u8:3+flush-8:009:29:451
2715977992620,4cyclictest2822505-21kworker/u8:3+flush-8:009:29:441
2715977992617,7cyclictest2924397-21kthreadcore10:37:321
2715982992520,3cyclictest2758202-21aten2_r5power_c07:52:252
2715977992519,4cyclictest3041444-21cpuspeed_turbos12:37:251
2715977992519,4cyclictest3025610-21unixbench_multi12:17:421
2715982992420,2cyclictest2937106-21aten2_r5power_e10:52:242
2715982992419,3cyclictest3020644-21unixbench_multi12:12:412
2715982992419,3cyclictest3006069-21cron12:00:012
2715982992418,4cyclictest2768083-21apt-get08:02:222
2715977992419,4cyclictest2837575-21kworker/u8:1+flush-8:009:47:231
2715982992320,2cyclictest2971515-21turbostat.cron11:25:002
2715982992320,2cyclictest2921532-21unixbench_multi10:32:422
2715982992315,6cyclictest281-21systemd-journal08:00:002
2715982992313,8cyclictest281-21systemd-journal12:17:392
2715977992319,3cyclictest2911735-21kworker/u8:3+flush-8:010:24:041
2715977992319,2cyclictest0-21swapper/109:07:211
2715977992315,6cyclictest2991326-21latency_hist11:45:011
271598299222,3cyclictest30424391kthreadcore12:37:312
2715982992217,4cyclictest2837575-21kworker/u8:1+flush-8:010:02:362
2715982992217,4cyclictest2792588-21unixbench_singl08:22:402
2715982992217,3cyclictest0-21swapper/207:15:012
2715977992218,3cyclictest2878082-21cut09:52:281
2715977992218,3cyclictest2817516-21unixbench_multi08:47:421
2715977992216,4cyclictest2798535-21cut08:32:271
271598299213,2cyclictest28104782cut08:42:302
2715982992115,4cyclictest2828135-21apt-get09:02:232
2715982992114,5cyclictest281-21systemd-journal11:35:402
2715977992117,2cyclictest0-21swapper/110:47:421
2715977992117,2cyclictest0-21swapper/110:47:421
27155772214,10sleep20-21swapper/207:07:442
271598299203,13cyclictest2930915-21ntpq10:42:342
271598299202,2cyclictest27572021mailstats07:47:402
271598299202,13cyclictest2798184-21apt-get08:32:242
2715982992017,2cyclictest2773048-21aten2_r5power_c08:07:232
2715982992015,3cyclictest0-21swapper/209:25:002
271598299192,12cyclictest2872879-21apt-get09:47:222
2715982991916,2cyclictest2897840-21fschecks_count10:12:252
2715982991913,4cyclictest2961076-21unixbench_multi11:12:412
2715982991814,3cyclictest0-21swapper/212:07:422
2715982991813,3cyclictest0-21swapper/211:47:352
271598299180,16cyclictest2955903-21runrttasks11:07:392
27112702182,9sleep30-21swapper/307:06:403
271598299173,8cyclictest2833046-21apt-get09:07:222
2715982991713,3cyclictest2911735-21kworker/u8:3+flush-8:011:42:402
2715982991713,2cyclictest0-21swapper/208:15:162
271598299171,11cyclictest2842946-21apt-get09:17:222
29443372160,2chrt584-21kworker/3:2-events10:57:313
271598299169,5cyclictest2997657-21tr11:52:302
271598299162,13cyclictest0-21swapper/212:31:302
2715982991612,2cyclictest0-21swapper/211:02:312
2715982991611,3cyclictest0-21swapper/208:27:242
2715982991610,4cyclictest2903258-21sed10:17:292
29509502156,6sleep30-21swapper/311:02:413
28281382152,8sleep30-21swapper/309:02:253
271598299152,12cyclictest0-21swapper/210:06:192
2715982991512,2cyclictest0-21swapper/209:10:132
2715982991512,2cyclictest0-21swapper/207:26:102
28691082145,5sleep30-21swapper/309:42:343
30259092132,6sleep30-21swapper/312:20:013
30011932132,6sleep30-21swapper/311:55:013
29809202132,7sleep30-21swapper/311:32:423
29707622133,6sleep30-21swapper/311:22:353
29321472132,7sleep30-21swapper/310:47:243
29321472132,7sleep30-21swapper/310:47:243
28576142132,6sleep30-21swapper/309:30:013
27668902132,7sleep30-21swapper/307:57:363
27333732133,7sleep30-21swapper/307:27:233
27312402130,2sleep3471rcuc/307:22:333
30452892123,6sleep30-21swapper/312:37:423
30352222122,6sleep30-21swapper/312:27:393
29882172122,6sleep30-21swapper/311:42:293
29818182122,6sleep30-21swapper/311:37:243
29292512122,6sleep30-21swapper/310:42:313
29247672122,5sleep30-21swapper/310:37:333
29076772122,6sleep30-21swapper/310:22:253
28724372122,5sleep30-21swapper/309:45:013
28528652122,6sleep30-21swapper/309:25:033
28528652122,6sleep30-21swapper/309:25:033
28435162122,6sleep30-21swapper/309:17:303
28326332122,5sleep30-21swapper/309:05:013
28271142122,6sleep30-21swapper/308:57:393
28183602122,6sleep30-21swapper/308:52:253
28076932121,6sleep30-21swapper/308:40:013
28035722123,6sleep30-21swapper/308:37:293
27840692122,6sleep30-21swapper/308:17:303
27824912122,6sleep30-21swapper/308:12:453
27685722122,6sleep30-21swapper/308:02:303
27581442122,6sleep30-21swapper/307:52:233
27572452122,6sleep30-21swapper/307:47:413
27527912122,6sleep30-21swapper/307:45:003
27419382122,6sleep30-21swapper/307:32:333
27255952122,6sleep30-21swapper/307:17:323
27162952122,6sleep30-21swapper/307:12:233
30361212112,5sleep30-21swapper/312:30:413
30257502112,6sleep30-21swapper/312:18:403
30167662112,6sleep30-21swapper/312:12:263
30113062112,6sleep30-21swapper/312:05:403
30069532112,5sleep30-21swapper/312:02:273
29991832112,5sleep30-21swapper/311:52:323
29916242112,6sleep30-21swapper/311:46:023
29719032112,6sleep30-21swapper/311:27:133
29616222112,6sleep30-21swapper/311:15:293
29606272112,5sleep30-21swapper/311:12:373
29367092112,5sleep30-21swapper/310:50:013
29171622112,6sleep30-21swapper/310:31:033
29126152112,5sleep30-21swapper/310:27:263
29022832112,6sleep30-21swapper/310:15:063
28971072112,5sleep30-21swapper/310:10:013
28926212112,5sleep30-21swapper/310:07:243
28875352112,5sleep30-21swapper/310:00:503
28826222112,6sleep30-21swapper/309:56:053
28780382112,5sleep30-21swapper/309:52:283
28666962112,6sleep30-21swapper/309:37:353
28478762112,6sleep30-21swapper/309:22:223
28379232112,6sleep30-21swapper/309:11:553
27980132112,6sleep30-21swapper/308:30:343
27931972112,5sleep30-21swapper/308:27:053
27883042112,5sleep30-21swapper/308:22:203
27428782112,5sleep30-21swapper/307:35:013
27728112102,5sleep30-21swapper/308:05:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional