You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 13:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Tue Dec 09, 2025 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2619398995128,19cyclictest2644010-21munin-run20:20:013
2619398995017,28cyclictest0-21swapper/321:37:313
2619390995041,6cyclictest2639912-21grep20:05:271
2619398994924,22cyclictest2730981-21grep00:30:193
2619393994943,4cyclictest2709339-21kworker/u8:2+events_unbound23:47:532
2619398994817,7cyclictest2630155-21sendmail19:40:023
2619398994719,25cyclictest0-21swapper/300:20:263
2619398994713,4cyclictest0-21swapper/319:15:193
2619398994713,4cyclictest0-21swapper/319:15:193
2619393994737,6cyclictest2671741-21sendmail21:40:002
2619390994631,11cyclictest231ktimers/119:30:141
2619398994515,5cyclictest0-21swapper/322:35:013
2619398994513,6cyclictest0-21swapper/321:05:023
2619393994420,13cyclictest637-21runrttasks22:40:432
2619398994316,3cyclictest2665646-21mailstats21:20:253
2619398994315,3cyclictest0-21swapper/321:40:233
2619393994337,4cyclictest2640143-21kworker/u8:1+events_unbound20:22:262
2619393994326,5cyclictest2725006-21kworker/u8:2-events_freezable_power_00:18:132
2619390994330,9cyclictest231ktimers/122:25:121
2619398994230,9cyclictest391ktimers/322:10:143
2619398994217,5cyclictest0-21swapper/323:50:283
2619393994224,4cyclictest2699435-21cron23:00:002
2619385994235,4cyclictest2663004-21munin-plugin-st21:15:000
2619385994235,4cyclictest2663004-21munin-plugin-st21:15:000
2619398994131,6cyclictest0-21swapper/323:20:263
2619398994113,7cyclictest2706285-21tr23:20:003
2619393994122,11cyclictest131rcu_preempt23:43:332
2619393994120,4cyclictest131rcu_preempt23:03:572
2619393994034,4cyclictest2661010-21kworker/u8:2+events_unbound21:12:322
2619393994034,4cyclictest2661010-21kworker/u8:2+events_unbound21:12:322
2619393994026,5cyclictest131rcu_preempt19:15:292
2619393994026,5cyclictest131rcu_preempt19:15:292
2619393994017,12cyclictest131rcu_preempt21:55:212
2619393994014,10cyclictest131rcu_preempt19:30:252
2619385994032,6cyclictest2669471-21kworker/u8:3+events_unbound21:32:320
2619393993933,4cyclictest2637328-21kworker/u8:3+events_unbound20:02:242
2619393993919,9cyclictest131rcu_preempt21:53:062
2619393993915,13cyclictest131rcu_preempt23:10:022
261938599394,9cyclictest11-21ksoftirqd/022:55:160
2619385993930,6cyclictest2704136-21unixbench_singl23:10:250
2619385993930,6cyclictest2641868-21unixbench_singl20:10:260
2619398993827,7cyclictest0-21swapper/322:20:253
2619398993815,4cyclictest0-21swapper/320:10:013
2619398993812,3cyclictest0-21swapper/321:35:023
2619393993823,4cyclictest131rcu_preempt00:09:322
2619393993823,12cyclictest311ktimers/220:25:162
2619393993823,12cyclictest311ktimers/220:25:162
2619390993829,6cyclictest2662985-21sh21:15:001
2619390993829,6cyclictest2662985-21sh21:15:001
2619390993829,5cyclictest2650405-21unixbench_singl20:35:261
261938599384,9cyclictest11-21ksoftirqd/022:05:120
2619385993830,6cyclictest2626392-21kworker/u8:1+events_unbound19:47:220
2619393993721,5cyclictest131rcu_preempt19:55:002
2619393993715,4cyclictest131rcu_preempt23:34:462
261938599378,5cyclictest131rcu_preempt22:35:140
2619385993719,5cyclictest131rcu_preempt20:05:150
2619393993627,6cyclictest0-21swapper/221:00:002
2619393993620,5cyclictest637-21runrttasks20:15:522
2619393993616,9cyclictest131rcu_preempt22:45:012
2619393993613,10cyclictest131rcu_preempt22:02:182
2619390993628,4cyclictest0-21swapper/123:15:011
2619390993625,7cyclictest2657669-21sendmail21:00:011
2619385993628,5cyclictest0-21swapper/019:25:000
2619385993623,9cyclictest121ktimers/021:50:120
2619398993524,7cyclictest0-21swapper/319:15:013
2619393993527,4cyclictest0-21swapper/200:40:002
2619393993519,5cyclictest131rcu_preempt23:52:382
2619393993519,3cyclictest131rcu_preempt19:29:322
2619393993518,5cyclictest131rcu_preempt21:05:262
2619393993517,5cyclictest131rcu_preempt19:10:182
2619393993516,5cyclictest131rcu_preempt19:55:252
2619393993515,4cyclictest131rcu_preempt19:22:132
2619393993515,12cyclictest131rcu_preempt22:05:062
2619393993515,11cyclictest0-21swapper/220:36:422
2619385993526,6cyclictest0-21swapper/020:45:010
2619385993524,7cyclictest0-21swapper/020:00:260
2619393993426,3cyclictest0-21swapper/223:20:002
2619393993422,8cyclictest2652544-21debian-sa120:45:002
2619393993419,5cyclictest131rcu_preempt19:35:192
2619393993419,4cyclictest131rcu_preempt21:40:062
2619393993418,6cyclictest2709339-21kworker/u8:2+events_unbound00:01:172
2619393993418,6cyclictest2709339-21kworker/u8:2+events_unbound00:01:172
2619393993418,5cyclictest131rcu_preempt21:45:182
2619393993417,4cyclictest131rcu_preempt21:16:002
2619393993417,3cyclictest131rcu_preempt22:35:232
2619393993415,4cyclictest131rcu_preempt21:00:132
2619393993414,11cyclictest131rcu_preempt20:46:542
2619393993413,9cyclictest0-21swapper/222:52:242
2619393993413,5cyclictest131rcu_preempt23:25:012
261939099346,4cyclictest131rcu_preempt19:35:121
2619390993427,4cyclictest2726971-21idleruntime-cro00:20:001
2619390993426,4cyclictest0-21swapper/122:45:261
2619390993426,4cyclictest0-21swapper/122:10:171
2619385993428,4cyclictest2676663-21kworker/u8:0+events_unbound21:57:340
2619385993426,6cyclictest2655750-21kworker/u8:0+events_unbound21:02:300
2619385993425,5cyclictest0-21swapper/021:00:000
2619385993424,7cyclictest440-21cron00:09:590
2619385993424,7cyclictest0-21swapper/000:25:010
261938599342,10cyclictest11-21ksoftirqd/022:30:150
2619398993325,4cyclictest0-21swapper/322:15:263
2619398993325,4cyclictest0-21swapper/300:15:283
2619398993321,9cyclictest2628441-21cron19:35:023
2619393993327,4cyclictest2725006-21kworker/u8:2+events_unbound00:31:442
2619393993320,4cyclictest131rcu_preempt20:54:262
2619393993317,5cyclictest131rcu_preempt21:20:262
2619393993317,5cyclictest131rcu_preempt00:20:132
2619393993317,4cyclictest131rcu_preempt19:40:222
2619393993316,5cyclictest131rcu_preempt21:30:012
2619393993315,4cyclictest131rcu_preempt20:32:112
2619393993315,4cyclictest131rcu_preempt20:32:112
2619393993314,11cyclictest131rcu_preempt22:15:162
2619393993314,10cyclictest131rcu_preempt23:29:122
2619393993314,10cyclictest131rcu_preempt22:14:522
2619393993311,12cyclictest32-21ksoftirqd/222:25:262
261939099335,5cyclictest131rcu_preempt23:00:111
261939099334,6cyclictest131rcu_preempt21:15:151
2619390993326,4cyclictest2678561-21munin-plugin-st22:00:011
2619390993325,4cyclictest0-21swapper/123:55:261
2619390993325,4cyclictest0-21swapper/100:30:271
2619390993325,3cyclictest0-21swapper/119:45:261
261938599334,11cyclictest11-21ksoftirqd/000:10:130
2619385993318,9cyclictest131rcu_preempt23:35:170
2619385993317,9cyclictest131rcu_preempt21:09:460
2619398993224,4cyclictest0-21swapper/319:25:003
2619398993222,7cyclictest2638688-21apt20:05:013
2619398993221,8cyclictest0-21swapper/320:45:013
2619398993221,6cyclictest0-21swapper/322:07:333
2619398993219,5cyclictest0-21swapper/323:40:003
261939399329,14cyclictest32-21ksoftirqd/221:35:002
261939399326,14cyclictest32-21ksoftirqd/222:25:002
2619393993218,5cyclictest2712840-21kworker/u8:1+events_unbound23:38:252
2619393993216,5cyclictest131rcu_preempt19:45:142
2619393993215,9cyclictest131rcu_preempt23:55:172
2619393993213,10cyclictest131rcu_preempt23:10:202
2619393993211,10cyclictest0-21swapper/222:33:482
2619393993210,13cyclictest32-21ksoftirqd/220:10:262
2619390993224,4cyclictest0-21swapper/123:25:251
2619390993224,4cyclictest0-21swapper/122:00:161
2619390993224,4cyclictest0-21swapper/121:10:001
2619385993221,7cyclictest0-21swapper/021:50:000
2619385993220,4cyclictest2617434-21kworker/u8:0+events_unbound19:17:070
2619385993220,4cyclictest2617434-21kworker/u8:0+events_unbound19:17:070
2619398993124,4cyclictest0-21swapper/319:55:273
2619398993123,4cyclictest0-21swapper/322:45:163
2619398993121,6cyclictest0-21swapper/319:50:253
261939399315,14cyclictest32-21ksoftirqd/200:25:272
2619390993123,4cyclictest0-21swapper/121:40:161
2619390993123,4cyclictest0-21swapper/121:35:221
2619390993123,4cyclictest0-21swapper/100:10:271
2619390993120,6cyclictest0-21swapper/120:20:001
261938599319,9cyclictest131rcu_preempt20:20:120
2619385993121,6cyclictest2719932-21sendmail00:00:000
2619385993117,8cyclictest131rcu_preempt22:40:220
2619385993116,9cyclictest131rcu_preempt23:40:250
2619385993116,9cyclictest131rcu_preempt00:18:090
2619385993111,2cyclictest0-21swapper/023:46:140
2619398993023,4cyclictest0-21swapper/319:25:193
2619398993019,7cyclictest2699436-21sh23:00:013
2619393993015,4cyclictest131rcu_preempt00:10:242
2619390993020,6cyclictest0-21swapper/119:15:011
2619390993018,8cyclictest1-21systemd00:23:031
261938599308,12cyclictest11-21ksoftirqd/019:52:050
2619385993020,6cyclictest0-21swapper/020:20:010
2619385993017,7cyclictest11-21ksoftirqd/020:25:240
2619385993017,7cyclictest11-21ksoftirqd/020:25:240
2619385993016,8cyclictest131rcu_preempt23:30:250
2619385993016,4cyclictest131rcu_preempt22:20:160
2619385993015,9cyclictest131rcu_preempt21:35:310
2619398992923,3cyclictest0-21swapper/321:15:273
261939899291,6cyclictest2674757-21users21:45:263
2619390992921,5cyclictest0-21swapper/100:30:001
2619390992920,6cyclictest0-21swapper/122:10:011
2619390992919,6cyclictest0-21swapper/123:20:251
2619385992923,4cyclictest2704473-21kworker/u8:0+events_unbound23:19:030
2619385992922,4cyclictest2709276-21unixbench_singl23:25:270
2619385992921,6cyclictest2647411-21kworker/u8:1+events_unbound20:31:430
2619385992921,6cyclictest2647411-21kworker/u8:1+events_unbound20:31:420
2619385992921,4cyclictest0-21swapper/021:45:000
2619385992920,7cyclictest2621156-21latency_hist19:15:010
2619385992919,6cyclictest0-21swapper/000:35:250
2619385992916,7cyclictest131rcu_preempt00:27:290
2619385992915,8cyclictest131rcu_preempt20:55:010
2619385992914,9cyclictest131rcu_preempt19:35:250
261938599291,10cyclictest11-21ksoftirqd/023:50:150
2619398992819,6cyclictest0-21swapper/300:35:253
2619393992813,5cyclictest131rcu_preempt20:06:372
2619390992822,4cyclictest2666237-21kworker/u8:1+events_unbound21:27:311
2619390992821,3cyclictest0-21swapper/123:35:171
2619390992820,5cyclictest0-21swapper/122:45:011
2619390992820,4cyclictest0-21swapper/123:17:401
2619390992820,4cyclictest0-21swapper/122:35:271
2619390992820,4cyclictest0-21swapper/119:55:011
2619390992820,4cyclictest0-21swapper/119:45:011
261938599289,13cyclictest131rcu_preempt22:10:140
261938599287,11cyclictest131rcu_preempt22:00:260
2619385992822,4cyclictest2626392-21kworker/u8:1+events_unbound19:33:430
2619385992817,4cyclictest131rcu_preempt23:20:260
2619385992816,4cyclictest131rcu_preempt23:00:220
2619385992810,10cyclictest11-21ksoftirqd/019:25:240
261939899276,4cyclictest2703710-21proc_pri23:10:233
2619398992716,7cyclictest0-21swapper/323:40:253
2619390992720,3cyclictest0-21swapper/100:40:011
261938599278,4cyclictest0-21swapper/000:01:560
261938599278,4cyclictest0-21swapper/000:01:560
261938599277,12cyclictest11-21ksoftirqd/019:45:010
2619385992721,4cyclictest2652310-21kworker/u8:2+events_unbound20:47:260
2619385992720,5cyclictest2694034-21kworker/u8:0+events_unbound22:49:580
2619385992720,4cyclictest0-21swapper/021:15:270
2619385992718,4cyclictest131rcu_preempt21:24:560
2619385992716,5cyclictest2690778-21kworker/u8:1+events_unbound22:51:210
2619385992714,5cyclictest131rcu_preempt22:25:220
2619385992713,8cyclictest131rcu_preempt20:36:100
2619385992712,9cyclictest131rcu_preempt22:18:480
261938599271,14cyclictest0-21swapper/019:57:160
2619398992620,4cyclictest2626392-21kworker/u8:1+events_unbound19:45:373
2619398992618,5cyclictest2702404-21unixbench_multi23:05:273
2619398992618,4cyclictest0-21swapper/320:45:283
2619398992616,7cyclictest2697285-21grep22:50:273
2619390992618,5cyclictest0-21swapper/121:30:171
2619390992618,4cyclictest0-21swapper/120:45:271
2619390992618,4cyclictest0-21swapper/120:25:281
2619390992618,4cyclictest0-21swapper/120:25:271
2619390992617,5cyclictest0-21swapper/119:15:051
2619390992617,5cyclictest0-21swapper/119:15:041
2619390992616,7cyclictest2717582-21threads23:50:261
261938599263,3cyclictest131rcu_preempt23:10:000
2619398992519,4cyclictest2690778-21kworker/u8:1+events_unbound22:42:363
2619398992519,3cyclictest0-21swapper/300:00:173
2619398992519,3cyclictest0-21swapper/300:00:163
2619398992515,6cyclictest0-21swapper/300:10:253
2619398992514,7cyclictest2679862-21head22:00:263
2619390992519,3cyclictest0-21swapper/121:45:271
2619390992518,4cyclictest0-21swapper/119:20:261
2619390992517,6cyclictest2690778-21kworker/u8:1+events_unbound22:52:481
2619385992518,5cyclictest2661010-21kworker/u8:2+events_unbound21:25:190
2619385992510,9cyclictest131rcu_preempt00:30:330
2619398992417,4cyclictest0-21swapper/319:45:003
2619398992417,3cyclictest0-21swapper/321:25:163
2619398992416,4cyclictest0-21swapper/320:55:303
2619390992419,3cyclictest2690922-21cron22:35:001
2619390992418,3cyclictest0-21swapper/123:00:011
2619390992417,4cyclictest2710959-21unixbench_singl23:30:251
2619390992417,4cyclictest2676991-21latency_hist21:55:021
2619398992316,4cyclictest2720031-21latency_hist00:00:013
2619398992316,4cyclictest0-21swapper/323:30:163
2619398992315,5cyclictest0-21swapper/322:35:183
2619398992315,5cyclictest0-21swapper/320:30:163
2619398992315,5cyclictest0-21swapper/320:30:163
2619398992315,4cyclictest2644878-21proc_pri20:20:233
2619398992315,4cyclictest0-21swapper/320:40:013
2619398992314,4cyclictest0-21swapper/320:27:253
2619398992314,4cyclictest0-21swapper/320:27:243
2619390992317,3cyclictest0-21swapper/120:40:161
2619390992315,5cyclictest0-21swapper/100:00:261
2619390992315,5cyclictest0-21swapper/100:00:251
2619390992315,4cyclictest0-21swapper/121:20:281
2619398992216,3cyclictest0-21swapper/321:50:143
2619398992213,6cyclictest2678149-21grep21:55:243
2619390992216,3cyclictest0-21swapper/121:05:001
2619390992212,7cyclictest2648083-21cat20:30:191
2619390992212,7cyclictest2648083-21cat20:30:191
2619398992114,5cyclictest391ktimers/322:25:183
2619398992110,8cyclictest2709850-21cut23:30:013
2619390992115,4cyclictest231ktimers/120:50:121
2619390992114,4cyclictest2681871-21kworker/u8:2+events_unbound22:15:241
2619390992114,4cyclictest0-21swapper/119:55:171
2619390992114,3cyclictest0-21swapper/119:25:251
2619390992113,4cyclictest0-21swapper/123:45:261
2619390992113,4cyclictest0-21swapper/123:05:271
2619390992110,8cyclictest2642182-21seq20:13:401
2619398992014,3cyclictest0-21swapper/321:15:013
2619398992014,3cyclictest0-21swapper/321:15:003
2619398992010,7cyclictest2721866-21apt-get00:05:133
2619390992014,3cyclictest0-21swapper/120:20:251
2619390992013,5cyclictest231ktimers/100:05:131
261939899199,8cyclictest2716086-21sed23:45:253
261939899199,7cyclictest2700461-21/usr/sbin/munin23:00:243
2619398991914,2cyclictest0-21swapper/320:50:163
261939899191,15cyclictest2640823-21apt-get20:10:063
2619390991912,5cyclictest231ktimers/123:40:141
2619398991811,5cyclictest391ktimers/300:25:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional