You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 23:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sun Nov 16, 2025 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1119112995641,11cyclictest121ktimers/009:20:150
1119121995140,6cyclictest1196646-21grep10:50:273
1119120994842,4cyclictest1202069-21kworker/u8:1+events_unbound11:20:242
1119117994634,9cyclictest231ktimers/110:45:131
1119120994539,4cyclictest1172615-21kworker/u8:2+events_unbound09:44:572
1119117994537,6cyclictest1169439-21kworker/u8:0+events_unbound09:34:571
1119120994337,4cyclictest1153871-21kworker/u8:2+events_unbound09:04:502
1119112994335,4cyclictest1136940-21munin-plugin-st08:00:000
1119120994231,7cyclictest0-21swapper/211:40:002
111912099421,8cyclictest0-21swapper/207:15:162
1119120994134,4cyclictest1178088-21cron10:00:012
1119112994131,6cyclictest0-21swapper/011:15:000
1119112994131,6cyclictest0-21swapper/011:15:000
1119120994034,3cyclictest1215835-21latency_hist11:50:012
1119117994028,9cyclictest231ktimers/109:45:131
1119120993933,4cyclictest1136937-21cron07:59:592
1119117993932,5cyclictest1212304-21kworker/u8:0+events_unbound12:00:341
1119121993830,4cyclictest0-21swapper/311:05:003
1119121993830,4cyclictest0-21swapper/308:45:003
1119120993832,4cyclictest1126164-21kworker/u8:1+events_unbound07:29:332
1119120993830,4cyclictest0-21swapper/207:55:002
1119117993830,4cyclictest0-21swapper/109:40:011
1119112993829,5cyclictest1154634-21fschecks_time08:50:170
1119112993829,4cyclictest0-21swapper/011:45:010
1119112993827,7cyclictest1145078-21grep08:20:270
1119121993729,5cyclictest1-21systemd11:05:213
1119120993730,4cyclictest1198771-21munin-plugin-st11:00:012
1119120993729,4cyclictest0-21swapper/207:15:002
1119120993727,5cyclictest0-21swapper/210:40:382
1119117993731,4cyclictest1191544-21kworker/u8:1+events_unbound10:40:091
1119112993728,4cyclictest1154013-21munin-plugin-st08:50:010
1119112993726,7cyclictest1164469-21sendmail09:20:010
1119112993725,9cyclictest121ktimers/010:20:140
1119121993626,7cyclictest1219241-21idleruntime-cro12:00:003
1119120993628,5cyclictest1195352-21cron10:50:012
1119120993627,4cyclictest0-21swapper/210:10:002
1119117993628,5cyclictest1217110-21unixbench_singl11:50:271
1119117993627,5cyclictest1200024-21unixbench_multi11:00:281
1119117993627,4cyclictest0-21swapper/107:45:181
1119121993526,4cyclictest0-21swapper/307:15:023
1119120993527,4cyclictest0-21swapper/212:20:242
1119120993527,4cyclictest0-21swapper/208:45:252
1119120993526,5cyclictest1165745-21grep09:20:282
1119117993527,4cyclictest0-21swapper/111:25:241
1119117993527,4cyclictest0-21swapper/109:04:501
1119112993523,9cyclictest121ktimers/012:30:150
1119121993425,4cyclictest0-21swapper/311:35:183
1119121993423,7cyclictest1133068-21grep07:45:263
1119120993419,10cyclictest215-21dbus-daemon10:50:152
1119120993415,12cyclictest1218115-21kernelversion11:55:182
1119120993410,13cyclictest32-21ksoftirqd/209:40:012
111911799346,6cyclictest231ktimers/107:40:151
1119117993426,6cyclictest1140581-21kworker/u8:0+events_unbound08:24:441
1119117993426,4cyclictest0-21swapper/110:50:261
1119117993425,4cyclictest0-21swapper/109:40:171
1119117993421,5cyclictest131rcu_preempt11:55:171
1119121993324,4cyclictest0-21swapper/309:00:263
1119120993327,4cyclictest1212304-21kworker/u8:0+events_unbound11:40:292
1119120993327,4cyclictest1126164-21kworker/u8:1+events_unbound07:33:412
1119120993326,5cyclictest1200299-21kworker/u8:2+events_unbound11:13:432
1119120993326,5cyclictest1200299-21kworker/u8:2+events_unbound11:13:422
1119120993325,4cyclictest0-21swapper/208:50:162
1119120993319,5cyclictest1187237-21kernelversion10:25:202
1119120993317,5cyclictest1129894-21kworker/u8:0+events_unbound07:45:322
1119120993315,5cyclictest131rcu_preempt12:05:242
111911799338,14cyclictest131rcu_preempt11:35:131
1119117993326,5cyclictest1140581-21kworker/u8:0+events_unbound08:35:131
111911799331,7cyclictest0-21swapper/107:50:131
1119117993313,4cyclictest131rcu_preempt07:15:151
1119112993325,4cyclictest0-21swapper/009:40:000
1119112993321,8cyclictest0-21swapper/010:10:270
1119112993321,8cyclictest0-21swapper/010:10:270
1119121993224,4cyclictest0-21swapper/312:40:003
1119121993224,4cyclictest0-21swapper/307:55:283
1119121993223,7cyclictest1146980-21kworker/u8:1+events_unbound08:46:423
1119121993216,12cyclictest391ktimers/308:25:143
1119120993224,4cyclictest1164458-21idleruntime-cro09:20:002
1119120993224,4cyclictest0-21swapper/209:50:262
1119120993222,7cyclictest301rcuc/211:00:132
1119120993219,5cyclictest1220921-21kworker/u8:2+events_unbound12:35:462
1119120993218,5cyclictest1217490-21kworker/u8:1+events_unbound12:01:412
1119120993217,7cyclictest1191544-21kworker/u8:1+events_unbound10:38:462
1119120993215,5cyclictest131rcu_preempt11:20:012
111911799328,13cyclictest24-21ksoftirqd/111:30:271
1119117993225,5cyclictest1146980-21kworker/u8:1+events_unbound08:53:421
1119117993225,4cyclictest0-21swapper/112:35:001
1119117993222,6cyclictest1143271-21grep08:15:261
1119117993222,6cyclictest0-21swapper/112:20:261
1119117993222,6cyclictest0-21swapper/108:45:261
1119117993221,5cyclictest1231221-21kworker/u8:1+events_unbound12:38:481
1119112993222,7cyclictest440-21cron09:55:010
1119112993222,7cyclictest1233317-21sendmail12:39:590
1119112993221,7cyclictest1190028-21apt10:35:010
111912199319,5cyclictest1210621-21auditctl11:34:013
1119121993123,4cyclictest0-21swapper/309:40:263
1119121993123,4cyclictest0-21swapper/308:30:193
1119121993121,7cyclictest1195357-21sh10:50:013
1119120993124,5cyclictest1177735-21kworker/u8:2+events_unbound10:00:052
1119120993123,4cyclictest0-21swapper/209:45:262
1119120993122,6cyclictest0-21swapper/208:35:182
1119120993114,5cyclictest1146980-21kworker/u8:1+events_unbound08:28:062
111911799319,12cyclictest24-21ksoftirqd/107:55:181
1119117993124,4cyclictest1140351-21sh08:10:001
1119117993124,4cyclictest0-21swapper/111:20:241
1119117993123,4cyclictest0-21swapper/109:20:011
1119117993123,4cyclictest0-21swapper/107:30:281
1119117993121,6cyclictest0-21swapper/108:05:001
1119117993117,5cyclictest1212304-21kworker/u8:0+events_unbound11:42:231
1119117993114,5cyclictest131rcu_preempt09:05:171
1119117993114,10cyclictest131rcu_preempt12:05:251
1119117993113,6cyclictest131rcu_preempt10:00:151
1119112993125,3cyclictest1202190-21idleruntime-cro11:10:000
1119112993123,4cyclictest0-21swapper/008:15:250
1119121993022,5cyclictest1133449-21kworker/u8:3+events_unbound07:54:373
1119121993022,4cyclictest0-21swapper/310:05:273
1119121993022,4cyclictest0-21swapper/309:55:283
1119121993022,4cyclictest0-21swapper/308:15:003
111912099307,13cyclictest32-21ksoftirqd/211:25:272
1119120993020,6cyclictest0-21swapper/208:30:292
1119120993015,6cyclictest1184169-21kworker/u8:0+events_unbound10:20:102
1119120993012,3cyclictest131rcu_preempt07:20:192
111912099301,18cyclictest0-21swapper/208:15:132
1119120993010,11cyclictest32-21ksoftirqd/209:05:302
1119117993024,4cyclictest1164097-21kworker/u8:0+events_unbound09:21:421
1119117993023,4cyclictest0-21swapper/108:30:001
1119117993019,8cyclictest1187868-21grep10:25:271
1119117993012,10cyclictest0-21swapper/110:05:391
1119121992921,4cyclictest0-21swapper/312:10:273
1119121992921,4cyclictest0-21swapper/312:10:263
1119121992921,4cyclictest0-21swapper/307:20:263
1119121992919,6cyclictest0-21swapper/308:10:013
1119120992922,4cyclictest0-21swapper/207:40:292
1119120992915,6cyclictest1169439-21kworker/u8:0+events_unbound09:33:412
1119120992915,11cyclictest1156380-21fschecks_time08:55:172
1119120992915,11cyclictest1156380-21fschecks_time08:55:162
111912099291,16cyclictest0-21swapper/211:05:252
1119120992910,3cyclictest131rcu_preempt08:40:252
111911799299,11cyclictest131rcu_preempt11:15:001
111911799299,11cyclictest131rcu_preempt11:15:001
111911799297,3cyclictest131rcu_preempt09:10:211
1119117992922,3cyclictest0-21swapper/107:15:011
1119117992921,6cyclictest1111997-21kworker/u8:2+events_unbound07:21:341
1119112992922,3cyclictest0-21swapper/012:19:590
1119121992821,3cyclictest0-21swapper/308:39:463
1119121992820,4cyclictest0-21swapper/312:15:343
1119121992820,4cyclictest0-21swapper/311:15:183
1119121992819,5cyclictest0-21swapper/310:00:283
1119120992822,4cyclictest1228428-21kworker/u8:0+events_unbound12:27:542
1119120992822,3cyclictest0-21swapper/210:10:262
1119120992822,3cyclictest0-21swapper/210:10:262
1119120992821,5cyclictest1220921-21kworker/u8:2+events_unbound12:18:102
1119120992820,4cyclictest0-21swapper/210:15:182
1119120992818,3cyclictest131rcu_preempt07:39:332
1119120992818,3cyclictest131rcu_preempt07:39:332
1119120992817,7cyclictest1138184-21grep08:00:282
1119120992815,5cyclictest1230129-21/usr/sbin/munin12:30:192
1119120992813,3cyclictest131rcu_preempt09:25:222
1119117992820,4cyclictest0-21swapper/110:35:171
1119117992819,4cyclictest0-21swapper/109:00:001
1119117992819,4cyclictest0-21swapper/109:00:001
1119117992816,4cyclictest131rcu_preempt07:28:401
1119117992810,11cyclictest0-21swapper/108:44:071
1119112992822,3cyclictest0-21swapper/009:00:260
1119112992820,4cyclictest13650irq/42-30be0000.ethernet12:20:250
1119121992720,3cyclictest0-21swapper/308:25:003
1119121992719,4cyclictest0-21swapper/311:20:163
1119121992716,7cyclictest1163980-21grep09:15:263
111912099278,11cyclictest32-21ksoftirqd/208:10:262
111912099276,11cyclictest32-21ksoftirqd/210:35:002
111912099275,12cyclictest32-21ksoftirqd/211:30:232
1119120992717,6cyclictest0-21swapper/209:10:262
1119120992710,6cyclictest32-21ksoftirqd/211:50:172
111911799277,10cyclictest24-21ksoftirqd/110:20:211
111911799274,4cyclictest131rcu_preempt10:10:271
111911799274,4cyclictest131rcu_preempt10:10:271
1119117992719,4cyclictest0-21swapper/111:05:171
1119117992718,7cyclictest1174334-21kworker/u8:1+events_unbound09:56:581
1119117992715,3cyclictest131rcu_preempt10:30:171
1119112992720,5cyclictest1210572-21kworker/u8:2+events_unbound11:35:300
1119112992720,3cyclictest0-21swapper/008:05:010
1119112992719,4cyclictest0-21swapper/009:49:580
1119112992718,6cyclictest1125502-21sed07:25:200
1119121992619,3cyclictest0-21swapper/312:25:213
1119121992619,3cyclictest0-21swapper/312:00:223
1119121992619,3cyclictest0-21swapper/311:25:263
1119121992618,4cyclictest0-21swapper/309:05:293
1119121992618,4cyclictest0-21swapper/307:40:203
1119121992617,5cyclictest0-21swapper/307:30:003
1119121992616,7cyclictest1182190-21meminfo10:10:213
1119121992616,7cyclictest1182190-21meminfo10:10:203
1119121992615,8cyclictest215-21dbus-daemon08:59:493
1119121992615,8cyclictest215-21dbus-daemon08:59:493
1119120992611,4cyclictest131rcu_preempt12:10:262
1119120992611,4cyclictest131rcu_preempt12:10:262
111911799268,4cyclictest131rcu_preempt11:45:151
111911799266,13cyclictest24-21ksoftirqd/110:55:271
1119117992620,4cyclictest1140581-21kworker/u8:0+events_unbound08:14:291
1119117992619,5cyclictest1169439-21kworker/u8:0+events_unbound09:54:141
1119117992619,5cyclictest1146980-21kworker/u8:1+events_unbound08:32:281
1119117992617,7cyclictest1174334-21kworker/u8:1+events_unbound10:15:101
1119117992617,7cyclictest1161265-21kworker/u8:2+events_unbound09:29:071
1119117992613,10cyclictest231ktimers/111:15:141
111911799261,14cyclictest24-21ksoftirqd/112:25:491
1119112992619,3cyclictest0-21swapper/007:10:190
1119112992618,4cyclictest1217903-21fschecks_count11:55:170
1119112992618,4cyclictest0-21swapper/007:45:010
1119112992618,3cyclictest0-21swapper/009:10:270
1119112992617,6cyclictest1128265-21latency_hist07:35:010
111911299261,4cyclictest131rcu_preempt11:20:130
111911299261,22cyclictest1161049-21awk09:09:590
1119121992519,3cyclictest0-21swapper/310:45:013
1119121992517,5cyclictest0-21swapper/308:05:013
1119121992517,4cyclictest0-21swapper/311:10:173
1119121992517,4cyclictest0-21swapper/311:10:173
1119121992517,3cyclictest0-21swapper/307:35:013
1119121992515,6cyclictest0-21swapper/309:40:003
111912099257,3cyclictest131rcu_preempt08:20:162
1119117992519,4cyclictest1220921-21kworker/u8:2+events_unbound12:17:011
111911299258,3cyclictest131rcu_preempt12:25:170
111911299257,3cyclictest637-21runrttasks10:55:260
1119112992518,4cyclictest0-21swapper/011:50:260
1119112992517,5cyclictest0-21swapper/011:19:590
1119112992517,4cyclictest0-21swapper/008:05:290
1119112992516,7cyclictest1113724-21kworker/u8:1+events_unbound07:19:340
1119121992418,3cyclictest0-21swapper/307:35:183
1119121992418,3cyclictest0-21swapper/307:35:183
1119121992417,4cyclictest0-21swapper/311:50:263
1119121992416,5cyclictest0-21swapper/311:40:283
1119121992414,6cyclictest0-21swapper/309:50:173
1119117992416,3cyclictest131rcu_preempt12:10:181
1119117992416,3cyclictest131rcu_preempt12:10:171
1119112992418,4cyclictest1174334-21kworker/u8:1+events_unbound09:55:190
1119112992417,3cyclictest0-21swapper/011:45:250
1119112992416,5cyclictest0-21swapper/010:05:260
1119112992416,4cyclictest0-21swapper/011:30:010
111911299241,19cyclictest0-21swapper/011:34:580
111911299241,19cyclictest0-21swapper/011:04:460
111911299241,19cyclictest0-21swapper/010:17:110
111911299241,19cyclictest0-21swapper/008:43:330
111911299241,19cyclictest0-21swapper/007:51:030
1119121992317,3cyclictest0-21swapper/310:25:263
1119121992315,5cyclictest391ktimers/307:18:213
1119121992315,5cyclictest0-21swapper/309:25:393
1119121992315,4cyclictest0-21swapper/310:30:193
1119121992312,8cyclictest1227003-21cat12:20:193
1119121992312,8cyclictest1154997-21ntpq08:50:223
111911299238,12cyclictest12196792sleep012:00:040
1119112992317,3cyclictest13650irq/42-30be0000.ethernet10:25:260
1119112992317,3cyclictest0-21swapper/009:25:190
1119112992316,4cyclictest1147184-21idleruntime-cro08:30:010
1119112992316,3cyclictest0-21swapper/010:45:530
1119112992313,6cyclictest0-21swapper/010:35:220
111911299231,18cyclictest0-21swapper/012:06:350
1119121992216,3cyclictest0-21swapper/309:45:183
1119121992215,4cyclictest1214503-21fschecks_count11:45:153
1119121992213,6cyclictest1143331-21grep08:15:253
1119112992216,3cyclictest13950irq/36-mmc108:40:000
1119112992215,5cyclictest0-21swapper/007:36:390
1119112992215,5cyclictest0-21swapper/007:36:390
1119112992215,3cyclictest0-21swapper/012:13:420
1119112992215,3cyclictest0-21swapper/012:13:410
1119112992215,3cyclictest0-21swapper/009:40:170
1119112992214,4cyclictest1178503-21fschecks_count10:00:170
111911299221,18cyclictest0-21swapper/008:31:240
111911299220,18cyclictest0-21swapper/008:56:140
111911299220,18cyclictest0-21swapper/008:56:130
1119121992114,3cyclictest0-21swapper/312:05:233
1119121992114,3cyclictest0-21swapper/309:15:003
1119121992113,5cyclictest391ktimers/312:30:183
1119112992114,3cyclictest0-21swapper/008:13:590
111911299211,3cyclictest0-21swapper/009:33:280
111911299211,3cyclictest0-21swapper/007:47:110
1119121992014,3cyclictest1197404-21sshd10:55:153
1119121992013,3cyclictest0-21swapper/310:35:273
111912199201,17cyclictest0-21swapper/310:20:143
1119121991811,5cyclictest391ktimers/309:30:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional