You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 12:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Fri May 09, 2025 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1145064995036,10cyclictest231ktimers/100:00:151
1145072994936,10cyclictest391ktimers/321:20:153
1145060994739,4cyclictest1239218-21unixbench_singl23:40:260
1145072994535,6cyclictest1184406-21unixbench_multi21:00:263
1145064994333,6cyclictest0-21swapper/119:55:011
1145060994335,4cyclictest0-21swapper/020:00:010
1145060994231,8cyclictest1186563-21munin-plugin-st21:10:000
1145072994133,5cyclictest1230932-21apt23:20:003
114506999405,6cyclictest131rcu_preempt20:00:112
1145069994032,4cyclictest1201387-21tail21:50:282
1145072993931,4cyclictest1200162-21munin-plugin-st21:50:003
1145072993829,4cyclictest0-21swapper/322:15:173
1145069993830,5cyclictest1186564-21cron21:10:002
1145069993825,8cyclictest1194640-21head21:30:272
1145060993826,8cyclictest1189502-21tail21:15:250
1145069993727,8cyclictest311ktimers/222:45:132
1145060993729,4cyclictest440-21cron21:05:000
114507299369,8cyclictest40-21ksoftirqd/320:10:173
1145072993617,14cyclictest0-21swapper/323:05:133
1145072993610,9cyclictest40-21ksoftirqd/319:30:183
1145069993626,6cyclictest1181245-21sh20:55:012
1145069993625,6cyclictest1249368-21grep00:10:282
1145069993624,7cyclictest0-21swapper/221:00:012
1145064993627,6cyclictest1183544-21cut21:00:171
1145069993525,5cyclictest0-21swapper/221:15:002
1145069993522,8cyclictest1204816-21grep22:00:272
1145069993522,8cyclictest1204816-21grep22:00:272
1145064993528,4cyclictest0-21swapper/122:25:171
1145064993524,7cyclictest1189974-21sendmail21:20:001
1145064993523,8cyclictest1199697-21grep21:45:261
114507299345,10cyclictest1158284-21ntp_states19:45:223
1145072993423,6cyclictest0-21swapper/322:30:253
1145069993428,3cyclictest1208866-21idleruntime-cro22:15:002
1145069993425,4cyclictest0-21swapper/200:15:192
1145069993425,4cyclictest0-21swapper/200:15:192
1145064993425,6cyclictest0-21swapper/119:35:001
1145064993424,6cyclictest0-21swapper/121:45:001
1145064993422,9cyclictest440-21cron22:15:001
1145060993425,6cyclictest0-21swapper/022:40:010
1145072993325,4cyclictest0-21swapper/320:50:233
1145072993316,12cyclictest0-21swapper/321:10:133
1145069993326,3cyclictest0-21swapper/220:05:262
1145069993325,4cyclictest0-21swapper/222:55:292
1145069993324,5cyclictest0-21swapper/220:25:182
1145064993324,6cyclictest0-21swapper/122:05:001
1145064993324,6cyclictest0-21swapper/122:05:001
1145060993325,5cyclictest0-21swapper/021:00:010
1145060993325,4cyclictest0-21swapper/023:15:240
1145060993325,4cyclictest0-21swapper/022:05:280
1145060993325,4cyclictest0-21swapper/022:05:280
1145072993223,4cyclictest0-21swapper/322:05:283
1145072993223,4cyclictest0-21swapper/322:05:283
1145072993218,11cyclictest1210910-21/usr/sbin/munin22:20:133
1145072993216,10cyclictest0-21swapper/319:50:123
1145069993222,5cyclictest0-21swapper/221:20:272
1145064993224,5cyclictest0-21swapper/121:00:021
1145064993223,5cyclictest1192968-21unixbench_singl21:25:331
1145064993222,6cyclictest0-21swapper/123:20:201
1145064993222,6cyclictest0-21swapper/120:25:271
1145060993224,4cyclictest0-21swapper/020:25:260
1145060993222,6cyclictest0-21swapper/000:35:000
1145060993220,7cyclictest0-21swapper/021:25:320
1145072993123,4cyclictest0-21swapper/319:55:253
1145072993122,4cyclictest0-21swapper/300:15:193
1145072993122,4cyclictest0-21swapper/300:15:193
1145072993121,7cyclictest1178100-21apt-get20:45:153
1145072993120,8cyclictest1246219-21sshd00:02:273
1145072993117,11cyclictest1234245-21cron23:29:003
114506999312,5cyclictest131rcu_preempt21:00:142
1145069993123,4cyclictest0-21swapper/221:55:232
1145069993123,4cyclictest0-21swapper/221:15:172
1145069993123,4cyclictest0-21swapper/220:45:272
1145069993122,5cyclictest0-21swapper/222:15:272
1145069993121,7cyclictest1235389-21switchtime23:30:272
1145069993121,6cyclictest0-21swapper/200:35:002
1145069993120,7cyclictest0-21swapper/221:50:002
1145064993125,3cyclictest0-21swapper/120:20:001
1145064993123,4cyclictest0-21swapper/123:50:241
1145060993124,3cyclictest0-21swapper/022:15:000
1145060993123,4cyclictest0-21swapper/021:50:000
1145060993121,6cyclictest0-21swapper/022:20:250
1145060993120,6cyclictest0-21swapper/021:40:000
1145072993023,3cyclictest0-21swapper/323:35:003
1145072993022,4cyclictest0-21swapper/322:45:263
1145072993022,4cyclictest0-21swapper/322:10:263
1145072993018,9cyclictest1185101-21apt-get21:05:133
1145072993017,10cyclictest1171870-21/usr/sbin/munin20:25:223
1145072993017,10cyclictest1168977-21sshd20:15:273
1145072993016,12cyclictest1224781-21sed23:00:183
1145064993023,4cyclictest1249822-21kthreadd00:15:001
1145064993023,4cyclictest1210571-21sendmail22:20:001
1145064993022,4cyclictest0-21swapper/123:35:261
1145064993021,6cyclictest1227082-21grep23:05:271
1145064993021,6cyclictest0-21swapper/121:15:001
114506099300,26cyclictest0-21swapper/000:10:130
1145072992922,4cyclictest0-21swapper/322:40:263
1145072992921,4cyclictest0-21swapper/300:05:253
1145072992920,6cyclictest0-21swapper/319:10:243
1145072992919,7cyclictest1249341-21/usr/sbin/munin00:10:273
1145072992919,7cyclictest1196762-21ls21:40:003
1145072992919,6cyclictest0-21swapper/300:30:003
1145072992918,8cyclictest1223797-21cron22:56:003
1145072992918,8cyclictest1213783-21cron22:28:013
1145072992917,9cyclictest1165132-21/usr/sbin/munin20:05:243
1145072992915,10cyclictest1171120-21sed20:25:013
1145072992913,12cyclictest1242549-21/usr/sbin/munin23:50:243
1145072992911,13cyclictest1154942-21wc19:35:243
1145069992922,3cyclictest0-21swapper/220:40:002
1145069992922,3cyclictest0-21swapper/220:40:002
1145064992922,4cyclictest0-21swapper/120:50:231
1145064992921,5cyclictest231ktimers/123:25:201
1145064992921,5cyclictest0-21swapper/123:45:171
1145064992921,4cyclictest0-21swapper/123:40:261
1145064992920,6cyclictest1222810-21fschecks_count22:55:171
1145064992919,7cyclictest1176614-21cut20:40:151
1145060992922,4cyclictest1222434-21cron22:55:000
1145060992922,3cyclictest0-21swapper/000:05:250
1145060992919,8cyclictest1146384-21kworker/u8:1+events_unbound20:05:140
1145060992919,6cyclictest1160453-21unixbench_singl19:50:240
1145060992915,12cyclictest0-21swapper/020:25:000
114507299289,5cyclictest40-21ksoftirqd/323:20:163
1145072992818,7cyclictest1253055-21cron00:23:013
1145072992818,7cyclictest1253055-21cron00:23:003
1145072992818,7cyclictest1239308-21cron23:41:003
1145072992818,7cyclictest1237596-21cron23:36:003
1145072992818,7cyclictest1222442-21idleruntime-cro22:55:003
1145072992818,6cyclictest0-21swapper/322:35:263
1145072992817,8cyclictest1256562-21sshd00:34:263
1145072992817,8cyclictest1228405-21/usr/sbin/munin23:10:243
1145072992817,7cyclictest1173448-21/usr/sbin/munin20:30:213
1145069992822,3cyclictest0-21swapper/220:30:192
1145069992820,4cyclictest0-21swapper/219:30:272
1145069992817,7cyclictest0-21swapper/219:15:022
1145069992815,7cyclictest0-21swapper/200:05:252
1145064992822,3cyclictest0-21swapper/100:25:001
1145064992822,3cyclictest0-21swapper/100:25:001
1145064992821,4cyclictest1147707-21fschecks_time19:15:171
1145064992820,5cyclictest0-21swapper/100:35:001
1145064992818,6cyclictest0-21swapper/119:30:001
1145060992820,4cyclictest0-21swapper/023:55:270
1145060992820,4cyclictest0-21swapper/023:10:000
114506099281,3cyclictest1167897-21apt-get20:15:140
1145072992718,5cyclictest0-21swapper/300:35:323
1145072992717,7cyclictest1244548-21cron23:58:003
1145072992717,7cyclictest1194715-21cron21:31:003
1145072992717,7cyclictest1193305-21sshd21:29:263
1145072992717,7cyclictest1182244-21/usr/sbin/munin20:55:263
1145072992717,6cyclictest1202523-21/usr/sbin/munin21:55:173
1145072992712,12cyclictest1151700-21awk19:25:253
1145069992719,4cyclictest0-21swapper/223:55:272
1145069992717,6cyclictest0-21swapper/220:15:252
114506499277,3cyclictest12058742cat22:05:201
114506499277,3cyclictest12058742cat22:05:201
1145064992720,4cyclictest0-21swapper/121:05:201
1145064992719,5cyclictest1146885-21latency_hist19:15:011
1145064992718,6cyclictest0-21swapper/122:00:011
1145064992717,7cyclictest1174026-21unixbench_singl20:30:261
1145060992720,4cyclictest0-21swapper/022:15:270
1145060992719,5cyclictest0-21swapper/019:35:180
1145060992716,7cyclictest1200680-21/usr/sbin/munin21:50:200
1145072992620,3cyclictest0-21swapper/319:20:173
1145072992620,3cyclictest0-21swapper/319:20:173
1145072992616,7cyclictest1205199-21sshd22:04:283
1145072992616,7cyclictest1205199-21sshd22:04:273
1145072992616,7cyclictest1197121-21/usr/sbin/munin21:40:163
1145072992616,7cyclictest1175412-21/usr/sbin/munin20:35:213
1145072992616,7cyclictest1175412-21/usr/sbin/munin20:35:213
1145072992616,7cyclictest1162815-21apt-get20:00:123
1145072992616,7cyclictest1147860-21/usr/sbin/munin19:15:193
1145072992615,8cyclictest1177810-21sshd20:44:293
1145072992614,8cyclictest0-21swapper/323:45:133
1145072992613,10cyclictest0-21swapper/321:15:133
1145069992618,5cyclictest0-21swapper/223:25:322
1145069992617,6cyclictest1158273-21grep19:45:222
1145069992617,5cyclictest1148992-21munin-plugin-st19:20:002
1145069992615,6cyclictest1151971-21grep19:25:272
114506999260,4cyclictest131rcu_preempt22:20:102
1145064992621,3cyclictest1214936-21mailstats22:30:241
1145064992620,3cyclictest0-21swapper/100:15:231
1145064992620,3cyclictest0-21swapper/100:15:231
1145064992619,3cyclictest0-21swapper/120:40:011
1145064992619,3cyclictest0-21swapper/120:40:001
1145060992622,2cyclictest13650irq/42-30be0000.ethernet21:10:130
1145060992621,2cyclictest13950irq/36-mmc123:21:060
1145060992619,4cyclictest13650irq/42-30be0000.ethernet19:24:510
1145060992619,4cyclictest13650irq/42-30be0000.ethernet19:24:510
1145060992619,4cyclictest0-21swapper/021:40:260
1145060992619,3cyclictest0-21swapper/022:00:000
1145060992618,5cyclictest0-21swapper/023:55:000
114506099261,4cyclictest1234344-21grep23:30:010
1145060992613,8cyclictest1258316-21run-parts00:39:590
1145072992516,7cyclictest1156023-21apt-get19:40:123
1145069992519,4cyclictest1186796-21kworker/u8:1-events_freezable_power_21:25:262
1145069992517,5cyclictest0-21swapper/222:25:172
1145069992517,4cyclictest0-21swapper/220:40:152
1145069992517,4cyclictest0-21swapper/200:20:252
1145069992517,4cyclictest0-21swapper/200:20:252
1145069992516,4cyclictest1232632-21cron23:25:002
1145069992515,5cyclictest0-21swapper/221:40:252
1145064992516,5cyclictest0-21swapper/122:40:011
1145064992514,8cyclictest1256850-21apt-get00:35:121
1145060992518,3cyclictest0-21swapper/021:30:170
1145060992514,7cyclictest1224155-21sendmail23:00:000
1145060992514,7cyclictest0-21swapper/020:00:220
114506099251,20cyclictest0-21swapper/023:10:380
1145069992418,3cyclictest0-21swapper/223:05:162
1145069992417,3cyclictest0-21swapper/220:15:012
1145069992415,6cyclictest0-21swapper/222:50:172
1145069992413,7cyclictest1196280-21grep21:35:262
1145064992418,3cyclictest0-21swapper/120:45:281
1145064992417,4cyclictest0-21swapper/120:20:221
1145064992417,3cyclictest0-21swapper/100:10:001
1145064992414,7cyclictest1218795-21seq22:41:581
1145064992414,6cyclictest0-21swapper/122:45:261
1145064992413,8cyclictest1243897-21cut23:55:241
1145060992418,3cyclictest0-21swapper/000:00:280
1145060992417,3cyclictest0-21swapper/023:46:350
1145060992416,5cyclictest0-21swapper/019:15:260
114506099241,19cyclictest0-21swapper/023:01:380
114506099241,19cyclictest0-21swapper/022:40:360
114506099241,19cyclictest0-21swapper/019:33:460
114506099240,20cyclictest0-21swapper/020:11:060
1145069992317,3cyclictest0-21swapper/223:10:252
1145069992315,4cyclictest1162120-21unixbench_multi19:55:252
1145069992314,6cyclictest1224909-21ntpq23:00:202
1145069992314,6cyclictest0-21swapper/200:25:162
1145064992317,3cyclictest0-21swapper/123:10:161
1145064992317,3cyclictest0-21swapper/120:05:211
1145064992317,3cyclictest0-21swapper/119:40:151
1145064992316,4cyclictest0-21swapper/121:35:261
1145064992316,4cyclictest0-21swapper/100:25:171
1145064992315,5cyclictest0-21swapper/121:50:281
114506499231,3cyclictest131rcu_preempt21:30:201
1145064992313,7cyclictest1167521-21seq20:13:221
114506099235,6cyclictest1236761-21if_eth023:35:170
1145060992317,3cyclictest13650irq/42-30be0000.ethernet00:25:150
1145060992316,3cyclictest0-21swapper/023:35:000
1145060992315,5cyclictest0-21swapper/021:20:270
1145060992314,6cyclictest1250808-21/usr/sbin/munin00:15:260
1145060992314,6cyclictest1250808-21/usr/sbin/munin00:15:260
114506099231,18cyclictest0-21swapper/022:47:430
114506099231,18cyclictest0-21swapper/019:40:040
114506099231,18cyclictest0-21swapper/019:13:180
114506099230,19cyclictest0-21swapper/020:52:150
114506099230,19cyclictest0-21swapper/020:31:490
114506999223,5cyclictest131rcu_preempt23:45:132
1145069992216,3cyclictest0-21swapper/223:40:172
1145069992216,3cyclictest0-21swapper/222:35:272
1145069992216,3cyclictest0-21swapper/219:20:222
1145069992216,3cyclictest0-21swapper/219:20:222
1145069992216,3cyclictest0-21swapper/200:00:182
1145069992215,3cyclictest0-21swapper/219:35:242
1145069992214,5cyclictest1156224-21fschecks_time19:40:152
1145069992211,8cyclictest1747-21packagekitd23:35:042
114506499222,3cyclictest131rcu_preempt22:55:001
1145064992216,3cyclictest0-21swapper/123:30:181
1145064992216,3cyclictest0-21swapper/120:05:011
1145064992214,6cyclictest1146384-21kworker/u8:1+events_unbound19:22:151
1145064992214,6cyclictest1146384-21kworker/u8:1+events_unbound19:22:151
1145064992213,6cyclictest1212191-21seq22:24:141
1145064992212,7cyclictest1230198-21tr23:15:221
1145064992212,7cyclictest1191740-21cut21:25:011
1145060992218,2cyclictest0-21swapper/022:30:170
1145060992217,3cyclictest0-21swapper/022:29:000
1145060992215,4cyclictest1252296-21ntpq00:20:200
1145060992215,4cyclictest1252296-21ntpq00:20:200
114506099221,3cyclictest1176401-21apt20:40:110
1145060992213,5cyclictest0-21swapper/019:25:270
114506099221,19cyclictest0-21swapper/020:35:180
114506099221,19cyclictest0-21swapper/020:35:170
114506099221,19cyclictest0-21swapper/019:48:430
114506099220,18cyclictest0-21swapper/022:02:390
114506099220,18cyclictest0-21swapper/022:02:390
1145069992114,3cyclictest0-21swapper/223:15:192
1145069992113,5cyclictest1160862-21cron19:55:012
1145064992115,3cyclictest0-21swapper/123:00:201
1145064992115,3cyclictest0-21swapper/119:45:151
1145064992113,5cyclictest0-21swapper/120:00:011
1145064992113,4cyclictest0-21swapper/119:35:171
114506999192,12cyclictest1170627-21tail20:20:222
1145069991912,5cyclictest311ktimers/223:50:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional