You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-20 - 16:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Mon Apr 20, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1131216995423,5cyclictest0-21swapper/309:00:003
113120599491,46cyclictest0-21swapper/007:55:130
1131210994739,5cyclictest1188434-21kthreadd09:55:011
1131216994622,4cyclictest0-21swapper/310:50:263
1131216994532,9cyclictest1245334-21sh12:40:013
113121499439,13cyclictest1195215-21seq10:14:402
1131214994335,5cyclictest1217860-21idleruntime-cro11:20:012
1131216994232,7cyclictest1147292-21sh07:55:013
1131216994230,7cyclictest0-21swapper/312:04:593
1131205994235,4cyclictest1183318-21grep09:40:000
1131216994029,7cyclictest1234647-21grep12:05:243
1131205994031,6cyclictest1232998-21unixbench_singl12:00:270
1131216993928,7cyclictest1201637-21head10:30:233
1131214993929,6cyclictest1196951-21sh10:19:592
1131205993933,4cyclictest1238949-21kworker/u8:3+events_unbound12:26:170
1131216993826,8cyclictest1165595-21tail08:45:263
1131214993830,4cyclictest0-21swapper/211:39:592
1131205993827,5cyclictest131rcu_preempt11:20:180
1131214993729,5cyclictest0-21swapper/210:00:002
1131210993727,6cyclictest0-21swapper/110:19:591
1131205993717,12cyclictest0-21swapper/007:40:190
1131216993627,6cyclictest0-21swapper/308:15:173
1131216993624,7cyclictest0-21swapper/309:35:283
1131214993627,6cyclictest0-21swapper/211:44:592
1131214993626,6cyclictest0-21swapper/209:30:262
1131210993629,4cyclictest1133099-21latency_hist07:15:011
1131205993629,4cyclictest1193557-21munin-plugin-st10:09:590
1131205993629,4cyclictest1193557-21munin-plugin-st10:09:590
1131205993628,5cyclictest0-21swapper/007:15:020
1131205993625,7cyclictest0-21swapper/008:45:010
1131216993526,7cyclictest391ktimers/310:10:133
1131216993526,5cyclictest0-21swapper/312:15:263
1131216993525,7cyclictest1133189-21latency_hist07:15:023
1131216993525,6cyclictest0-21swapper/311:35:243
1131216993524,7cyclictest0-21swapper/307:55:263
1131216993524,5cyclictest0-21swapper/310:05:463
1131216993524,5cyclictest0-21swapper/310:05:463
1131214993527,4cyclictest0-21swapper/207:35:262
1131210993528,4cyclictest1224877-21latency_hist11:40:001
1131205993525,6cyclictest0-21swapper/008:10:260
1131205993525,5cyclictest0-21swapper/007:30:010
1131216993424,6cyclictest1169862-21fschecks_count09:00:133
1131216993424,6cyclictest0-21swapper/309:10:173
1131216993422,7cyclictest0-21swapper/312:30:003
1131214993426,5cyclictest0-21swapper/208:25:012
1131214993424,6cyclictest0-21swapper/210:50:162
113120599349,8cyclictest11-21ksoftirqd/012:15:010
113120599345,16cyclictest11-21ksoftirqd/008:55:010
1131205993425,6cyclictest0-21swapper/009:15:260
1131205993425,6cyclictest0-21swapper/009:15:260
1131205993424,6cyclictest0-21swapper/008:35:270
1131205993422,9cyclictest121ktimers/008:25:110
1131205993421,7cyclictest1182934-21kworker/u8:1+events_unbound10:14:410
113120599341,29cyclictest1235114-21idleruntime-cro12:10:010
1131216993325,5cyclictest1222506-21grep11:30:243
1131216993324,5cyclictest0-21swapper/312:20:233
1131216993323,7cyclictest1164349-21auditctl08:45:013
1131216993321,7cyclictest0-21swapper/310:20:003
1131216993321,10cyclictest391ktimers/307:35:133
1131214993325,4cyclictest0-21swapper/207:50:262
1131210993326,4cyclictest0-21swapper/107:15:261
1131210993326,4cyclictest0-21swapper/107:15:261
1131210993326,3cyclictest0-21swapper/107:45:261
1131210993326,3cyclictest0-21swapper/107:45:261
1131210993324,6cyclictest0-21swapper/111:15:011
113120599336,13cyclictest11-21ksoftirqd/011:30:170
1131205993328,3cyclictest121ktimers/009:56:330
1131205993323,6cyclictest0-21swapper/010:30:220
1131205993322,7cyclictest0-21swapper/007:15:240
1131205993322,7cyclictest0-21swapper/007:15:240
1131205993318,9cyclictest131rcu_preempt07:50:200
113120599331,24cyclictest11-21ksoftirqd/007:20:160
1131216993224,4cyclictest0-21swapper/308:10:253
1131216993222,6cyclictest0-21swapper/309:20:013
1131216993222,6cyclictest0-21swapper/309:20:003
1131216993221,7cyclictest1231292-21grep11:55:253
1131216993220,8cyclictest0-21swapper/311:05:263
1131214993225,3cyclictest0-21swapper/208:40:162
1131214993224,4cyclictest0-21swapper/212:00:152
1131214993223,6cyclictest0-21swapper/209:20:012
1131214993223,6cyclictest0-21swapper/209:20:012
1131214993222,7cyclictest1236356-21grep12:10:252
1131210993225,4cyclictest1142197-21sendmail07:40:021
1131210993221,7cyclictest0-21swapper/110:55:001
1131210993212,11cyclictest1131200-21cyclictest08:16:291
113120599327,6cyclictest11-21ksoftirqd/008:55:200
1131205993224,5cyclictest1210814-21munin-plugin-st10:59:590
1131205993223,5cyclictest0-21swapper/010:40:000
1131205993222,6cyclictest0-21swapper/011:05:260
1131205993221,6cyclictest0-21swapper/011:45:260
1131205993214,11cyclictest131rcu_preempt07:45:180
1131205993214,11cyclictest131rcu_preempt07:45:170
1131205993212,4cyclictest131rcu_preempt11:00:150
1131205993212,4cyclictest0-21swapper/011:30:000
1131216993123,5cyclictest962958-21kworker/u8:0+events_unbound07:34:533
1131216993121,7cyclictest1210407-21grep10:55:253
1131210993125,4cyclictest1190128-21cron10:00:001
1131210993123,6cyclictest53-21kcompactd009:05:111
1131210993123,6cyclictest53-21kcompactd009:05:111
1131210993123,4cyclictest0-21swapper/111:56:131
1131210993122,6cyclictest645-21runrttasks10:11:321
1131210993115,12cyclictest231ktimers/109:10:121
1131210993111,13cyclictest1131200-21cyclictest10:42:391
113120599318,19cyclictest121ktimers/009:00:200
113120599313,10cyclictest11-21ksoftirqd/012:20:010
1131205993123,5cyclictest0-21swapper/008:20:010
1131205993123,4cyclictest0-21swapper/007:40:010
1131205993122,7cyclictest121ktimers/011:50:200
1131205993122,7cyclictest121ktimers/011:50:200
1131205993116,9cyclictest131rcu_preempt08:34:310
1131205993110,4cyclictest0-21swapper/010:50:020
1131216993020,7cyclictest1181210-21grep09:30:273
1131216993013,13cyclictest391ktimers/311:45:133
1131214993023,4cyclictest1161338-21fschecks_count08:35:172
1131214993023,4cyclictest0-21swapper/211:00:142
1131214993022,5cyclictest1170333-21sshd09:00:212
1131214993022,4cyclictest0-21swapper/212:35:002
1131214993021,6cyclictest1132381-21unixbench_multi07:10:262
1131214993018,9cyclictest1182390-21/usr/sbin/munin09:35:232
1131214993017,10cyclictest1218095-21/usr/sbin/munin11:20:252
1131210993024,4cyclictest1137307-21apt-get07:25:131
1131210993021,6cyclictest0-21swapper/111:40:251
113120599307,7cyclictest11-21ksoftirqd/009:55:010
113120599307,14cyclictest0-21swapper/010:25:010
113120599306,8cyclictest11-21ksoftirqd/008:20:220
113120599303,6cyclictest11-21ksoftirqd/009:30:020
1131205993022,5cyclictest0-21swapper/010:20:000
1131205993020,7cyclictest121ktimers/011:10:210
1131205993020,7cyclictest121ktimers/009:40:150
1131205993020,6cyclictest0-21swapper/011:55:250
1131205993015,9cyclictest131rcu_preempt12:20:400
1131205993014,3cyclictest131rcu_preempt10:45:180
1131205993012,3cyclictest131rcu_preempt09:20:250
113120599301,16cyclictest0-21swapper/012:35:180
1131205993010,9cyclictest131rcu_preempt08:02:330
1131216992922,4cyclictest0-21swapper/309:25:003
1131216992921,4cyclictest0-21swapper/307:30:013
1131216992920,6cyclictest1220420-21ps11:25:213
1131214992923,3cyclictest0-21swapper/212:05:142
1131214992922,4cyclictest0-21swapper/208:25:252
1131214992921,5cyclictest0-21swapper/211:05:262
1131214992921,4cyclictest1155812-21auditctl08:20:002
1131214992921,4cyclictest0-21swapper/209:50:442
1131214992917,9cyclictest1221016-21sshd11:27:042
1131214992917,8cyclictest1230499-21/usr/sbin/munin11:55:182
1131210992923,3cyclictest1176277-21apt-get09:20:061
1131210992921,4cyclictest0-21swapper/111:15:161
1131210992920,6cyclictest1191830-21taskset10:04:531
113120599299,3cyclictest0-21swapper/010:25:160
1131205992919,7cyclictest121ktimers/008:05:170
1131205992918,8cyclictest1243633-21auditctl12:35:010
1131205992913,4cyclictest131rcu_preempt09:35:020
1131205992913,4cyclictest0-21swapper/011:15:150
1131205992911,4cyclictest131rcu_preempt07:32:010
113120599291,14cyclictest0-21swapper/011:40:180
1131205992910,11cyclictest151rcuc/010:00:200
1131216992820,4cyclictest0-21swapper/310:35:273
1131216992819,4cyclictest0-21swapper/308:04:583
1131216992817,7cyclictest1243212-21grep12:30:263
1131216992816,8cyclictest1212535-21basename11:04:593
113121499289,11cyclictest0-21swapper/210:27:042
1131214992822,3cyclictest0-21swapper/210:05:222
1131214992822,3cyclictest0-21swapper/210:05:222
1131214992821,4cyclictest0-21swapper/211:10:252
1131214992817,8cyclictest1227162-21/usr/sbin/munin11:45:182
1131214992817,8cyclictest1203692-21sshd10:39:032
1131214992817,8cyclictest1165722-21sshd08:46:032
1131214992817,8cyclictest0-21swapper/208:10:112
1131214992814,11cyclictest1171957-21/usr/sbin/munin09:05:212
1131214992814,11cyclictest1171957-21/usr/sbin/munin09:05:212
1131214992814,11cyclictest1166741-21memory08:50:212
1131214992811,12cyclictest1210974-21latency_hist11:00:012
1131210992821,4cyclictest0-21swapper/108:40:011
1131210992819,6cyclictest1180988-21timerandwakeup09:30:251
1131210992818,7cyclictest1203299-21grep10:35:281
1131210992818,7cyclictest1131200-21cyclictest11:50:121
1131210992818,7cyclictest1131200-21cyclictest11:50:111
1131210992816,9cyclictest0-21swapper/107:20:171
113121099281,10cyclictest1149589-21irqstats08:00:191
113120599284,8cyclictest11-21ksoftirqd/009:45:260
1131205992822,4cyclictest151rcuc/009:09:210
1131205992822,4cyclictest151rcuc/009:09:210
1131205992822,4cyclictest1164569-21sshd08:45:040
1131205992810,4cyclictest151rcuc/011:35:150
1131216992719,4cyclictest0-21swapper/307:40:173
1131216992718,5cyclictest0-21swapper/310:20:263
1131216992717,7cyclictest1157063-21grep08:20:253
1131216992715,5cyclictest0-21swapper/309:40:433
113121499276,12cyclictest0-21swapper/209:45:372
1131214992721,3cyclictest0-21swapper/209:00:012
1131214992720,4cyclictest0-21swapper/212:40:002
1131214992716,8cyclictest1137290-21sshd07:25:032
1131214992716,7cyclictest0-21swapper/209:25:112
1131214992715,8cyclictest1176731-21apt-get09:20:052
1131214992714,9cyclictest1190659-21/usr/sbin/munin10:00:162
1131214992714,10cyclictest1197962-21/usr/sbin/munin10:20:242
1131210992723,2cyclictest1238767-21apt-get12:20:121
1131210992719,6cyclictest231ktimers/112:10:111
1131210992718,6cyclictest1164342-21cron08:45:001
1131210992718,6cyclictest0-21swapper/108:20:151
1131210992717,6cyclictest0-21swapper/110:50:011
1131210992715,7cyclictest1214623-21latency_hist11:10:021
113120599272,7cyclictest11-21ksoftirqd/009:15:010
1131205992711,3cyclictest131rcu_preempt10:40:230
1131216992620,3cyclictest0-21swapper/310:25:223
1131216992616,5cyclictest0-21swapper/309:55:003
1131214992619,3cyclictest0-21swapper/210:45:152
1131214992618,6cyclictest311ktimers/208:05:152
1131214992615,7cyclictest1228863-21runrttasks11:50:182
1131214992615,7cyclictest1228863-21runrttasks11:50:182
1131214992614,9cyclictest1144373-21/usr/sbin/munin07:45:162
1131214992614,9cyclictest1144373-21/usr/sbin/munin07:45:162
1131214992614,8cyclictest1173549-21/usr/sbin/munin09:10:192
1131214992613,8cyclictest1239332-21/usr/sbin/munin12:20:202
1131214992613,10cyclictest1200868-21/usr/sbin/munin10:30:152
1131214992610,13cyclictest1221684-21grep11:30:152
1131214992610,12cyclictest1240467-21/usr/sbin/munin12:25:162
1131214992610,12cyclictest1159776-21/usr/sbin/munin08:30:182
1131210992619,5cyclictest1148600-21unixbench_singl07:55:261
1131210992619,4cyclictest0-21swapper/108:50:001
113121099261,8cyclictest1182018-21fschecks_count09:35:171
1131210992618,5cyclictest0-21swapper/112:16:151
1131210992617,6cyclictest0-21swapper/111:05:011
1131210992616,7cyclictest1220421-21grep11:25:221
1131210992616,7cyclictest1186336-21uptime09:45:281
1131210992614,9cyclictest0-21swapper/108:12:191
1131216992518,4cyclictest0-21swapper/308:25:233
1131216992514,7cyclictest0-21swapper/309:55:263
113121699251,13cyclictest0-21swapper/308:30:183
113121499259,13cyclictest1183563-21/usr/sbin/munin09:40:162
1131214992516,6cyclictest1135659-21/usr/sbin/munin07:20:132
1131214992515,7cyclictest1148140-21proc_pri07:55:242
1131214992512,10cyclictest1142612-21/usr/sbin/munin07:40:182
1131214992511,11cyclictest1139468-21sort07:30:212
113121099254,8cyclictest0-21swapper/110:55:161
1131210992519,3cyclictest0-21swapper/109:45:011
1131210992518,4cyclictest0-21swapper/110:30:231
1131210992515,7cyclictest0-21swapper/107:50:191
1131210992512,10cyclictest1223175-21sort11:35:011
113121099250,9cyclictest0-21swapper/108:26:211
1131216992418,4cyclictest1145130-21unixbench_multi07:45:263
1131216992418,4cyclictest1145130-21unixbench_multi07:45:253
1131216992416,4cyclictest1219148-21head11:20:263
1131216992415,6cyclictest0-21swapper/311:50:163
1131216992415,6cyclictest0-21swapper/311:50:153
1131216992414,7cyclictest1216555-21grep11:15:173
1131216992413,8cyclictest1190602-21cut10:00:153
1131216992413,3cyclictest0-21swapper/311:40:263
113121499249,12cyclictest1203770-21cron10:40:012
1131214992414,7cyclictest0-21swapper/208:00:142
1131214992413,7cyclictest1237447-21sed12:15:192
1131210992418,3cyclictest0-21swapper/112:35:221
1131210992418,3cyclictest0-21swapper/110:20:251
1131210992417,4cyclictest0-21swapper/109:15:271
1131210992417,4cyclictest0-21swapper/109:15:261
1131210992416,6cyclictest1231944-21/usr/sbin/munin12:00:191
1131210992416,6cyclictest1192964-21grep10:05:261
1131210992416,6cyclictest1192964-21grep10:05:251
1131210992416,4cyclictest0-21swapper/112:31:171
1131210992415,7cyclictest1131200-21cyclictest12:05:321
1131210992415,7cyclictest0-21swapper/110:25:181
1131210992415,6cyclictest0-21swapper/107:30:251
1131210992413,8cyclictest0-21swapper/107:40:141
113121699232,15cyclictest1205088-21grep10:40:253
1131216992317,3cyclictest0-21swapper/309:25:243
1131216992316,5cyclictest208-21systemd-logind11:14:403
1131216992316,5cyclictest1151834-21sort08:05:263
1131216992316,4cyclictest0-21swapper/309:05:173
1131216992316,4cyclictest0-21swapper/309:05:163
1131216992314,6cyclictest1133512-21sort07:15:033
1131216992314,6cyclictest1133512-21sort07:15:033
113121099234,7cyclictest0-21swapper/111:22:061
1131210992314,7cyclictest1131200-21cyclictest11:46:171
1131210992314,7cyclictest1131200-21cyclictest09:27:011
1131210992313,7cyclictest0-21swapper/109:00:231
113121699222,13cyclictest1136599-21tail07:20:263
1131216992216,4cyclictest1224155-21kworker/u8:3+events_unbound12:10:373
1131216992212,7cyclictest1166711-21sed08:50:203
113121099221,8cyclictest0-21swapper/108:50:031
1131210992213,6cyclictest0-21swapper/108:55:241
1131210992210,9cyclictest0-21swapper/112:26:131
1131216992112,4cyclictest0-21swapper/310:50:013
113121099210,6cyclictest0-21swapper/108:30:561
1131216992014,3cyclictest0-21swapper/308:35:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional