You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 05:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu Sep 03, 2026 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1264246995833,22cyclictest391ktimers/320:10:113
1264235995733,20cyclictest1364198-21fgrep23:55:230
126423599541,33cyclictest1286570-21sed20:10:230
126423599491,38cyclictest0-21swapper/000:20:090
1264246994739,5cyclictest1287771-21cut20:15:163
1264235994728,15cyclictest0-21swapper/022:25:010
1264243994636,7cyclictest1279859-21grep19:50:262
126423599460,38cyclictest0-21swapper/022:15:110
1264243994532,10cyclictest311ktimers/221:35:142
1264235994535,7cyclictest1350847-21grep23:15:220
1264235994532,10cyclictest121ktimers/000:30:130
1264235994532,10cyclictest121ktimers/000:30:120
126423599450,35cyclictest0-21swapper/020:40:130
1264246994432,8cyclictest1332574-21apt-key22:25:023
1264243994432,8cyclictest311ktimers/223:40:132
1264238994433,8cyclictest231ktimers/123:15:111
126423599440,42cyclictest0-21swapper/023:32:360
1264246994336,4cyclictest1371338-21unixbench_multi00:15:273
1264238994335,5cyclictest1364981-21sh23:59:591
126423599432,38cyclictest1322690-21/usr/sbin/munin21:55:200
126423599430,33cyclictest0-21swapper/023:50:130
1264235994225,13cyclictest121ktimers/021:05:120
1264235994225,13cyclictest121ktimers/021:05:120
126423599421,38cyclictest1360875-21/usr/sbin/munin23:45:240
126423599421,38cyclictest1359099-21/usr/sbin/munin23:40:220
126423599421,37cyclictest1315527-21/usr/sbin/munin21:35:160
126423599421,36cyclictest1374198-21/usr/sbin/munin00:25:190
126423599421,36cyclictest1338021-21cstates22:40:150
126423599421,36cyclictest1307393-21/usr/sbin/munin21:10:220
126423599421,34cyclictest0-21swapper/000:15:130
1264238994124,12cyclictest231ktimers/122:25:101
1264235994131,7cyclictest1324862-21grep22:00:240
126423599412,34cyclictest1299749-21apt-get20:50:110
126423599411,37cyclictest1366169-21chrt00:00:260
126423599411,37cyclictest1366169-21chrt00:00:260
126423599411,37cyclictest1352422-21/usr/sbin/munin23:20:250
126423599411,37cyclictest1348405-21/usr/sbin/munin23:10:210
126423599411,37cyclictest1327952-21/usr/sbin/munin22:10:280
126423599411,37cyclictest1289764-21/usr/sbin/munin20:20:190
1264246994032,5cyclictest0-21swapper/321:00:003
1264243994033,4cyclictest1354756-21munin-run23:30:002
1264238994028,6cyclictest0-21swapper/100:39:591
126423599401,36cyclictest1333233-21latency22:25:170
126423599401,36cyclictest1314058-21/usr/sbin/munin21:30:170
126423599401,36cyclictest1284095-21/usr/sbin/munin20:05:190
126423599401,35cyclictest1264449-21/usr/sbin/munin19:10:130
126423599401,22cyclictest1280468-21cat19:55:020
1264235994010,27cyclictest1267025-21interrupts19:15:160
126423599400,34cyclictest1368631-21apt-get00:10:130
126423599400,34cyclictest0-21swapper/020:35:130
126423599393,31cyclictest0-21swapper/019:35:110
126423599393,22cyclictest1301787-21irqstats20:55:160
126423599391,35cyclictest1340609-21/usr/sbin/munin22:45:260
126423599391,35cyclictest1321142-21/usr/sbin/munin21:50:280
126423599391,35cyclictest1280856-21if_eth019:55:170
126423599391,33cyclictest1346569-21/usr/sbin/munin23:05:140
126423599391,33cyclictest1275243-21/usr/sbin/munin19:40:120
1264243993826,8cyclictest1267695-21grep19:15:252
1264238993830,5cyclictest1323618-21sh22:00:001
1264238993830,4cyclictest0-21swapper/100:18:311
126423599386,29cyclictest1325856-21if_eth022:05:170
126423599383,32cyclictest1366932-21apt00:05:140
126423599381,34cyclictest1377962-21/usr/sbin/munin00:35:240
126423599381,34cyclictest1337707-21sendmail-msp22:40:010
126423599381,34cyclictest1312507-21/usr/sbin/munin21:25:230
126423599381,34cyclictest1309162-21/usr/sbin/munin21:15:250
126423599381,34cyclictest1303170-21apt-get21:00:120
126423599381,34cyclictest1303170-21apt-get21:00:120
126423599381,34cyclictest1293373-21/usr/sbin/munin20:30:190
126423599381,34cyclictest1292166-21/usr/sbin/munin20:25:230
126423599381,34cyclictest1288042-21/usr/sbin/munin20:15:200
126423599381,33cyclictest1310214-21/usr/sbin/munin21:20:140
126423599381,32cyclictest1341510-21fschecks_count22:50:150
126423599381,32cyclictest1341510-21fschecks_count22:50:150
126423599380,33cyclictest1270125-21apt-get19:25:140
126423599380,32cyclictest0-21swapper/023:00:110
1264243993729,4cyclictest0-21swapper/220:40:162
1264243993729,4cyclictest0-21swapper/220:40:002
1264243993727,7cyclictest1302479-21grep20:55:242
1264238993728,6cyclictest1356051-21unixbench_singl23:30:251
126423599372,32cyclictest1268761-21/usr/sbin/munin19:20:180
126423599371,33cyclictest1343270-21/usr/sbin/munin22:55:170
126423599371,33cyclictest1319181-21/usr/sbin/munin21:45:180
126423599371,33cyclictest1318067-21/usr/sbin/munin21:40:270
126423599371,33cyclictest1298326-21/usr/sbin/munin20:45:160
126423599371,33cyclictest1282451-21fschecks_count20:00:150
126423599371,33cyclictest1277699-21/usr/sbin/munin19:45:270
126423599371,32cyclictest1356684-21apt-get23:35:120
126423599371,32cyclictest1354529-21sshd23:27:240
126423599361,32cyclictest1334589-21/usr/sbin/munin22:30:120
1264243993528,4cyclictest1290781-21apt-get20:25:012
1264243993528,4cyclictest0-21swapper/223:00:142
1264243993525,6cyclictest0-21swapper/223:45:242
1264238993524,6cyclictest0-21swapper/119:25:011
1264246993423,7cyclictest0-21swapper/321:35:163
1264243993427,4cyclictest0-21swapper/220:30:152
1264243993426,6cyclictest311ktimers/222:55:122
1264243993426,4cyclictest1342803-21sh22:55:002
1264243993426,4cyclictest1342803-21sh22:55:002
1264243993426,4cyclictest0-21swapper/222:10:202
1264243993426,4cyclictest0-21swapper/221:10:172
1264238993423,7cyclictest0-21swapper/123:15:001
1264238993423,7cyclictest0-21swapper/122:15:011
1264243993322,6cyclictest0-21swapper/221:05:262
1264243993322,6cyclictest0-21swapper/221:05:262
1264238993326,3cyclictest0-21swapper/119:40:161
1264238993323,6cyclictest0-21swapper/120:10:231
1264238993322,7cyclictest0-21swapper/119:45:281
1264238993321,8cyclictest0-21swapper/119:40:011
1264246993224,4cyclictest0-21swapper/323:35:163
1264246993224,4cyclictest0-21swapper/320:30:243
1264243993223,6cyclictest1324899-21grep22:00:252
1264243993223,4cyclictest0-21swapper/222:06:242
1264243993221,8cyclictest438-21cron22:35:012
1264238993224,5cyclictest1287731-21fschecks_count20:15:151
1264238993224,4cyclictest0-21swapper/122:35:161
1264238993222,7cyclictest1342398-21grep22:50:251
1264238993222,7cyclictest1342398-21grep22:50:241
1264238993222,6cyclictest0-21swapper/123:40:251
1264246993123,4cyclictest0-21swapper/323:30:163
1264246993123,4cyclictest0-21swapper/321:15:263
1264243993124,4cyclictest0-21swapper/221:30:252
1264243993123,4cyclictest0-21swapper/220:50:162
1264243993123,4cyclictest0-21swapper/200:08:282
1264243993118,10cyclictest438-21cron21:30:012
1264238993123,4cyclictest0-21swapper/122:05:011
1264238993121,6cyclictest0-21swapper/119:25:491
1264238993116,11cyclictest231ktimers/120:25:101
1264246993023,4cyclictest0-21swapper/300:35:273
1264243993023,4cyclictest311ktimers/223:30:032
1264243993022,4cyclictest0-21swapper/222:25:022
126423899301,4cyclictest131rcu_preempt00:20:091
1264246992923,4cyclictest1321674-21kworker/u8:1+events_unbound21:54:423
1264246992921,5cyclictest0-21swapper/320:40:013
1264246992921,4cyclictest0-21swapper/321:05:263
1264246992921,4cyclictest0-21swapper/321:05:253
1264246992921,4cyclictest0-21swapper/320:05:293
1264246992919,6cyclictest0-21swapper/323:45:173
1264243992923,3cyclictest0-21swapper/219:35:012
1264243992923,3cyclictest0-21swapper/219:35:012
1264243992922,3cyclictest1364978-21kthreadd00:00:002
1264243992921,4cyclictest0-21swapper/200:35:162
1264238992922,4cyclictest0-21swapper/122:19:591
1264238992921,4cyclictest0-21swapper/119:15:011
1264238992919,5cyclictest0-21swapper/121:10:011
1264238992919,5cyclictest0-21swapper/121:10:001
1264238992918,7cyclictest0-21swapper/121:30:001
1264246992821,5cyclictest1335573-21unixbench_singl22:30:243
1264246992820,4cyclictest0-21swapper/323:40:243
1264246992817,7cyclictest1-21systemd22:46:303
1264243992822,4cyclictest1347774-21kworker/u8:1+events_unbound23:11:332
1264243992818,7cyclictest0-21swapper/220:30:012
1264243992817,6cyclictest0-21swapper/219:25:252
126424399281,5cyclictest131rcu_preempt00:10:122
1264238992821,4cyclictest0-21swapper/121:40:161
1264238992821,3cyclictest0-21swapper/121:36:221
1264238992819,6cyclictest0-21swapper/119:35:011
1264238992819,6cyclictest0-21swapper/119:35:001
1264238992819,6cyclictest0-21swapper/100:10:001
1264238992818,7cyclictest1339397-21apt22:45:001
1264246992720,5cyclictest208-21systemd-logind19:12:403
1264246992720,4cyclictest0-21swapper/321:05:013
1264246992720,4cyclictest0-21swapper/321:05:013
1264246992718,6cyclictest1328723-21sh22:15:013
1264246992718,5cyclictest0-21swapper/322:55:153
1264246992715,9cyclictest1375518-21date00:30:013
1264246992715,9cyclictest1375518-21date00:30:013
1264243992719,4cyclictest0-21swapper/222:45:262
1264238992717,6cyclictest0-21swapper/119:55:251
1264246992618,4cyclictest0-21swapper/322:41:303
1264246992618,4cyclictest0-21swapper/319:50:013
1264243992621,3cyclictest1283372-21kworker/u8:0+events_unbound20:00:562
1264243992620,3cyclictest0-21swapper/222:40:002
1264243992620,3cyclictest0-21swapper/221:50:282
1264243992620,3cyclictest0-21swapper/200:30:172
1264243992620,3cyclictest0-21swapper/200:30:162
1264243992616,7cyclictest1347934-21basename23:10:012
1264243992616,7cyclictest1333791-21grep22:25:242
1264238992618,4cyclictest0-21swapper/100:00:271
1264238992618,4cyclictest0-21swapper/100:00:261
1264238992617,7cyclictest1323402-21kworker/u8:2+events_unbound22:06:271
1264238992617,5cyclictest0-21swapper/100:15:001
1264238992616,6cyclictest0-21swapper/122:25:011
1264238992615,8cyclictest221rcuc/123:50:121
1264238992615,8cyclictest1358170-21tr23:40:001
1264238992615,8cyclictest1-21systemd21:21:181
1264246992519,4cyclictest178-21systemd-udevd20:50:403
1264246992518,4cyclictest438-21cron19:20:003
1264246992518,3cyclictest0-21swapper/323:10:303
1264246992517,4cyclictest1290988-21latency_hist20:25:003
1264246992517,4cyclictest0-21swapper/322:15:143
1264246992515,7cyclictest1334294-21basename22:30:003
1264246992515,7cyclictest0-21swapper/323:06:333
1264246992515,5cyclictest0-21swapper/323:20:263
1264243992519,3cyclictest0-21swapper/221:00:232
1264243992519,3cyclictest0-21swapper/221:00:232
1264243992516,5cyclictest0-21swapper/222:20:002
1264243992514,8cyclictest1362610-21wc23:50:242
1264238992519,3cyclictest0-21swapper/123:25:191
1264238992517,6cyclictest231ktimers/119:50:051
1264246992418,3cyclictest0-21swapper/323:55:213
1264246992418,3cyclictest0-21swapper/300:30:013
1264246992416,4cyclictest0-21swapper/300:10:173
1264246992415,5cyclictest0-21swapper/321:35:003
1264246992414,6cyclictest1279016-21cut19:50:173
1264246992413,8cyclictest1-21systemd20:46:183
126424699240,3cyclictest0-21swapper/319:59:463
1264243992418,3cyclictest0-21swapper/219:35:172
1264243992417,3cyclictest0-21swapper/223:20:172
1264243992417,3cyclictest0-21swapper/222:00:012
1264243992416,5cyclictest0-21swapper/219:45:182
1264243992415,5cyclictest1374774-21grep00:25:272
1264243992413,8cyclictest1265172-21wc19:10:252
126423899245,3cyclictest1294555-21sed20:35:021
1264238992417,4cyclictest0-21swapper/120:45:151
1264238992416,4cyclictest438-21cron00:35:001
1264238992416,4cyclictest438-21cron00:35:001
1264238992415,5cyclictest0-21swapper/121:20:001
1264238992414,6cyclictest231ktimers/123:05:121
1264246992316,4cyclictest1327032-21kthreadd22:10:003
1264246992316,4cyclictest0-21swapper/322:00:243
1264246992316,3cyclictest0-21swapper/319:30:263
1264246992316,3cyclictest0-21swapper/319:30:253
1264246992315,5cyclictest0-21swapper/319:30:013
1264246992315,4cyclictest0-21swapper/321:46:243
1264246992314,7cyclictest1367801-21sed00:05:293
1264243992317,4cyclictest1276515-21kworker/u8:2+events_unbound19:43:122
1264243992317,3cyclictest0-21swapper/221:40:242
1264243992317,3cyclictest0-21swapper/221:20:222
126424399231,19cyclictest1365228-21seq00:00:112
126424399231,19cyclictest1365228-21seq00:00:112
1264238992317,3cyclictest0-21swapper/121:50:211
1264238992317,3cyclictest0-21swapper/121:50:001
1264238992315,4cyclictest1283744-21sh20:05:011
1264238992315,4cyclictest0-21swapper/121:35:001
1264238992314,6cyclictest1335969-21cron22:35:011
126424699222,3cyclictest1317379-21uname21:40:193
1264246992216,3cyclictest0-21swapper/321:20:193
1264246992215,5cyclictest391ktimers/320:30:013
1264246992215,4cyclictest1354275-21unixbench_multi23:25:263
1264246992215,3cyclictest0-21swapper/319:40:253
1264246992214,5cyclictest0-21swapper/322:50:243
1264246992214,5cyclictest0-21swapper/322:50:243
1264246992214,5cyclictest0-21swapper/319:35:193
1264246992213,6cyclictest0-21swapper/300:00:243
1264246992213,6cyclictest0-21swapper/300:00:243
1264246992211,8cyclictest1362411-21pluginstate23:50:233
126424699221,18cyclictest1345800-21head23:00:253
1264243992216,3cyclictest0-21swapper/219:20:192
1264243992214,4cyclictest0-21swapper/220:45:252
1264238992216,4cyclictest231ktimers/120:40:231
1264238992214,5cyclictest231ktimers/121:10:191
1264238992213,6cyclictest0-21swapper/120:20:241
1264238992212,6cyclictest0-21swapper/119:15:021
126423899221,18cyclictest1360107-21runrttasks23:45:121
1264246992115,4cyclictest391ktimers/321:25:133
1264246992115,3cyclictest0-21swapper/320:05:003
1264246992114,3cyclictest0-21swapper/323:20:003
1264246992113,5cyclictest0-21swapper/320:40:203
1264243992115,3cyclictest0-21swapper/223:35:212
1264243992115,3cyclictest0-21swapper/221:19:592
1264243992115,3cyclictest0-21swapper/200:20:242
1264243992114,3cyclictest0-21swapper/222:40:162
1264243992113,6cyclictest1370826-21sed00:15:212
1264243992113,5cyclictest0-21swapper/220:17:012
1264238992116,3cyclictest0-21swapper/121:00:181
1264238992116,3cyclictest0-21swapper/121:00:171
1264238992115,3cyclictest0-21swapper/122:45:141
1264238992114,4cyclictest0-21swapper/123:20:271
1264238992114,4cyclictest0-21swapper/123:00:001
1264238992114,4cyclictest0-21swapper/120:50:261
1264238992113,5cyclictest0-21swapper/120:55:231
1264238992113,5cyclictest0-21swapper/120:35:261
126423899211,13cyclictest0-21swapper/123:00:571
126424699209,8cyclictest1336778-21ntp_states22:35:223
1264246992012,5cyclictest0-21swapper/319:20:253
1264243992014,4cyclictest1349501-21kworker/u8:2+events_unbound23:16:112
1264243992014,3cyclictest1281128-21sh19:55:222
126424399201,17cyclictest311ktimers/220:05:282
1264246991911,5cyclictest0-21swapper/321:55:133
126424399199,7cyclictest1319870-21seq21:46:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional