You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-18 - 13:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot4.osadl.org (updated Sat Oct 18, 2025 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1191799733,64cyclictest19423-21aten_rbpower_cu16:44:113
1191799722,64cyclictest32675-21kworker/3:017:45:373
1191799712,62cyclictest15651-21mailstats17:24:253
11917997110,55cyclictest0-21swapper/317:53:353
1191799703,61cyclictest15660-21ssh18:11:513
1191799702,62cyclictest4491-21/usr/sbin/munin14:24:173
1191799692,61cyclictest25619-21/usr/sbin/munin13:54:303
1191799682,60cyclictest20003-21/usr/sbin/munin13:39:343
11917996812,50cyclictest0-21swapper/315:49:173
1191799673,58cyclictest0-21swapper/318:29:273
1191799673,30cyclictest32053-21ssh16:14:263
1191799672,59cyclictest7645-21latency_hist17:13:593
1191799672,59cyclictest31577-21ssh18:35:313
1191799672,59cyclictest13867-21/usr/sbin/munin14:49:193
11917996710,51cyclictest0-21swapper/315:45:113
1191799663,55cyclictest0-21swapper/316:24:163
1191799662,58cyclictest6734-21fschecks_time14:29:193
1191799662,58cyclictest6734-21fschecks_time14:29:193
1191799662,58cyclictest3818-21missed_timers17:54:183
1191799662,58cyclictest3818-21missed_timers17:54:183
1191799662,58cyclictest32675-21kworker/3:017:00:513
1191799662,58cyclictest25339-21unixbench_singl16:04:323
1191799662,58cyclictest23749-21/usr/sbin/munin13:49:273
11917996612,24cyclictest0-21swapper/315:20:383
1191799653,56cyclictest10165-21timerwakeupswit16:29:303
1191799653,29cyclictest24380-21ssh16:49:513
1191799652,58cyclictest17232-21awk16:39:323
1191799652,57cyclictest27497-21/usr/sbin/munin13:59:383
1191799652,57cyclictest21872-21/usr/sbin/munin13:44:243
1191799652,29cyclictest24576-21grep18:24:283
1191799649,50cyclictest0-21swapper/316:37:583
1191799648,50cyclictest0-21swapper/317:21:073
1191799647,26cyclictest0-21swapper/317:39:583
1191799646,52cyclictest0-21swapper/318:08:013
1191799645,54cyclictest0-21swapper/317:14:493
1191799645,53cyclictest0-21swapper/317:37:243
1191799645,53cyclictest0-21swapper/317:29:093
1191799644,54cyclictest0-21swapper/318:00:043
1191799643,56cyclictest32764-21/usr/sbin/munin15:29:223
1191799642,56cyclictest32675-21kworker/3:018:44:493
1191799642,56cyclictest3158-21ssh18:42:343
1191799638,49cyclictest0-21swapper/318:20:073
1191799638,49cyclictest0-21swapper/318:20:073
1191799634,53cyclictest0-21swapper/316:21:373
1191799634,53cyclictest0-21swapper/316:21:373
1191799633,54cyclictest22844-21ssh16:01:553
1191799632,56cyclictest1805-21/usr/sbin/munin17:04:273
1191799632,55cyclictest32675-21kworker/3:018:18:023
1191799632,55cyclictest30271-21ssh16:12:563
1191799632,55cyclictest17556-21sh15:54:153
1191799632,55cyclictest11995-21/usr/sbin/munin14:44:303
1191799632,54cyclictest26338-21/usr/sbin/munin16:54:173
1191799632,33cyclictest4184-21sendmail_mailqu15:34:313
1191799624,52cyclictest0-21swapper/315:39:083
1191799622,54cyclictest31619-21ssh15:28:303
1191799614,51cyclictest0-21swapper/313:19:063
1191299603,52cyclictest0-21swapper/218:22:312
1191299603,52cyclictest0-21swapper/218:22:312
1191799593,50cyclictest0-21swapper/314:24:043
1191799592,51cyclictest24342-21snmpd13:38:203
11912995849,5cyclictest29-21ksoftirqd/217:08:592
1134625811,17sleep10-21swapper/113:15:241
1191799558,42cyclictest0-21swapper/314:15:533
1191299554,45cyclictest0-21swapper/215:34:212
1191299553,47cyclictest0-21swapper/216:33:472
1191299544,44cyclictest0-21swapper/218:48:572
1191299544,44cyclictest0-21swapper/218:02:282
1191299543,46cyclictest0-21swapper/214:55:122
1191299534,43cyclictest0-21swapper/215:48:312
1191299527,40cyclictest0-21swapper/217:13:592
1191299524,8cyclictest0-21swapper/216:36:302
1191299524,41cyclictest0-21swapper/216:16:382
1191299514,41cyclictest0-21swapper/218:34:382
1191299514,41cyclictest0-21swapper/217:50:012
1191299513,5cyclictest0-21swapper/215:21:122
1191299513,43cyclictest0-21swapper/218:14:082
1191299513,41cyclictest0-21swapper/216:04:512
11912995112,33cyclictest0-21swapper/215:28:372
1191799502,42cyclictest31980-21/usr/sbin/munin14:09:273
1191299505,39cyclictest0-21swapper/217:37:562
1191299504,40cyclictest0-21swapper/216:12:312
1191299502,43cyclictest11193-21/usr/sbin/munin17:19:112
11912995012,33cyclictest23030-21latency_hist15:14:022
11912995011,33cyclictest0-21swapper/218:04:162
1191299495,38cyclictest0-21swapper/217:40:412
1191299494,39cyclictest0-21swapper/218:30:282
1191299494,39cyclictest0-21swapper/216:50:012
1191299494,39cyclictest0-21swapper/215:59:282
1191299493,41cyclictest0-21swapper/217:02:492
1191299493,40cyclictest0-21swapper/215:50:212
1191299493,40cyclictest0-21swapper/214:14:202
1191299492,41cyclictest716-21/usr/sbin/munin18:39:272
11912994915,28cyclictest14544-21timerwakeupswit18:09:282
11912994911,5cyclictest0-21swapper/215:56:232
11912994910,5cyclictest0-21swapper/215:14:352
11912994910,33cyclictest0-21swapper/217:26:172
11917994818,25cyclictest21645-21cut15:09:183
1191299484,39cyclictest0-21swapper/213:26:202
1191299484,38cyclictest0-21swapper/217:44:042
1191299484,38cyclictest0-21swapper/216:39:062
1191299484,38cyclictest0-21swapper/216:24:422
1191299484,38cyclictest0-21swapper/215:04:152
1191299484,38cyclictest0-21swapper/215:00:352
1191299484,19cyclictest0-21swapper/217:30:112
1191299484,18cyclictest0-21swapper/215:42:252
11912994811,6cyclictest0-21swapper/216:57:482
11912994810,5cyclictest0-21swapper/216:19:512
11912994810,5cyclictest0-21swapper/216:19:512
1190299483,40cyclictest0-21swapper/015:23:520
1191799473,38cyclictest24198-21/usr/sbin/munin15:14:303
11917994714,28cyclictest18223-21/usr/sbin/munin14:59:253
11917994712,29cyclictest16630-21/usr/sbin/munin14:54:293
1191299474,37cyclictest0-21swapper/216:44:242
1191299473,39cyclictest0-21swapper/215:29:422
1191299473,38cyclictest0-21swapper/213:19:212
1191299473,37cyclictest0-21swapper/213:31:212
1191299472,6cyclictest24506-21cat18:24:282
1191299472,40cyclictest5985-21sh17:58:082
1191299472,40cyclictest5985-21sh17:58:082
11912994712,29cyclictest10167-21wget14:39:142
11912994711,5cyclictest0-21swapper/217:14:322
1190699472,39cyclictest3969-21idleruntime-cro17:08:591
116522477,13sleep20-21swapper/213:18:592
1191799463,38cyclictest0-21swapper/314:40:523
1191799463,37cyclictest17389-21unixbench-2d13:29:363
1191299463,9cyclictest0-21swapper/214:09:032
1191299463,8cyclictest0-21swapper/214:19:182
1191299463,37cyclictest0-21swapper/214:03:382
1190699463,38cyclictest0-21swapper/116:54:341
1191799453,37cyclictest8748-21kernelversion14:34:203
1191799453,36cyclictest29869-21/usr/sbin/munin14:04:243
1191799453,36cyclictest19567-21/usr/sbin/munin15:04:143
1191799453,36cyclictest14672-21fschecks_time13:24:193
1191299454,36cyclictest0-21swapper/214:35:572
1191299454,36cyclictest0-21swapper/214:28:182
1191299453,37cyclictest0-21swapper/213:49:592
1191299453,37cyclictest0-21swapper/213:34:302
1191299453,36cyclictest0-21swapper/214:49:332
1190699454,36cyclictest0-21swapper/113:19:241
1190299454,7cyclictest27958-21vmstat18:29:310
1190299454,36cyclictest0-21swapper/016:13:070
1190299454,36cyclictest0-21swapper/015:52:310
133242442,6sleep113371-21/usr/sbin/munin16:34:281
1191299443,35cyclictest0-21swapper/213:42:102
1191299442,36cyclictest31243-21/usr/sbin/munin14:09:172
1190299445,34cyclictest0-21swapper/016:20:460
1190299445,34cyclictest0-21swapper/016:20:460
1190299445,15cyclictest0-21swapper/015:24:240
1191299433,35cyclictest0-21swapper/214:29:172
1191299433,35cyclictest0-21swapper/214:29:172
1191299433,34cyclictest0-21swapper/213:49:042
1190699434,35cyclictest0-21swapper/116:08:511
1190299435,32cyclictest0-21swapper/018:44:390
1190299434,34cyclictest0-21swapper/016:01:490
1190299433,36cyclictest0-21swapper/014:15:410
1190299433,34cyclictest12168-21diskstats14:44:170
300322423,6sleep10-21swapper/117:44:431
257742423,6sleep00-21swapper/018:27:290
186542423,6sleep00-21swapper/015:55:070
1191299423,34cyclictest0-21swapper/213:55:282
1190699423,34cyclictest0-21swapper/115:41:161
1190299423,34cyclictest0-21swapper/014:40:320
290182413,6sleep10-21swapper/116:09:571
120142413,6sleep10-21swapper/115:45:501
76242403,6sleep10-21swapper/114:29:361
76242403,6sleep10-21swapper/114:29:361
300312403,6sleep00-21swapper/016:59:140
247032403,6sleep00-21swapper/016:50:410
24382403,6sleep00-21swapper/018:40:330
229952403,6sleep00-21swapper/018:23:460
229952403,6sleep00-21swapper/018:23:460
1191299403,32cyclictest0-21swapper/214:44:202
11902994031,5cyclictest3-21ksoftirqd/016:09:000
1190299402,22cyclictest174402sh17:27:560
58102383,6sleep10-21swapper/115:37:331
326742383,6sleep10-21swapper/117:03:261
255602383,6sleep10-21swapper/118:26:531
172402383,6sleep00-21swapper/014:57:150
159682383,7sleep00-21swapper/013:28:180
1190299384,29cyclictest0-21swapper/018:05:150
1190299384,29cyclictest0-21swapper/014:20:540
11902993829,5cyclictest3-21ksoftirqd/017:33:580
1118123812,19sleep30-21swapper/313:14:333
100962383,6sleep00-21swapper/017:16:570
16402373,6sleep00-21swapper/015:30:510
140762373,6sleep00-21swapper/013:23:030
11906993725,8cyclictest7904-21tail17:59:331
1190299374,28cyclictest0-21swapper/015:38:540
1190299373,29cyclictest0-21swapper/017:54:100
1190299373,29cyclictest0-21swapper/017:54:100
1091723711,17sleep00-21swapper/013:14:300
238162363,6sleep10-21swapper/117:36:381
231712363,6sleep00-21swapper/013:44:520
197152363,6sleep00-21swapper/013:38:200
145732363,6sleep00-21swapper/016:36:200
11906993625,7cyclictest15448-21wc13:24:341
11906993624,7cyclictest29746-21wc15:24:311
1190299364,26cyclictest0-21swapper/017:04:070
1190299363,29cyclictest0-21swapper/017:53:500
11902993624,7cyclictest5550-21grep14:24:310
239782351,6sleep024004-21ntp_states15:14:250
1190699354,26cyclictest0-21swapper/115:30:031
11906993521,9cyclictest589-21gdbus15:14:011
1190299354,26cyclictest0-21swapper/018:09:010
1190299353,27cyclictest0-21swapper/013:39:160
11902993524,6cyclictest22220-21sh17:34:190
11902993524,6cyclictest17258-21grep13:29:340
1190299352,28cyclictest31372-21tune2fs16:14:130
47282342,4sleep00-21swapper/017:09:160
11906993423,7cyclictest667-21runrttasks17:40:101
1190299343,27cyclictest0-21swapper/015:39:060
1190299343,26cyclictest0-21swapper/014:29:190
1190299343,26cyclictest0-21swapper/014:29:190
1190299343,25cyclictest0-21swapper/017:43:350
11902993425,5cyclictest3-21ksoftirqd/013:59:030
11902993415,15cyclictest11209-21cut17:19:100
67412332,25sleep06801-21df_inode17:59:150
1190699336,21cyclictest0-21swapper/117:14:321
11906993322,7cyclictest4244-21/usr/sbin/munin17:09:101
11906993322,7cyclictest19786-21munin-plugin-st13:39:031
11906993322,7cyclictest12365-21timerwakeupswit17:19:301
11906993321,8cyclictest20481-21/usr/sbin/munin15:59:301
11906993321,7cyclictest16251-21fschecks_time16:39:161
1190299334,25cyclictest0-21swapper/016:47:220
1190299333,26cyclictest0-21swapper/018:34:590
1190699323,24cyclictest0-21swapper/118:44:291
11906993222,6cyclictest5513-21timerandwakeup14:24:311
11906993222,6cyclictest28743-21uptime13:59:371
11906993221,7cyclictest16777-21/usr/sbin/munin18:14:191
11906993221,7cyclictest13819-21idleruntime18:09:151
11906993220,7cyclictest17908-21crond13:34:031
11906993220,7cyclictest10799-21tr14:39:241
11906993219,8cyclictest25999-21ntpq15:19:271
11906993212,15cyclictest667-21runrttasks16:18:441
1190299323,24cyclictest0-21swapper/014:34:290
11902993223,5cyclictest3-21ksoftirqd/015:09:150
11902993221,7cyclictest24617-21grep13:49:300
11902993220,7cyclictest455-21crond14:14:030
11902993215,14cyclictest31152-21sh17:47:270
1190699318,19cyclictest11319-21tail18:04:311
1190699314,23cyclictest0-21swapper/116:27:441
1190699314,22cyclictest0-21swapper/118:37:511
1190699314,22cyclictest0-21swapper/117:24:161
1190699314,22cyclictest0-21swapper/116:50:311
1190699314,22cyclictest0-21swapper/113:49:171
1190699314,21cyclictest0-21swapper/114:44:171
11906993122,5cyclictest22758-21sendmail_mailst13:44:301
11906993121,6cyclictest14477-21missed_timers14:49:221
11906993119,7cyclictest19754-21tune2fs16:44:161
1190299318,18cyclictest0-21swapper/016:54:300
1190299314,23cyclictest0-21swapper/018:16:010
1190299313,24cyclictest0-21swapper/016:41:340
1190299313,24cyclictest0-21swapper/016:27:530
1190299313,24cyclictest0-21swapper/014:50:000
1190699304,23cyclictest0-21swapper/118:22:441
1190699304,23cyclictest0-21swapper/118:22:441
1190699304,22cyclictest0-21swapper/117:54:361
1190699304,22cyclictest0-21swapper/117:54:361
1190699304,22cyclictest0-21swapper/114:54:341
1190699303,23cyclictest0-21swapper/115:51:031
11906993021,5cyclictest9158-21df16:29:131
11906993021,5cyclictest32376-21unixbench-2d14:09:351
11906993020,6cyclictest8241-21aten_rbpower_cu14:34:121
11906993020,6cyclictest3417-21proc_pri14:19:291
11906993020,6cyclictest26599-21sh18:29:091
11906993020,6cyclictest19772-21fschecks_time15:04:171
11906993020,6cyclictest1160-21idleruntime18:39:161
11906993019,7cyclictest25729-21cpu13:54:151
11906993019,7cyclictest20457-21if_err_eth213:39:211
11906993019,6cyclictest24908-21diskmemload15:55:371
11906993018,7cyclictest589-21gdbus15:14:021
11906993018,7cyclictest32454-21fschecks_time17:49:151
11906993018,7cyclictest2402-21fschecks_time16:19:161
11906993018,7cyclictest2402-21fschecks_time16:19:161
1190299304,21cyclictest0-21swapper/015:44:040
11906992919,6cyclictest29858-21sh14:04:221
11906992919,6cyclictest1067-21fschecks_time14:14:191
1190299295,18cyclictest0-21swapper/013:59:170
1190299293,23cyclictest0-21swapper/014:06:260
1190299293,22cyclictest0-21swapper/016:31:420
11902992919,6cyclictest17700-21aten_rbpower_vo14:59:170
1190699284,19cyclictest0-21swapper/114:59:081
11906992819,5cyclictest18372-21sh17:29:141
1190299282,14cyclictest197572cut15:04:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional