You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-19 - 06:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot4.osadl.org (updated Sat Jul 19, 2025 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2874299744,64cyclictest0-21swapper/317:18:013
2874299722,26cyclictest21322-21grep16:23:123
2874299714,61cyclictest0-21swapper/317:36:403
2874299712,63cyclictest3539-21ssh18:11:553
2874299712,63cyclictest29676-21fschecks_time14:08:103
2874299712,63cyclictest23140-21/usr/sbin/munin15:18:073
2874299712,4cyclictest7816-21ssh16:48:223
2874299712,4cyclictest7816-21ssh16:48:223
2874299709,56cyclictest0-21swapper/318:32:193
2874299709,55cyclictest12671-21ntpq14:48:183
2874299702,63cyclictest15643-21/usr/sbin/munin14:58:123
2874299702,62cyclictest4426-21/usr/sbin/munin14:28:263
2874299694,59cyclictest0-21swapper/316:36:243
2874299692,61cyclictest8169-21/usr/sbin/munin14:38:083
2874299692,61cyclictest8169-21/usr/sbin/munin14:38:083
2874299692,61cyclictest19399-21/usr/sbin/munin15:08:143
2874299692,61cyclictest17532-21/usr/sbin/munin15:03:103
2874299692,42cyclictest3125-21ssh17:27:333
2874299692,37cyclictest27745-21runrttasks17:16:353
2874299688,54cyclictest0-21swapper/317:46:243
2874299687,55cyclictest0-21swapper/319:37:103
2874299685,57cyclictest0-21swapper/318:26:163
2874299685,57cyclictest0-21swapper/318:26:163
2874299683,60cyclictest8920-21irqstats19:03:113
2874299683,59cyclictest25727-21netstat15:23:173
2874299683,32cyclictest21849-21/usr/sbin/munin19:23:013
2874299683,27cyclictest5411-21iostat_ios18:58:073
2874299682,61cyclictest31109-21interrupts15:38:113
2874299682,61cyclictest10034-21/usr/sbin/munin14:43:163
2874299682,60cyclictest8308-21netstat16:03:143
2874299682,60cyclictest2557-21/usr/sbin/munin14:23:163
2874299678,54cyclictest9250-21diskmemload17:41:433
2874299678,54cyclictest9250-21diskmemload17:41:433
2874299678,26cyclictest0-21swapper/317:00:143
2874299677,54cyclictest0-21swapper/316:10:153
2874299676,55cyclictest18494-21cut17:48:043
2874299673,58cyclictest20956-21ssh18:34:503
2874299673,58cyclictest20131-21ssh16:22:283
2874299673,31cyclictest2573-21/usr/sbin/munin18:53:223
2874299673,31cyclictest2573-21/usr/sbin/munin18:53:223
2874299672,59cyclictest6298-21/usr/sbin/munin14:33:163
2874299672,59cyclictest6298-21/usr/sbin/munin14:33:163
2874299672,59cyclictest3843-21/usr/sbin/munin15:53:243
2874299672,59cyclictest31344-21ssh18:48:263
2874299672,59cyclictest28758-21/usr/sbin/munin15:33:233
2874299672,59cyclictest27177-21sendmail_mailqu18:43:143
2874299672,59cyclictest25380-21fschecks_count19:28:033
2874299672,59cyclictest21266-21/usr/sbin/munin15:13:083
2874299672,59cyclictest16624-21ssh19:14:023
2874299672,59cyclictest13771-21/usr/sbin/munin14:53:183
2874299672,58cyclictest24933-21/usr/sbin/munin16:28:123
2874299672,31cyclictest9292-21/usr/sbin/munin18:18:213
2874299672,31cyclictest1932-21latency_hist15:47:533
28742996711,51cyclictest0-21swapper/317:56:153
28727996714,9cyclictest29931-21latency18:03:100
2874299669,51cyclictest0-21swapper/319:19:433
2874299666,55cyclictest4240-21unixbench_singl16:43:253
2874299665,28cyclictest0-21swapper/319:08:163
2874299664,56cyclictest0-21swapper/318:02:383
2874299664,56cyclictest0-21swapper/316:54:193
2874299663,57cyclictest4094-21/usr/sbin/munin17:28:113
2874299663,57cyclictest22070-21/usr/sbin/munin17:08:173
2874299662,58cyclictest667-21runrttasks18:42:093
2874299662,58cyclictest32649-21ssh18:07:483
2874299662,58cyclictest14923-21ssh16:14:033
2874299655,54cyclictest0-21swapper/318:12:563
2874299654,55cyclictest0-21swapper/317:04:013
2874299652,58cyclictest5712-21/usr/sbin/munin15:58:123
2874299652,58cyclictest5712-21/usr/sbin/munin15:58:123
2874299652,58cyclictest2145-21df_inode15:48:093
2874299652,57cyclictest26878-21/usr/sbin/munin15:28:163
28742996510,51cyclictest31974-21fschecks_time16:38:063
28727996420,38cyclictest29150-21sed16:33:230
2874299632,55cyclictest681-21/usr/sbin/munin14:18:313
28727996319,38cyclictest23741-21ksmtuned16:27:190
2873799624,52cyclictest0-21swapper/218:07:502
28727996121,13cyclictest22430-21grep19:23:100
28727996119,37cyclictest13042-21grep19:08:210
28727996117,38cyclictest9557-21/usr/sbin/munin16:08:250
28727996113,42cyclictest2888-21/usr/sbin/munin16:43:150
2873799605,48cyclictest0-21swapper/217:33:242
28727996015,39cyclictest24643-21cat17:12:510
28727995918,36cyclictest29561-21find19:33:150
28727995917,36cyclictest7418-21pluginstate16:48:160
28727995917,36cyclictest7418-21pluginstate16:48:160
28727995916,38cyclictest23010-21ls17:53:210
28727995914,38cyclictest1370-21ntp_states18:08:110
28727995819,12cyclictest1795-21cat18:53:090
28727995819,12cyclictest1795-21cat18:53:090
28727995818,34cyclictest30830-21processes18:48:170
28727995814,39cyclictest25399-21timerandwakeup16:28:200
28727995720,32cyclictest28607-21/usr/sbin/munin17:18:210
28727995714,37cyclictest16860-21ssh16:17:560
28727995713,38cyclictest0-21swapper/016:55:220
28727995712,39cyclictest0-21swapper/017:05:100
2811625711,16sleep20-21swapper/214:03:262
28727995616,34cyclictest22486-21kworker/0:118:47:010
28727995615,35cyclictest16762-21cat16:17:520
28727995613,12cyclictest0-21swapper/019:03:280
28727995612,38cyclictest0-21swapper/018:02:480
2873799553,47cyclictest0-21swapper/219:13:332
28727995518,32cyclictest9250-21diskmemload19:29:120
28727995516,33cyclictest17247-21ssh17:46:170
28727995514,8cyclictest27714-21ssh17:16:300
28727995511,38cyclictest0-21swapper/019:20:340
2873799546,42cyclictest0-21swapper/218:52:182
2873799544,44cyclictest0-21swapper/218:09:502
28727995411,12cyclictest0-21swapper/016:41:310
2873799534,7cyclictest0-21swapper/216:49:212
2873799534,7cyclictest0-21swapper/216:49:212
2873799532,7cyclictest24982-21ssh17:57:102
28727995316,32cyclictest23769-21ssh18:38:200
28727995316,31cyclictest6248-21users18:58:210
28727995312,35cyclictest0-21swapper/018:17:320
28727995310,37cyclictest15296-21basename18:28:010
2817625310,15sleep10-21swapper/114:04:101
2873799524,7cyclictest0-21swapper/218:32:092
2873799524,42cyclictest0-21swapper/217:00:112
2873799518,36cyclictest23057-21/usr/sbin/munin18:38:062
2873799514,41cyclictest0-21swapper/219:19:142
2873799513,42cyclictest0-21swapper/216:19:422
2873799508,36cyclictest0-21swapper/218:13:092
2873799504,40cyclictest0-21swapper/216:38:302
2873799503,42cyclictest0-21swapper/217:17:312
2873799503,42cyclictest0-21swapper/216:15:372
2873799503,41cyclictest0-21swapper/218:45:492
2873799494,40cyclictest0-21swapper/219:05:282
2873799494,39cyclictest0-21swapper/216:08:082
2873799493,41cyclictest0-21swapper/219:32:382
2873799493,41cyclictest0-21swapper/219:12:382
2873799493,41cyclictest0-21swapper/218:56:192
2873799493,41cyclictest0-21swapper/218:56:192
2873799493,41cyclictest0-21swapper/217:31:302
2873799492,42cyclictest8231-21latency_hist19:02:482
2873799492,42cyclictest0-21swapper/214:28:372
28737994911,33cyclictest0-21swapper/216:31:312
28727994920,22cyclictest9291-21timerwakeupswit14:38:250
28727994920,22cyclictest9291-21timerwakeupswit14:38:250
2874299482,41cyclictest32053-21processes14:13:203
2873799488,35cyclictest26656-21latency_hist15:27:532
2873799488,34cyclictest0-21swapper/218:01:212
2873799485,37cyclictest0-21swapper/216:24:152
2873799484,39cyclictest0-21swapper/217:05:482
2873799484,39cyclictest0-21swapper/216:35:052
2873799484,38cyclictest0-21swapper/218:25:232
2873799484,38cyclictest0-21swapper/218:25:232
2873799484,38cyclictest0-21swapper/217:38:562
2873799484,38cyclictest0-21swapper/217:38:562
2873799484,38cyclictest0-21swapper/216:57:042
2873799483,40cyclictest0-21swapper/219:24:182
2873799483,40cyclictest0-21swapper/218:34:092
2873799483,40cyclictest0-21swapper/217:20:312
28737994811,31cyclictest0-21swapper/217:44:522
28737994811,31cyclictest0-21swapper/217:09:302
2873799477,34cyclictest0-21swapper/216:43:032
2873799474,37cyclictest0-21swapper/217:23:282
2873799474,10cyclictest0-21swapper/214:13:202
2873799473,8cyclictest0-21swapper/217:49:402
28727994716,25cyclictest14706-21wc14:53:200
2873799467,34cyclictest0-21swapper/215:33:232
2873799464,37cyclictest0-21swapper/215:50:292
2873799464,36cyclictest0-21swapper/219:35:062
2873799464,36cyclictest0-21swapper/218:19:352
2873799463,37cyclictest0-21swapper/214:23:012
28727994619,21cyclictest755-21proc_pri17:23:130
2873799454,9cyclictest0-21swapper/214:38:062
2873799454,9cyclictest0-21swapper/214:38:062
2873799454,36cyclictest0-21swapper/214:53:032
2873799453,37cyclictest0-21swapper/215:08:202
2873799453,36cyclictest0-21swapper/215:17:002
2873799445,34cyclictest0-21swapper/215:32:532
2873799444,35cyclictest0-21swapper/216:03:172
2873799443,36cyclictest0-21swapper/215:19:062
2873799443,36cyclictest0-21swapper/215:03:542
2873799443,36cyclictest0-21swapper/214:58:082
2873799443,36cyclictest0-21swapper/214:49:182
2873799443,36cyclictest0-21swapper/214:33:182
2873799443,36cyclictest0-21swapper/214:33:182
2873799443,36cyclictest0-21swapper/214:18:142
2873799443,35cyclictest5486-21crond15:57:522
2873799442,36cyclictest1756-21munin-run15:47:532
28727994416,22cyclictest15756-21egrep14:58:060
28727994329,9cyclictest21286-21aten_rbpower_cu15:13:030
28727994328,10cyclictest32390-21grep14:13:250
28727994326,11cyclictest10790-21/usr/sbin/munin14:43:160
28727994323,14cyclictest19714-21ntpdc18:33:120
138612433,7sleep10-21swapper/116:58:011
2873799424,33cyclictest0-21swapper/214:12:552
28727994226,10cyclictest6467-21/usr/sbin/munin14:33:090
28727994226,10cyclictest6467-21/usr/sbin/munin14:33:090
28727994226,10cyclictest6462-21/usr/sbin/munin15:58:150
28727994226,10cyclictest6462-21/usr/sbin/munin15:58:150
28727994226,10cyclictest3095-21/usr/sbin/munin14:23:140
28727994226,10cyclictest1204-21/usr/sbin/munin14:18:170
28727994224,13cyclictest19085-21open_inodes17:48:140
28727994223,13cyclictest20075-21/usr/sbin/munin15:08:140
28727994222,14cyclictest32558-21aten_rbpower_po15:43:050
28727994216,20cyclictest23872-21tr15:18:150
28727994216,20cyclictest1387650ssh17:41:570
28727994216,20cyclictest1387650ssh17:41:570
28727994215,21cyclictest1101050ssh18:22:140
313182413,7sleep10-21swapper/118:48:251
2873799413,32cyclictest0-21swapper/216:02:532
2873799413,32cyclictest0-21swapper/216:02:532
28727994125,10cyclictest4614-21/usr/sbin/munin14:28:080
28727994125,10cyclictest29379-21/usr/sbin/munin14:08:070
28727994125,10cyclictest12814-21/usr/sbin/munin14:48:210
28727994123,13cyclictest26877-21runrttasks15:28:040
28727994123,13cyclictest1967-21sshd15:47:590
28727994122,14cyclictest7790-21fschecks_count16:03:070
28727994122,13cyclictest4198-21cut15:53:090
28727994122,13cyclictest28799-21aten_rbpower_en15:33:070
28727994121,14cyclictest12379-21ntp_offset18:23:120
28727994121,14cyclictest12379-21ntp_offset18:23:120
28727994117,19cyclictest7260-21wget17:33:030
28727994117,19cyclictest16221-21runrttasks17:00:290
28727994115,20cyclictest26240-21grep15:23:260
212112413,6sleep10-21swapper/118:35:251
2873799402,32cyclictest11683-21idleruntime-cro14:47:532
28727994025,10cyclictest18447-21/usr/sbin/munin15:03:230
28727994023,12cyclictest30802-21entropy15:38:080
28727994022,13cyclictest15112-21egrep19:13:000
28727994021,14cyclictest4193-21latency17:28:120
16142403,7sleep10-21swapper/115:46:181
311582393,6sleep10-21swapper/117:20:591
28731993926,8cyclictest1466-21cut18:53:051
28731993926,8cyclictest1466-21cut18:53:051
96542383,6sleep10-21swapper/117:35:441
2873799383,30cyclictest0-21swapper/215:42:532
246762383,7sleep10-21swapper/117:56:291
42152373,6sleep10-21swapper/118:12:591
28731993724,8cyclictest31628-21cat15:38:221
28731993715,16cyclictest21142-21sshd19:21:561
273732373,7sleep10-21swapper/119:30:271
2873199364,28cyclictest0-21swapper/118:22:331
28731993623,8cyclictest27202-21grep15:28:091
2843623613,17sleep00-21swapper/014:07:140
2873199354,26cyclictest0-21swapper/117:58:001
2873199353,28cyclictest0-21swapper/118:06:101
189002353,6sleep10-21swapper/115:04:331
49702343,6sleep10-21swapper/117:28:281
2873199343,26cyclictest0-21swapper/116:30:371
28731993423,7cyclictest25653-21missed_timers15:23:161
28731993422,7cyclictest7167-21grep14:33:221
28731993422,7cyclictest7167-21grep14:33:221
28731993422,7cyclictest14200-21idleruntime14:53:091
28731993422,7cyclictest14050-21awk16:13:141
28731993421,8cyclictest23426-21fschecks_time15:18:081
2836623411,17sleep30-21swapper/314:06:253
75902333,6sleep10-21swapper/116:03:001
2873199333,26cyclictest0-21swapper/118:11:561
2873199333,26cyclictest0-21swapper/116:37:241
28731993323,6cyclictest10817-21latency16:53:101
28731993321,7cyclictest4270-21idleruntime15:53:101
28731993321,7cyclictest29938-21grep19:33:201
28731993321,7cyclictest10633-21load14:43:131
2873199325,21cyclictest0-21swapper/119:23:111
2873199324,24cyclictest0-21swapper/117:10:351
2873199323,25cyclictest0-21swapper/116:39:341
2873199323,25cyclictest0-21swapper/116:20:311
2873199323,24cyclictest0-21swapper/117:13:001
28731993223,6cyclictest19543-21unixbench_singl17:48:201
28731993222,6cyclictest17931-21sa117:47:491
28731993221,7cyclictest19592-21cut15:08:071
28731993221,7cyclictest11565-21/usr/sbin/munin18:23:081
28731993221,7cyclictest11565-21/usr/sbin/munin18:23:081
28731993220,7cyclictest29395-21aten_rbpower_po14:08:071
28731993220,7cyclictest10975-21ssh16:08:271
28731993219,8cyclictest2636-21awk15:48:171
28731993122,6cyclictest3451-21tr16:43:131
28731993121,6cyclictest7672-21timerandwakeup16:48:201
28731993121,6cyclictest7672-21timerandwakeup16:48:201
28731993121,6cyclictest18771-21sort17:03:201
28731993120,7cyclictest12021-21timerandwakeup17:38:211
28731993120,7cyclictest12021-21timerandwakeup17:38:211
28731993120,6cyclictest6132-21idleruntime15:58:091
28731993120,6cyclictest6132-21idleruntime15:58:091
28731993120,6cyclictest593-21polkitd14:27:551
28731993119,8cyclictest667-21runrttasks19:09:081
28731993115,11cyclictest16314-21sh18:28:181
28731993110,16cyclictest0-21swapper/119:06:161
2873199304,21cyclictest0-21swapper/118:42:531
2873199304,20cyclictest0-21swapper/115:37:541
2873199303,24cyclictest0-21swapper/118:38:551
2873199303,22cyclictest0-21swapper/119:00:041
28731993019,7cyclictest21043-21idleruntime16:23:071
28731993019,7cyclictest12674-21open_files14:48:181
2873199294,21cyclictest0-21swapper/119:13:251
2873199294,21cyclictest0-21swapper/117:24:181
2873199294,21cyclictest0-21swapper/114:28:151
2873199294,20cyclictest0-21swapper/114:18:111
28731992918,7cyclictest16464-21grep14:58:191
28731992817,7cyclictest8847-21expr14:38:161
28731992817,7cyclictest8847-21expr14:38:161
28731992816,8cyclictest574-21dbus-daemon14:12:561
28731992716,6cyclictest21673-21seq15:13:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional