You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-13 - 08:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Sun Sep 13, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
197462860,0sleep00-21swapper/023:32:030
313699196,9cyclictest19389-21sh00:27:180
313699196,10cyclictest22318-21sh23:52:030
313699196,10cyclictest22318-21sh23:52:020
313699180,14cyclictest8786-21sh23:44:580
313699180,14cyclictest31319-21sh00:15:260
313699180,14cyclictest27752-21sh22:41:100
313699180,14cyclictest20982-21sh00:10:070
313699180,14cyclictest12678-21sh22:15:000
313699180,10cyclictest938-21sh22:25:520
315099174,9cyclictest10358-21cut22:50:193
314199175,9cyclictest711-21snmpd22:30:241
313699170,9cyclictest5243-21sh21:51:520
313699170,9cyclictest28956-21sh23:19:200
313699170,9cyclictest28687-21sh00:32:450
313699170,9cyclictest18231-21sh21:40:330
313699170,9cyclictest15561-21sh23:48:290
313699170,9cyclictest10918-21sh00:22:280
313699170,9cyclictest10841-21sh22:31:410
313699170,14cyclictest29345-21sh23:00:240
315299164,9cyclictest9085-21cat23:45:004
315099169,5cyclictest28563-21sed23:00:153
3145991612,3cyclictest683-21dbus-daemon23:35:192
314199160,2cyclictest0-21swapper/121:45:001
313699163,9cyclictest2526-21sh21:14:170
313699160,8cyclictest7409-21runrttasks21:16:260
313699160,8cyclictest28842-21sh21:28:570
313699160,8cyclictest28249-21processes23:55:200
313699160,13cyclictest6299-21sh23:05:330
313699160,12cyclictest774-21runrttasks19:33:370
313699160,10cyclictest103-1kworker/0:1H+kblockd21:59:220
313699160,10cyclictest103-1kworker/0:1H+kblockd21:59:220
315299152,9cyclictest30963-21cat20:05:244
315299151,10cyclictest24672-21taskset22:58:074
3150991511,3cyclictest15558-21latency_hist21:40:003
315099151,10cyclictest32104-21/usr/sbin/munin21:30:223
314599157,6cyclictest25314-21ssh00:30:292
314599155,8cyclictest12221-21/usr/sbin/munin20:35:212
314599154,8cyclictest751-21postgres20:12:282
3145991511,3cyclictest21239-21needreboot19:45:202
314599151,10cyclictest31026-21sh23:20:122
314599151,10cyclictest18539-21ssh23:31:102
314599150,11cyclictest774-21runrttasks19:21:542
3141991511,3cyclictest7740-21sendmail19:20:001
3141991511,3cyclictest3609-21latency_hist23:04:591
313699156,7cyclictest17798-21sh00:08:130
3136991511,3cyclictest13282-21gdbus19:35:060
313699151,10cyclictest6236-21sh00:01:070
313699151,10cyclictest22584-21perl22:20:140
313699150,7cyclictest9325-21munin-plugin-st22:49:590
315299143,8cyclictest751-21postgres20:22:284
315299142,9cyclictest23045-21fschecks_time19:50:164
315299141,9cyclictest4845-21ssh00:00:224
315299141,9cyclictest26245-21sh00:12:494
315299141,9cyclictest22064-21runrttasks19:47:484
315299141,9cyclictest19163-21sh22:36:194
315299141,10cyclictest774-21runrttasks21:51:594
315299141,10cyclictest5819-21sh00:38:204
315299141,10cyclictest32478-21runrttasks22:07:264
315299141,10cyclictest19759-21sh23:32:034
315299140,10cyclictest9956-21sh21:35:594
315299140,10cyclictest8611-21/usr/sbin/munin20:30:214
315299140,10cyclictest8425-21sh21:17:104
315299140,10cyclictest7874-21sh23:06:434
315299140,10cyclictest774-21runrttasks20:27:204
315299140,10cyclictest711-21snmpd19:25:164
315299140,10cyclictest6619-21ssh23:25:024
315299140,10cyclictest508-21munin-plugin-st22:45:004
315299140,10cyclictest3873-21sh22:28:014
315299140,10cyclictest3333-21cat19:10:004
315299140,10cyclictest31471-21ssh23:57:214
315299140,10cyclictest3073-21runrttasks22:45:274
315299140,10cyclictest27703-21/usr/sbin/munin21:10:134
315299140,10cyclictest27161-21/usr/sbin/munin20:00:244
315299140,10cyclictest26189-21runrttasks23:17:174
315299140,10cyclictest25034-21basename21:45:134
315299140,10cyclictest2486-21sh23:22:154
315299140,10cyclictest24349-21/usr/sbin/munin23:35:124
315299140,10cyclictest23362-21diskmemload00:30:014
315299140,10cyclictest23133-21sh23:52:384
315299140,10cyclictest23133-21sh23:52:384
315299140,10cyclictest22325-21sh21:43:314
315299140,10cyclictest21619-21apt-key21:25:004
315299140,10cyclictest19631-21runrttasks20:51:274
315299140,10cyclictest19034-21ssh22:00:124
315299140,10cyclictest19034-21ssh22:00:114
315299140,10cyclictest1864-21sh21:31:314
315299140,10cyclictest17545-21sh00:25:574
315299140,10cyclictest15286-21sh23:10:414
315299140,10cyclictest13654-21switchtime00:05:244
315299140,10cyclictest11944-21sh22:14:284
315099145,8cyclictest16135-21/usr/sbin/munin00:25:183
315099144,8cyclictest4982-21/usr/sbin/munin21:15:193
315099141,9cyclictest774-21runrttasks20:15:063
315099141,9cyclictest29500-21cut20:05:133
315099141,9cyclictest26792-21sh23:17:433
315099141,9cyclictest26355-21cron23:55:003
315099141,9cyclictest26355-21cron23:55:003
315099141,9cyclictest15605-21/usr/sbin/munin19:35:143
315099141,9cyclictest14087-21missed_timers23:10:203
315099141,9cyclictest11252-21ssh22:31:583
315099140,12cyclictest28104-21ssh00:32:193
315099140,10cyclictest9931-21sh21:55:033
315099140,10cyclictest9931-21sh21:55:023
315099140,10cyclictest8799-21ssh23:44:583
315099140,10cyclictest774-21runrttasks23:34:013
315099140,10cyclictest6772-21fschecks_time00:20:163
315099140,10cyclictest6608-21runrttasks23:25:013
315099140,10cyclictest4001-21/usr/sbin/munin20:20:273
315099140,10cyclictest3639-21sh00:36:433
315099140,10cyclictest31987-21chrt00:15:383
315099140,10cyclictest31828-21wget20:10:133
315099140,10cyclictest30583-21sh22:25:033
315099140,10cyclictest2977-21ssh22:09:343
315099140,10cyclictest27161-21/usr/sbin/munin20:00:133
315099140,10cyclictest24957-21wget19:55:153
315099140,10cyclictest24830-21/usr/sbin/munin21:05:183
315099140,10cyclictest24793-21ssh21:45:063
315099140,10cyclictest23612-21cat21:25:223
315099140,10cyclictest23222-21chrt22:20:173
315099140,10cyclictest20318-21wget20:55:143
315099140,10cyclictest19849-21sh21:41:433
315099140,10cyclictest19102-21ssh22:36:163
315099140,10cyclictest1693-21sh21:13:403
315099140,10cyclictest16834-21ssh21:21:503
315099140,10cyclictest14562-21python319:30:233
315099140,10cyclictest14062-21idleruntime22:15:163
315099140,10cyclictest12636-21chrt20:35:333
315099140,10cyclictest12622-21cut00:05:163
315099140,10cyclictest1216-21ssh21:50:073
315099140,10cyclictest1186-21ssh23:21:173
315099140,10cyclictest10644-21/usr/sbin/munin19:25:173
315099140,10cyclictest10305-21ssh23:08:303
314599146,6cyclictest31398-21perl22:25:142
314599144,8cyclictest19542-21/usr/sbin/munin22:55:182
314599141,9cyclictest7240-21sh21:16:182
314599141,9cyclictest6758-21ssh00:01:292
314599141,9cyclictest29875-21ssh21:10:352
314599141,9cyclictest24461-21taskset21:04:132
314599141,9cyclictest23743-21ssh22:02:262
314599141,9cyclictest23743-21ssh22:02:262
314599141,9cyclictest13213-21cat19:30:002
314599141,9cyclictest12323-21cpuspeed_turbos00:05:142
314599141,10cyclictest31211-21chrt20:06:392
3145991410,3cyclictest13673-21tail21:20:162
314599140,10cyclictest8626-21ssh00:20:482
314599140,10cyclictest774-21runrttasks19:17:462
314599140,10cyclictest7588-21sh22:30:142
314599140,10cyclictest7086-21tr23:25:122
314599140,10cyclictest4801-21sh23:42:022
314599140,10cyclictest4163-21/usr/sbin/munin23:05:242
314599140,10cyclictest4148-21ssh21:33:102
314599140,10cyclictest30430-21sh23:00:542
314599140,10cyclictest29999-21sh22:24:502
314599140,10cyclictest28993-21sh23:55:302
314599140,10cyclictest27613-21ssh22:05:022
314599140,10cyclictest27152-21chrt20:00:022
314599140,10cyclictest23232-21taskset00:10:362
314599140,10cyclictest22955-21ssh21:44:002
314599140,10cyclictest22384-21gltestperf23:15:172
314599140,10cyclictest18760-21wc19:40:182
314599140,10cyclictest18207-21sh23:50:132
314599140,10cyclictest18207-21sh23:50:122
314599140,10cyclictest17776-21ssh00:26:072
314599140,10cyclictest17375-21seq19:36:562
314599140,10cyclictest16457-21sh22:16:212
314599140,10cyclictest14464-21sh23:47:412
314599140,10cyclictest1320-21mailstats00:35:212
314599140,10cyclictest13091-21sh22:51:072
314599140,10cyclictest10913-21grep19:25:152
314599140,10cyclictest10394-21ssh21:36:192
314199143,8cyclictest19023-21open_inodes19:40:201
314199141,9cyclictest9660-21diskmemload00:21:321
314199141,9cyclictest774-21runrttasks19:14:241
314199141,9cyclictest19126-21ssh23:31:361
314199141,9cyclictest15440-21sh23:48:231
314199141,9cyclictest14830-21ssh21:39:291
314199141,10cyclictest28265-21sh21:46:261
3141991410,3cyclictest683-21dbus-daemon21:05:001
314199140,10cyclictest8701-21chrt22:12:081
314199140,10cyclictest7001-21ssh00:01:401
314199140,10cyclictest6113-21ssh23:05:251
314199140,10cyclictest6094-21ssh22:29:371
314199140,10cyclictest5887-21ssh21:52:191
314199140,10cyclictest5025-21ssh00:37:441
314199140,10cyclictest4203-21ssh23:23:291
314199140,10cyclictest4118-21/usr/sbin/munin21:15:181
314199140,10cyclictest32281-21sh23:39:501
314199140,10cyclictest31390-21ssh22:06:381
314199140,10cyclictest29532-21grep21:10:251
314199140,10cyclictest25189-21sh22:40:141
314199140,10cyclictest24418-21sh22:20:441
314199140,10cyclictest23932-21sh21:25:251
314199140,10cyclictest23694-21sh00:30:161
314199140,10cyclictest23539-21ssh22:39:321
314199140,10cyclictest23216-21rm23:15:251
314199140,10cyclictest20276-21sh23:14:211
314199140,10cyclictest19116-21ssh00:09:121
314199140,10cyclictest18844-21ssh22:55:021
314199140,10cyclictest18248-21/usr/sbin/munin20:50:131
314199140,10cyclictest16553-21rm22:16:251
314199140,10cyclictest12855-21taskset20:38:321
314199140,10cyclictest10554-21sed19:25:001
314199140,10cyclictest10415-21ssh23:26:381
313699146,6cyclictest14458-21/usr/sbin/munin21:20:230
313699145,7cyclictest2138-21sh23:21:590
313699145,7cyclictest14518-21ssh23:10:240
313699144,8cyclictest23576-21/usr/sbin/munin21:00:210
313699143,8cyclictest321-21systemd-journal19:40:130
313699142,9cyclictest24049-21ssh22:02:390
313699142,9cyclictest24049-21ssh22:02:390
313699141,9cyclictest15506-21diskmemload22:52:520
313699141,9cyclictest13994-21sh22:15:150
313699141,9cyclictest12033-21/usr/sbin/munin20:35:200
313699141,10cyclictest17352-21runrttasks20:46:460
313699140,7cyclictest8537-21sed23:25:220
313699140,7cyclictest10141-21ssh21:36:070
313699140,12cyclictest21827-21chrt22:56:020
313699140,10cyclictest774-21runrttasks21:30:030
313699140,10cyclictest3174-21sh00:36:210
313699140,10cyclictest30869-21ssh23:38:490
313699140,10cyclictest29877-21ssh22:05:310
313699140,10cyclictest27757-21sh21:46:040
313699140,10cyclictest20474-21grep19:45:150
313699140,10cyclictest20080-21ssh22:36:590
315299139,3cyclictest25251-21fschecks_count21:05:154
315299135,6cyclictest11678-21if_enp6s020:35:174
315299130,9cyclictest9722-21timerandwakeup19:20:274
315299130,9cyclictest7161-21/usr/sbin/munin22:30:124
315299130,9cyclictest6002-21ssh00:20:044
315299130,9cyclictest4463-21ntp_kernel_pll_19:10:204
315299130,9cyclictest32297-21perl20:10:154
315299130,9cyclictest25263-21runrttasks19:55:174
315299130,9cyclictest22082-21ssh22:20:114
315299130,9cyclictest17344-21runrttasks19:36:314
315299130,9cyclictest15642-21aten2_r5power_e20:45:144
315299130,9cyclictest14547-21runrttasks20:40:194
315299130,9cyclictest13753-21fschecks_count19:30:164
315299130,9cyclictest12959-21sh21:20:124
315299130,9cyclictest10297-21/usr/sbin/munin22:50:194
315299130,9cyclictest10167-21/usr/sbin/munin21:55:124
315299130,9cyclictest10167-21/usr/sbin/munin21:55:124
315299130,10cyclictest774-21runrttasks21:04:394
315299130,10cyclictest774-21runrttasks19:17:264
315299130,10cyclictest31654-21tail00:15:274
315299130,10cyclictest29510-21sort23:00:244
315299130,10cyclictest2789-21processes20:15:214
315299130,10cyclictest21974-21chrt20:57:024
315299130,10cyclictest19690-21runrttasks19:41:504
315299130,10cyclictest13017-21ssh22:15:024
315299130,10cyclictest11847-21sh23:45:464
315099135,6cyclictest20310-21cut19:45:143
315099130,9cyclictest975-21ssh22:45:063
315099130,9cyclictest774-21runrttasks23:45:103
315099130,9cyclictest774-21runrttasks19:50:053
315099130,9cyclictest774-21runrttasks19:15:093
315099130,9cyclictest6306-21runrttasks20:25:123
315099130,9cyclictest3403-21/usr/sbin/munin19:10:173
315099130,9cyclictest28541-21sh23:37:063
315099130,9cyclictest27712-21sh22:41:093
315099130,9cyclictest19570-21fschecks_time22:00:153
315099130,9cyclictest19570-21fschecks_time22:00:153
315099130,9cyclictest18788-21sh22:55:003
315099130,9cyclictest18119-21cpuspeed_turbos20:50:133
315099130,9cyclictest18030-21aten2_r5power_v19:40:133
315099130,9cyclictest15597-21/usr/sbin/munin20:45:213
315099130,9cyclictest13291-21/usr/sbin/munin20:40:093
315099130,9cyclictest10087-21timerwakeupswit20:30:253
315099130,10cyclictest5465-21ssh00:00:323
315099130,10cyclictest5146-21sed22:10:153
315099130,10cyclictest27948-21load23:55:183
315099130,10cyclictest24324-21runrttasks21:02:233
315099130,10cyclictest21946-21hddtemp_smartct00:10:203
315099130,10cyclictest10143-21taskset19:22:253
314599135,6cyclictest5510-21cat22:10:192
314599131,7cyclictest2699550cat21:10:002
314599130,9cyclictest9627-21netstat20:30:192
314599130,9cyclictest862-21sh22:45:002
314599130,9cyclictest8056-21chrt20:26:432
314599130,9cyclictest4279-21runrttasks19:10:192
314599130,9cyclictest3354-21latency_hist19:10:012
314599130,9cyclictest29535-21ssh00:15:002
314599130,9cyclictest26848-21/usr/sbin/munin21:45:252
314599130,9cyclictest25453-21gltestperf19:55:182
314599130,9cyclictest24551-21chrt22:40:022
314599130,9cyclictest23308-21kernelversion19:50:182
314599130,9cyclictest22022-21runrttasks20:57:392
314599130,9cyclictest21993-21/usr/sbin/munin21:25:162
314599130,9cyclictest18963-21ntp_offset20:50:192
314599130,9cyclictest13291-21/usr/sbin/munin20:40:162
314599130,9cyclictest10167-21/usr/sbin/munin21:55:252
314599130,9cyclictest10167-21/usr/sbin/munin21:55:252
314599130,10cyclictest5534-21grep20:20:272
314599130,10cyclictest3314-21users20:15:272
314599130,10cyclictest17958-21sh22:35:272
314599130,10cyclictest1694-21cut21:50:132
314599130,10cyclictest15597-21/usr/sbin/munin20:45:192
314599130,10cyclictest13323-21tr23:10:152
314199135,6cyclictest15947-21df20:45:151
314199132,8cyclictest4676-21smartctl20:20:181
314199131,9cyclictest774-21runrttasks20:30:391
314199131,9cyclictest20857-21sh00:10:021
314199131,9cyclictest19723-21ssh23:50:251
314199131,9cyclictest19723-21ssh23:50:241
314199130,9cyclictest9931-21runrttasks22:50:001
314199130,9cyclictest774-21runrttasks00:15:101
314199130,9cyclictest3158-21sh22:45:301
314199130,9cyclictest29849-21fschecks_count20:05:151
314199130,9cyclictest26685-21sh23:55:011
314199130,9cyclictest26499-21taskset21:05:371
314199130,9cyclictest25247-21fschecks_count19:55:171
314199130,9cyclictest24212-21chrt19:50:411
314199130,9cyclictest21885-21runrttasks20:55:481
314199130,9cyclictest21386-21ssh22:00:441
314199130,9cyclictest21386-21ssh22:00:431
314199130,9cyclictest20235-21/usr/sbin/munin19:45:141
314199130,9cyclictest1657-21/usr/sbin/munin20:15:141
314199130,9cyclictest13787-21idleruntime21:20:171
314199130,9cyclictest12685-21ssh21:55:491
314199130,9cyclictest12685-21ssh21:55:491
314199130,9cyclictest1111-21ssh21:30:571
314199130,10cyclictest7066-21uname20:25:191
314199130,10cyclictest481-21find20:10:201
314199130,10cyclictest3223-21runrttasks23:40:531
314199130,10cyclictest321-21systemd-journal19:25:241
314199130,10cyclictest15605-21/usr/sbin/munin19:35:221
314199130,10cyclictest14987-21chrt20:40:561
314199130,10cyclictest14864-21ssh00:25:101
314199130,10cyclictest13304-21/usr/sbin/munin19:30:161
313699131,6cyclictest103-1kworker/0:1H+kblockd19:50:160
313699130,9cyclictest8678-21cstates19:20:170
313699130,9cyclictest8010-21runrttasks20:26:060
313699130,9cyclictest774-21runrttasks20:57:260
313699130,9cyclictest774-21runrttasks20:05:150
313699130,9cyclictest26094-21swap21:05:240
313699130,9cyclictest14044-21/usr/sbin/munin20:40:140
313699130,7cyclictest3252-21cat19:10:010
313699130,7cyclictest103-1kworker/0:1H+kblockd20:52:480
313699130,7cyclictest103-1kworker/0:1H+kblockd20:12:380
313699130,7cyclictest103-1kworker/0:1H+kblockd20:03:000
313699130,7cyclictest103-1kworker/0:1H+kblockd19:57:440
313699130,10cyclictest8826-21grep20:30:130
313699130,10cyclictest711-21snmpd19:17:580
313699130,10cyclictest3412-21cat19:10:140
313699130,10cyclictest1911-21expr20:15:140
314199124,6cyclictest27657-21fschecks_time20:00:131
313699125,6cyclictest5240-21mailstats20:20:220
313699120,9cyclictest10638-21runrttasks19:25:080
261002110,1sleep50-21swapper/522:04:115
261002110,1sleep50-21swapper/522:04:105
242892110,1sleep50-21swapper/519:51:475
203542110,1sleep50-21swapper/519:45:155
315099105,3cyclictest3232-21wc19:10:013
314199101,7cyclictest3167-21latency_hist19:10:011
300932100,1sleep50-21swapper/521:29:525
212892100,1sleep50-21swapper/500:28:435
205552100,1sleep50-21swapper/521:24:335
20172100,1sleep50-21swapper/521:13:555
29811290,0sleep50-21swapper/522:05:295
26046290,0sleep50-21swapper/522:21:575
20111290,7sleep50-21swapper/522:19:025
7433280,1sleep50-21swapper/519:16:225
669270,0sleep50-21swapper/522:45:015
10312270,0sleep50-21swapper/520:31:055
591260,1sleep50-21swapper/521:49:575
17218262,2sleep50-21swapper/523:49:425
13444264,0sleep50-21swapper/523:10:175
662252,1sleep50-21swapper/521:30:415
26235250,1sleep50-21swapper/523:54:555
26235250,1sleep50-21swapper/523:54:555
2562250,3sleep50-21swapper/523:22:205
2555250,1sleep50-21swapper/523:59:575
24212250,1sleep50-21swapper/521:44:555
12560250,1sleep50-21swapper/522:14:565
12477250,2sleep50-21swapper/500:05:155
5841240,1sleep50-21swapper/520:22:585
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional