You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 17:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Tue Dec 30, 2025 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11768391390,0EcMasterDemoSyn0-21swapper/109:01:411
1811539920,0EcMasterDemoSyn1812529tAtEmLog_008:05:555
938739830,0EcMasterDemoSyn939729tAtEmLog_008:56:375
2576139830,0EcMasterDemoSyn2577129tAtEmLog_010:07:365
2395039830,0EcMasterDemoSyn2396229tAtEmLog_011:54:065
184039830,0EcMasterDemoSyn185029tAtEmLog_009:37:125
184039830,0EcMasterDemoSyn185029tAtEmLog_009:37:115
2999839820,0EcMasterDemoSyn3000829tAtEmLog_011:03:235
2120239820,0EcMasterDemoSyn2121229tAtEmLog_010:22:495
2081839820,0EcMasterDemoSyn2082829tAtEmLog_010:58:205
2047139820,0EcMasterDemoSyn2048129tAtEmLog_008:10:595
678939660,3EcMasterDemoSyn6796-21runintdemo5min11:08:274
157992520,0sleep10-21swapper/110:20:111
284342310,0sleep50-21swapper/509:51:235
2500639310,2EcMasterDemoSyn0-21swapper/311:18:363
22026992314,7cyclictest21230-21cut12:10:171
731629200,0tAtEmLog_00-21swapper/510:38:015
152982200,0sleep00-21swapper/010:01:430
2798299190,14tDemoTimingTask29112-21taskset12:15:005
2202399195,12cyclictest13753-21basename08:00:000
2202399185,9cyclictest31640-21sh11:21:520
2202399180,9cyclictest831-21runrttasks11:36:070
2202399180,14cyclictest21681-21sh09:48:020
2202399180,10cyclictest722-21sed11:40:250
2202399180,10cyclictest722-21sed11:40:240
2202399180,10cyclictest32250-21sh11:58:360
2202399180,10cyclictest10911-21ssh12:04:560
731799170,9tDemoTimingTask10491-21taskset10:35:015
2908099170,10tDemoTimingTask21719-21sleep11:39:565
2203399170,9cyclictest17333-21missed_timers08:05:224
2203099170,10cyclictest831-21runrttasks12:20:223
22029991713,3cyclictest23262-21munin-plugin-st12:30:002
2202399170,9cyclictest379-21sh12:35:030
2202399170,9cyclictest20848-21sh09:13:020
2202399170,9cyclictest10324-21sh11:28:200
2202399170,10cyclictest23297-21/usr/sbin/munin07:10:180
1891739170,0EcMasterDemoSyn0-21swapper/512:09:185
2203099161,9cyclictest31453-21sh11:21:443
2202699160,9cyclictest1816-21sh12:17:251
2202699160,10cyclictest17799-21ssh09:11:001
2202399169,6cyclictest7762-21strings09:40:200
2202399161,14cyclictest21727-21awk11:35:010
2202399160,9cyclictest27304-21sh09:50:360
2202399160,7cyclictest23365-21sh10:41:270
2202399160,11cyclictest16237-21ssh10:55:210
1577199160,9tDemoTimingTask16098-21chrt08:04:555
989439150,1EcMasterDemoSyn9902-21runintdemo5min12:04:142
2203399151,10cyclictest16-1pr/legacy09:47:184
2203399150,12cyclictest25368-21sshd08:22:404
2203099151,10cyclictest20501-21/usr/sbin/munin12:10:223
2203099151,10cyclictest20159-21latency_hist12:10:003
2203099150,9cyclictest16613-21sh10:38:053
2203099150,11cyclictest25863-21irqstats10:25:203
2202999151,10cyclictest21268-21ssh09:47:472
2202999150,9cyclictest29576-21ssh11:03:062
2202999150,9cyclictest24318-21runrttasks07:14:472
2202999150,11cyclictest11912-21chrt10:00:142
2202699158,5cyclictest5709-21grep08:50:161
2202699153,9cyclictest28048-21forks11:20:151
2202699151,10cyclictest831-21runrttasks12:26:401
2202699150,8cyclictest26019-21ssh09:32:561
2202699150,11cyclictest31672-21ssh09:19:001
2202699150,11cyclictest20202-21cat12:10:011
2202699150,10cyclictest25553-21perl10:25:181
2202699150,10cyclictest19984-21/usr/sbin/munin10:40:151
2202699150,10cyclictest18343-21ssh11:15:021
2202399156,7cyclictest25332-21ls09:15:170
2202399150,10cyclictest4075-21sh10:30:420
1535699150,8tDemoTimingTask20044-21taskset09:30:005
1367599150,9tDemoTimingTask13699-21taskset12:24:325
1367429150,6tAtEmLog_022327-21taskset12:29:225
1339199150,9tDemoTimingTask11395-21sleep07:59:555
1167699150,8tDemoTimingTask14212-21turbostat10:54:595
105399150,9tDemoTimingTask1713-21taskset07:34:565
2203399141,9cyclictest831-21runrttasks07:50:274
2203399141,9cyclictest521-21runrttasks08:40:054
2203399141,9cyclictest4259-21latency_hist07:40:004
2203399141,9cyclictest4259-21latency_hist07:40:004
2203399141,9cyclictest21658-21timerandwakeup10:40:264
2203399141,9cyclictest14490-21ssh09:44:284
2203399141,10cyclictest2461-21grep10:30:164
2203399141,10cyclictest16-1pr/legacy11:43:564
2203399141,10cyclictest16-1pr/legacy11:43:564
2203399140,9cyclictest4581-21/usr/sbin/munin07:40:114
2203399140,9cyclictest28177-21ssh09:51:114
2203399140,10cyclictest831-21runrttasks11:18:424
2203399140,10cyclictest7960-21rm12:02:524
2203399140,10cyclictest7496-21sh11:26:204
2203399140,10cyclictest3961-21latency_hist11:25:014
2203399140,10cyclictest32290-21diskmemload12:16:034
2203399140,10cyclictest26975-21processes08:25:204
2203399140,10cyclictest25855-21ssh10:25:184
2203399140,10cyclictest25137-21ssh09:32:204
2203399140,10cyclictest24521-21sh11:54:284
2203399140,10cyclictest2409-21sh10:12:294
2203399140,10cyclictest19561-21ssh10:57:274
2203399140,10cyclictest17685-21ssh12:26:014
2203399140,10cyclictest15676-21ssh10:20:064
2203399140,10cyclictest14047-21rm10:19:124
2203399140,10cyclictest13506-21chrt07:56:594
2203399140,10cyclictest13279-21/usr/sbin/munin11:30:204
2203099146,7cyclictest22017-21cyclictest11:05:113
2203099146,6cyclictest327-21systemd-journal11:50:543
2203099144,8cyclictest29080-21/usr/sbin/munin08:30:183
2203099143,8cyclictest23362-21netstat07:10:183
2203099143,7cyclictest17223-21kworker/u24:2+nfsiod11:55:043
2203099142,9cyclictest8408-21unixbench_multi10:15:223
2203099142,8cyclictest807-21postgres08:24:033
2203099141,9cyclictest831-21runrttasks11:12:113
2203099141,9cyclictest831-21runrttasks10:45:053
2203099141,9cyclictest5293-21sh09:39:313
2203099141,9cyclictest5293-21sh09:39:313
2203099141,9cyclictest27804-21runrttasks08:28:483
2203099141,9cyclictest23089-21runrttasks08:18:583
2203099141,9cyclictest16113-21latency_hist08:05:003
2203099141,10cyclictest27822-21ssh12:31:413
22030991410,3cyclictest15040-21cpuspeed_turbos10:55:153
2203099140,9cyclictest20746-21taskset08:14:143
2203099140,12cyclictest29755-21cpuspeed_turbos12:15:133
2203099140,11cyclictest16965-21grep09:45:183
2203099140,10cyclictest9951-21cat09:00:003
2203099140,10cyclictest831-21runrttasks11:28:203
2203099140,10cyclictest771-21sshd07:25:393
2203099140,10cyclictest7687-21ssh11:45:043
2203099140,10cyclictest7155-21fschecks_time09:40:153
2203099140,10cyclictest6852-21head10:50:183
2203099140,10cyclictest6828-21ssh09:22:463
2203099140,10cyclictest5280-21chrt08:50:093
2203099140,10cyclictest3806-21runrttasks07:36:263
2203099140,10cyclictest3806-21runrttasks07:36:263
2203099140,10cyclictest32024-21ssh10:10:333
2203099140,10cyclictest31919-21ssh09:19:103
2203099140,10cyclictest30829-21grep08:35:153
2203099140,10cyclictest29070-21runrttasks07:21:003
2203099140,10cyclictest27381-21rm10:44:143
2203099140,10cyclictest2633-21latency_hist08:45:003
2203099140,10cyclictest25451-21ssh11:36:203
2203099140,10cyclictest25111-21/usr/sbin/munin09:50:143
2203099140,10cyclictest24649-21/usr/sbin/munin07:15:243
2203099140,10cyclictest23641-21ssh11:00:033
2203099140,10cyclictest2234-21ssh09:55:113
2203099140,10cyclictest2229-21ssh11:41:253
2203099140,10cyclictest2229-21ssh11:41:243
2203099140,10cyclictest20376-21sh10:05:013
2203099140,10cyclictest20142-21sh09:30:053
2203099140,10cyclictest19424-21rm09:12:063
2203099140,10cyclictest17369-21ssh10:03:083
2203099140,10cyclictest15555-21sh10:20:013
2203099140,10cyclictest14925-21/usr/sbin/munin12:25:213
2203099140,10cyclictest1487-21ssh10:30:023
2203099140,10cyclictest11742-21chrt09:01:293
2203099140,10cyclictest11687-21/usr/sbin/munin07:55:153
2203099140,10cyclictest10994-21/usr/sbin/munin09:25:203
2202999143,8cyclictest26274-21head09:50:192
2202999141,9cyclictest5002-21sh11:43:242
2202999141,9cyclictest5002-21sh11:43:232
2202999141,9cyclictest491-21runrttasks09:36:192
2202999141,9cyclictest491-21runrttasks09:36:182
2202999141,9cyclictest27321-21/usr/sbin/munin07:20:182
2202999140,9cyclictest29291-21rm10:27:072
2202999140,9cyclictest25907-21ssh10:07:402
2202999140,8cyclictest13693-21df_inode11:30:142
2202999140,10cyclictest831-21runrttasks10:51:282
2202999140,10cyclictest831-21runrttasks08:41:192
2202999140,10cyclictest6971-21taskset07:45:012
2202999140,10cyclictest6971-21taskset07:45:012
2202999140,10cyclictest6343-21ntp_kernel_pll_08:50:202
2202999140,10cyclictest5622-21ssh09:56:242
2202999140,10cyclictest4896-21expr07:40:132
2202999140,10cyclictest4261-21/usr/sbin/munin11:25:192
2202999140,10cyclictest425-21rm12:35:042
2202999140,10cyclictest32679-21diskmemload11:22:372
2202999140,10cyclictest30414-21latency12:15:172
2202999140,10cyclictest29568-21rm10:10:022
2202999140,10cyclictest2935-21/usr/sbin/munin08:45:192
2202999140,10cyclictest2923-21sed07:35:182
2202999140,10cyclictest2923-21sed07:35:182
2202999140,10cyclictest27919-21ssh12:14:222
2202999140,10cyclictest27419-21unixbench_multi08:25:242
2202999140,10cyclictest27015-21ssh12:31:062
2202999140,10cyclictest25800-21ssh11:55:122
2202999140,10cyclictest24656-21ps07:15:122
2202999140,10cyclictest24222-21sh11:54:162
2202999140,10cyclictest23573-21sh10:41:372
2202999140,10cyclictest17925-21ssh09:11:062
2202999140,10cyclictest1679-21sh10:47:362
2202999140,10cyclictest15943-21ssh11:13:332
2202999140,10cyclictest15882-21ssh09:27:232
2202999140,10cyclictest15670-21seq10:55:182
2202999140,10cyclictest13109-21sh09:43:302
2202999140,10cyclictest11687-21/usr/sbin/munin07:55:242
2202699148,5cyclictest644-21dbus-daemon08:30:001
2202699142,8cyclictest26570-21runrttasks07:18:251
2202699141,9cyclictest2244-21/usr/sbin/munin09:55:131
2202699141,10cyclictest16-1pr/legacy08:46:271
2202699140,7cyclictest31245-21sh09:35:241
2202699140,7cyclictest31245-21sh09:35:231
2202699140,10cyclictest8787-21ssh10:15:341
2202699140,10cyclictest831-21runrttasks09:26:591
2202699140,10cyclictest831-21runrttasks07:40:221
2202699140,10cyclictest831-21runrttasks07:22:111
2202699140,10cyclictest771-21sshd09:40:031
2202699140,10cyclictest7633-21sh11:45:011
2202699140,10cyclictest7234-21ssh11:26:081
2202699140,10cyclictest6986-21/usr/sbin/munin07:45:261
2202699140,10cyclictest6986-21/usr/sbin/munin07:45:261
2202699140,10cyclictest6468-21runrttasks10:32:231
2202699140,10cyclictest6061-21/usr/sbin/munin12:20:221
2202699140,10cyclictest32086-21/usr/sbin/munin07:30:261
2202699140,10cyclictest31944-21sh11:40:161
2202699140,10cyclictest31944-21sh11:40:151
2202699140,10cyclictest31796-21sh10:45:591
2202699140,10cyclictest3133-21ssh11:05:541
2202699140,10cyclictest30923-21systemctl07:25:201
2202699140,10cyclictest30591-21ssh11:57:251
2202699140,10cyclictest30130-21rm11:39:371
2202699140,10cyclictest29575-21ssh10:10:021
2202699140,10cyclictest28731-21rm12:32:201
2202699140,10cyclictest28232-21basename08:30:111
2202699140,10cyclictest25749-21perl09:50:161
2202699140,10cyclictest2424-21missed_timers09:20:201
2202699140,10cyclictest23856-21/usr/sbin/munin11:00:191
2202699140,10cyclictest23494-21runrttasks08:20:051
2202699140,10cyclictest22468-21sed08:15:241
2202699140,10cyclictest21673-21rm10:05:191
2202699140,10cyclictest21189-21rm10:58:331
2202699140,10cyclictest21071-21latency_hist08:15:011
2202699140,10cyclictest17835-21sh11:14:531
2202699140,10cyclictest17766-21ssh11:32:141
2202699140,10cyclictest16859-21/usr/sbin/munin11:50:131
2202699140,10cyclictest15605-21diskmemload09:45:011
2202699140,10cyclictest15270-21ssh10:01:421
2202699140,10cyclictest13043-21xargs07:55:231
2202699140,10cyclictest13036-21taskset09:05:161
2202699140,10cyclictest12032-21sh10:53:291
2202699140,10cyclictest10595-21ssh10:35:031
2202699140,10cyclictest1051-21rm12:35:141
2202399146,6cyclictest25025-21aten2_r5power_c10:25:140
2202399145,7cyclictest9532-21apt11:10:100
2202399145,7cyclictest6706-21grep12:20:170
2202399145,7cyclictest6087-21sh10:50:150
2202399145,7cyclictest30545-21smartctl10:45:210
2202399145,7cyclictest2384-21memory09:20:200
2202399145,7cyclictest16310-21sh09:27:400
2202399141,9cyclictest6493-21sh09:57:010
2202399141,10cyclictest6975-21df10:15:120
2202399141,10cyclictest30918-21which07:25:200
2202399140,9cyclictest831-21runrttasks08:36:250
2202399140,7cyclictest6287-21runrttasks07:40:360
2202399140,7cyclictest24185-21tr11:00:130
2202399140,12cyclictest17300-21chrt10:20:230
2202399140,12cyclictest15062-21basename12:25:130
2202399140,10cyclictest7041-21cut07:45:140
2202399140,10cyclictest7041-21cut07:45:130
2202399140,10cyclictest6399-21proc_pri08:50:210
2202399140,10cyclictest3385-21ssh11:06:040
2202399140,10cyclictest25917-21/usr/sbin/munin12:30:240
2202399140,10cyclictest24672-21runrttasks10:06:510
2202399140,10cyclictest22644-21ssh12:10:340
2202399140,10cyclictest22435-21rm11:53:020
2202399140,10cyclictest22332-21mailstats08:15:210
2202399140,10cyclictest17346-21sh10:38:360
2202399140,10cyclictest12417-21if_enp5s012:05:190
2202399140,10cyclictest11927-21sh11:46:550
2202399140,10cyclictest11675-21runrttasks09:00:330
2283639130,1EcMasterDemoSyn671rcuc/508:16:035
2203399139,3cyclictest25280-21needreboot12:30:174
2203399135,7cyclictest23803-21/usr/sbin/munin11:35:234
2203399135,6cyclictest24612-21cpuspeed_turbos09:15:134
2203399134,5cyclictest19664-21sed08:10:184
2203399133,8cyclictest28206-21/usr/sbin/munin08:30:114
2203399131,9cyclictest23351-21cut07:10:184
2203399131,9cyclictest14317-21sh12:06:004
2203399131,7cyclictest2878-21perl09:55:144
2203399130,9cyclictest831-21runrttasks11:45:064
2203399130,9cyclictest831-21runrttasks10:05:034
2203399130,9cyclictest831-21runrttasks08:50:574
2203399130,9cyclictest831-21runrttasks07:45:304
2203399130,9cyclictest831-21runrttasks07:45:304
2203399130,9cyclictest7627-21taskset08:55:044
2203399130,9cyclictest6026-21diskmemload12:20:114
2203399130,9cyclictest326-21runrttasks12:35:004
2203399130,9cyclictest32617-21fschecks_time07:30:164
2203399130,9cyclictest29799-21seq11:56:524
2203399130,9cyclictest2932-21runrttasks08:45:114
2203399130,9cyclictest28774-21ssh10:45:014
2203399130,9cyclictest27440-21tr07:20:114
2203399130,9cyclictest25804-21diskmemload11:00:264
2203399130,9cyclictest23116-21runrttasks08:19:204
2203399130,9cyclictest20706-21cpuspeed12:10:154
2203399130,9cyclictest18429-21sh09:29:084
2203399130,9cyclictest15430-21ssh09:10:144
2203399130,9cyclictest14817-21ssh10:36:514
2203399130,9cyclictest14064-21/usr/sbin/munin08:00:254
2203399130,9cyclictest1379-21/usr/sbin/munin09:20:164
2203399130,9cyclictest12361-21/usr/sbin/munin09:05:134
2203399130,7cyclictest30671-21basename08:35:144
2203399130,10cyclictest5865-21grep10:50:134
2203399130,10cyclictest29464-21ssh09:35:064
2203399130,10cyclictest29464-21ssh09:35:054
2203399130,10cyclictest26186-21cat07:15:244
2203399130,10cyclictest11405-21ssh10:00:094
2203399130,10cyclictest10038-21fschecks_count11:10:144
2203099134,5cyclictest17576-21processes08:05:233
2203099131,9cyclictest9816-21fschecks_time07:50:163
2203099130,9cyclictest831-21runrttasks07:40:363
2203099130,9cyclictest6986-21/usr/sbin/munin07:45:163
2203099130,9cyclictest6986-21/usr/sbin/munin07:45:163
2203099130,9cyclictest3389-21fschecks_count08:45:163
2203099130,9cyclictest2624-21/usr/sbin/munin12:00:173
2203099130,9cyclictest1419-21ssh12:35:163
2203099130,9cyclictest13141-21diskmemload11:30:053
2203099130,9cyclictest12361-21/usr/sbin/munin09:05:173
2203099130,10cyclictest448-21latency07:30:183
2202999135,6cyclictest21648-21fschecks_time08:15:172
2202999131,9cyclictest24760-21runrttasks08:20:222
2202999130,9cyclictest9998-21taskset09:00:032
2202999130,9cyclictest8974-21switchtime08:55:222
2202999130,9cyclictest8679-21sh10:15:292
2202999130,9cyclictest7719-21taskset11:45:042
2202999130,9cyclictest6061-21/usr/sbin/munin12:20:142
2202999130,9cyclictest372-21/usr/sbin/munin07:30:182
2202999130,9cyclictest29666-21runrttasks07:25:042
2202999130,9cyclictest28205-21/usr/sbin/munin08:30:182
2202999130,9cyclictest22681-21fschecks_count11:35:142
2202999130,9cyclictest22485-21sh09:30:332
2202999130,9cyclictest18800-21wget08:10:122
2202999130,9cyclictest1740-21/usr/sbin/munin11:05:202
2202999130,9cyclictest1712-21/usr/sbin/munin10:30:192
2202999130,9cyclictest16411-21runrttasks08:05:082
2202999130,9cyclictest15902-21ssh10:37:362
2202999130,9cyclictest15622-21ssh10:20:032
2202999130,9cyclictest14182-21grep08:00:132
2202999130,9cyclictest1270-21diskmemload09:20:092
2202999130,9cyclictest12360-21taskset09:05:112
2202999130,9cyclictest12347-21hddtemp_smartct12:05:172
2202999130,9cyclictest1066-21munin-node07:50:112
2202999130,10cyclictest31027-21fschecks_count08:35:162
2202999130,10cyclictest24312-21/usr/sbin/munin09:15:202
2202999130,10cyclictest18560-21ssh11:15:112
2202699131,8cyclictest539-21atemtest08:40:131
2202699131,10cyclictest16-1pr/legacy08:36:191
2202699130,9cyclictest831-21runrttasks08:55:011
2202699130,9cyclictest22285-21runrttasks07:10:041
2202699130,9cyclictest2029-21/usr/sbin/munin07:35:151
2202699130,9cyclictest2029-21/usr/sbin/munin07:35:151
2202699130,9cyclictest16996-21gltestperf08:05:191
2202699130,11cyclictest14576-21cut08:00:161
2202699130,10cyclictest831-21runrttasks07:51:171
2202699130,10cyclictest5182-21sh12:00:511
2202399135,6cyclictest532-21apt-get08:40:130
2202399135,6cyclictest30633-21gltestperf10:10:180
2202399134,7cyclictest29808-21ls12:15:130
2202399132,8cyclictest25981-21cpu08:25:130
2202399131,9cyclictest3989-21runrttasks07:38:570
2202399131,9cyclictest3989-21runrttasks07:38:570
2202399131,9cyclictest17603-21sendmail_mailst08:05:230
2202399131,7cyclictest14067-21apt08:00:120
2202399130,9cyclictest831-21runrttasks08:23:310
2202399130,9cyclictest7639-21apt-get08:55:100
2202399130,9cyclictest29956-21runrttasks08:31:170
2202399130,9cyclictest27406-21aten2_r5power_p07:20:110
2202399130,9cyclictest20050-21diskmemload09:30:000
2202399130,9cyclictest12866-21fschecks_time09:05:160
2202399130,8cyclictest25566-21cut07:15:170
2202399130,7cyclictest175-1kworker/0:1H+kblockd09:35:040
2202399130,7cyclictest175-1kworker/0:1H+kblockd09:35:040
2202399130,7cyclictest175-1kworker/0:1H+kblockd08:45:010
2202399130,10cyclictest9990-21tail07:50:150
2202399130,10cyclictest32081-21chrt07:30:080
2202399130,10cyclictest22124-21latency_hist07:10:000
2202399130,10cyclictest20216-21/usr/sbin/munin11:15:280
1993799130,11tDemoTimingTask21647-21chrt07:05:395
703139120,1EcMasterDemoSyn671rcuc/508:51:335
3099899120,10tDemoTimingTask31542-21taskset07:26:545
2798299120,10tDemoTimingTask4315-21taskset12:19:145
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional