You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 19:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Mon Mar 16, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
390239830,0EcMasterDemoSyn391229tAtEmLog_009:32:335
2548539830,0EcMasterDemoSyn2549529tAtEmLog_009:07:125
1791939830,0EcMasterDemoSyn1792929tAtEmLog_009:57:555
863839820,0EcMasterDemoSyn864829tAtEmLog_008:31:435
3159839820,0EcMasterDemoSyn3160829tAtEmLog_011:34:165
2916839820,0EcMasterDemoSyn2917829tAtEmLog_008:06:225
1758039820,0EcMasterDemoSyn1759029tAtEmLog_011:44:255
849839810,0EcMasterDemoSyn850829tAtEmLog_011:03:505
849839810,0EcMasterDemoSyn850829tAtEmLog_011:03:505
386439810,0EcMasterDemoSyn387429tAtEmLog_008:21:345
2443439810,0EcMasterDemoSyn2444429tAtEmLog_007:56:125
2312839810,0EcMasterDemoSyn2313829tAtEmLog_009:02:085
2312839810,0EcMasterDemoSyn2313829tAtEmLog_009:02:075
1839239810,0EcMasterDemoSyn1840229tAtEmLog_008:52:005
1839239810,0EcMasterDemoSyn1840229tAtEmLog_008:51:595
148139810,0EcMasterDemoSyn149129tAtEmLog_008:16:305
1277439810,0EcMasterDemoSyn1278429tAtEmLog_012:35:075
53942750,0sleep4581rcuc/411:55:144
742639370,1EcMasterDemoSyn7434-21runintdemo5min07:20:443
2688539220,0EcMasterDemoSyn26892-21runintdemo5min11:13:583
246872210,0sleep10-21swapper/111:12:271
65999198,6cyclictest11368-21sed07:30:134
1972699191,17tDemoTimingTask0-21swapper/507:46:075
63999180,14cyclictest29282-21sh10:39:590
63999180,10cyclictest15760-21sh10:50:120
3031729180,0tAtEmLog_00-21swapper/507:05:295
191722180,0sleep10-21swapper/112:02:491
1793099180,15tDemoTimingTask25924-21chrt10:02:045
1320699180,15tDemoTimingTask13419-21taskset10:48:455
878299170,10tDemoTimingTask8789-21chrt09:52:525
65999171,12cyclictest16-1pr/legacy09:42:414
63999175,9cyclictest20859-21sh12:04:010
63999171,12cyclictest16-1pr/legacy10:13:070
63999170,9cyclictest780-21runrttasks11:52:400
63999170,9cyclictest5522-21sh10:09:010
63999170,9cyclictest22585-21taskset11:46:320
63999170,9cyclictest17974-21diskmemload10:15:190
286952170,0sleep50-21swapper/509:10:445
1320699170,14tDemoTimingTask19205-21chrt10:51:285
1245399170,10tDemoTimingTask12779-21chrt07:34:555
864829160,9tAtEmLog_09213-21chrt08:35:005
65999160,9cyclictest12362-21runrttasks09:37:024
65999160,13cyclictest3370-21if_enp6s010:25:154
65899164,9cyclictest728-21lldpd12:17:573
65899160,9cyclictest3853-21diskmemload10:07:563
65799164,9cyclictest28883-21if_enp6s011:50:162
657991612,3cyclictest21326-21sendmail12:40:002
64799169,5cyclictest13586-21grep12:35:151
64799164,9cyclictest13149-21cut07:35:121
64799160,9cyclictest2970-21sh11:54:111
63999160,9cyclictest21435-21sh12:21:200
63999160,8cyclictest780-21runrttasks07:55:350
63999160,8cyclictest32135-21sh10:59:070
63999160,8cyclictest23524-21sh09:43:210
63999160,7cyclictest5805-21ssh09:50:470
63999160,12cyclictest19888-21sh10:34:490
1325529160,14tAtEmLog_020560-21taskset09:41:205
659991512,2cyclictest22410-21turbostat07:59:544
659991512,2cyclictest19288-21idleruntime-cro11:10:014
659991512,2cyclictest19288-21idleruntime-cro11:10:014
659991511,3cyclictest14232-21sh11:25:014
65999151,10cyclictest23086-21diskmemload10:54:084
65999150,9cyclictest1366-21ssh10:06:124
65899153,9cyclictest19678-21fschecks_time11:45:163
65899151,10cyclictest31690-21runrttasks11:34:193
65899151,10cyclictest30543-21diskmemload10:22:213
65899150,9cyclictest27742-21sh10:03:203
65899150,9cyclictest12786-21taskset07:34:593
65899150,11cyclictest7100-21rm09:16:453
65899150,11cyclictest14404-21ssh11:06:373
65899150,11cyclictest14404-21ssh11:06:373
65799159,4cyclictest24295-21grep11:30:122
65799158,6cyclictest23015-21wc12:05:122
65799152,9cyclictest887-21runrttasks09:30:282
65799151,10cyclictest3711-21unixbench_singl08:20:252
65799151,10cyclictest25014-21sh10:19:522
65799151,10cyclictest18185-21/usr/sbin/munin12:20:192
65799151,10cyclictest13675-21sh11:06:062
65799151,10cyclictest13675-21sh11:06:052
65799150,9cyclictest7794-21sh12:14:422
65799150,9cyclictest7470-21if_err_enp6s010:45:162
65799150,8cyclictest4370-21grep09:50:182
65799150,7cyclictest18968-21ssh12:02:392
65799150,11cyclictest563-21ssh11:16:562
65799150,10cyclictest1758639runintdemo5min11:44:252
64799157,7cyclictest630-21cyclictest09:02:431
64799157,7cyclictest630-21cyclictest09:02:421
64799154,8cyclictest11998-21seq11:05:191
64799154,8cyclictest11998-21seq11:05:181
647991511,3cyclictest29123-21cpuspeed_turbos11:15:111
64799151,10cyclictest7355-21ssh11:03:031
64799151,10cyclictest7355-21ssh11:03:021
64799150,9cyclictest802-21sh12:28:161
64799150,8cyclictest4535-21ssh10:08:221
64799150,8cyclictest18131-21diskmemload10:33:311
63999156,7cyclictest9503-21cut12:15:140
63999156,7cyclictest28465-21sh10:03:500
63999153,5cyclictest326-21systemd-journal12:35:000
63999151,9cyclictest14736-21runrttasks09:55:410
639991512,2cyclictest14304-21mailstats12:35:200
639991511,3cyclictest27660-21unixbench_multi10:20:240
63999150,9cyclictest6094-21ssh11:20:130
63999150,9cyclictest2592-21postgres10:42:380
63999150,11cyclictest12480-21ssh11:40:490
63999150,10cyclictest326-21systemd-journal11:15:490
2254899151,11tDemoTimingTask29303-21taskset09:46:025
65999146,6cyclictest5588-21/usr/sbin/munin08:25:204
65999140,9cyclictest326-21systemd-journal08:05:104
65999140,11cyclictest29532-21ssh10:57:194
65999140,10cyclictest8953-21ssh11:39:414
65999140,10cyclictest8441-21sh11:03:494
65999140,10cyclictest8441-21sh11:03:484
65999140,10cyclictest6871-21/usr/sbin/munin08:30:234
65999140,10cyclictest30273-21mailstats11:15:184
65999140,10cyclictest28598-21ssh10:21:004
65999140,10cyclictest26718-21runrttasks10:02:394
65999140,10cyclictest26361-21sh10:38:004
65999140,10cyclictest22107-21hostname09:25:124
65999140,10cyclictest21325-21chrt09:00:054
65999140,10cyclictest21325-21chrt09:00:044
65999140,10cyclictest18228-21ssh12:02:094
65999140,10cyclictest1313-21sh09:30:464
65999140,10cyclictest12682-21sh11:40:574
65999140,10cyclictest11684-21sh10:47:354
65899146,6cyclictest11124-21grep11:40:203
65899141,9cyclictest8089-21/usr/sbin/munin07:25:133
65899141,9cyclictest6472-21runrttasks09:51:163
65899141,9cyclictest6372-21runrttasks08:27:263
65899141,9cyclictest28491-21diskmemload11:50:133
65899141,9cyclictest22884-21ssh12:05:113
65899141,9cyclictest15652-21/usr/sbin/munin07:40:133
65899141,10cyclictest716-21snmpd12:20:013
65899141,10cyclictest28414-21runrttasks10:39:243
658991410,3cyclictest12299-21fschecks_time10:30:143
65899140,9cyclictest7257-21fschecks_count08:30:123
65899140,10cyclictest9642-21grep08:35:133
65899140,10cyclictest845-21ssh09:48:443
65899140,10cyclictest8355-21sh10:28:053
65899140,10cyclictest811-21runintdemo5min07:15:393
65899140,10cyclictest7497-21/usr/sbin/munin10:10:193
65899140,10cyclictest7315-21chrt11:38:343
65899140,10cyclictest716-21snmpd08:58:013
65899140,10cyclictest716-21snmpd07:58:383
65899140,10cyclictest7125-21/usr/sbin/munin11:20:193
65899140,10cyclictest6758-21ssh11:02:373
65899140,10cyclictest6758-21ssh11:02:363
65899140,10cyclictest6635-21apt-get10:45:113
65899140,10cyclictest5576-21basename11:55:163
65899140,10cyclictest5101-21sh12:30:183
65899140,10cyclictest32739-21swap09:30:223
65899140,10cyclictest32329-21wget12:10:133
65899140,10cyclictest29878-21sh11:15:153
65899140,10cyclictest28542-21ssh10:56:373
65899140,10cyclictest2823-21runrttasks07:12:383
65899140,10cyclictest27196-21sh12:25:103
65899140,10cyclictest24323-21rm09:25:403
65899140,10cyclictest22003-21sh10:17:483
65899140,10cyclictest19807-21runrttasks07:46:473
65899140,10cyclictest17896-21ssh09:40:153
65899140,10cyclictest17740-21ssh11:25:553
65899140,10cyclictest15776-21rm10:50:113
65899140,10cyclictest15302-21ntp_kernel_err08:45:183
65899140,10cyclictest13798-21python309:55:193
65899140,10cyclictest13648-21ssh12:00:033
65899140,10cyclictest12892-21/usr/sbin/munin12:35:203
65899140,10cyclictest12652-21runrttasks09:37:143
65899140,10cyclictest12647-21sh09:20:063
65899140,10cyclictest12589-21tail08:40:183
65899140,10cyclictest1056-21ssh10:41:333
65799147,3cyclictest504439EcMasterDemoSyn07:15:382
65799145,7cyclictest8933-21pluginstate08:35:002
65799141,9cyclictest7481-21runrttasks07:20:582
65799141,9cyclictest22419-21open_inodes09:00:192
65799141,9cyclictest22419-21open_inodes09:00:182
65799141,9cyclictest13097-21/usr/sbin/munin07:35:122
65799141,10cyclictest30440-21tune2fs10:40:152
65799140,9cyclictest380-21sh10:05:332
65799140,9cyclictest17132-21ssh09:40:042
65799140,10cyclictest9924-21ssh11:57:412
65799140,10cyclictest9904-21ssh12:15:162
65799140,10cyclictest830-21/usr/sbin/munin11:35:192
65799140,10cyclictest8231-21ssh11:20:502
65799140,10cyclictest8181-21/usr/sbin/munin07:25:122
65799140,10cyclictest8087-21/usr/sbin/munin09:35:192
65799140,10cyclictest780-21runrttasks10:00:112
65799140,10cyclictest780-21runrttasks09:08:062
65799140,10cyclictest780-21runrttasks08:07:012
65799140,10cyclictest7484-21runrttasks09:17:002
65799140,10cyclictest744-21postgres07:46:322
65799140,10cyclictest4369-21tune2fs12:30:132
65799140,10cyclictest3210-21gltestperf10:25:152
65799140,10cyclictest31953-21ssh10:58:592
65799140,10cyclictest31066-21rm09:47:162
65799140,10cyclictest30708-21rm10:22:282
65799140,10cyclictest28429-21ssh09:10:332
65799140,10cyclictest27087-21sh09:27:322
65799140,10cyclictest27017-21ssh12:25:032
65799140,10cyclictest24509-21sh10:36:402
65799140,10cyclictest22153-21rm11:10:412
65799140,10cyclictest1991-21diskstats11:00:132
65799140,10cyclictest1991-21diskstats11:00:122
65799140,10cyclictest19336-21ssh11:27:022
65799140,10cyclictest18990-21sh11:45:102
65799140,10cyclictest18175-21sh10:50:442
65799140,10cyclictest15652-21/usr/sbin/munin07:40:152
65799140,10cyclictest15275-21ssh09:20:482
65799140,10cyclictest13625-21ssh10:13:182
65799140,10cyclictest12337-21/usr/sbin/munin09:55:172
65799140,10cyclictest11685-21/usr/sbin/munin10:30:132
65799140,10cyclictest11598-21/usr/sbin/munin08:40:142
64799146,6cyclictest24970-21switchtime09:05:241
64799143,8cyclictest30328-21forks10:40:151
64799142,9cyclictest25042-21sh12:05:341
64799142,9cyclictest23191-21ssh10:18:361
64799142,9cyclictest15850-21hddtemp_smartct11:25:161
64799141,9cyclictest8967-21sh12:15:051
64799141,9cyclictest24839-21/usr/sbin/munin10:55:111
64799141,9cyclictest22708-21/usr/sbin/munin07:55:191
64799141,9cyclictest2113-21/usr/sbin/munin08:20:171
64799141,9cyclictest19712-21runrttasks09:40:441
64799141,10cyclictest17080-21fschecks_time08:50:151
64799141,10cyclictest17080-21fschecks_time08:50:141
64799140,9cyclictest2427-21diskmemload10:25:071
64799140,10cyclictest780-21runrttasks07:25:351
64799140,10cyclictest716-21snmpd11:48:101
64799140,10cyclictest7133-21ssh09:51:441
64799140,10cyclictest7056-21ssh11:55:391
64799140,10cyclictest32088-21ssh10:23:231
64799140,10cyclictest31128-21ssh09:30:061
64799140,10cyclictest29150-21taskset08:06:151
64799140,10cyclictest25380-21ntp_kernel_pll_11:30:171
64799140,10cyclictest25083-21/usr/sbin/munin08:00:191
64799140,10cyclictest24633-21sh10:01:121
64799140,10cyclictest22222-21ssh10:53:341
64799140,10cyclictest16582-21sed07:40:181
64799140,10cyclictest15300-21ssh09:39:021
64799140,10cyclictest15000-21ssh09:20:361
64799140,10cyclictest13307-21ssh11:41:251
64799140,10cyclictest1269-21/usr/sbin/munin11:35:141
64799140,10cyclictest11097-21df_inode07:30:131
64799140,10cyclictest10933-21ssh10:47:031
63999146,6cyclictest326-21systemd-journal08:21:360
63999146,6cyclictest25198-21ssh09:26:150
63999146,6cyclictest21272-21/usr/sbin/munin11:10:210
63999145,7cyclictest9583-21sh09:18:250
63999145,7cyclictest29419-21ssh09:46:070
63999145,7cyclictest14742-21sh09:20:260
63999144,5cyclictest9277-21cut08:35:110
63999141,7cyclictest2399-21/usr/sbin/munin11:00:160
63999141,7cyclictest2399-21/usr/sbin/munin11:00:150
63999141,7cyclictest174-1kworker/0:1H+kblockd08:06:530
63999141,11cyclictest12795-21latency_hist07:35:010
63999141,10cyclictest5136-21sh11:55:120
63999140,7cyclictest379-21/usr/sbin/munin09:30:230
63999140,7cyclictest30847-21ssh09:12:110
63999140,7cyclictest16277-21sh11:25:190
63999140,7cyclictest1376-21/usr/sbin/munin12:10:230
63999140,12cyclictest1564-21gltestperf11:35:150
63999140,10cyclictest7191-21cat07:20:230
63999140,10cyclictest4707-21sh10:25:330
63999140,10cyclictest25282-21sh12:05:440
63999140,10cyclictest13962-21sed07:35:170
63999140,10cyclictest13352-21diskmemload11:05:530
63999140,10cyclictest13352-21diskmemload11:05:520
63999140,10cyclictest11009-21sh09:36:050
63999140,10cyclictest10013-21sh10:46:230
3096839140,8EcMasterDemoSyn22328-21sleep12:09:545
65999135,6cyclictest2592-21cut08:20:144
65999132,8cyclictest24152-21fschecks_time09:05:144
65999131,9cyclictest780-21runrttasks09:10:114
65999131,9cyclictest32188-21sh12:10:104
65999131,9cyclictest11258-21sh10:11:414
65999131,8cyclictest14472-21/usr/sbin/munin08:45:134
65999131,10cyclictest16-1pr/legacy08:41:504
65999130,9cyclictest9225-21/usr/sbin/munin08:35:094
65999130,9cyclictest9125-21/usr/sbin/munin12:15:144
65999130,9cyclictest8089-21/usr/sbin/munin07:25:124
65999130,9cyclictest780-21runrttasks09:15:054
65999130,9cyclictest5799-21wget07:20:124
65999130,9cyclictest5353-21sh09:50:304
65999130,9cyclictest30258-21sh10:40:134
65999130,9cyclictest29783-21sshd08:10:114
65999130,9cyclictest29326-21sh12:25:324
65999130,9cyclictest28007-21sh11:50:074
65999130,9cyclictest26213-21sh09:45:014
65999130,9cyclictest25083-21/usr/sbin/munin08:00:144
65999130,9cyclictest24096-21ssh11:30:084
65999130,9cyclictest21896-21sh11:10:294
65999130,9cyclictest20395-21aten2_r5power_e07:50:114
65999130,9cyclictest19616-21mailstats12:20:204
65999130,9cyclictest19436-21df11:45:144
65999130,9cyclictest19078-21open_files07:45:194
65999130,9cyclictest18237-21unixbench_singl08:50:254
65999130,9cyclictest18237-21unixbench_singl08:50:244
65999130,9cyclictest17703-21latency_hist07:45:004
65999130,9cyclictest16621-21/usr/sbin/munin10:15:174
65999130,9cyclictest15086-21/usr/sbin/munin11:25:134
65999130,9cyclictest13173-21chrt07:35:134
65999130,9cyclictest13010-21aten2_r5power_p12:35:124
65999130,9cyclictest12337-21/usr/sbin/munin09:55:124
65999130,9cyclictest11704-21ssh10:30:114
65999130,9cyclictest1076-21cpu07:10:134
65999130,8cyclictest11906-21apt-get09:20:014
65999130,10cyclictest780-21runrttasks07:17:574
65999130,10cyclictest5155-21uname12:30:174
65999130,10cyclictest22763-21sh12:05:074
65899132,8cyclictest21732-21cut09:00:143
65899132,8cyclictest21732-21cut09:00:143
65899130,9cyclictest3837-21taskset08:21:203
65899130,9cyclictest32492-21df_inode08:15:133
65899130,9cyclictest27796-21diskstats08:05:133
65899130,9cyclictest26901-21fschecks_time09:10:143
65899130,9cyclictest25083-21/usr/sbin/munin08:00:123
65899130,9cyclictest24358-21hddtemp_smartct09:05:153
65899130,9cyclictest20354-21/usr/sbin/munin07:50:103
65899130,9cyclictest18498-21runrttasks08:52:563
65899130,9cyclictest18498-21runrttasks08:52:563
65899130,9cyclictest15018-21runrttasks07:37:473
65799135,6cyclictest21484-21processes07:50:182
65799132,8cyclictest15909-21awk08:45:262
65799131,9cyclictest25194-21aten2_r5power_v08:00:132
65799131,7cyclictest6491-21chrt08:29:032
65799130,9cyclictest9225-21/usr/sbin/munin08:35:122
65799130,9cyclictest31787-21runrttasks08:14:302
65799130,9cyclictest22731-21aten2_r5power_c07:55:112
65799130,9cyclictest19313-21df_inode08:55:122
65799130,9cyclictest16978-21/usr/sbin/munin08:50:152
65799130,9cyclictest16978-21/usr/sbin/munin08:50:152
65799130,9cyclictest10750-21/usr/sbin/munin07:30:112
65799130,10cyclictest951-21/usr/sbin/munin07:10:142
65799130,10cyclictest32169-21wget08:15:112
64799135,6cyclictest4546-21grep07:15:191
64799131,9cyclictest31066-21switchtime08:10:251
64799130,9cyclictest780-21runrttasks08:36:321
64799130,9cyclictest7155-21timerandwakeup07:20:231
64799130,9cyclictest4515-21/usr/sbin/munin08:25:131
64799130,9cyclictest32134-21/usr/sbin/munin08:15:171
64799130,9cyclictest32072-21ssh12:10:051
64799130,9cyclictest26297-21ssh09:45:051
64799130,9cyclictest24751-21ssh09:25:561
64799130,9cyclictest23025-21ssh10:35:391
64799130,9cyclictest18958-21/usr/sbin/munin08:55:181
64799130,9cyclictest18185-21/usr/sbin/munin12:20:241
64799130,9cyclictest18003-21taskset07:45:121
64799130,9cyclictest1287-21cstates07:10:131
64799130,9cyclictest12258-21ssh09:55:071
64799130,10cyclictest9850-21ssh10:10:411
64799130,10cyclictest7560-21sort08:30:141
64799130,10cyclictest5579-21rm11:20:061
64799130,10cyclictest4074-21cpuspeed_turbos12:30:111
64799130,10cyclictest3002-21sh09:15:051
64799130,10cyclictest26994-21gltestperf09:10:151
64799130,10cyclictest15292-21/usr/sbin/munin08:45:181
64799130,10cyclictest13616-21seq08:44:401
63999136,6cyclictest22115-21wc07:51:110
63999132,4cyclictest24239-21basename11:30:110
63999130,9cyclictest9215-21processes07:25:190
63999130,9cyclictest780-21runrttasks08:00:210
63999130,9cyclictest4469-21apt-get08:25:110
63999130,9cyclictest27080-21ssh12:25:060
63999130,7cyclictest174-1kworker/0:1H+kblockd08:57:040
63999130,7cyclictest174-1kworker/0:1H+kblockd08:50:140
63999130,7cyclictest174-1kworker/0:1H+kblockd08:50:130
63999130,7cyclictest174-1kworker/0:1H+kblockd08:30:060
63999130,7cyclictest174-1kworker/0:1H+kblockd07:41:170
63999130,7cyclictest12850-21/usr/sbin/munin08:40:200
63999130,6cyclictest14618-21/usr/sbin/munin08:45:140
63999130,11cyclictest29784-21sshd08:10:120
63999130,11cyclictest174-1kworker/0:1H+kblockd09:03:220
63999130,11cyclictest174-1kworker/0:1H+kblockd09:03:210
63999130,10cyclictest780-21runrttasks08:18:030
63999130,10cyclictest3355-21cut07:15:120
63999130,10cyclictest24680-21tail09:05:190
63999130,10cyclictest2430-21grep07:10:240
63999130,10cyclictest18408-21grep07:45:140
3162129130,3tAtEmLog_0493-21chrt10:59:405
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional