You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 19:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Thu Sep 24, 2026 12:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16113391000,0EcMasterDemoSyn0-21swapper/307:28:183
896239820,0EcMasterDemoSyn897229tAtEmLog_007:13:055
659239820,0EcMasterDemoSyn660229tAtEmLog_011:21:335
2913139820,0EcMasterDemoSyn2914129tAtEmLog_010:20:435
1454739820,0EcMasterDemoSyn1455729tAtEmLog_010:30:525
2916339810,0EcMasterDemoSyn2917329tAtEmLog_009:04:395
1802639810,0EcMasterDemoSyn1803629tAtEmLog_010:51:095
2605439800,0EcMasterDemoSyn2606429tAtEmLog_007:48:365
787839700,0EcMasterDemoSyn0-21swapper/308:19:013
1559839220,0EcMasterDemoSyn0-21swapper/512:22:245
6854992119,2cyclictest19181-21kworker/4:2+events10:25:464
778329200,0tAtEmLog_00-21swapper/509:19:505
201362200,0sleep30-21swapper/310:52:393
6841991917,2cyclictest16618-21kworker/1:0+events11:16:281
683699196,9cyclictest7363-21sh12:17:450
685099181,13cyclictest16-1pr/legacy09:24:553
6845991815,2cyclictest15157-21kworker/2:2+events12:37:372
683699180,14cyclictest7442-21sh12:35:450
683699180,10cyclictest785-21runrttasks09:19:030
683699180,10cyclictest1893-21apache210:35:240
2430299180,10tDemoTimingTask29132-21chrt11:35:015
685499171,12cyclictest16-1pr/legacy11:31:414
6845991713,3cyclictest21075-21/usr/sbin/munin09:40:122
683699170,9cyclictest8122-21sh11:22:400
683699170,9cyclictest785-21runrttasks10:49:380
683699170,9cyclictest5794-21sh11:02:570
683699170,9cyclictest24254-21expr10:55:150
683699170,9cyclictest20016-21sh12:06:080
683699170,9cyclictest12171-21sh11:06:150
683699170,12cyclictest22843-21ssh11:30:390
2582339170,0EcMasterDemoSyn0-21swapper/510:00:255
1026429170,10tAtEmLog_010658-21chrt08:25:025
685499162,10cyclictest22429-21chrt12:07:524
685499161,12cyclictest16-1pr/legacy09:35:034
685499161,12cyclictest16-1pr/legacy09:35:034
685499160,10cyclictest17719-21sh09:20:114
685099160,11cyclictest11387-21chrt12:01:093
684599163,10cyclictest785-21runrttasks09:46:252
684599160,9cyclictest785-21runrttasks11:05:252
684599160,9cyclictest6512-21diskmemload11:03:302
684599160,10cyclictest28029-21runrttasks11:52:262
684199168,6cyclictest1648-21cron12:15:011
684199168,6cyclictest1397-21strings10:05:181
684199164,8cyclictest31477-21vmstat10:40:251
684199161,7cyclictest1132350latency_hist11:25:011
684199160,9cyclictest30101-21ssh10:03:331
684199160,10cyclictest2623-21ssh09:11:031
683699164,9cyclictest5510-21sh10:25:420
683699161,9cyclictest11859-21runrttasks12:01:280
683699160,7cyclictest32730-21sh12:14:020
683699160,14cyclictest31723-21cat11:55:010
683699160,14cyclictest20887-21ssh09:58:140
683699160,14cyclictest19423-21ssh10:15:220
683699160,10cyclictest26905-21tr11:15:090
387199160,9tDemoTimingTask3887-21chrt11:57:045
685499154,7cyclictest5457-21kworker/u24:1+nfsiod12:25:024
685499151,10cyclictest13934-21latency_hist07:25:004
685499150,11cyclictest1224-21ssh10:24:004
685499150,10cyclictest11818-21sh12:01:284
685099155,8cyclictest2745-21/usr/sbin/munin08:05:213
685099154,6cyclictest6235-21fschecks_count11:40:143
685099154,6cyclictest6235-21fschecks_count11:40:133
685099153,8cyclictest8672-21apt-key09:15:013
685099152,9cyclictest21287-21runrttasks07:39:593
6850991511,3cyclictest13937-21latency_hist07:25:003
685099151,10cyclictest17612-21ssh09:55:523
685099150,9cyclictest3594-21sh09:48:413
685099150,9cyclictest22450-21ssh12:07:533
684599155,7cyclictest4001-21kworker/u24:3+nfsiod10:44:162
684599154,6cyclictest32569-21cat08:00:232
684599152,10cyclictest16-1pr/legacy09:04:392
684599151,10cyclictest21319-21/usr/sbin/munin08:45:192
684599151,10cyclictest18710-21hddtemp_smartct10:15:172
684599151,10cyclictest16647-21ssh10:14:282
684199157,6cyclictest15696-21grep09:55:141
684199152,9cyclictest10290-21ssh10:47:051
684199150,9cyclictest30651-21sh10:58:571
684199150,9cyclictest13165-21/usr/sbin/munin11:25:191
683699156,7cyclictest11758-21sh09:53:140
683699154,8cyclictest4281-21tr09:30:180
683699154,6cyclictest25523-21grep07:45:240
683699154,6cyclictest21689-21aten2_r5power_c07:40:130
683699153,9cyclictest17434-21latency_hist08:39:590
683699153,9cyclictest14270-21cut11:45:010
683699153,9cyclictest14270-21cut11:45:000
2430299150,9tDemoTimingTask20055-21sleep11:34:555
1972599150,9tDemoTimingTask19729-21taskset08:44:235
1560829150,12tAtEmLog_023035-21chrt12:26:295
685499143,8cyclictest17842-21grep08:40:094
685499141,9cyclictest5210-21/usr/sbin/munin11:40:014
685499141,9cyclictest2532-21diskmemload11:00:374
685499141,9cyclictest24299-21load11:50:184
685499141,10cyclictest5352-21sh10:07:404
685499141,10cyclictest16501-21ssh11:09:244
685499140,9cyclictest9410-21ssh09:33:384
685499140,9cyclictest23333-21sh09:40:554
685499140,10cyclictest7595-21ssh12:35:514
685499140,10cyclictest6815-21wc11:40:174
685499140,10cyclictest6815-21wc11:40:164
685499140,10cyclictest5791-21latency_hist08:15:014
685499140,10cyclictest466-21ssh09:46:294
685499140,10cyclictest4124-21chrt09:12:084
685499140,10cyclictest3855-21ssh12:34:444
685499140,10cyclictest32005-21/usr/sbin/munin11:55:154
685499140,10cyclictest31470-21sh11:17:304
685499140,10cyclictest30955-21systemctl10:40:184
685499140,10cyclictest3019-21sshd08:07:134
685499140,10cyclictest28656-21sh12:11:044
685499140,10cyclictest27272-21basename09:00:144
685499140,10cyclictest26509-21/usr/sbin/munin07:50:164
685499140,10cyclictest26504-21ssh09:25:064
685499140,10cyclictest24910-21ssh10:55:194
685499140,10cyclictest24234-21aten2_r5power_p07:45:134
685499140,10cyclictest23856-21/usr/sbin/munin10:00:194
685499140,10cyclictest18330-21diskstats11:10:164
685499140,10cyclictest15190-21ssh11:26:284
685499140,10cyclictest10832-21/usr/sbin/munin08:25:134
685499140,10cyclictest10436-21cut07:15:174
685499140,10cyclictest10320-21sh10:47:084
685499140,10cyclictest10306-21runrttasks08:24:144
685099147,5cyclictest16154-21tr08:35:183
685099143,8cyclictest715-21snmpd09:30:413
685099142,9cyclictest18969-21sh10:15:193
685099141,9cyclictest4623-21apt-key12:35:003
685099141,9cyclictest32504-21df_inode09:10:113
685099141,9cyclictest26509-21/usr/sbin/munin07:50:143
685099141,9cyclictest24805-21sh09:42:003
685099141,9cyclictest22900-21ssh11:12:403
685099141,9cyclictest22817-21runrttasks08:50:123
685099141,9cyclictest22540-21memory07:40:173
685099141,10cyclictest21069-21df11:30:163
685099141,10cyclictest16-1pr/legacy08:44:213
685099140,8cyclictest29140-21sh09:25:503
685099140,11cyclictest30463-21ssh10:21:403
685099140,10cyclictest9202-21sh10:10:153
685099140,10cyclictest8928-21ssh09:51:093
685099140,10cyclictest7419-21ssh12:17:493
685099140,10cyclictest6723-21hddtemp_smartct10:45:143
685099140,10cyclictest4298-21ssh11:39:203
685099140,10cyclictest3475-21cpuspeed_turbos10:25:113
685099140,10cyclictest32549-21chrt10:05:073
685099140,10cyclictest30820-21runrttasks07:58:573
685099140,10cyclictest29540-21/usr/sbin/munin09:05:263
685099140,10cyclictest27647-21cut09:00:163
685099140,10cyclictest27622-21ssh10:56:433
685099140,10cyclictest27003-21sh10:38:323
685099140,10cyclictest26618-21ssh10:00:593
685099140,10cyclictest24901-21/usr/sbin/munin07:45:163
685099140,10cyclictest21677-21ssh12:25:283
685099140,10cyclictest16395-21ssh11:27:183
685099140,10cyclictest11738-21ssh09:35:063
685099140,10cyclictest11738-21ssh09:35:053
685099140,10cyclictest10898-21/usr/sbin/munin12:20:123
685099140,10cyclictest1012-21rm10:41:483
684599145,7cyclictest19106-21kworker/u24:1+nfsiod09:34:522
684599145,7cyclictest13253-21which09:35:202
684599145,7cyclictest13253-21which09:35:192
684599143,8cyclictest715-21snmpd08:12:412
684599143,8cyclictest3760-21sed12:15:212
684599143,8cyclictest25279-21fschecks_count08:55:142
684599143,6cyclictest14841-21cpuspeed_turbos11:45:112
684599141,9cyclictest9345-21sh11:41:382
684599141,9cyclictest9345-21sh11:41:372
684599141,9cyclictest26761-21/usr/sbin/munin10:20:162
684599140,9cyclictest6034-21sh11:58:382
684599140,9cyclictest19985-21sh09:20:372
684599140,12cyclictest24913-21sh10:36:592
684599140,11cyclictest12387-21sshd08:26:122
684599140,10cyclictest9450-21runrttasks07:15:092
684599140,10cyclictest841-21ssh11:36:502
684599140,10cyclictest785-21runrttasks12:05:042
684599140,10cyclictest5497-21ssh10:25:412
684599140,10cyclictest4925-21sed11:20:232
684599140,10cyclictest3298-21sh09:11:322
684599140,10cyclictest30740-21rm12:12:332
684599140,10cyclictest29919-21taskset09:05:152
684599140,10cyclictest27796-21sh12:29:582
684599140,10cyclictest24252-21sh11:31:412
684599140,10cyclictest24166-21chrt08:51:042
684599140,10cyclictest23695-21ssh10:00:052
684599140,10cyclictest2259-21sh12:33:322
684599140,10cyclictest21665-21/usr/sbin/munin07:40:192
684599140,10cyclictest20177-21missed_timers07:35:172
684599140,10cyclictest17783-21ssh11:10:092
684599140,10cyclictest16815-21sh11:27:372
684599140,10cyclictest16622-21cut07:30:122
684599140,10cyclictest16103-21sh09:19:142
684599140,10cyclictest15219-21/usr/sbin/munin10:50:212
684599140,10cyclictest14969-21ssh09:55:092
684599140,10cyclictest14272-21aten2_r5power_e07:25:122
684599140,10cyclictest13868-21ssh12:21:092
684599140,10cyclictest12453-21grep07:20:142
684599140,10cyclictest11757-21ssh12:01:252
684599140,10cyclictest1060-21if_enp6s010:05:162
684599140,10cyclictest10167-21ssh09:52:042
684199147,5cyclictest9278-21ssh09:51:251
684199143,8cyclictest23541-21open_files08:50:171
684199142,9cyclictest785-21runrttasks08:21:321
684199142,8cyclictest21542-21date07:40:001
684199141,9cyclictest6052-21sh12:16:501
684199141,9cyclictest27191-21/usr/sbin/munin09:00:221
684199141,9cyclictest24950-21sh09:42:061
684199141,9cyclictest14428-21ssh11:45:071
684199141,10cyclictest452-21runrttasks09:46:291
684199141,10cyclictest21805-21ssh11:11:521
6841991410,3cyclictest22156-21sh08:50:001
684199140,9cyclictest27201-21ssh10:38:401
684199140,8cyclictest1009-21gltestperf11:00:171
684199140,11cyclictest11102-21head10:10:281
684199140,10cyclictest5649-21rm11:40:071
684199140,10cyclictest5649-21rm11:40:061
684199140,10cyclictest4128-21grep10:25:171
684199140,10cyclictest3304-21sh11:56:401
684199140,10cyclictest31358-21runrttasks09:07:391
684199140,10cyclictest28446-21/usr/sbin/munin12:30:151
684199140,10cyclictest27045-21tr10:20:121
684199140,10cyclictest26682-21ssh12:29:091
684199140,10cyclictest26602-21/usr/sbin/munin09:25:121
684199140,10cyclictest24207-21aten2_r5power_e07:45:121
684199140,10cyclictest24024-21sh12:09:041
684199140,10cyclictest23360-21aten2_r5power_c11:50:121
684199140,10cyclictest21635-21sh10:53:461
684199140,10cyclictest18320-21chrt07:31:231
684199140,10cyclictest17998-21aten2_r5power_c10:15:141
684199140,10cyclictest17524-21seq09:20:001
684199140,10cyclictest16247-21sh10:32:051
684199140,10cyclictest16140-21ssh12:04:421
684199140,10cyclictest14281-21sh11:07:461
684199140,10cyclictest14219-21sh09:35:421
684199140,10cyclictest14219-21sh09:35:411
684199140,10cyclictest11271-21ssh09:15:431
684199140,10cyclictest10437-21sh12:37:561
684199140,10cyclictest10051-21gltestperf07:15:151
683699145,7cyclictest12950-21irqstats10:30:210
683699144,8cyclictest28023-21/usr/sbin/munin07:50:230
683699143,8cyclictest103-1kworker/0:1H+kblockd10:00:210
683699142,8cyclictest27161-21diskstats10:20:130
683699141,9cyclictest9039-21sh10:10:070
683699141,7cyclictest12809-21sed09:35:170
683699141,7cyclictest12809-21sed09:35:160
683699140,9cyclictest785-21runrttasks07:12:060
683699140,7cyclictest358-21cat11:55:160
683699140,7cyclictest16546-21ssh11:45:280
683699140,12cyclictest6573-21ssh10:08:330
683699140,12cyclictest3339-21chrt11:38:390
683699140,12cyclictest30682-21grep10:40:170
683699140,12cyclictest29055-21/usr/sbin/munin12:30:180
683699140,12cyclictest23545-21cut10:55:000
683699140,10cyclictest715-21snmpd08:04:230
683699140,10cyclictest5314-21sh09:49:580
683699140,10cyclictest4173-21sh09:12:120
683699140,10cyclictest28794-21sh09:25:360
683699140,10cyclictest27631-21sh09:44:030
683699140,10cyclictest23385-21sh09:23:050
683699140,10cyclictest20628-21sh12:25:160
683699140,10cyclictest18522-21sh11:10:170
683699140,10cyclictest14507-21rm11:25:560
200872140,3sleep50-21swapper/510:15:345
1234039140,2EcMasterDemoSyn651irq_work/511:06:215
968529130,11tAtEmLog_012417-21taskset11:43:505
968529130,11tAtEmLog_012417-21taskset11:43:495
685499130,9cyclictest785-21runrttasks07:36:034
685499130,9cyclictest7115-21sshd07:10:134
685499130,9cyclictest5934-21/usr/sbin/munin08:15:114
685499130,9cyclictest5731-21ssh09:50:034
685499130,9cyclictest31233-21/usr/sbin/munin08:00:244
685499130,9cyclictest2542-21cpuspeed_turbos12:15:114
685499130,9cyclictest24014-21date07:45:004
685499130,9cyclictest20704-21gltestperf08:45:144
685499130,9cyclictest18075-21sort07:30:244
685499130,9cyclictest17945-21/usr/sbin/munin10:15:184
685499130,9cyclictest16338-21needreboot08:35:194
685499130,9cyclictest14844-21sh09:55:044
685499130,9cyclictest14440-21sh11:45:074
685499130,9cyclictest11856-21ssh10:30:054
685499130,8cyclictest1342550tune2fs08:30:144
685499130,10cyclictest9541-21tune2fs09:15:154
685499130,10cyclictest715-21snmpd07:55:294
685499130,10cyclictest5391-21sh11:20:414
685499130,10cyclictest31185-21/usr/sbin/munin09:05:264
685499130,10cyclictest25425-21tail08:55:154
685499130,10cyclictest21188-21/usr/sbin/munin10:35:134
685499130,10cyclictest18674-21sh10:51:344
685499130,10cyclictest15958-21chrt07:26:194
685499130,10cyclictest13734-21ssh10:12:204
685499130,10cyclictest12425-21expr12:20:204
685099135,6cyclictest3043-21apt11:20:103
685099130,9cyclictest9453-21/usr/sbin/munin07:15:193
685099130,9cyclictest8877-21fschecks_time08:20:153
685099130,9cyclictest785-21runrttasks07:33:443
685099130,9cyclictest531-21runrttasks08:01:513
685099130,9cyclictest3581-21/usr/sbin/munin08:10:123
685099130,9cyclictest32096-21/usr/sbin/munin11:55:113
685099130,9cyclictest31699-21sh12:31:253
685099130,9cyclictest26701-21aten2_r5power_v11:15:093
685099130,9cyclictest26552-21perl12:10:203
685099130,9cyclictest24814-21/usr/sbin/munin08:55:123
685099130,9cyclictest23341-21atemtest11:50:123
685099130,9cyclictest20326-21cpuspeed_turbos08:45:123
685099130,9cyclictest17697-21diskmemload11:46:193
685099130,9cyclictest12745-21gltestperf10:30:193
685099130,9cyclictest10670-21/usr/sbin/munin08:25:123
685099130,10cyclictest4053-21ssh11:01:423
685099130,10cyclictest13379-21df08:30:133
685099130,10cyclictest11969-21sh11:06:053
684599133,7cyclictest10092-21kworker/u24:2+nfsiod09:25:172
684599131,9cyclictest10048-21taskset08:21:232
684599130,9cyclictest785-21runrttasks07:53:042
684599130,9cyclictest6050-21grep08:15:112
684599130,9cyclictest29063-21cpuspeed_turbos07:55:132
684599130,9cyclictest24197-21aten2_r5power_e07:45:122
684599130,9cyclictest14119-21sh10:30:342
684599130,9cyclictest13026-21/usr/sbin/munin08:30:132
684599130,10cyclictest8901-21runrttasks07:12:232
684599130,10cyclictest5945-21/usr/sbin/munin10:45:232
684599130,10cyclictest27587-21ssh11:15:142
684599130,10cyclictest25519-21ssh10:55:252
684599130,10cyclictest18103-21df08:40:102
684599130,10cyclictest17268-21runrttasks08:38:352
684599130,10cyclictest1293-21cpu08:05:102
684199131,9cyclictest11751-21ssh12:20:151
684199130,9cyclictest7442-21cstates07:10:141
684199130,9cyclictest3995-21latency09:30:171
684199130,9cyclictest3581-21/usr/sbin/munin08:10:131
684199130,9cyclictest32068-21ssh11:35:591
684199130,9cyclictest31616-21fschecks_count08:00:141
684199130,9cyclictest2985-21runrttasks08:06:461
684199130,9cyclictest28860-21/usr/sbin/munin07:55:211
684199130,9cyclictest26509-21/usr/sbin/munin07:50:121
684199130,9cyclictest23647-21taskset07:43:021
684199130,9cyclictest20819-21ssh11:30:161
684199130,9cyclictest17047-21runrttasks08:35:341
684199130,9cyclictest14233-21/usr/sbin/munin07:25:151
684199130,9cyclictest13126-21aten2_r5power_v08:30:141
684199130,9cyclictest12351-21runrttasks08:25:431
684199130,10cyclictest25214-21fschecks_count08:55:141
684199130,10cyclictest18467-21if_enp6s008:40:131
684199130,10cyclictest12531-21sed07:20:151
683699135,6cyclictest13385-21/usr/sbin/munin08:30:150
683699133,7cyclictest103-1kworker/0:1H+kblockd07:20:550
683699130,9cyclictest785-21runrttasks08:20:230
683699130,9cyclictest6996-21ntp_kernel_pll_08:15:170
683699130,9cyclictest30161-21grep09:05:160
683699130,9cyclictest30116-21python307:55:200
683699130,9cyclictest27172-21date09:00:010
683699130,9cyclictest24010-21unixbench_multi08:50:220
683699130,9cyclictest11441-21kernelversion08:25:160
683699130,7cyclictest11568-21latency_hist07:20:000
683699130,7cyclictest103-1kworker/0:1H+kblockd08:46:160
683699130,6cyclictest103-1kworker/0:1H+kblockd07:30:130
683699130,10cyclictest1984-21uname08:05:150
683699130,10cyclictest19531-21grep07:35:120
683699130,10cyclictest11464-21tune2fs12:20:130
683699130,10cyclictest103-1kworker/0:1H+kblockd08:40:150
424499130,11tDemoTimingTask6461-21chrt07:06:245
2343599130,7tDemoTimingTask23452-21taskset10:35:575
1545999130,7tDemoTimingTask20052-21turbostat11:30:005
897229120,2tAtEmLog_011250-21taskset07:17:195
685499120,9cyclictest22976-21fschecks_time08:50:134
685099120,9cyclictest7103-21/usr/sbin/munin07:10:203
685099120,9cyclictest7054-21latency_hist07:10:003
684199120,9cyclictest6865-21sed07:10:001
684199120,9cyclictest6271-21ls08:15:121
683699120,9cyclictest785-21runrttasks08:55:060
683699120,9cyclictest785-21runrttasks08:10:250
683699120,9cyclictest785-21runrttasks07:25:070
683699120,7cyclictest6866-21latency_hist07:10:000
2444199120,10tDemoTimingTask26741-21chrt08:59:085
1612499120,10tDemoTimingTask16228-21chrt07:29:215
1025439120,0EcMasterDemoSyn0-21swapper/508:24:055
883439110,0EcMasterDemoSyn0-21swapper/510:46:055
82739110,0EcMasterDemoSyn0-21swapper/512:32:345
714839110,0EcMasterDemoSyn0-21swapper/509:50:175
684599113,6cyclictest7000-21cat07:10:002
565539110,0EcMasterDemoSyn0-21swapper/510:25:475
550839110,0EcMasterDemoSyn0-21swapper/508:13:575
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional