You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 22:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Mon Mar 30, 2026 12:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29979391110,1EcMasterDemoSyn29987-21runintdemo5min08:23:171
1352739900,0EcMasterDemoSyn1353729tAtEmLog_009:24:095
2997939840,0EcMasterDemoSyn2998929tAtEmLog_008:23:185
418439830,0EcMasterDemoSyn419429tAtEmLog_009:19:055
963839820,0EcMasterDemoSyn964829tAtEmLog_012:01:215
494739820,0EcMasterDemoSyn495729tAtEmLog_008:38:315
3211439820,0EcMasterDemoSyn3212429tAtEmLog_009:34:185
2722039820,0EcMasterDemoSyn2723029tAtEmLog_009:14:015
2280139820,0EcMasterDemoSyn2281129tAtEmLog_009:29:135
1875439820,0EcMasterDemoSyn1876429tAtEmLog_012:06:275
1677939820,0EcMasterDemoSyn1678929tAtEmLog_009:03:525
1503539820,0EcMasterDemoSyn1504529tAtEmLog_011:10:395
1204139810,0EcMasterDemoSyn1205129tAtEmLog_008:53:445
26267994441,2cyclictest23050irq/32-nvkm10:50:220
68739420,1EcMasterDemoSyn705-21runintdemo5min07:22:273
6802410,1sleep40-21swapper/410:45:194
188822300,0sleep2401ktimers/212:25:092
2722039260,0EcMasterDemoSyn27228-21runintdemo5min09:14:013
1373039260,1EcMasterDemoSyn13736-21runintdemo5min12:21:390
145262190,0sleep40-21swapper/410:35:174
3216739180,8EcMasterDemoSyn3652-21chrt12:34:325
3197299180,13tDemoTimingTask32582-21taskset10:10:005
2628099180,8cyclictest30728-21ssh09:15:203
2626799180,14cyclictest7913-21sh09:55:480
2626799180,14cyclictest24233-21sh09:11:530
2626799180,10cyclictest14467-21sh09:41:530
433399170,15tDemoTimingTask7739-21chrt10:31:175
3234629170,7tAtEmLog_01426-21chrt08:30:185
2627699171,12cyclictest16-1pr/legacy10:19:562
2626799170,9cyclictest31221-21sh12:31:080
2626799170,9cyclictest22854-21cpuspeed10:40:120
2626799170,9cyclictest12720-21sh12:39:360
1001699170,7tDemoTimingTask10818-21chrt10:50:395
2913329160,7tAtEmLog_01810-21chrt11:04:055
26285991612,3cyclictest11178-21apt-key11:45:004
2628099163,9cyclictest7056-21awk08:40:233
26280991612,3cyclictest30368-21idleruntime-cro11:20:003
2627199164,8cyclictest468-21tr10:10:121
26271991612,3cyclictest30078-21cpuspeed_turbos11:55:141
26267991612,3cyclictest9927-21idleruntime-cro09:40:000
26267991612,3cyclictest27739-21idleruntime-cro08:20:000
2626799160,9cyclictest780-21runrttasks07:12:510
2626799160,8cyclictest7520-21runrttasks09:20:200
2626799160,11cyclictest30363-21latency_hist11:20:000
3211439150,6EcMasterDemoSyn4982-21taskset09:36:365
2628599153,8cyclictest15280-21fschecks_count09:00:134
2628599150,9cyclictest1205-21sh11:39:404
2628599150,8cyclictest10211-21sh09:57:244
2628599150,7cyclictest286-21jbd2/md0-812:18:134
2628599150,11cyclictest20571-21threads12:25:254
2628599150,11cyclictest16959-21diskmemload10:00:444
2628099157,6cyclictest13277-21turbostat.cron07:50:003
2628099154,8cyclictest24492-21grep12:10:143
2628099154,8cyclictest24492-21grep12:10:133
2628099151,10cyclictest24102-21df_inode10:05:143
2628099151,10cyclictest24102-21df_inode10:05:143
2628099150,9cyclictest8302-21sort07:40:003
2628099150,9cyclictest22786-21ssh12:09:163
2628099150,9cyclictest22155-21sh09:45:533
2628099150,9cyclictest17734-21sh09:25:423
2628099150,9cyclictest10343-21taskset07:42:013
2628099150,8cyclictest8095-21sh09:38:463
2627699153,8cyclictest6460-21aten2_r5power_p12:00:132
2627699152,9cyclictest11590-21entropy07:45:142
26276991511,3cyclictest23947-21runrttasks09:30:002
2627699150,10cyclictest22650-21ssh10:21:502
2627199154,8cyclictest27718-21smartctl11:00:151
2627199154,6cyclictest29366-21fschecks_count07:15:141
2627199151,11cyclictest16-1pr/legacy10:50:201
2627199151,11cyclictest16-1pr/legacy10:40:131
2627199151,10cyclictest8104-21ssh10:31:331
2627199151,10cyclictest3610-21sh11:22:361
2627199151,10cyclictest26539-21runrttasks07:10:151
2627199150,10cyclictest26463-21sh11:17:171
2626799155,6cyclictest14-21ksoftirqd/010:55:300
2626799152,9cyclictest4693-21diskmemload11:40:450
2626799151,7cyclictest29738-21memory09:50:170
26267991511,3cyclictest811-21runintdemo5min11:56:200
2626799151,11cyclictest16-1pr/legacy08:58:470
2626799151,11cyclictest16-1pr/legacy08:43:340
26267991510,4cyclictest25637-21grep09:30:170
2626799150,9cyclictest3773-21sh10:47:050
2626799150,9cyclictest15085-21diskmemload11:10:400
2626799150,8cyclictest780-21runrttasks08:00:080
2626799150,12cyclictest174-1kworker/0:1H+kblockd11:45:370
462129140,5tAtEmLog_05369-21taskset12:17:055
42329140,3tAtEmLog_07961-21sleep10:50:015
2628599146,6cyclictest22542-21grep08:05:244
2628599141,9cyclictest6796-21sh10:30:384
2628599141,9cyclictest3481-21sh11:58:224
2628599141,9cyclictest21098-21sh10:56:174
2628599141,9cyclictest20574-21diskmemload11:50:094
2628599141,10cyclictest780-21runrttasks07:17:404
2628599141,10cyclictest16-1pr/legacy07:32:354
2628599140,9cyclictest30701-21diskmemload11:20:014
2628599140,7cyclictest17473-21ssh11:48:094
2628599140,10cyclictest8293-21sh10:50:034
2628599140,10cyclictest780-21runrttasks09:51:424
2628599140,10cyclictest780-21runrttasks09:37:264
2628599140,10cyclictest716-21snmpd12:20:574
2628599140,10cyclictest5714-21latency_hist09:20:004
2628599140,10cyclictest411-21diskmemload09:34:484
2628599140,10cyclictest30509-21ssh12:30:364
2628599140,10cyclictest28868-21date07:15:004
2628599140,10cyclictest26797-21sh11:17:314
2628599140,10cyclictest2561-21ssh10:10:324
2628599140,10cyclictest18844-21ssh09:26:294
2628599140,10cyclictest18757-21grep08:00:144
2628599140,10cyclictest18610-21ssh10:20:094
2628599140,10cyclictest17876-21taskset07:58:414
2628599140,10cyclictest16614-21sh10:19:004
2628599140,10cyclictest15517-21rm09:42:384
2628599140,10cyclictest14249-21hddtemp_smartct07:50:164
2628599140,10cyclictest13158-21smartctl08:55:164
2628599140,10cyclictest11277-21ssh12:38:344
2628099141,9cyclictest780-21runrttasks07:30:033
2628099141,9cyclictest7758-21diskmemload09:55:423
2628099141,9cyclictest28753-21sh10:43:173
2628099141,9cyclictest24210-21sh12:27:453
2628099141,9cyclictest12630-21sh11:10:073
2628099141,10cyclictest29145-21sh11:00:313
2628099141,10cyclictest27722-21ssh11:35:353
2628099140,9cyclictest8998-21runrttasks11:43:463
2628099140,9cyclictest16916-21ssh10:36:223
2628099140,9cyclictest13207-21sh11:27:593
2628099140,10cyclictest7471-21sh10:13:583
2628099140,10cyclictest716-21snmpd10:19:413
2628099140,10cyclictest6719-21sh12:18:033
2628099140,10cyclictest3719-21rm11:58:323
2628099140,10cyclictest3400-21ssh12:34:213
2628099140,10cyclictest31978-21ssh10:26:573
2628099140,10cyclictest27157-21sh09:30:543
2628099140,10cyclictest25615-21cut08:15:003
2628099140,10cyclictest24860-21runrttasks10:23:233
2628099140,10cyclictest24419-21ssh11:51:403
2628099140,10cyclictest23661-21sh10:58:073
2628099140,10cyclictest20959-21/usr/sbin/munin08:05:223
2628099140,10cyclictest17108-21rm09:43:443
2628099140,10cyclictest11799-21ssh10:34:103
2628099140,10cyclictest10772-21ssh12:38:133
2627699146,6cyclictest648-21dbus-daemon07:55:002
2627699141,9cyclictest780-21runrttasks08:11:232
2627699141,9cyclictest22470-21diskmemload10:40:032
2627699141,9cyclictest22428-21runrttasks12:09:012
2627699141,10cyclictest22438-21ssh09:10:392
2627699141,10cyclictest16-1pr/legacy12:11:292
2627699141,10cyclictest16-1pr/legacy12:11:292
2627699140,9cyclictest31684-21cut08:25:182
2627699140,10cyclictest9469-21ssh10:32:302
2627699140,10cyclictest8575-21apt07:40:122
2627699140,10cyclictest8320-21ssh10:50:042
2627699140,10cyclictest780-21runrttasks08:51:102
2627699140,10cyclictest553-21taskset07:20:562
2627699140,10cyclictest4072-21rm09:54:282
2627699140,10cyclictest3632-21ssh11:05:092
2627699140,10cyclictest3178-21ssh12:15:332
2627699140,10cyclictest30757-21ssh11:20:042
2627699140,10cyclictest30427-21sed08:25:012
2627699140,10cyclictest29214-21sh09:15:082
2627699140,10cyclictest28797-21ssh11:54:462
2627699140,10cyclictest27587-21ssh09:31:112
2627699140,10cyclictest27312-21cut11:00:122
2627699140,10cyclictest23595-21wc11:15:252
2627699140,10cyclictest23502-21ssh10:05:032
2627699140,10cyclictest23502-21ssh10:05:032
2627699140,10cyclictest20673-21latency_hist08:05:002
2627699140,10cyclictest19450-21ssh09:45:082
2627699140,10cyclictest1939-21ssh10:45:472
2627699140,10cyclictest16224-21ssh12:23:302
2627699140,10cyclictest16077-21mailstats09:00:192
2627699140,10cyclictest15418-21ssh11:46:422
2627699140,10cyclictest14305-21ssh10:00:012
2627699140,10cyclictest10864-21ssh12:38:172
2627699140,10cyclictest10789-21sh11:26:162
2627199146,6cyclictest16832-21sensors_fan12:05:211
2627199145,5cyclictest326-21systemd-journal12:31:271
2627199144,8cyclictest32189-21df10:45:131
2627199143,8cyclictest12814-21unixbench_singl07:45:241
2627199141,9cyclictest28534-21sh09:50:061
2627199141,10cyclictest19191-21runrttasks09:09:101
2627199141,10cyclictest10434-21diskmemload09:40:091
26271991410,3cyclictest20934-21packagekitd08:10:061
26271991410,3cyclictest18982-21cpuspeed_turbos10:20:121
2627199140,12cyclictest3481-21ssh11:05:041
2627199140,10cyclictest9445-21memory07:40:171
2627199140,10cyclictest9396-21ssh12:01:131
2627199140,10cyclictest780-21runrttasks08:35:091
2627199140,10cyclictest6689-21fschecks_time09:20:151
2627199140,10cyclictest5719-21latency_hist07:35:001
2627199140,10cyclictest4507-21sh12:16:311
2627199140,10cyclictest3573-21sh09:35:361
2627199140,10cyclictest31892-21perl07:20:161
2627199140,10cyclictest30540-21ssh10:25:561
2627199140,10cyclictest29024-21ssh10:07:441
2627199140,10cyclictest29024-21ssh10:07:441
2627199140,10cyclictest28144-21ssh09:31:341
2627199140,10cyclictest24793-21sh12:10:141
2627199140,10cyclictest24793-21sh12:10:141
2627199140,10cyclictest21329-21awk09:10:191
2627199140,10cyclictest20959-21/usr/sbin/munin08:05:181
2627199140,10cyclictest20730-21ssh10:56:011
2627199140,10cyclictest20388-21rm11:50:011
2627199140,10cyclictest19524-21ssh09:45:111
2627199140,10cyclictest19356-21df_inode12:25:141
2627199140,10cyclictest17689-21ssh11:12:291
2627199140,10cyclictest16802-21sh11:30:111
2627199140,10cyclictest14950-21ssh11:46:231
2627199140,10cyclictest14638-21ssh10:17:371
2627199140,10cyclictest1155-21cron09:17:001
2627199140,10cyclictest11208-21awk08:50:191
2627199140,10cyclictest10256-21sh11:25:541
2627199140,10cyclictest10061-21latency_hist08:50:011
2626799146,6cyclictest16286-21/usr/sbin/munin07:55:140
2626799146,6cyclictest11306-21find08:50:200
2626799145,8cyclictest9528-21/usr/sbin/munin07:40:170
2626799145,7cyclictest31366-21ssh09:15:290
2626799145,7cyclictest13326-21sh10:35:010
2626799144,6cyclictest15417-21aten2_r5power_c12:05:130
2626799143,8cyclictest27550-21fschecks_time11:00:140
2626799143,6cyclictest1486-21grep07:25:110
2626799142,9cyclictest28505-21sh11:36:050
2626799142,10cyclictest16-1pr/legacy11:25:510
2626799141,7cyclictest10094-21cat08:50:000
2626799141,10cyclictest1146-21head10:10:150
2626799140,7cyclictest780-21runrttasks10:20:230
2626799140,7cyclictest6489-21basename12:00:120
2626799140,7cyclictest17500-21tr09:05:130
2626799140,12cyclictest9497-21chrt10:15:090
2626799140,10cyclictest780-21runrttasks11:51:360
2626799140,10cyclictest780-21runrttasks10:34:160
2626799140,10cyclictest5255-21latency_hist08:40:010
2626799140,10cyclictest5125-21sh11:05:210
2626799140,10cyclictest31212-21taskset12:13:490
2626799140,10cyclictest31212-21taskset12:13:480
2626799140,10cyclictest30276-21ssh10:25:450
2626799140,10cyclictest24107-21sh10:05:140
2626799140,10cyclictest24107-21sh10:05:140
2626799140,10cyclictest23471-21ssh09:46:480
2626799140,10cyclictest22653-21grep10:04:420
2626799140,10cyclictest21078-21ssh09:28:020
2626799140,10cyclictest1264-21ssh11:20:550
2626799140,10cyclictest11431-21wc07:45:130
23753991410,3tDemoTimingTask0-21swapper/511:55:165
2362299140,11tDemoTimingTask25840-21chrt07:05:385
3234799130,11tDemoTimingTask32433-21chrt08:29:125
3197299130,11tDemoTimingTask6996-21chrt10:13:385
2738829130,3tAtEmLog_031007-21chrt09:50:385
2628599139,3cyclictest27647-21gltestperf11:00:154
2628599131,9cyclictest3497-21sh11:05:044
26285991310,2cyclictest693-21in:imuxsock08:30:014
2628599130,9cyclictest8759-21ntp_kernel_pll_11:25:174
2628599130,9cyclictest8052-21runrttasks07:37:414
2628599130,9cyclictest7825-21sh12:00:214
2628599130,9cyclictest780-21runrttasks08:48:124
2628599130,9cyclictest780-21runrttasks08:17:324
2628599130,9cyclictest5896-21ssh09:20:024
2628599130,9cyclictest3225-21cpuspeed08:35:124
2628599130,9cyclictest31321-21/usr/sbin/munin07:20:144
2628599130,9cyclictest30806-21df_inode08:25:124
2628599130,9cyclictest29539-21timerandwakeup10:25:244
2628599130,9cyclictest28111-21wget08:20:134
2628599130,9cyclictest24249-21ssh12:10:074
2628599130,9cyclictest24249-21ssh12:10:064
2628599130,9cyclictest23574-21ssh10:05:074
2628599130,9cyclictest23574-21ssh10:05:064
2628599130,9cyclictest23312-21/usr/sbin/munin08:10:134
2628599130,9cyclictest22571-21ssh10:40:074
2628599130,9cyclictest19954-21ssh09:10:044
2628599130,9cyclictest19409-21sh09:45:074
2628599130,9cyclictest17633-21/usr/sbin/munin09:05:144
2628599130,9cyclictest16561-21/usr/sbin/munin11:30:234
2628599130,9cyclictest16251-21uname12:05:184
2628599130,9cyclictest1304-21aten2_r5power_e07:25:104
2628599130,9cyclictest12837-21ssh11:10:134
2628599130,9cyclictest12180-21needreboot07:45:174
2628599130,9cyclictest10375-21chrt07:42:264
2628599130,9cyclictest10246-21wget08:50:134
2628599130,11cyclictest6101-21smartctl08:40:144
2628099139,3cyclictest11090-21needreboot08:50:183
2628099135,6cyclictest6771-21tune2fs09:20:153
2628099133,6cyclictest11063-21cat12:20:173
2628099132,6cyclictest14035-21fschecks_count07:50:153
2628099131,9cyclictest31269-21ssh09:50:493
2628099131,9cyclictest18519-21sh11:30:273
2628099130,9cyclictest8511-21/usr/sbin/munin10:50:203
2628099130,9cyclictest780-21runrttasks08:56:363
2628099130,9cyclictest7771-21runrttasks08:45:053
2628099130,9cyclictest7235-21kernelversion12:00:173
2628099130,9cyclictest661-21/usr/sbin/munin08:30:143
2628099130,9cyclictest4901-21runrttasks08:38:043
2628099130,9cyclictest32259-21taskset08:27:273
2628099130,9cyclictest32176-21cat10:45:123
2628099130,9cyclictest31436-21ssh11:20:133
2628099130,9cyclictest28939-21taskset07:15:083
2628099130,9cyclictest26540-21/usr/sbin/munin07:10:223
2628099130,9cyclictest18330-21aten2_r5power_c08:00:113
2628099130,9cyclictest17766-21cut09:05:153
2628099130,9cyclictest17653-21sshd07:56:183
2628099130,9cyclictest14338-21rm10:00:023
2628099130,9cyclictest1251-21chrt07:25:043
2628099130,10cyclictest5995-21sh11:05:383
2628099130,10cyclictest28050-21/usr/sbin/munin08:20:143
2628099130,10cyclictest26222-21latency_hist07:10:003
2628099130,10cyclictest16609-21chrt09:01:403
2628099130,10cyclictest11633-21ssh11:45:133
2627699135,6cyclictest13942-21ntp_kernel_err11:10:192
2627699131,7cyclictest2791-21fschecks_time11:40:142
2627699130,9cyclictest7770-21postgres08:45:042
2627699130,9cyclictest6020-21/usr/sbin/munin07:35:142
2627699130,9cyclictest5908-21diskmemload09:20:022
2627699130,9cyclictest5867-21ssh09:55:152
2627699130,9cyclictest5418-21chrt08:40:052
2627699130,9cyclictest326-21systemd-journal08:15:052
2627699130,9cyclictest3052-21/usr/sbin/munin08:35:112
2627699130,9cyclictest3000-21runrttasks07:26:322
2627699130,9cyclictest29297-21sh10:25:212
2627699130,9cyclictest28979-21grep07:15:122
2627699130,9cyclictest28097-21sh12:30:052
2627699130,9cyclictest27679-21processes07:10:252
2627699130,9cyclictest27512-21taskset11:35:262
2627699130,9cyclictest21134-21rm10:56:202
2627699130,9cyclictest17211-21/usr/sbin/munin09:05:132
2627699130,9cyclictest17146-21ssh11:30:132
2627699130,9cyclictest15934-21/usr/sbin/munin07:55:132
2627699130,9cyclictest14100-21fschecks_count10:35:152
2627699130,9cyclictest12725-21ssh09:40:362
2627699130,9cyclictest1223-21diskmemload09:35:072
2627699130,9cyclictest1209-21fschecks_time08:30:152
2627699130,10cyclictest3962-21df07:30:122
2627699130,10cyclictest32599-21ssh11:56:042
2627699130,10cyclictest2894-21ssh10:10:462
2627699130,10cyclictest22679-21taskset08:06:202
2627199131,9cyclictest6382-21latency09:55:181
2627199131,9cyclictest16926-21switchtime09:25:231
2627199130,9cyclictest780-21runrttasks08:30:101
2627199130,9cyclictest780-21runrttasks08:15:031
2627199130,9cyclictest716-21snmpd08:55:121
2627199130,9cyclictest6020-21/usr/sbin/munin07:35:201
2627199130,9cyclictest5425-21/usr/sbin/munin08:40:171
2627199130,9cyclictest4868-21/usr/sbin/munin12:35:171
2627199130,9cyclictest3596-21sendmail_mailqu11:40:191
2627199130,9cyclictest30452-21/usr/sbin/munin08:25:111
2627199130,9cyclictest18297-21runrttasks08:00:041
2627199130,9cyclictest16561-21sh10:36:061
2627199130,9cyclictest15934-21/usr/sbin/munin07:55:191
2627199130,9cyclictest15270-21ssh10:00:141
2627199130,9cyclictest15198-21cstates09:00:111
2627199130,9cyclictest1258-21/usr/sbin/munin07:25:131
2627199130,10cyclictest25377-21ssh11:35:051
2627199130,10cyclictest15341-21runrttasks07:51:521
2627199130,10cyclictest12102-21sh12:20:311
2626799130,9cyclictest3708-21aten2_r5power_v07:30:120
2626799130,9cyclictest3391-21sh12:15:430
2626799130,9cyclictest30825-21forks08:25:120
2626799130,9cyclictest24435-21processes08:10:200
2626799130,9cyclictest21742-21kernelversion08:05:170
2626799130,9cyclictest19808-21/usr/sbin/munin12:25:170
2626799130,9cyclictest16531-21sh11:30:070
2626799130,8cyclictest16749-21kworker/u24:2+events_unbound07:50:120
2626799130,7cyclictest28471-21fschecks_count08:20:150
2626799130,10cyclictest7903-21runrttasks07:36:050
2626799130,10cyclictest26325-21cat07:10:000
2626799130,10cyclictest174-1kworker/0:1H+kblockd08:30:560
883299120,10tDemoTimingTask9412-21chrt12:37:155
876029120,2tAtEmLog_012396-21taskset10:16:035
733899120,10tDemoTimingTask7775-21chrt08:45:095
732739120,2EcMasterDemoSyn5118-21sleep08:44:555
2628099120,9cyclictest25945-21tr08:15:123
2627699120,9cyclictest12550-21aten2_r5power_p08:55:132
2627199120,7cyclictest26222-21latency_hist07:10:001
2626799124,6cyclictest31761-21fschecks_count07:20:150
2626799120,9cyclictest780-21runrttasks09:00:030
2626799120,9cyclictest29348-21fschecks_count07:15:150
1343699121,9tDemoTimingTask18625-21chrt10:01:535
105199120,10tDemoTimingTask6785-21taskset11:24:505
1001699120,2tDemoTimingTask17661-21chrt10:55:035
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional