You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-18 - 18:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Mon May 18, 2026 12:44:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
821239990,0EcMasterDemoSyn0-21swapper/108:20:511
174539880,0EcMasterDemoSyn1750-21runintdemo5min10:58:041
2777039840,0EcMasterDemoSyn2778029tAtEmLog_009:01:255
493639830,0EcMasterDemoSyn494629tAtEmLog_011:53:505
2057139830,0EcMasterDemoSyn2058129tAtEmLog_010:32:425
2057139830,0EcMasterDemoSyn2058129tAtEmLog_010:32:425
1292739830,0EcMasterDemoSyn1293929tAtEmLog_012:34:245
897139820,0EcMasterDemoSyn898129tAtEmLog_012:14:075
346339820,0EcMasterDemoSyn347329tAtEmLog_008:10:435
3226439820,0EcMasterDemoSyn3227429tAtEmLog_012:09:045
2539239820,0EcMasterDemoSyn2540229tAtEmLog_008:56:225
2504039820,0EcMasterDemoSyn2505029tAtEmLog_010:52:595
1583239820,0EcMasterDemoSyn1584229tAtEmLog_009:36:565
1404339820,0EcMasterDemoSyn1405329tAtEmLog_011:58:545
1268739820,0EcMasterDemoSyn1269729tAtEmLog_007:25:055
642239810,0EcMasterDemoSyn643229tAtEmLog_010:42:515
2967639810,1EcMasterDemoSyn29682-21ps10:02:172
2414939810,0EcMasterDemoSyn2415929tAtEmLog_011:28:305
110339810,0EcMasterDemoSyn111329tAtEmLog_008:05:395
2067739470,1EcMasterDemoSyn20685-21runintdemo5min08:46:130
89032460,0sleep38900-21wget08:25:123
2319539300,1EcMasterDemoSyn30438-21diskmemload12:03:590
306002270,0sleep30-21swapper/311:14:153
1001239270,0EcMasterDemoSyn10019-21grep07:20:003
2967639210,1EcMasterDemoSyn2968629tAtEmLog_010:02:175
1292739210,0EcMasterDemoSyn12935-21ps12:34:244
538799186,9cyclictest31540-21sh09:27:580
538799180,14cyclictest6501-21sh11:36:080
538799180,10cyclictest27546-21grep11:30:150
242972180,0sleep40-21swapper/412:22:114
584029170,10tAtEmLog_06502-21taskset08:20:015
540299170,9cyclictest6215-21diskmemload10:42:423
539899170,9cyclictest23339-21ssh10:51:472
539299175,9cyclictest31344-21sh11:14:461
5392991710,6cyclictest7800-21sort11:55:151
538799171,9cyclictest1742-21diskmemload09:47:020
538799170,9cyclictest30397-21sh10:02:460
538799170,9cyclictest25749-21sh11:10:510
538799170,9cyclictest17223-21sh12:18:340
538799170,9cyclictest14047-21sh10:29:430
538799170,14cyclictest4274-21ssh11:53:230
2983229170,7tAtEmLog_0922-21taskset09:29:145
175529170,10tAtEmLog_04413-21chrt10:59:565
1501799170,10tDemoTimingTask17237-21chrt11:24:565
540699161,11cyclictest16-1pr/legacy07:50:254
540299161,9cyclictest19129-21ssh10:31:423
540299161,9cyclictest19129-21ssh10:31:423
540299161,9cyclictest16-1pr/legacy10:58:033
540299161,8cyclictest12899-21ssh10:28:543
539899160,9cyclictest18291-21forks11:25:132
539299160,10cyclictest7102-21ssh11:36:351
538799161,8cyclictest716-21snmpd10:41:450
538799160,9cyclictest5471-21aten2_r5power_p12:30:120
538799160,7cyclictest24719-21cat10:00:000
538799160,7cyclictest1222-21latency_hist12:10:000
538799160,14cyclictest6613-21ssh10:07:260
538799160,11cyclictest28904-21ssh09:44:420
2367829160,6tAtEmLog_024747-21taskset07:50:085
2067739160,0EcMasterDemoSyn0-21swapper/508:46:125
181729160,7tAtEmLog_04694-21taskset09:49:055
540699150,8cyclictest32129-21ssh09:45:374
540699150,8cyclictest18273-21ssh11:43:064
540699150,11cyclictest16803-21sh09:20:104
540299152,9cyclictest6433-21sh11:54:523
540299150,6cyclictest7553-21ssh11:19:303
539899158,5cyclictest15929-21grep10:47:552
539899152,9cyclictest5463-21ssh09:31:042
539899152,10cyclictest1352-21sh09:29:322
539899151,10cyclictest6843-21/usr/sbin/munin09:50:192
539899150,9cyclictest8819-21latency07:15:172
539899150,9cyclictest32065-21diskmemload10:56:352
539899150,11cyclictest5825-21sh11:54:272
539899150,11cyclictest12018-21sh11:57:282
539899150,11cyclictest10196-21ssh11:38:452
539299153,8cyclictest29595-21grep08:00:121
539299151,10cyclictest32614-21runrttasks11:33:041
539299151,10cyclictest28821-21/usr/sbin/munin12:25:211
539299151,10cyclictest28821-21/usr/sbin/munin12:25:201
539299151,10cyclictest22382-21sh11:09:511
539299151,10cyclictest21223-21ssh12:38:571
539299151,10cyclictest21223-21ssh12:38:571
539299150,9cyclictest5598-21ssh10:42:161
539299150,9cyclictest32379-21rm09:45:471
539299150,9cyclictest12146-21ssh10:28:221
538799154,8cyclictest326-21systemd-journal08:53:310
538799150,9cyclictest29519-21rm11:49:400
538799150,13cyclictest18313-21sh10:49:350
538799150,12cyclictest3916-21ssh11:16:570
538799150,12cyclictest30438-21diskmemload12:28:550
538799150,12cyclictest30438-21diskmemload12:28:550
3115439150,2EcMasterDemoSyn671rcuc/508:00:355
2304799150,9tDemoTimingTask23341-21chrt08:54:565
540699143,8cyclictest716-21snmpd10:27:314
540699142,8cyclictest755-21postgres12:35:014
540699142,8cyclictest755-21postgres12:35:014
540699141,9cyclictest7608-21sh09:15:074
540699141,9cyclictest24791-21sh10:00:014
540699141,10cyclictest31821-21ssh11:50:204
540699140,8cyclictest10301-21ssh11:38:494
540699140,7cyclictest27522-21rm10:19:094
540699140,11cyclictest9793-21sed08:25:184
540699140,10cyclictest8787-21sh12:14:004
540699140,10cyclictest7175-21/usr/sbin/munin11:55:204
540699140,10cyclictest716-21snmpd08:32:554
540699140,10cyclictest3834-21ssh09:12:424
540699140,10cyclictest3136-21perl09:30:134
540699140,10cyclictest29242-21sh12:06:544
540699140,10cyclictest26846-21ssh10:35:454
540699140,10cyclictest26846-21ssh10:35:454
540699140,10cyclictest26513-21sh11:47:324
540699140,10cyclictest24140-21sh10:35:004
540699140,10cyclictest24140-21sh10:35:004
540699140,10cyclictest23677-21sh12:04:184
540299144,6cyclictest16823-21kworker/u24:3+xprtiod11:47:213
540299143,8cyclictest31102-21netstat09:45:203
540299142,9cyclictest12362-21ssh11:57:433
540299141,9cyclictest8298-21sensors_volt09:50:193
540299141,9cyclictest23678-21runrttasks12:21:453
540299141,9cyclictest1840-21sh09:11:193
5402991411,2cyclictest423-21turbostat.cron10:40:003
5402991411,2cyclictest423-21turbostat.cron10:40:003
540299141,10cyclictest8807-21runrttasks09:33:233
540299141,10cyclictest1828-21sh12:27:543
540299141,10cyclictest1828-21sh12:27:543
5402991410,3cyclictest29158-21sh07:59:593
5402991410,3cyclictest18348-21cron08:45:003
5402991410,3cyclictest18348-21cron08:45:003
540299140,9cyclictest5677-21basename07:10:133
540299140,7cyclictest3267-21sh11:35:013
540299140,11cyclictest9016-21grep09:15:203
540299140,10cyclictest9952-21sh11:02:293
540299140,10cyclictest9149-21ssh10:09:133
540299140,10cyclictest8813-21/usr/sbin/munin11:20:123
540299140,10cyclictest780-21runrttasks12:07:443
540299140,10cyclictest716-21snmpd09:43:263
540299140,10cyclictest716-21snmpd08:12:583
540299140,10cyclictest382-21ssh10:21:323
540299140,10cyclictest382-21ssh10:21:323
540299140,10cyclictest31025-21sh11:31:573
540299140,10cyclictest30970-21cat08:00:233
540299140,10cyclictest27906-21runrttasks09:02:463
540299140,10cyclictest27407-21ssh10:00:433
540299140,10cyclictest23684-21ssh10:52:023
540299140,10cyclictest22754-21df07:45:143
540299140,10cyclictest20200-21sh11:08:173
540299140,10cyclictest19793-21sh12:37:563
540299140,10cyclictest19793-21sh12:37:553
540299140,10cyclictest18282-21ssh09:20:213
540299140,10cyclictest17279-21sh11:42:233
540299140,10cyclictest17152-21diskmemload10:48:463
540299140,10cyclictest16652-21ssh12:00:143
540299140,10cyclictest1632-21sh12:10:053
540299140,10cyclictest16189-21latency_hist08:40:003
540299140,10cyclictest15519-21ssh12:17:243
540299140,10cyclictest11500-21rm09:35:033
539899143,8cyclictest28261-21processes11:30:202
539899143,8cyclictest18645-21proc_pri07:35:202
539899141,9cyclictest32188-21ssh11:15:092
539899141,9cyclictest16957-21sh11:42:102
539899141,10cyclictest10799-21ssh11:03:052
5398991410,3cyclictest15978-21sendmail08:40:002
539899140,8cyclictest31327-21rm12:08:242
539899140,10cyclictest716-21snmpd07:27:292
539899140,10cyclictest5821-21rm10:25:052
539899140,10cyclictest4706-21sh10:06:082
539899140,10cyclictest32167-21ssh09:45:382
539899140,10cyclictest31831-21/usr/sbin/munin08:05:172
539899140,10cyclictest31624-21sh12:26:022
539899140,10cyclictest31624-21sh12:26:022
539899140,10cyclictest31564-21ssh10:20:382
539899140,10cyclictest31564-21ssh10:20:382
539899140,10cyclictest31093-21sh10:38:452
539899140,10cyclictest31093-21sh10:38:452
539899140,10cyclictest28648-21ssh11:49:022
539899140,10cyclictest28086-21ssh09:44:072
539899140,10cyclictest25921-21sort09:00:002
539899140,10cyclictest23952-21ssh10:16:402
539899140,10cyclictest22954-21sh11:10:022
539899140,10cyclictest22422-21diskmemload12:20:512
539899140,10cyclictest21304-21/usr/sbin/munin08:50:102
539899140,10cyclictest20353-21ssh11:08:242
539899140,10cyclictest20027-21cmp07:40:042
539899140,10cyclictest19346-21ssh10:31:512
539899140,10cyclictest19346-21ssh10:31:512
539899140,10cyclictest18234-21ssh09:20:192
539899140,10cyclictest17921-21ssh12:36:352
539899140,10cyclictest17921-21ssh12:36:342
539899140,10cyclictest1778-21/usr/sbin/munin08:10:172
539899140,10cyclictest17661-21ssh12:18:532
539899140,10cyclictest15943-21/usr/sbin/munin09:55:212
539899140,10cyclictest14593-21sh10:11:422
539899140,10cyclictest14256-21sh11:22:542
539899140,10cyclictest10536-21sh12:32:422
539899140,10cyclictest1034-21/usr/sbin/munin10:40:252
539899140,10cyclictest10230-21sh09:15:492
539299149,4cyclictest25710-21needreboot07:50:191
539299146,7cyclictest5378-21cyclictest10:49:231
539299143,8cyclictest9724-21latency08:25:171
539299141,9cyclictest20008-21sh11:25:331
539299141,9cyclictest16651-21/usr/sbin/munin08:40:131
539299141,9cyclictest16651-21/usr/sbin/munin08:40:121
539299141,10cyclictest5853-21ssh09:31:201
5392991410,3cyclictest17198-21latency_hist07:35:001
539299140,9cyclictest780-21runrttasks07:59:291
539299140,9cyclictest6900-21ssh12:12:391
539299140,9cyclictest29273-21runrttasks10:20:091
539299140,9cyclictest29273-21runrttasks10:20:091
539299140,8cyclictest8339-21sh12:31:081
539299140,8cyclictest27971-21taskset10:36:341
539299140,8cyclictest27971-21taskset10:36:341
539299140,7cyclictest21088-21ssh09:57:371
539299140,10cyclictest9228-21df_inode11:20:121
539299140,10cyclictest8759-21sh09:15:181
539299140,10cyclictest8005-21runrttasks07:15:111
539299140,10cyclictest7964-21sh11:01:041
539299140,10cyclictest5720-21aten2_r5power_p07:10:131
539299140,10cyclictest30944-21sh09:27:331
539299140,10cyclictest26599-21ssh10:18:301
539299140,10cyclictest25972-21grep10:00:171
539299140,10cyclictest25355-21sh09:42:121
539299140,10cyclictest23918-21timerwakeupswit07:45:241
539299140,10cyclictest2318-21ssh11:51:591
539299140,10cyclictest21552-21/usr/sbin/munin11:45:241
539299140,10cyclictest19301-21ssh10:50:051
539299140,10cyclictest17035-21cpuspeed_turbos09:20:101
539299140,10cyclictest16230-21/usr/sbin/munin12:00:201
539299140,10cyclictest1503-21ssh10:05:021
539299140,10cyclictest11130-21ssh09:52:031
539299140,10cyclictest10809-21/usr/sbin/munin10:10:231
538799145,7cyclictest20297-21sh10:50:150
538799143,8cyclictest16969-21smartctl08:40:150
538799143,8cyclictest16969-21smartctl08:40:150
538799142,8cyclictest780-21runrttasks07:28:430
538799141,9cyclictest30255-21rm10:38:090
538799141,9cyclictest30255-21rm10:38:090
538799141,9cyclictest16361-21sh11:05:360
538799141,7cyclictest18838-21cat11:25:160
538799141,6cyclictest16658-21/usr/sbin/munin10:30:200
538799141,6cyclictest16658-21/usr/sbin/munin10:30:200
538799141,10cyclictest9714-21rm11:02:190
538799141,10cyclictest32444-21runrttasks10:21:140
538799141,10cyclictest32444-21runrttasks10:21:140
538799141,10cyclictest16-1pr/legacy08:00:340
538799141,10cyclictest16-1pr/legacy07:55:300
538799140,9cyclictest10693-21runrttasks08:27:060
538799140,8cyclictest15408-21sh09:19:280
538799140,7cyclictest9465-21ssh11:55:390
538799140,7cyclictest7443-21cut09:50:140
538799140,7cyclictest29595-21ls10:55:220
538799140,7cyclictest20892-21cat12:20:200
538799140,7cyclictest11829-21memory10:10:180
538799140,12cyclictest5255-21sh12:11:310
538799140,10cyclictest8244-21ssh09:32:590
538799140,10cyclictest716-21snmpd09:02:550
538799140,10cyclictest4194-21ssh09:12:560
538799140,10cyclictest3987-21cat08:15:000
538799140,10cyclictest22341-21sh10:15:320
538799140,10cyclictest21867-21runrttasks07:41:570
538799140,10cyclictest17207-21sh12:36:030
538799140,10cyclictest17207-21sh12:36:030
538799140,10cyclictest16650-21diskmemload09:20:040
538799140,10cyclictest15230-21ssh11:40:580
538799140,10cyclictest14232-21df_inode08:35:150
538799140,10cyclictest10042-21sh11:20:180
645529134,7tAtEmLog_09045-21chrt10:09:095
540699133,6cyclictest30863-21grep10:20:244
540699133,6cyclictest30863-21grep10:20:244
540699131,9cyclictest3537-21taskset08:11:094
540699131,9cyclictest23721-21ssh09:41:054
540699131,9cyclictest18263-21runrttasks08:43:584
540699131,9cyclictest18263-21runrttasks08:43:584
540699130,9cyclictest8696-21sh11:20:044
540699130,9cyclictest8003-21runrttasks07:15:094
540699130,9cyclictest780-21runrttasks08:35:014
540699130,9cyclictest780-21runrttasks08:15:144
540699130,9cyclictest6577-21gpgv09:50:004
540699130,9cyclictest6515-21/usr/sbin/munin08:20:134
540699130,9cyclictest5653-21/usr/sbin/munin07:10:134
540699130,9cyclictest5140-21aten2_r5power_c11:00:124
540699130,9cyclictest4498-21ssh10:41:304
540699130,9cyclictest31118-21users08:00:244
540699130,9cyclictest29160-21latency_hist08:00:004
540699130,9cyclictest28813-21ssh12:25:114
540699130,9cyclictest28813-21ssh12:25:104
540699130,9cyclictest28444-21diskmemload10:55:104
540699130,9cyclictest28384-21/usr/sbin/munin09:05:134
540699130,9cyclictest27561-21grep09:00:254
540699130,9cyclictest26887-21ssh11:30:104
540699130,9cyclictest25802-21sh09:25:064
540699130,9cyclictest24723-21latency_hist07:49:594
540699130,9cyclictest23654-21runrttasks08:55:094
540699130,9cyclictest23094-21sh11:10:084
540699130,9cyclictest22247-21latency_hist07:45:004
540699130,9cyclictest21313-21atemtest08:50:094
540699130,9cyclictest20804-21sendmail_mailqu10:50:194
540699130,9cyclictest20165-21ssh09:57:004
540699130,9cyclictest19194-21tr08:45:124
540699130,9cyclictest17876-21/usr/sbin/munin07:35:144
540699130,9cyclictest17680-21rm11:25:024
540699130,9cyclictest15746-21fschecks_time07:30:144
540699130,9cyclictest1566-21ssh10:05:044
540699130,9cyclictest14625-21runrttasks07:28:424
540699130,9cyclictest14153-21sh10:11:234
540699130,9cyclictest14086-21taskset09:35:444
540699130,9cyclictest13861-21ssh11:05:014
540699130,9cyclictest10345-21taskset07:20:014
540699130,9cyclictest10055-21apt-key10:45:014
540699130,10cyclictest3577-21ssh11:16:434
540699130,10cyclictest11515-21hddtemp_smartct12:15:154
540299135,6cyclictest21396-21aten2_r5power_v08:50:103
540299135,6cyclictest16664-21grep09:55:143
540299135,6cyclictest12689-21sendmail_mailqu08:30:203
540299131,9cyclictest17487-21runrttasks07:35:053
540299130,9cyclictest780-21runrttasks07:54:463
540299130,9cyclictest780-21runrttasks07:25:543
540299130,9cyclictest6603-21wget08:20:133
540299130,9cyclictest5364-21/usr/sbin/munin12:30:123
540299130,9cyclictest4249-21cpu08:15:123
540299130,9cyclictest24418-21kernelversion08:55:183
540299130,9cyclictest20221-21/usr/sbin/munin10:15:123
540299130,9cyclictest1246-21runrttasks08:07:043
540299130,9cyclictest12431-21diskmemload10:10:243
540299130,9cyclictest10382-21/usr/sbin/munin07:20:203
540299130,10cyclictest29597-21mailstats09:05:213
540299130,10cyclictest27057-21netstat09:25:173
540299130,10cyclictest22172-21ssh11:27:053
540299130,10cyclictest20046-21/usr/sbin/munin07:40:133
540299130,10cyclictest19271-21grep08:45:133
540299130,10cyclictest15143-21basename07:30:113
539899139,3cyclictest7769-21python308:20:212
539899131,9cyclictest5903-21runrttasks08:16:142
539899131,9cyclictest11834-21aten2_r5power_v09:35:122
539899131,8cyclictest534050latency_hist07:10:012
539899130,9cyclictest780-21runrttasks08:25:342
539899130,9cyclictest5653-21/usr/sbin/munin07:10:202
539899130,9cyclictest3489-21ssh12:10:242
539899130,9cyclictest32051-21/usr/sbin/munin09:10:182
539899130,9cyclictest30752-21switchtime08:00:232
539899130,9cyclictest28764-21runrttasks07:55:282
539899130,9cyclictest28384-21/usr/sbin/munin09:05:182
539899130,9cyclictest27711-21runrttasks09:00:472
539899130,9cyclictest26001-21sensors_temp07:50:222
539899130,9cyclictest16138-21missed_timers07:30:182
539899130,10cyclictest23572-21sendmail_mailqu07:45:202
539899130,10cyclictest18753-21mktemp08:45:012
539899130,10cyclictest18284-21runrttasks08:44:162
539899130,10cyclictest18284-21runrttasks08:44:162
539899130,10cyclictest16999-21sh12:00:172
539899130,10cyclictest12424-21missed_timers08:30:182
539899130,10cyclictest10899-21fschecks_time07:20:152
539299135,6cyclictest326-21systemd-journal07:44:591
539299131,7cyclictest10382-21/usr/sbin/munin07:20:191
539299130,9cyclictest780-21runrttasks08:13:051
539299130,9cyclictest4129-21/usr/sbin/munin08:15:111
539299130,9cyclictest31831-21/usr/sbin/munin08:05:121
539299130,9cyclictest31412-21diskstats09:10:141
539299130,9cyclictest28384-21/usr/sbin/munin09:05:191
539299130,9cyclictest25084-21sh12:05:051
539299130,9cyclictest23659-21/usr/sbin/munin08:55:181
539299130,9cyclictest19171-21cpuspeed_turbos08:45:131
539299130,9cyclictest15348-21aten2_r5power_c10:30:121
539299130,9cyclictest15348-21aten2_r5power_c10:30:121
539299130,9cyclictest13874-21/usr/sbin/munin08:35:201
539299130,9cyclictest13143-21unixbench_singl08:30:251
539299130,9cyclictest10552-21sh12:15:011
539299130,10cyclictest901-21needreboot11:15:171
539299130,10cyclictest26391-21df09:00:141
539299130,10cyclictest22627-21cat08:50:201
539299130,10cyclictest21192-21ssh12:20:221
539299130,10cyclictest18067-21fschecks_time07:35:151
539299130,10cyclictest14159-21ssh09:35:471
539299130,10cyclictest12767-21wget07:25:111
539299130,10cyclictest12554-21wget11:40:101
538799135,6cyclictest8444-21cut07:15:150
538799131,9cyclictest30390-21taskset09:09:350
538799131,6cyclictest24573-21missed_timers08:55:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional