You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 16:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Thu Mar 19, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2912039920,0EcMasterDemoSyn2913029tAtEmLog_009:07:255
1839039920,9EcMasterDemoSyn1840029tAtEmLog_007:36:085
3069739870,0EcMasterDemoSyn3070529tAtEmLog_009:27:415
660939830,0EcMasterDemoSyn661929tAtEmLog_010:08:165
660939830,0EcMasterDemoSyn661929tAtEmLog_010:08:155
3039639830,0EcMasterDemoSyn3040629tAtEmLog_008:01:295
2565939830,0EcMasterDemoSyn2566929tAtEmLog_007:51:215
750539820,0EcMasterDemoSyn751529tAtEmLog_008:21:465
652339820,0EcMasterDemoSyn653329tAtEmLog_007:10:475
516739820,0EcMasterDemoSyn517729tAtEmLog_012:30:155
2801339820,0EcMasterDemoSyn2802329tAtEmLog_007:56:265
1609639820,0EcMasterDemoSyn1610629tAtEmLog_010:48:505
893439810,0EcMasterDemoSyn894429tAtEmLog_007:15:525
1608039810,0EcMasterDemoSyn1609029tAtEmLog_010:13:215
1608039810,0EcMasterDemoSyn1609029tAtEmLog_010:13:205
1514239810,0EcMasterDemoSyn1515229tAtEmLog_011:24:205
1367239810,0EcMasterDemoSyn1368229tAtEmLog_007:25:595
1222239810,0EcMasterDemoSyn1223229tAtEmLog_008:31:555
166902670,0sleep00-21swapper/007:35:120
301292220,0sleep40-21swapper/411:14:504
1459399190,0tDemoTimingTask0-21swapper/508:37:025
426499185,9cyclictest326-21systemd-journal07:42:483
426199181,12cyclictest16-1pr/legacy09:42:541
426199180,13cyclictest16-1pr/legacy08:11:371
426199180,13cyclictest16-1pr/legacy08:11:361
426099180,10cyclictest17403-21sh12:36:590
173572180,0sleep50-21swapper/509:55:415
1176429180,8tAtEmLog_014439-21chrt09:54:595
426499175,9cyclictest716-21snmpd12:13:463
426099175,10cyclictest780-21runrttasks09:13:190
426099174,9cyclictest29408-21sh10:38:380
426099170,9cyclictest780-21runrttasks12:07:110
426099170,9cyclictest780-21runrttasks07:11:350
426099170,9cyclictest5176-21sh11:54:500
426099170,9cyclictest4963-21ssh11:18:340
426099170,9cyclictest31736-21sh09:28:250
426099170,9cyclictest29467-21sh11:31:420
426099170,9cyclictest16012-21sh11:06:160
426099170,9cyclictest12854-21sh10:46:320
426099170,14cyclictest18457-21sh12:20:070
2331499170,10tDemoTimingTask23608-21chrt07:49:555
1415029170,7tAtEmLog_017591-21taskset12:00:535
1415029170,7tAtEmLog_017591-21taskset12:00:525
1132599170,7tDemoTimingTask11640-21chrt07:24:515
501699160,9tDemoTimingTask5022-21taskset11:54:465
4264991612,3cyclictest645-21avahi-daemon11:35:003
426499160,9cyclictest3526-21sh11:00:003
426499160,9cyclictest16618-21sh12:19:053
4262991612,3cyclictest23507-21sh10:00:012
426299160,9cyclictest31388-21ssh09:10:202
426199165,6cyclictest997-21sh10:05:131
426199165,6cyclictest997-21sh10:05:131
426199160,9cyclictest24573-21sh10:17:561
426099160,9cyclictest780-21runrttasks10:29:290
426099160,9cyclictest780-21runrttasks07:19:090
426099160,8cyclictest5837-21sh11:00:290
426099160,8cyclictest12938-21sh09:53:520
426099160,7cyclictest23253-21sh09:24:020
426099160,10cyclictest6194-21ssh10:08:000
426099160,10cyclictest6194-21ssh10:07:590
426099160,10cyclictest1037-21ssh10:22:490
2920829160,9tAtEmLog_030289-21chrt11:14:565
2755729160,6tAtEmLog_032442-21chrt12:27:335
2676239160,0EcMasterDemoSyn0-21swapper/509:02:205
2118429160,9tAtEmLog_024678-21taskset09:25:005
1468329160,7tAtEmLog_016302-21chrt12:36:115
426999159,5cyclictest6576-21tail10:25:234
426999154,8cyclictest20285-21cut08:50:124
426499150,9cyclictest10949-21sh10:28:233
426499150,3cyclictest170-1kworker/3:1H+kblockd09:24:593
426499150,10cyclictest5963-21/usr/sbin/munin11:55:123
426499150,10cyclictest5963-21/usr/sbin/munin11:55:113
426499150,10cyclictest15189-21sh10:12:433
426499150,10cyclictest15189-21sh10:12:423
426299152,10cyclictest16-1pr/legacy10:58:582
426299151,10cyclictest17825-21timerwakeupswit09:20:242
426299150,9cyclictest19805-21ssh12:38:412
426299150,10cyclictest21672-21ssh10:15:552
426199152,9cyclictest17960-21sh10:31:551
4261991512,2cyclictest28168-21kworker/1:1+events11:49:401
4261991511,3cyclictest6759-21gltestperf09:50:131
426199151,10cyclictest13979-21chrt07:29:431
426199150,11cyclictest9774-21ssh10:27:341
426099156,7cyclictest28935-21ssh12:25:200
426099156,7cyclictest15420-21fschecks_count09:55:130
426099154,8cyclictest326-21systemd-journal08:11:280
426099154,8cyclictest326-21systemd-journal08:11:270
426099151,7cyclictest23503-21cat12:05:010
426099151,7cyclictest23503-21cat12:05:000
426099151,4cyclictest21386-21memory09:40:190
426099150,8cyclictest2788-21fschecks_count11:35:120
426099150,8cyclictest27838-21sh10:01:410
426099150,8cyclictest1695-21sh10:58:570
426099150,13cyclictest21444-21cat07:45:000
1459399150,6tDemoTimingTask16884-21chrt08:41:115
426999147,6cyclictest903-21gpm10:05:584
426999147,6cyclictest903-21gpm10:05:574
426999146,2cyclictest0-21swapper/407:15:154
426999145,7cyclictest19577-21latency_hist08:50:004
426999144,7cyclictest14493-21kworker/u24:3+nfsiod09:51:484
426999141,9cyclictest22903-21/usr/sbin/munin10:35:124
426999141,9cyclictest18493-21/usr/sbin/munin12:20:174
426999141,10cyclictest4829-21/usr/sbin/munin07:10:134
426999141,10cyclictest14108-21sh11:40:594
4269991410,3cyclictest811-21runintdemo5min12:25:114
426999140,9cyclictest28480-21ssh10:02:154
426999140,9cyclictest18204-21ssh09:20:344
426999140,10cyclictest780-21runrttasks08:16:464
426999140,10cyclictest31111-21ntpq09:10:174
426999140,10cyclictest2869-21ssh11:35:134
426999140,10cyclictest28066-21uname09:05:194
426999140,10cyclictest22182-21sh11:27:564
426999140,10cyclictest19551-21rm12:38:314
426999140,10cyclictest15022-21basename07:30:144
426499141,9cyclictest366-21sh10:05:053
426499141,9cyclictest366-21sh10:05:043
426499141,9cyclictest28861-21sendmail_mailtr12:25:173
426499141,9cyclictest26460-21ssh11:48:233
426499141,9cyclictest22589-21runrttasks08:55:123
426499141,9cyclictest17521-21sh10:49:523
426499141,11cyclictest16-1pr/legacy11:54:453
426499141,10cyclictest1951-21sh10:23:273
426499141,10cyclictest16-1pr/legacy08:36:593
426499140,9cyclictest27217-21ssh10:37:033
426499140,9cyclictest21967-21ssh10:34:443
426499140,8cyclictest18360-21ps12:20:063
426499140,12cyclictest24001-21aten2_r5power_p12:05:103
426499140,10cyclictest939-21/usr/sbin/munin08:10:193
426499140,10cyclictest939-21/usr/sbin/munin08:10:183
426499140,10cyclictest780-21runrttasks11:07:163
426499140,10cyclictest716-21snmpd09:15:213
426499140,10cyclictest5542-21ssh09:31:253
426499140,10cyclictest5260-21sh11:36:093
426499140,10cyclictest3694-21ssh11:17:403
426499140,10cyclictest31037-21cut08:05:123
426499140,10cyclictest31037-21cut08:05:113
426499140,10cyclictest30612-21ssh10:03:423
426499140,10cyclictest30216-21unixbench_multi08:00:223
426499140,10cyclictest29883-21/usr/sbin/munin09:10:103
426499140,10cyclictest29464-21sh09:26:493
426499140,10cyclictest28281-21ssh11:13:333
426499140,10cyclictest25604-21sshd07:50:463
426499140,10cyclictest25320-21cat11:29:593
426499140,10cyclictest24698-21sh10:53:373
426499140,10cyclictest23644-21ssh09:41:203
426499140,10cyclictest22183-21rm10:16:173
426499140,10cyclictest18596-21cp07:37:043
426499140,10cyclictest18264-21ssh09:56:203
426499140,10cyclictest17564-21ssh12:00:523
426499140,10cyclictest17564-21ssh12:00:513
426499140,10cyclictest17524-21/usr/sbin/munin08:45:233
426499140,10cyclictest16068-21sh12:36:013
426499140,10cyclictest1521-21ssh09:47:173
426499140,10cyclictest13761-21sh11:40:453
426499140,10cyclictest12810-21ssh11:22:423
426499140,10cyclictest10522-21runrttasks09:52:113
426299145,7cyclictest23250-21expr10:35:112
426299143,6cyclictest2352-21cat08:10:242
426299143,6cyclictest2352-21cat08:10:232
426299141,9cyclictest30822-21sh10:20:562
426299141,9cyclictest29366-21diskmemload11:13:262
426299141,9cyclictest23082-21sh09:40:572
426299141,9cyclictest21764-21ssh10:51:322
426299141,9cyclictest17980-21sh09:38:422
426299141,9cyclictest11496-21runrttasks07:22:512
426299140,11cyclictest29806-21fschecks_count09:45:162
426299140,10cyclictest9157-21ssh11:56:172
426299140,10cyclictest9157-21ssh11:56:172
426299140,10cyclictest780-21runrttasks10:33:452
426299140,10cyclictest7413-21diskstats09:15:142
426299140,10cyclictest6298-21sh11:00:482
426299140,10cyclictest5580-21rm11:19:012
426299140,10cyclictest5316-21missed_timers12:30:162
426299140,10cyclictest5044-21grep07:10:132
426299140,10cyclictest469-21sh10:05:092
426299140,10cyclictest469-21sh10:05:082
426299140,10cyclictest4068-21users09:30:242
426299140,10cyclictest326-21systemd-journal07:36:472
426299140,10cyclictest29544-21taskset12:25:292
426299140,10cyclictest27448-21ssh10:01:252
426299140,10cyclictest26476-21sh09:25:172
426299140,10cyclictest24431-21sh11:46:562
426299140,10cyclictest22881-21rm12:22:072
426299140,10cyclictest2187-21sh11:35:072
426299140,10cyclictest18522-21ssh11:44:082
426299140,10cyclictest17888-21ssh12:01:062
426299140,10cyclictest17888-21ssh12:01:052
426299140,10cyclictest17315-21perl11:25:142
426299140,10cyclictest15699-21ssh10:13:042
426299140,10cyclictest15699-21ssh10:13:032
426299140,10cyclictest14746-21sh11:24:042
426299140,10cyclictest14534-21cpuspeed_turbos07:30:112
426299140,10cyclictest13148-21sh08:35:142
426299140,10cyclictest12798-21rm11:05:082
426299140,10cyclictest11570-21processes08:30:182
426299140,10cyclictest11140-21xargs12:15:222
426199148,4cyclictest16-1pr/legacy09:37:491
426199146,6cyclictest5140-21grep07:10:141
426199144,7cyclictest26317-21kworker/u24:4+nfsiod10:36:131
426199142,9cyclictest865-21ssh09:46:491
426199141,9cyclictest434-21sh09:11:071
426199141,9cyclictest30959-21/usr/sbin/munin11:15:201
426199141,9cyclictest29272-21ssh10:55:261
426199141,9cyclictest14895-21ssh09:19:331
426199141,10cyclictest19506-21sh09:21:271
426199141,10cyclictest16-1pr/legacy11:04:011
426199140,8cyclictest24564-21sh10:00:141
426199140,7cyclictest22769-21ssh12:22:021
426199140,11cyclictest11681-21df_inode11:40:111
426199140,10cyclictest9653-21ssh11:56:381
426199140,10cyclictest9653-21ssh11:56:381
426199140,10cyclictest910-21cat08:10:001
426199140,10cyclictest7227-21ssh10:44:081
426199140,10cyclictest5836-21runrttasks11:36:331
426199140,10cyclictest5672-21taskset08:20:031
426199140,10cyclictest4804-21ssh12:30:131
426199140,10cyclictest4573-21ssh12:11:551
426199140,10cyclictest32277-21sh12:27:271
426199140,10cyclictest29374-21ssh11:50:101
426199140,10cyclictest29054-21sh11:31:241
426199140,10cyclictest28648-21/usr/sbin/munin08:00:161
426199140,10cyclictest27388-21basename09:05:131
426199140,10cyclictest24470-21perl12:05:131
426199140,10cyclictest23541-21needreboot08:55:191
426199140,10cyclictest18663-21ssh12:01:391
426199140,10cyclictest18663-21ssh12:01:381
426199140,10cyclictest14104-21rm10:11:571
426199140,10cyclictest14104-21rm10:11:561
426199140,10cyclictest13438-21/usr/sbin/munin11:05:141
426199140,10cyclictest13284-21sh12:16:411
426199140,10cyclictest13107-21sh10:46:431
426199140,10cyclictest11952-21chrt11:22:051
426099147,6cyclictest22540-21grep11:10:130
426099146,6cyclictest11504-21taskset10:10:230
426099146,6cyclictest11504-21taskset10:10:220
426099143,8cyclictest174-1kworker/0:1H+kblockd08:31:040
426099143,10cyclictest4457-21cpuspeed12:30:110
426099142,9cyclictest1126-21sh09:47:000
426099141,9cyclictest780-21runrttasks08:00:020
426099141,9cyclictest27999-21chrt07:56:210
426099141,9cyclictest13032-21cpuspeed_turbos08:35:130
426099141,12cyclictest174-1kworker/0:1H+kblockd09:15:350
426099141,10cyclictest16-1pr/legacy09:32:440
426099140,7cyclictest25955-21sh10:54:280
426099140,7cyclictest21718-21ssh10:15:550
426099140,7cyclictest174-1kworker/0:1H+kblockd12:10:380
426099140,7cyclictest13842-21sh11:23:250
426099140,12cyclictest32382-21wget10:40:100
426099140,12cyclictest21814-21sh11:45:210
426099140,12cyclictest174-1kworker/0:1H+kblockd08:45:450
426099140,12cyclictest15987-21sh10:30:320
426099140,10cyclictest780-21runrttasks08:58:020
426099140,10cyclictest780-21runrttasks08:40:510
426099140,10cyclictest25153-21cpuspeed09:00:130
426099140,10cyclictest12072-21idleruntime11:40:140
426099140,10cyclictest11676-21sh11:58:050
426099140,10cyclictest11676-21sh11:58:050
426099140,10cyclictest11631-21cut09:35:110
426099140,10cyclictest10084-21grep12:15:140
426999139,3cyclictest715-21cpuspeed_turbos12:10:114
426999135,6cyclictest30815-21ssh09:45:224
426999135,6cyclictest2988-21cron08:15:014
426999135,6cyclictest2988-21cron08:15:004
426999130,9cyclictest9611-21/usr/sbin/munin07:20:104
426999130,9cyclictest9237-21sh10:45:094
426999130,9cyclictest8611-21sh11:02:244
426999130,9cyclictest780-21runrttasks07:45:044
426999130,9cyclictest7742-21taskset08:24:304
426999130,9cyclictest716-21snmpd08:05:584
426999130,9cyclictest716-21snmpd08:05:574
426999130,9cyclictest6275-21ssh12:30:244
426999130,9cyclictest6016-21aten2_r5power_e11:55:124
426999130,9cyclictest6016-21aten2_r5power_e11:55:114
426999130,9cyclictest31939-21ssh11:50:524
426999130,9cyclictest3102-21sh11:17:154
426999130,9cyclictest28549-21proc_pri10:55:194
426999130,9cyclictest28493-21sh10:20:124
426999130,9cyclictest26925-21python309:25:214
426999130,9cyclictest25491-21ssh11:30:014
426999130,9cyclictest24970-21ssh09:42:174
426999130,9cyclictest24955-21/usr/sbin/munin09:00:264
426999130,9cyclictest24811-21ssh12:05:154
426999130,9cyclictest23276-21cat08:55:174
426999130,9cyclictest21215-21ssh10:15:354
426999130,9cyclictest20145-21sh11:45:034
426999130,9cyclictest18007-21ssh10:31:584
426999130,9cyclictest16671-21/usr/sbin/munin07:35:124
426999130,9cyclictest15669-21ssh12:18:244
426999130,9cyclictest15556-21fschecks_time12:00:154
426999130,9cyclictest15556-21fschecks_time12:00:144
426999130,9cyclictest15256-21rm09:36:484
426999130,9cyclictest14964-21/usr/sbin/munin09:55:124
426999130,9cyclictest14855-21latency_hist08:40:004
426999130,9cyclictest1314-21sh10:40:194
426999130,9cyclictest12684-21ssh11:05:044
426999130,9cyclictest12037-21rm10:10:284
426999130,9cyclictest12037-21rm10:10:284
426999130,10cyclictest780-21runrttasks07:25:094
426999130,10cyclictest716-21snmpd08:33:254
426999130,10cyclictest7113-21ssh09:15:124
426999130,10cyclictest21188-21chrt07:44:004
426999130,10cyclictest18100-21rm10:50:044
426999130,10cyclictest10081-21chrt08:29:204
426999130,10cyclictest10016-21ssh11:20:434
426499139,3cyclictest467-21head10:40:143
426499130,9cyclictest9259-21runrttasks07:19:473
426499130,9cyclictest8243-21sh12:31:463
426499130,9cyclictest811-21runintdemo5min09:07:263
426499130,9cyclictest8090-21/usr/sbin/munin08:25:123
426499130,9cyclictest780-21runrttasks08:40:203
426499130,9cyclictest6934-21latency_hist07:15:003
426499130,9cyclictest5672-21runrttasks08:20:023
426499130,9cyclictest3320-21aten2_r5power_c08:15:113
426499130,9cyclictest326-21systemd-journal07:20:093
426499130,9cyclictest27041-21ssh10:55:013
426499130,9cyclictest26273-21/usr/sbin/munin07:55:173
426499130,9cyclictest24955-21/usr/sbin/munin09:00:193
426499130,9cyclictest21576-21/usr/sbin/munin07:45:193
426499130,9cyclictest20176-21/usr/sbin/munin08:50:173
426499130,9cyclictest14316-21munin-node07:30:093
426499130,9cyclictest11947-21latency_hist07:25:013
426499130,9cyclictest11286-21/usr/sbin/munin09:35:103
426499130,9cyclictest10443-21/usr/sbin/munin08:30:163
426299131,9cyclictest7236-21/usr/sbin/munin07:15:142
426299131,9cyclictest20525-21switchtime07:40:232
426299131,8cyclictest26269-21diskmemload11:30:132
426299131,7cyclictest26311-21/usr/sbin/munin07:55:102
426299130,9cyclictest9087-21sh10:45:012
426299130,9cyclictest8090-21/usr/sbin/munin08:25:122
426299130,9cyclictest780-21runrttasks09:01:112
426299130,9cyclictest5800-21ssh09:50:022
426299130,9cyclictest5669-21latency_hist08:20:012
426299130,9cyclictest31000-21/usr/sbin/munin08:05:202
426299130,9cyclictest31000-21/usr/sbin/munin08:05:192
426299130,9cyclictest29221-21sh11:50:052
426299130,9cyclictest29076-21runrttasks09:06:552
426299130,9cyclictest26148-21ssh12:05:362
426299130,9cyclictest2283-21sh10:40:432
426299130,9cyclictest21939-21runrttasks07:45:142
426299130,9cyclictest21882-21chrt08:51:042
426299130,9cyclictest17524-21/usr/sbin/munin08:45:142
426299130,9cyclictest15171-21/usr/sbin/munin08:40:232
426299130,10cyclictest780-21runrttasks07:25:042
426299130,10cyclictest4573-21ssh10:25:042
426299130,10cyclictest29763-21proc_pri08:00:182
426299130,10cyclictest24158-21tr07:50:132
426299130,10cyclictest22936-21df08:55:142
426299130,10cyclictest1267-21ssh12:10:142
426199131,9cyclictest5139-21runrttasks08:17:071
426199130,9cyclictest9210-21taskset07:19:041
426199130,9cyclictest394-21taskset08:07:311
426199130,9cyclictest29795-21cat10:20:231
426199130,9cyclictest26704-21runrttasks09:01:421
426199130,9cyclictest25305-21ssh09:25:041
426199130,9cyclictest24771-21sh11:11:031
426199130,9cyclictest23923-21/usr/sbin/munin07:50:201
426199130,9cyclictest21563-21taskset07:45:021
426199130,9cyclictest21037-21latency08:50:161
426199130,9cyclictest1994-21runrttasks09:30:051
426199130,9cyclictest19243-21aten2_r5power_c07:40:111
426199130,9cyclictest16507-21ssh11:25:031
426199130,9cyclictest15164-21runrttasks08:40:051
426199130,9cyclictest14893-21rm09:55:071
426199130,9cyclictest14326-21taskset07:30:101
426199130,9cyclictest13237-21aten2_r5power_e12:35:101
426199130,9cyclictest12798-21/usr/sbin/munin08:35:181
426199130,9cyclictest10443-21/usr/sbin/munin08:30:231
426199130,10cyclictest9776-21grep07:20:111
426199130,10cyclictest9610-21unixbench-2d08:25:241
426199130,10cyclictest18415-21cpu10:50:141
426199130,10cyclictest18208-21basename08:45:161
426099130,9cyclictest780-21runrttasks08:25:050
426099130,9cyclictest6780-21ntp_kernel_err08:20:180
426099130,9cyclictest18397-21wc11:25:230
426099130,9cyclictest14354-21aten2_r5power_e07:30:100
426099130,8cyclictest21810-21grep07:45:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional