You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 05:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Mon Aug 03, 2026 00:44:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
996439980,0EcMasterDemoSyn0-21swapper/221:55:202
548939970,1EcMasterDemoSyn5497-21runintdemo5min21:35:030
131132930,0sleep20-21swapper/222:34:102
37022880,1sleep43699-21apt-get19:15:124
631139830,0EcMasterDemoSyn632129tAtEmLog_020:29:075
548939830,0EcMasterDemoSyn549929tAtEmLog_021:35:035
127339830,0EcMasterDemoSyn128329tAtEmLog_023:21:315
812639820,0EcMasterDemoSyn813629tAtEmLog_000:02:075
682839820,0EcMasterDemoSyn683829tAtEmLog_023:06:185
492339820,0EcMasterDemoSyn493329tAtEmLog_022:10:325
3161739820,0EcMasterDemoSyn3162729tAtEmLog_020:13:555
3156039820,0EcMasterDemoSyn3157029tAtEmLog_023:57:015
2591539820,0EcMasterDemoSyn2592529tAtEmLog_000:12:145
2470339820,0EcMasterDemoSyn2471329tAtEmLog_023:16:275
2452339820,0EcMasterDemoSyn2453329tAtEmLog_019:58:425
2452339820,0EcMasterDemoSyn2453329tAtEmLog_019:58:425
2343039820,0EcMasterDemoSyn2344029tAtEmLog_021:45:115
157739820,0EcMasterDemoSyn158729tAtEmLog_020:18:595
1271239820,0EcMasterDemoSyn1272229tAtEmLog_019:33:215
82639810,0EcMasterDemoSyn83629tAtEmLog_019:08:005
320639810,0EcMasterDemoSyn321629tAtEmLog_019:13:045
2557539810,0EcMasterDemoSyn2558529tAtEmLog_021:09:415
2083939810,0EcMasterDemoSyn2084929tAtEmLog_020:59:335
1847939810,0EcMasterDemoSyn1848929tAtEmLog_020:54:295
1701239810,0EcMasterDemoSyn1702229tAtEmLog_000:07:115
1507039810,0EcMasterDemoSyn1508029tAtEmLog_019:38:255
1449239810,0EcMasterDemoSyn1450229tAtEmLog_021:40:075
1398239810,0EcMasterDemoSyn1399229tAtEmLog_022:15:375
2557539780,0EcMasterDemoSyn0-21swapper/321:09:413
2111639740,0EcMasterDemoSyn0-21swapper/122:56:101
1027639620,2EcMasterDemoSyn10281-21runintdemo5min23:26:350
1082992311,6cyclictest6731-21sed19:20:151
312662210,0sleep40-21swapper/422:07:314
108299200,14cyclictest29738-21sh21:30:151
108299200,10cyclictest6326-21ssh00:00:461
108699190,10cyclictest31107-21ssh23:02:012
108699190,10cyclictest23466-21sh00:29:492
108699190,10cyclictest1920-21ssh23:21:582
108699190,10cyclictest11619-21/usr/sbin/munin21:20:152
108299191,10cyclictest8863-21sh23:25:361
108299191,10cyclictest26208-21users00:30:251
108299190,9cyclictest30171-21sh23:01:191
108299190,10cyclictest9847-21sh23:08:271
108299190,10cyclictest5567-21ssh23:24:381
108299190,10cyclictest26506-21ssh23:35:361
108299190,10cyclictest23597-21/usr/sbin/munin21:05:221
997599180,8tDemoTimingTask15097-21chrt21:58:365
2868299180,10tDemoTimingTask29041-21chrt21:30:005
108699180,10cyclictest28848-21ssh21:47:562
108699180,10cyclictest26405-21/usr/sbin/munin22:05:192
108699180,10cyclictest2545-21ssh21:33:072
108699180,10cyclictest18695-21rm00:08:212
108699180,10cyclictest17909-21runrttasks19:45:112
108699180,10cyclictest1253-21runrttasks21:14:252
108299180,9cyclictest8984-21sh22:50:021
108299180,9cyclictest5382-21ssh22:10:501
108299180,10cyclictest24342-21ssh23:16:121
108299180,10cyclictest20028-21ssh00:09:201
3002399170,7tDemoTimingTask26370-21turbostat23:04:545
108299179,6cyclictest24587-21head21:45:191
108299170,10cyclictest18398-21runrttasks20:53:311
107799175,9cyclictest666-21gdbus19:35:190
107799171,11cyclictest21500-21aten2_r5power_c00:10:120
107799171,10cyclictest9812-21ssh00:03:170
107799170,9cyclictest14648-21sh22:16:040
107799170,9cyclictest10379-21sh22:14:250
107799170,14cyclictest2322-21sh23:04:390
107799170,14cyclictest2079-21sh21:14:590
107799170,14cyclictest17917-21sh23:30:470
997599160,11tDemoTimingTask177832sleep522:00:145
2298429160,10tAtEmLog_022995-21chrt22:20:415
1345029160,9tAtEmLog_018085-21taskset23:50:005
109599164,9cyclictest722-21postgres20:36:514
109599160,9cyclictest3872-21diskmemload00:36:204
109199166,5cyclictest12413-21head22:15:153
1091991612,3cyclictest28957-21cron22:25:003
109199160,9cyclictest7281-21sh22:12:123
109199160,9cyclictest3098-21sh23:22:503
109199160,9cyclictest16914-21ssh21:22:523
108699165,8cyclictest15265-21sendmail-msp19:40:002
108299163,9cyclictest532-21cat20:15:171
1082991612,3cyclictest20923-21sendmail20:59:591
108299160,9cyclictest13688-21sh22:15:241
107799165,8cyclictest25163-21runrttasks22:40:180
107799160,9cyclictest744-21runrttasks23:09:120
107799160,9cyclictest26040-21latency_hist22:05:000
107799160,9cyclictest15294-21rm23:11:000
107799160,7cyclictest23648-21ssh22:21:080
109599152,9cyclictest6863-21sh21:54:054
1095991512,2cyclictest8773-21cron20:35:014
109599150,9cyclictest7151-21ssh21:17:154
109599150,9cyclictest22215-21rm23:15:174
109599150,10cyclictest2873650latency_hist21:30:004
1091991512,2cyclictest666-21gdbus23:50:013
109199151,10cyclictest7746-21ssh21:35:303
109199151,10cyclictest29357-21chrt22:42:563
109199151,10cyclictest28804-21which23:55:193
109199151,10cyclictest17610-21runrttasks23:30:313
109199151,10cyclictest17178-21hddtemp_smartct20:50:153
109199150,9cyclictest5510-21ssh21:16:053
109199150,8cyclictest820050cat21:55:003
109199150,8cyclictest29790-21sh23:01:053
109199150,8cyclictest20586-21cut19:50:133
109199150,11cyclictest25303-21sh00:11:493
108699155,8cyclictest26049-21/usr/sbin/munin20:00:202
108699151,10cyclictest3308-21sh22:46:052
108699150,9cyclictest22327-21ssh21:44:362
108699150,10cyclictest32504-21ssh00:15:382
108299154,6cyclictest31580-21processes00:15:201
1082991511,3cyclictest644-21dbus-daemon00:40:011
1082991511,3cyclictest26658-21sed22:46:001
108299151,10cyclictest3202-21ssh21:51:251
108299151,10cyclictest21245-21/usr/sbin/munin21:00:171
108299150,11cyclictest21391-21sh00:10:081
107799157,6cyclictest31308-21grep00:15:180
107799156,7cyclictest878-21ssh22:26:440
107799156,7cyclictest22645-21sh00:29:120
107799150,9cyclictest3229-21runrttasks23:22:540
107799150,8cyclictest744-21runrttasks20:20:300
107799150,8cyclictest25655-21diskmemload00:07:120
107799150,6cyclictest10788-21switchtime22:50:240
2112629140,3tAtEmLog_022402-21chrt22:57:075
109599143,8cyclictest722-21postgres19:14:484
109599143,8cyclictest19012-21proc_pri19:45:204
109599143,8cyclictest12787-21cut20:40:184
109599142,9cyclictest18602-21ssh23:31:154
109599141,9cyclictest7988-21runrttasks19:23:194
109599141,9cyclictest27305-21cpuspeed_turbos23:00:134
1095991410,3cyclictest5423-21sh22:30:004
109599140,11cyclictest30131-21ssh23:20:094
109599140,10cyclictest7520-21sh22:49:114
109599140,10cyclictest6536-21ssh00:20:024
109599140,10cyclictest32739-21chrt21:13:464
109599140,10cyclictest32340-21rm23:39:544
109599140,10cyclictest2920-21runrttasks21:33:234
109599140,10cyclictest24973-21sh22:04:224
109599140,10cyclictest23404-21sh00:10:244
109599140,10cyclictest21142-21memory19:50:174
109599140,10cyclictest19498-21sh21:24:444
109599140,10cyclictest18157-21users20:50:264
109599140,10cyclictest18130-21sh00:07:564
109599140,10cyclictest17304-21chrt19:41:414
109599140,10cyclictest14896-21rm22:53:044
109599140,10cyclictest14692-21sh23:10:354
109599140,10cyclictest10830-21ssh21:37:424
109199149,2cyclictest171rcu_preempt19:30:003
109199145,7cyclictest18377-21gdbus23:50:003
109199141,9cyclictest6883-21grep00:20:113
109199141,9cyclictest4371-21runrttasks19:15:163
109199141,9cyclictest3765-21ssh00:00:063
109199141,9cyclictest26223-21mailstats20:00:223
109199141,9cyclictest1505-21sh00:16:413
109199141,6cyclictest50-21ksoftirqd/320:35:013
109199141,10cyclictest2074-21ssh21:32:473
109199140,9cyclictest11307-21sh23:27:193
109199140,7cyclictest2654-21/usr/sbin/munin19:10:243
109199140,10cyclictest8715-21/usr/sbin/munin21:55:143
109199140,10cyclictest744-21runrttasks20:28:113
109199140,10cyclictest744-21runrttasks19:45:153
109199140,10cyclictest744-21runrttasks19:36:273
109199140,10cyclictest686-21ssh22:26:373
109199140,10cyclictest6728-21/usr/sbin/munin20:30:163
109199140,10cyclictest651-21/usr/sbin/munin00:35:213
109199140,10cyclictest5933-21ssh23:05:403
109199140,10cyclictest5843-21ssh22:30:073
109199140,10cyclictest32246-21sh21:13:233
109199140,10cyclictest31684-21runrttasks20:14:193
109199140,10cyclictest28389-21/usr/sbin/munin20:05:193
109199140,10cyclictest27930-21switchtime22:05:233
109199140,10cyclictest2698-21idleruntime20:20:153
109199140,10cyclictest26932-21sh21:46:323
109199140,10cyclictest2570-21ssh22:45:353
109199140,10cyclictest24478-21sh23:16:183
109199140,10cyclictest24171-21ssh00:30:073
109199140,10cyclictest21544-21ssh00:28:243
109199140,10cyclictest21263-21rm22:56:163
109199140,10cyclictest2069-21/usr/sbin/munin23:40:193
109199140,10cyclictest20545-21/usr/sbin/munin21:25:223
109199140,10cyclictest17632-21sh22:36:023
109199140,10cyclictest17571-21ssh21:41:083
109199140,10cyclictest17518-21ssh22:00:103
109199140,10cyclictest17331-21sh23:12:283
109199140,10cyclictest15899-21taskset20:46:343
109199140,10cyclictest14395-21timerandwakeup00:05:253
109199140,10cyclictest12527-21ssh22:51:213
109199140,10cyclictest10833-21/usr/sbin/munin19:30:133
108699149,3cyclictest4984-21grep20:25:152
108699145,7cyclictest26202-21/usr/sbin/munin00:30:252
108699141,9cyclictest6430-21ssh21:53:452
108699141,9cyclictest20366-21ssh22:01:012
108699141,9cyclictest12324-21sh23:10:012
1086991410,3cyclictest25647-21cron21:10:002
108699140,9cyclictest12230-21sh22:51:092
108699140,12cyclictest12981-21cut19:35:002
108699140,12cyclictest12604-21irqstats22:15:162
108699140,11cyclictest25282-21ssh22:22:202
108699140,10cyclictest9437-21/usr/sbin/munin23:45:232
108699140,10cyclictest8971-21ssh21:36:222
108699140,10cyclictest8542-21chrt20:32:352
108699140,10cyclictest8380-21runrttasks22:12:592
108699140,10cyclictest8245-21ssh23:44:312
108699140,10cyclictest744-21runrttasks20:50:352
108699140,10cyclictest744-21runrttasks20:15:362
108699140,10cyclictest6039-21sh23:05:452
108699140,10cyclictest5866-21sh00:00:272
108699140,10cyclictest5525-21runrttasks19:17:462
108699140,10cyclictest32220-21rm23:57:302
108699140,10cyclictest31735-21cron20:15:002
108699140,10cyclictest31043-21rm23:38:562
108699140,10cyclictest28231-21sh00:13:552
108699140,10cyclictest27342-21/usr/sbin/munin20:05:172
108699140,10cyclictest26112-21diskmemload22:40:352
108699140,10cyclictest25724-21runrttasks22:59:312
108699140,10cyclictest2448-21fschecks_count20:20:132
108699140,10cyclictest23545-21sh23:15:362
108699140,10cyclictest22770-21diskmemload21:25:412
108699140,10cyclictest22601-21sh23:51:542
108699140,10cyclictest21245-21/usr/sbin/munin21:00:202
108699140,10cyclictest20546-21runrttasks22:38:092
108699140,10cyclictest19402-21cut20:55:172
108699140,10cyclictest14622-21ssh00:24:452
108699140,10cyclictest1345-21/usr/sbin/munin19:10:252
108699140,10cyclictest1185-21sendmail-mta21:17:342
108299146,6cyclictest644-21dbus-daemon21:20:201
108299142,8cyclictest7278-21fschecks_time00:20:141
108299141,9cyclictest14164-21/usr/sbin/munin20:45:141
108299141,9cyclictest12906-21awk20:40:201
108299141,10cyclictest6715-21rm22:30:161
108299141,10cyclictest5499-21runrttasks19:17:251
108299140,9cyclictest10833-21/usr/sbin/munin19:30:161
108299140,12cyclictest20458-21ssh21:25:101
108299140,10cyclictest9494-21ssh23:45:131
108299140,10cyclictest8752-21rm21:36:131
108299140,10cyclictest8489-21aten2_r5power_p19:25:131
108299140,10cyclictest7557-21cat20:30:181
108299140,10cyclictest744-21runrttasks19:48:191
108299140,10cyclictest744-21runrttasks19:10:301
108299140,10cyclictest4839-21fschecks_time20:25:151
108299140,10cyclictest3187-21sh23:59:581
108299140,10cyclictest31407-21ssh21:12:471
108299140,10cyclictest29531-21/usr/sbin/munin22:25:221
108299140,10cyclictest2729-21if_enp6s020:20:151
108299140,10cyclictest26992-21ssh22:41:101
108299140,10cyclictest26239-21sh22:05:041
108299140,10cyclictest25519-21fschecks_time20:00:171
108299140,10cyclictest22788-21cpuspeed19:55:141
108299140,10cyclictest22788-21cpuspeed19:55:141
108299140,10cyclictest22028-21chrt19:51:511
108299140,10cyclictest20666-21/usr/sbin/munin22:20:141
108299140,10cyclictest20368-21ssh21:43:101
108299140,10cyclictest18708-21grep22:00:191
108299140,10cyclictest18079-21sh22:36:211
108299140,10cyclictest15555-21/usr/sbin/munin19:40:171
108299140,10cyclictest15275-21ssh23:30:021
108299140,10cyclictest13185-21apt19:35:101
108299140,10cyclictest12839-21ssh21:56:581
108299140,10cyclictest12367-21ssh23:10:031
108299140,10cyclictest11118-21taskset20:35:501
108299140,10cyclictest10519-21sh21:19:391
107799145,7cyclictest7501-21basename00:20:150
107799145,7cyclictest14570-21grep21:40:090
107799145,7cyclictest1450-21cat22:45:170
107799143,8cyclictest8135-21sh21:55:000
107799141,10cyclictest31110-21sh23:38:590
107799140,9cyclictest16092-21grep19:40:120
107799140,8cyclictest23727-21tr21:45:140
107799140,7cyclictest24507-21sed21:05:190
107799140,6cyclictest30934-21find21:30:260
107799140,12cyclictest22888-21ssh23:52:050
107799140,12cyclictest20433-21ssh21:25:090
107799140,12cyclictest10895-21chrt21:19:540
107799140,10cyclictest5761-21sh22:30:030
107799140,10cyclictest329-21systemd-journal20:18:280
107799140,10cyclictest3263-21chrt19:13:200
107799140,10cyclictest30228-21fschecks_time20:10:140
107799140,10cyclictest29311-21sh22:06:060
107799140,10cyclictest27560-21sh00:31:240
107799140,10cyclictest27293-21rm23:55:070
107799140,10cyclictest21152-21sh23:15:040
107799140,10cyclictest20883-21rm22:56:010
107799140,10cyclictest19295-21ssh21:24:350
107799140,10cyclictest17549-21runrttasks22:35:580
107799140,10cyclictest1708-21/usr/sbin/munin00:35:210
107799140,10cyclictest15676-21sh23:48:300
107799140,10cyclictest1475-21ssh23:40:160
632129130,2tAtEmLog_08656-21chrt20:34:095
2453499130,10tDemoTimingTask25341-21taskset20:00:155
2267929131,10tAtEmLog_022793-21taskset23:52:025
109599139,3cyclictest4085-21fschecks_count23:05:144
109599131,9cyclictest30081-21sh23:55:574
109599131,9cyclictest17950-21sh22:55:044
109599131,8cyclictest644-21dbus-daemon22:40:024
109599130,9cyclictest8423-21/usr/sbin/munin19:25:134
109599130,9cyclictest7956-21ssh22:30:294
109599130,9cyclictest744-21runrttasks23:25:344
109599130,9cyclictest6615-21ssh00:01:004
109599130,9cyclictest484-21diskmemload23:40:064
109599130,9cyclictest31901-21sed20:15:004
109599130,9cyclictest30559-21cpuspeed_turbos00:15:154
109599130,9cyclictest24268-21hddtemp_smartct21:05:164
109599130,9cyclictest23958-21sed19:55:264
109599130,9cyclictest23958-21sed19:55:264
109599130,9cyclictest23298-21ssh21:45:064
109599130,9cyclictest21826-21gltestperf21:00:154
109599130,9cyclictest20666-21/usr/sbin/munin22:20:194
109599130,9cyclictest20595-21chrt20:56:244
109599130,9cyclictest2020-21/usr/sbin/munin20:20:224
109599130,9cyclictest18549-21sh23:50:094
109599130,9cyclictest17628-21ssh00:25:344
109599130,9cyclictest14615-21/usr/sbin/munin21:40:194
109599130,9cyclictest14164-21/usr/sbin/munin20:45:204
109599130,9cyclictest12674-21chrt19:32:584
109599130,9cyclictest12422-21sh21:56:404
109599130,9cyclictest1213-21sed19:10:004
109599130,9cyclictest11532-21sh22:15:024
109599130,10cyclictest9182-21latency_hist23:45:014
109599130,10cyclictest4876-21ssh22:10:304
109599130,10cyclictest26586-21sh00:30:424
109599130,10cyclictest25624-21grep20:00:174
109599130,10cyclictest15850-21ssh22:35:184
109599130,10cyclictest13183-21/usr/sbin/munin19:35:114
109199135,6cyclictest21973-21if_err_enp6s021:00:163
109199131,9cyclictest22619-21/usr/sbin/munin19:55:213
109199131,9cyclictest22619-21/usr/sbin/munin19:55:203
109199130,9cyclictest32713-21hddtemp_smartct20:15:153
109199130,9cyclictest24189-21ssh23:35:073
109199130,9cyclictest18869-21/usr/sbin/munin20:55:153
109199130,10cyclictest7787-21runrttasks19:21:133
109199130,10cyclictest15555-21/usr/sbin/munin19:40:103
109199130,10cyclictest13062-21sensors_volt20:40:203
108699134,7cyclictest20797-21/usr/sbin/munin19:50:142
108699130,9cyclictest8813-21rm23:25:342
108699130,9cyclictest8733-21cpuspeed_turbos19:25:142
108699130,9cyclictest744-21runrttasks20:44:202
108699130,9cyclictest744-21runrttasks19:21:232
108699130,9cyclictest583-21ssh00:35:122
108699130,9cyclictest17882-21latency_hist19:45:012
108699130,9cyclictest1177-21latency_hist19:10:002
108699130,9cyclictest11131-21runrttasks20:35:582
108699130,10cyclictest32441-21sh22:26:072
108699130,10cyclictest24402-21taskset19:57:102
108699130,10cyclictest24402-21taskset19:57:102
108699130,10cyclictest16238-21chrt23:30:152
108699130,10cyclictest14382-21cpuspeed_turbos20:45:142
108299130,9cyclictest576-21/usr/sbin/munin23:40:131
108299130,9cyclictest31401-21runrttasks20:11:091
108299130,9cyclictest27544-21/usr/sbin/munin20:05:131
108299130,9cyclictest15284-21sh00:25:021
108299130,10cyclictest18526-21sh23:50:061
107799130,9cyclictest9492-21/usr/sbin/munin19:25:200
107799130,9cyclictest7819-21runrttasks19:21:400
107799130,9cyclictest744-21runrttasks21:03:090
107799130,9cyclictest744-21runrttasks20:04:550
107799130,9cyclictest744-21runrttasks19:34:050
107799130,9cyclictest5299-21head19:15:250
107799130,9cyclictest21056-21latency19:50:180
107799130,9cyclictest20626-21taskset20:56:500
107799130,7cyclictest470-21gltestperf21:50:150
107799130,7cyclictest102-1kworker/0:1H+kblockd20:45:450
107799130,7cyclictest102-1kworker/0:1H+kblockd20:38:330
107799130,7cyclictest102-1kworker/0:1H+kblockd19:55:320
107799130,7cyclictest102-1kworker/0:1H+kblockd19:55:320
107799130,10cyclictest27507-21grep20:05:130
107799130,10cyclictest19617-21chrt19:46:070
107799130,10cyclictest18177-21taskset20:50:320
107799130,10cyclictest12015-21wc20:40:130
558739120,2EcMasterDemoSyn651irq_work/500:37:355
2023529124,0tAtEmLog_00-21swapper/500:32:075
1613099120,7tDemoTimingTask16248-21taskset20:50:005
109599124,6cyclictest27720-21fschecks_count20:05:144
109599120,9cyclictest32164-21grep20:15:124
109599120,8cyclictest744-21runrttasks20:25:054
109199120,7cyclictest1192-21latency_hist19:10:003
108299120,9cyclictest1093-21latency_hist19:10:001
1079099122,7tDemoTimingTask15594-21chrt21:21:535
107799124,6cyclictest6971-21cpuspeed_turbos20:30:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional