You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 14:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Thu Jun 11, 2026 12:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
144272830,0sleep10-21swapper/110:45:181
144272830,0sleep10-21swapper/110:45:171
1399539830,0EcMasterDemoSyn1400529tAtEmLog_008:25:135
1899139820,0EcMasterDemoSyn1900129tAtEmLog_007:29:265
1843539820,0EcMasterDemoSyn1844529tAtEmLog_010:11:425
951839810,0EcMasterDemoSyn952829tAtEmLog_007:09:095
366439810,0EcMasterDemoSyn367429tAtEmLog_008:04:575
2590639810,0EcMasterDemoSyn2591629tAtEmLog_011:27:465
2717139770,1EcMasterDemoSyn27178-21runintdemo5min08:50:353
3128339710,0EcMasterDemoSyn0-21swapper/407:54:494
9687993128,2cyclictest16639-21kworker/2:0+events07:30:392
276872270,0sleep50-21swapper/512:22:405
1843539270,1EcMasterDemoSyn18443-21grep10:11:430
9684992623,2cyclictest19736-21kworker/1:0+events09:11:061
9697992422,2cyclictest10629-21kworker/4:1+events10:23:074
9697992422,2cyclictest10629-21kworker/4:1+events09:16:354
9693992321,2cyclictest24493-21kworker/3:2+events10:23:043
9684992218,3cyclictest19736-21kworker/1:0+events08:33:501
6326992120,0tDemoTimingTask0-21swapper/508:12:275
9697992017,2cyclictest10629-21kworker/4:1+events10:54:154
9684992017,2cyclictest19736-21kworker/1:0+events07:21:281
9693991917,2cyclictest24493-21kworker/3:2+events11:57:433
9684991917,2cyclictest19736-21kworker/1:0+events08:18:211
9697991815,2cyclictest10629-21kworker/4:1+events10:59:324
9693991814,3cyclictest24493-21kworker/3:2+events11:10:593
9684991815,2cyclictest19736-21kworker/1:0+events07:38:271
967999180,14cyclictest16087-21sh11:22:120
967999180,14cyclictest14965-21ssh10:45:230
967999180,14cyclictest14965-21ssh10:45:220
115692180,0sleep00-21swapper/012:13:560
969799175,9cyclictest716-21snmpd12:13:344
9693991715,2cyclictest24493-21kworker/3:2+events07:15:313
969399170,9cyclictest17760-21ssh09:53:523
968799175,8cyclictest648-21dbus-daemon09:42:212
968799174,9cyclictest11364-21munin-plugin-st09:15:012
9687991714,2cyclictest16639-21kworker/2:0+events11:59:432
9687991714,2cyclictest16639-21kworker/2:0+events09:29:492
9684991714,2cyclictest19736-21kworker/1:0+events11:23:391
9684991714,2cyclictest19736-21kworker/1:0+events08:35:181
967999179,6cyclictest26265-21sed08:50:160
967999171,9cyclictest780-21runrttasks10:31:560
967999171,14cyclictest6547-21latency_hist09:30:000
9679991710,6cyclictest23720-21strings12:20:180
967999170,9cyclictest8512-21sh11:54:140
967999170,9cyclictest780-21runrttasks07:56:290
967999170,9cyclictest31453-21sh12:06:280
967999170,9cyclictest27397-21sh11:28:490
967999170,9cyclictest21077-21sh12:00:290
967999170,9cyclictest18170-21sh11:05:190
967999170,9cyclictest14847-21sh11:57:270
1011129170,6tAtEmLog_014383-21chrt09:34:135
969799164,9cyclictest716-21snmpd09:28:394
969799164,8cyclictest25610-21tr08:50:134
9697991614,2cyclictest10629-21kworker/4:1+events08:33:484
969399169,5cyclictest1388-21wc07:59:593
9693991612,3cyclictest699-21polkitd07:54:593
9693991612,3cyclictest20453-21cron09:20:003
969399160,9cyclictest4277-21sh10:04:263
968799160,7cyclictest17649-21ssh10:29:472
9684991613,2cyclictest19736-21kworker/1:0+events11:05:231
9684991613,2cyclictest19736-21kworker/1:0+events08:11:151
967999164,9cyclictest9459-21ssh10:42:430
967999160,7cyclictest29772-21basename10:00:180
967999160,14cyclictest4234-21python309:10:190
967999160,14cyclictest19628-21ssh09:36:310
967999160,14cyclictest18130-21ssh11:40:510
967999160,10cyclictest10949-21ssh12:31:010
3191799160,9tDemoTimingTask32325-21taskset09:05:015
2500199160,9tDemoTimingTask27777-21taskset12:05:005
1915999160,9tDemoTimingTask19180-21chrt09:36:135
969799157,7cyclictest9670-21cyclictest07:46:014
969799157,6cyclictest21437-21apt07:35:004
9697991513,2cyclictest10629-21kworker/4:1+events10:10:234
9697991511,3cyclictest648-21dbus-daemon12:30:004
969799150,9cyclictest9421-21ssh09:49:234
969799150,9cyclictest21335-21tr09:20:134
969399158,6cyclictest966-21apache207:47:123
969399158,5cyclictest17978-21grep09:35:243
969399154,8cyclictest716-21snmpd08:39:203
969399153,8cyclictest22891-21latency_hist08:45:013
9693991511,3cyclictest1-21systemd12:25:003
969399150,9cyclictest26496-21taskset07:43:483
969399150,9cyclictest17375-21sed08:30:253
969399150,11cyclictest8783-21rm11:54:263
968799154,8cyclictest22472-21unixbench_multi11:25:232
968799154,8cyclictest16042-21sort07:20:212
968799154,6cyclictest30743-21expr07:50:252
9687991513,2cyclictest16639-21kworker/2:0+events08:30:562
9687991512,2cyclictest16639-21kworker/2:0+events12:36:542
9687991512,2cyclictest16639-21kworker/2:0+events11:30:102
9687991512,2cyclictest16639-21kworker/2:0+events10:44:422
968799151,10cyclictest15192-21runrttasks08:26:262
968799150,11cyclictest6912-21sh11:53:042
968799150,10cyclictest1513-21ssh09:45:022
968499159,2cyclictest19736-21kworker/1:0+events09:39:431
968499157,7cyclictest716-21snmpd11:00:041
968499154,6cyclictest21122-21expr08:40:131
968499152,9cyclictest2368-21runrttasks12:08:501
9684991512,2cyclictest19736-21kworker/1:0+events09:57:291
9684991512,2cyclictest19736-21kworker/1:0+events07:25:401
968499151,10cyclictest8113-21ssh11:53:531
968499151,10cyclictest29385-21cat11:30:011
968499150,11cyclictest7971-21run-parts11:35:201
968499150,10cyclictest19883-21ssh12:36:011
967999153,6cyclictest20988-21cat09:55:160
967999151,10cyclictest18448-21sh12:17:300
967999150,9cyclictest16441-21runrttasks07:21:560
967999150,6cyclictest13547-21sed09:15:240
967999150,13cyclictest5728-21ssh12:28:400
967999150,12cyclictest360-21aten2_r5power_p10:20:120
2347029150,6tAtEmLog_029763-21chrt10:00:175
1426229150,13tAtEmLog_016342-21taskset09:52:515
969799142,9cyclictest780-21runrttasks09:44:474
969799142,9cyclictest32534-21sh10:37:324
969799141,9cyclictest731-21sshd09:00:214
969799141,9cyclictest7137-21fschecks_time11:35:144
969799141,9cyclictest27727-21sh11:29:024
969799141,9cyclictest25752-21runrttasks10:15:294
969799141,9cyclictest23391-21sh11:44:334
9697991412,2cyclictest10629-21kworker/4:1+events09:30:314
969799140,9cyclictest780-21runrttasks09:38:234
969799140,9cyclictest12300-21apt07:15:114
969799140,10cyclictest8142-21sh10:05:494
969799140,10cyclictest7836-21ssh11:00:034
969799140,10cyclictest716-21snmpd11:21:394
969799140,10cyclictest4918-21sh09:10:334
969799140,10cyclictest28882-21ssh10:00:094
969799140,10cyclictest18513-21ssh10:30:114
969799140,10cyclictest17026-21/usr/sbin/munin07:25:134
969399142,9cyclictest716-21snmpd08:48:513
969399141,9cyclictest780-21runrttasks11:29:453
969399141,9cyclictest6961-21ssh11:35:133
969399141,9cyclictest27804-21sh11:46:203
969399141,9cyclictest23482-21runrttasks11:08:343
969399141,9cyclictest11598-21/usr/sbin/munin11:20:193
969399141,10cyclictest3416-21runrttasks08:02:253
969399141,10cyclictest31964-21runrttasks12:25:143
969399141,10cyclictest18705-21ssh11:41:153
969399141,10cyclictest16912-21runrttasks12:35:043
969399141,10cyclictest15158-21sh09:34:463
969399140,9cyclictest24631-21ssh10:33:213
969399140,10cyclictest9727-21tr10:25:123
969399140,10cyclictest780-21runrttasks10:10:533
969399140,10cyclictest6618-21ssh10:59:263
969399140,10cyclictest6366-21/usr/sbin/munin08:10:163
969399140,10cyclictest5598-21ssh09:29:203
969399140,10cyclictest4939-21sh09:46:163
969399140,10cyclictest4605-21/usr/sbin/munin12:10:133
969399140,10cyclictest4260-21/usr/sbin/munin10:40:153
969399140,10cyclictest31157-21ntp_offset11:30:193
969399140,10cyclictest30830-21grep09:00:163
969399140,10cyclictest29723-21ssh10:35:333
969399140,10cyclictest28015-21/usr/sbin/munin12:05:193
969399140,10cyclictest2619-21/usr/sbin/munin11:15:113
969399140,10cyclictest23455-21ssh10:15:013
969399140,10cyclictest20578-21ssh09:55:133
969399140,10cyclictest20425-21grep07:30:173
969399140,10cyclictest2005-21sshd09:07:203
969399140,10cyclictest15442-21unixbench_multi12:15:233
969399140,10cyclictest13906-21ssh11:03:113
969399140,10cyclictest12680-21unixbench_multi08:20:263
969399140,10cyclictest10087-21sh12:30:253
968799147,5cyclictest18449-21grep11:05:212
968799146,6cyclictest15106-21grep10:45:242
968799146,6cyclictest15106-21grep10:45:232
968799142,9cyclictest25802-21rm10:51:302
968799141,9cyclictest8016-21runrttasks12:30:052
968799141,9cyclictest7735-21ssh09:30:132
968799141,9cyclictest4423-21sh12:27:462
968799141,9cyclictest3307-21runrttasks08:00:582
968799141,9cyclictest27842-21/usr/sbin/munin08:55:162
968799141,9cyclictest24575-21sh12:20:262
9687991411,2cyclictest16639-21kworker/2:0+events08:39:362
968799141,10cyclictest4446-21ssh12:10:042
968799141,10cyclictest14704-21ssh11:03:442
968799141,10cyclictest11997-21head09:50:192
968799140,9cyclictest30386-21cpuspeed09:00:142
968799140,10cyclictest6560-21/usr/sbin/munin11:35:192
968799140,10cyclictest5990-21diskmemload10:58:592
968799140,10cyclictest4166-21ssh10:21:422
968799140,10cyclictest31332-21ssh10:19:232
968799140,10cyclictest30701-21sh12:05:562
968799140,10cyclictest28709-21taskset07:46:532
968799140,10cyclictest28192-21grep10:35:152
968799140,10cyclictest27527-21runrttasks11:10:222
968799140,10cyclictest24539-21/usr/sbin/munin11:45:182
968799140,10cyclictest23015-21sh09:20:272
968799140,10cyclictest22888-21ssh11:44:122
968799140,10cyclictest21272-21sh12:00:372
968799140,10cyclictest17690-21sh10:11:122
968799140,10cyclictest17620-21switchtime09:35:232
968799140,10cyclictest15060-21ssh09:16:132
968799140,10cyclictest14468-21kernelversion12:15:172
968799140,10cyclictest13935-21ssh11:20:402
968799140,10cyclictest10216-21ssh10:07:132
968499144,5cyclictest31166-21hddtemp_smartct09:25:151
968499143,8cyclictest23948-21latency08:45:151
968499142,8cyclictest32381-21if_err_enp6s012:25:151
968499141,9cyclictest780-21runrttasks08:50:101
968499141,9cyclictest24171-21ssh10:33:011
968499141,9cyclictest23031-21fschecks_count12:20:141
968499141,9cyclictest15631-21ssh10:28:221
9684991411,2cyclictest19736-21kworker/1:0+events12:13:581
9684991411,2cyclictest19736-21kworker/1:0+events09:44:291
9684991411,2cyclictest19736-21kworker/1:0+events08:25:321
9684991410,3cyclictest21360-21runintdemo5min07:34:311
968499140,12cyclictest28872-21ssh11:11:021
968499140,10cyclictest9630-21latency_hist07:10:011
968499140,10cyclictest8769-21sh09:48:561
968499140,10cyclictest8085-21ssh12:30:091
968499140,10cyclictest5468-21ssh10:05:031
968499140,10cyclictest5327-21ssh11:15:541
968499140,10cyclictest4079-21sh10:21:391
968499140,10cyclictest31108-21ssh10:55:021
968499140,10cyclictest30219-21ssh10:35:551
968499140,10cyclictest26890-21ssh12:04:341
968499140,10cyclictest26025-21sh11:45:191
968499140,10cyclictest22352-21sendmail_mailqu09:20:191
968499140,10cyclictest19332-21sh09:19:131
968499140,10cyclictest16308-21ssh09:52:501
968499140,10cyclictest11222-21cat11:55:171
967999148,5cyclictest24415-21sed10:15:140
967999146,7cyclictest17291-21/usr/sbin/munin12:35:120
967999146,6cyclictest780-21runrttasks11:31:250
967999145,7cyclictest25307-21rm09:40:120
967999141,10cyclictest780-21runrttasks08:59:240
967999140,9cyclictest1241-21sh10:55:410
967999140,8cyclictest780-21runrttasks08:10:440
967999140,8cyclictest10066-21sh09:49:500
967999140,7cyclictest8849-21basename11:00:160
967999140,7cyclictest24488-21ssh11:45:060
967999140,7cyclictest12140-21awk09:50:200
967999140,6cyclictest174-1kworker/0:1H+kblockd11:35:090
967999140,12cyclictest27306-21diskstats07:45:140
967999140,12cyclictest19480-21cat08:35:240
967999140,11cyclictest18085-21grep07:25:180
967999140,10cyclictest9781-21/usr/sbin/munin08:15:180
967999140,10cyclictest9491-21sh09:30:440
967999140,10cyclictest780-21runrttasks10:37:220
967999140,10cyclictest780-21runrttasks07:32:120
967999140,10cyclictest26554-21sh10:52:020
967999140,10cyclictest15807-21sh10:28:290
967999140,10cyclictest1522-21timerandwakeup09:05:250
967999140,10cyclictest10645-21ssh11:19:440
967999140,10cyclictest1030-21sh11:14:150
969799131,9cyclictest2299-21idleruntime08:00:174
969799130,9cyclictest9946-21/usr/sbin/munin07:10:124
969799130,9cyclictest981-21taskset11:50:034
969799130,9cyclictest9010-21cpuspeed_turbos08:15:114
969799130,9cyclictest780-21runrttasks12:20:034
969799130,9cyclictest780-21runrttasks08:46:114
969799130,9cyclictest780-21runrttasks07:35:034
969799130,9cyclictest716-21snmpd08:10:064
969799130,9cyclictest5992-21cat10:40:254
969799130,9cyclictest29476-21apt-config11:30:014
969799130,9cyclictest28202-21sh08:55:134
969799130,9cyclictest26034-21/usr/sbin/munin11:10:114
969799130,9cyclictest24592-21/usr/sbin/munin07:40:134
969799130,9cyclictest22528-21chrt08:40:554
969799130,9cyclictest19714-21ssh09:55:014
969799130,9cyclictest19230-21ssh11:05:344
969799130,9cyclictest18886-21sh12:00:044
969799130,9cyclictest18118-21/usr/sbin/munin08:35:124
969799130,9cyclictest14672-21/usr/sbin/munin07:20:174
969799130,9cyclictest13940-21fschecks_time08:25:134
969799130,9cyclictest12998-21ssh10:45:014
969799130,9cyclictest12998-21ssh10:45:004
969799130,9cyclictest1176-21sshd07:59:184
969799130,9cyclictest11255-21sh11:55:184
969799130,9cyclictest11099-21/usr/sbin/munin08:20:164
969799130,9cyclictest10786-21sh09:50:084
969799130,9cyclictest10114-21ssh12:30:254
969799130,10cyclictest780-21runrttasks09:08:594
969799130,10cyclictest6367-21sh11:16:424
969799130,10cyclictest31994-21ssh12:06:524
969799130,10cyclictest28764-21ssh11:47:014
969799130,10cyclictest16983-21ssh12:35:064
969799130,10cyclictest14073-21fschecks_count12:15:134
969799130,10cyclictest13518-21ssh10:26:554
969399139,3cyclictest22729-21fschecks_count10:50:143
969399132,8cyclictest648-21dbus-daemon10:05:193
969399131,9cyclictest21475-21sh09:20:143
969399130,9cyclictest8660-21taskset08:15:003
969399130,9cyclictest780-21runrttasks08:25:073
969399130,9cyclictest780-21runrttasks07:35:063
969399130,9cyclictest744-21postgres07:10:023
969399130,9cyclictest5072-21ssh09:10:393
969399130,9cyclictest28128-21cpuspeed_turbos08:55:123
969399130,9cyclictest18291-21swap07:25:213
969399130,9cyclictest14798-21cpu07:20:103
969399130,9cyclictest13129-21ssh10:45:063
969399130,9cyclictest13129-21ssh10:45:053
969399130,10cyclictest4517-21perl08:05:133
969399130,10cyclictest27350-21sh09:40:363
969399130,10cyclictest19025-21/usr/sbin/munin12:00:173
968799139,3cyclictest17672-21sed07:25:142
968799131,9cyclictest2024-21runrttasks09:07:362
968799131,9cyclictest19924-21ssh10:30:192
968799131,9cyclictest19916-21/usr/sbin/munin09:55:152
968799130,9cyclictest780-21runrttasks07:42:572
968799130,9cyclictest6366-21/usr/sbin/munin08:10:122
968799130,9cyclictest29993-21missed_timers10:00:192
968799130,9cyclictest2619-21/usr/sbin/munin11:15:192
968799130,9cyclictest25492-21/usr/sbin/munin08:50:212
968799130,9cyclictest12297-21/usr/sbin/munin07:15:192
968799130,9cyclictest10726-21runrttasks08:19:592
968799130,9cyclictest10357-21fschecks_count07:10:142
968799130,10cyclictest4398-21grep08:05:132
968799130,10cyclictest24113-21cat07:40:012
968799130,10cyclictest22680-21chrt08:42:592
968499130,9cyclictest9946-21/usr/sbin/munin07:10:141
968499130,9cyclictest780-21runrttasks07:54:401
968499130,9cyclictest780-21runrttasks07:46:271
968499130,9cyclictest4397-21aten2_r5power_v10:40:151
968499130,9cyclictest4018-21/usr/sbin/munin08:05:121
968499130,9cyclictest32713-21sshd07:55:191
968499130,9cyclictest29895-21latency_hist09:00:001
968499130,9cyclictest23669-21/usr/sbin/munin10:15:151
968499130,9cyclictest22293-21/usr/sbin/munin10:50:131
968499130,9cyclictest1924-21tr08:00:121
968499130,9cyclictest14627-21latency_hist07:20:011
968499130,9cyclictest14554-21ssh10:10:061
968499130,9cyclictest13589-21/usr/sbin/munin12:15:161
968499130,9cyclictest11099-21/usr/sbin/munin08:20:191
968499130,10cyclictest6882-21ssh09:30:031
968499130,10cyclictest32634-21/usr/sbin/munin09:05:121
968499130,10cyclictest30216-21/usr/sbin/munin09:00:191
968499130,10cyclictest29912-21apt11:30:121
968499130,10cyclictest29404-21awk10:00:161
968499130,10cyclictest15415-21ssh11:40:041
967999135,6cyclictest24692-21hostname07:40:110
967999134,8cyclictest14531-21latency_hist07:20:010
967999131,9cyclictest9630-21latency_hist07:10:010
967999131,3cyclictest6491-21irqstats10:05:160
967999130,9cyclictest23530-21fschecks_count08:45:140
967999130,7cyclictest174-1kworker/0:1H+kblockd09:01:080
967999130,7cyclictest174-1kworker/0:1H+kblockd08:06:040
967999130,6cyclictest22616-21timerandwakeup09:20:220
967999130,10cyclictest780-21runrttasks08:31:120
967999130,10cyclictest22801-21awk07:35:190
967999130,10cyclictest22598-21chrt08:41:510
967999130,10cyclictest2020-21fschecks_count08:00:140
967999130,10cyclictest174-1kworker/0:1H+kblockd07:50:030
967999130,10cyclictest15253-21chrt08:27:190
967999130,10cyclictest12650-21grep08:20:250
967999130,10cyclictest10541-21grep07:10:140
367599130,11tDemoTimingTask5994-21chrt08:09:495
366929130,10tAtEmLog_010400-21taskset11:00:435
2952839130,12EcMasterDemoSyn29816-21chrt08:59:055
2271929130,10tAtEmLog_029795-21chrt10:35:385
1461529130,3tAtEmLog_014964-21taskset09:16:085
969799120,9cyclictest5059-21ntpq08:05:174
968799124,7cyclictest23888-21/usr/sbin/munin08:45:152
968799121,7cyclictest128750latency_hist07:59:592
968799120,9cyclictest11066-21runintdemo5min08:20:092
968499120,8cyclictest24414-21apt-key07:40:011
868899120,10tDemoTimingTask10433-21taskset08:16:025
767799120,10tDemoTimingTask12687-21taskset11:20:175
2834699120,10tDemoTimingTask30058-21chrt09:42:265
2192239120,10EcMasterDemoSyn28725-21chrt11:10:575
1900299120,10tDemoTimingTask21140-21chrt07:31:495
1353539120,10EcMasterDemoSyn22456-21chrt10:31:485
1206129120,10tAtEmLog_012522-21taskset11:38:135
11077991212,0tDemoTimingTask0-21swapper/508:21:115
969799110,8cyclictest9848-21latency_hist07:10:004
968799112,7cyclictest9795-21cat07:10:012
859139110,0EcMasterDemoSyn0-21swapper/510:42:075
84039110,0EcMasterDemoSyn0-21swapper/509:26:045
701799112,7tDemoTimingTask13340-21taskset11:56:235
700639110,0EcMasterDemoSyn0-21swapper/511:53:075
507639110,0EcMasterDemoSyn0-21swapper/509:46:225
3024339110,0EcMasterDemoSyn0-21swapper/511:48:045
2893629110,2tAtEmLog_031168-21taskset07:53:225
288839110,0EcMasterDemoSyn0-21swapper/511:32:515
2658199110,9tDemoTimingTask28778-21chrt07:47:505
2389929110,8tAtEmLog_024588-21chrt07:40:085
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional