You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 14:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Sat Apr 04, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
987039840,0EcMasterDemoSyn988029tAtEmLog_011:06:365
407239840,0EcMasterDemoSyn408229tAtEmLog_008:29:235
1772039840,0EcMasterDemoSyn1773029tAtEmLog_012:22:405
1897939830,0EcMasterDemoSyn1898929tAtEmLog_011:11:405
1824239830,0EcMasterDemoSyn1825229tAtEmLog_008:59:495
2671239820,0EcMasterDemoSyn2672229tAtEmLog_008:09:065
2435839820,0EcMasterDemoSyn2436829tAtEmLog_008:04:025
2197839820,0EcMasterDemoSyn2198829tAtEmLog_007:58:585
71039810,0EcMasterDemoSyn72629tAtEmLog_011:01:315
50539810,0EcMasterDemoSyn51629tAtEmLog_011:37:015
1486139810,0EcMasterDemoSyn1487129tAtEmLog_007:43:455
2453939800,0EcMasterDemoSyn2454929tAtEmLog_009:45:285
565239770,1EcMasterDemoSyn5660-21runintdemo5min10:46:190
208702540,3sleep50-21swapper/511:48:365
1972839360,1EcMasterDemoSyn19736-21runintdemo5min10:36:100
2303239310,4EcMasterDemoSyn23040-21grep09:09:584
969939300,1EcMasterDemoSyn9696-21ssh11:42:051
3075099196,10cyclictest1699-21sh12:31:310
879439180,0EcMasterDemoSyn0-21swapper/508:39:325
3075099186,9cyclictest16835-21sh10:17:010
3075099181,9cyclictest31903-21latency_hist11:55:000
3075099180,14cyclictest3236-21sh09:51:500
3075099180,14cyclictest12122-21sh10:32:090
3075099180,10cyclictest11108-21sh10:14:220
1507399180,10tDemoTimingTask15117-21chrt09:40:235
1353139180,1EcMasterDemoSyn13540-21wc08:49:414
30767991713,3cyclictest8895-21turbostat.cron09:20:004
3075499171,12cyclictest16-1pr/legacy12:17:351
3075499170,9cyclictest2123-21ssh10:09:261
3075099175,9cyclictest780-21runrttasks09:36:520
3075099174,9cyclictest30030-21sh11:17:500
3075099174,9cyclictest30030-21sh11:17:500
3075099170,9cyclictest3648-21ssh11:03:330
3075099170,9cyclictest29251-21sh09:30:220
3075099170,9cyclictest11178-21sh11:07:290
3075099170,13cyclictest13807-21sh11:26:310
3075099170,13cyclictest13807-21sh11:26:300
3075099170,12cyclictest23065-21cut09:45:140
3053599170,7tDemoTimingTask32703-21chrt07:10:495
3076799164,8cyclictest3264-21latency_hist12:15:004
3076799161,9cyclictest3004250latency_hist12:30:004
3076799160,9cyclictest29013-21sh09:48:344
3076299161,10cyclictest16-1pr/legacy11:21:483
3075499168,6cyclictest11035-21tail11:25:161
3075499168,6cyclictest11035-21tail11:25:161
3075099164,9cyclictest30753-21sh10:06:460
3075099160,8cyclictest1324-21sendmail-mta12:11:370
3075099160,7cyclictest8229-21ssh09:19:330
3075099160,13cyclictest10225-21users09:55:250
3075099160,10cyclictest22017-21ssh11:49:240
1518929160,9tAtEmLog_012032-21sleep10:19:555
466399150,10tDemoTimingTask8400-21chrt11:59:565
3076799159,3cyclictest1376639EcMasterDemoSyn12:02:224
3076799153,8cyclictest716-21snmpd08:51:534
3076799153,8cyclictest3996-21latency_hist09:35:004
30767991512,2cyclictest17724-21runrttasks10:00:134
30767991511,3cyclictest25338-21gltestperf11:15:154
30767991511,3cyclictest25338-21gltestperf11:15:154
30767991510,2cyclictest9673-21kworker/4:0+events10:26:014
3076799150,9cyclictest7270-21ssh12:35:024
3076799150,11cyclictest16-1pr/legacy09:55:364
30762991511,3cyclictest1363-21runintdemo5min09:50:323
3076299150,9cyclictest7469-21runrttasks07:27:053
3076299150,9cyclictest30668-21runrttasks12:11:363
3076299150,9cyclictest11650-21ssh12:00:513
3076299150,11cyclictest12154-21ssh12:37:213
3075999154,8cyclictest24113-21gltestperf11:50:162
3075999151,9cyclictest13412-21ssh09:40:112
3075999151,10cyclictest3644-21/usr/sbin/munin12:15:202
3075999151,10cyclictest29214-21/usr/sbin/munin11:35:152
3075999151,10cyclictest2886-21sh09:15:492
3075499152,9cyclictest15056-21latency_hist07:45:001
3075499151,10cyclictest19084-21fschecks_count09:00:131
3075499150,9cyclictest3417-21/usr/sbin/munin10:10:131
3075499150,11cyclictest17543-21ssh12:22:331
3075499150,10cyclictest6205-21ssh10:29:211
3075099156,7cyclictest19439-21ssh10:00:290
3075099151,10cyclictest23212-21sh11:14:370
3075099151,10cyclictest20231-21unixbench_singl09:00:230
3075099150,9cyclictest5093-21ssh11:21:440
3075099150,8cyclictest23123-21sh09:27:110
2441229150,14tAtEmLog_030165-21turbostat10:25:005
198052150,0sleep119806-21runintdemo5min10:36:121
3076799145,7cyclictest25160-21ssh10:39:574
3076799145,7cyclictest18179-21kworker/u24:1+nfsiod11:26:114
3076799145,7cyclictest18179-21kworker/u24:1+nfsiod11:26:114
3076799143,8cyclictest7221-21unixbench_singl11:40:244
3076799141,9cyclictest21736-21ssh10:20:124
3076799141,9cyclictest2113-21/usr/sbin/munin08:25:194
3076799141,10cyclictest17160-21sh11:10:234
3076799141,10cyclictest16-1pr/legacy10:15:524
3076799140,10cyclictest9209-21atemtest08:40:134
3076799140,10cyclictest5623-21ssh09:35:194
3076799140,10cyclictest5496-21sh09:53:264
3076799140,10cyclictest4540-21rm12:33:304
3076799140,10cyclictest26945-21wget10:05:134
3076799140,10cyclictest23810-21sh10:56:204
3076799140,10cyclictest20002-21/usr/sbin/munin07:55:114
3076799140,10cyclictest18290-21chrt08:59:574
3076799140,10cyclictest13510-21fschecks_time07:40:154
3076799140,10cyclictest10657-21sh10:14:034
3076299143,8cyclictest14315-21timerwakeupswit12:20:233
3076299142,9cyclictest326-21systemd-journal07:35:483
3076299142,9cyclictest15794-21sh10:52:043
3076299141,9cyclictest960-21/usr/sbin/munin07:15:223
3076299141,9cyclictest32008-21latency_hist08:20:003
3076299141,9cyclictest15923-21rm09:59:243
3076299141,9cyclictest15270-21ssh11:10:113
3076299141,10cyclictest9071-21mailstats10:30:193
3076299141,10cyclictest24184-21gltestperf11:50:173
3076299140,10cyclictest990-21ssh12:31:013
3076299140,10cyclictest7960-21ssh10:47:553
3076299140,10cyclictest780-21runrttasks11:33:423
3076299140,10cyclictest780-21runrttasks11:33:423
3076299140,10cyclictest780-21runrttasks09:49:233
3076299140,10cyclictest766-21df_inode09:15:143
3076299140,10cyclictest3056-21sh10:27:083
3076299140,10cyclictest29611-21/usr/sbin/munin11:00:163
3076299140,10cyclictest28648-21ssh10:41:033
3076299140,10cyclictest28629-21sh10:23:563
3076299140,10cyclictest28498-21ssh11:16:453
3076299140,10cyclictest28498-21ssh11:16:453
3076299140,10cyclictest28343-21gltestperf09:30:143
3076299140,10cyclictest23761-21ssh12:08:033
3076299140,10cyclictest23711-21sh12:25:303
3076299140,10cyclictest22132-21ssh10:02:183
3076299140,10cyclictest2195-21ssh11:38:103
3076299140,10cyclictest21720-21ssh10:37:343
3076299140,10cyclictest21067-21sh09:25:473
3076299140,10cyclictest20260-21ssh10:55:013
3076299140,10cyclictest15078-21sh09:22:573
3076299140,10cyclictest13947-21basename08:50:133
3076299140,10cyclictest11598-21sh11:07:483
3076299140,10cyclictest10749-21df11:25:153
3076299140,10cyclictest10749-21df11:25:153
3075999144,5cyclictest3526-21cat08:25:232
3075999143,8cyclictest18545-21fschecks_count12:05:142
3075999143,8cyclictest12920-21grep12:37:532
3075999141,9cyclictest7735-21sh11:05:222
3075999141,9cyclictest31976-21runrttasks09:32:012
3075999141,9cyclictest17782-21ssh11:29:172
3075999141,9cyclictest17782-21ssh11:29:172
3075999141,9cyclictest17082-21ssh09:24:222
3075999140,9cyclictest30713-21apt-key10:25:002
3075999140,8cyclictest5287-21ssh11:40:072
3075999140,12cyclictest1130-21sed11:55:172
3075999140,10cyclictest8287-21/usr/sbin/munin09:55:192
3075999140,10cyclictest4437-21sh10:45:282
3075999140,10cyclictest3397-21ssh12:32:452
3075999140,10cyclictest31492-21ssh10:07:172
3075999140,10cyclictest30074-21ssh12:11:112
3075999140,10cyclictest29051-21runrttasks09:48:352
3075999140,10cyclictest2727-21taskset07:16:552
3075999140,10cyclictest25748-21ssh09:10:322
3075999140,10cyclictest24541-21ssh11:15:082
3075999140,10cyclictest24541-21ssh11:15:082
3075999140,10cyclictest21602-21/usr/sbin/munin10:20:172
3075999140,10cyclictest21457-21sh11:30:312
3075999140,10cyclictest21457-21sh11:30:312
3075999140,10cyclictest21367-21chrt09:25:592
3075999140,10cyclictest20256-21sh10:55:012
3075999140,10cyclictest19853-21sh11:47:532
3075999140,10cyclictest19651-21ssh11:12:072
3075999140,10cyclictest18193-21if_enp6s010:00:162
3075999140,10cyclictest17767-21cat08:55:232
3075999140,10cyclictest15419-21ssh12:03:322
3075999140,10cyclictest14666-21ssh10:15:322
3075999140,10cyclictest12887-21sh10:32:412
3075999140,10cyclictest1178-21ssh11:20:092
3075999140,10cyclictest11767-21cpuspeed_turbos08:45:132
3075999140,10cyclictest11458-21ssh10:14:372
3075499146,6cyclictest23474-21apt-get11:50:121
3075499142,9cyclictest28000-21cat12:10:161
3075499141,9cyclictest3091-21unixbench_singl11:20:221
3075499141,9cyclictest21630-21/usr/sbin/munin12:25:181
3075499141,9cyclictest20871-21sh10:01:271
3075499141,9cyclictest13348-21runrttasks08:47:171
3075499140,9cyclictest20394-21sh10:55:071
3075499140,9cyclictest15247-21/usr/sbin/munin11:10:141
3075499140,10cyclictest9105-21ssh09:37:221
3075499140,10cyclictest884-21processes08:20:201
3075499140,10cyclictest780-21runrttasks10:41:051
3075499140,10cyclictest476-21ssh11:37:011
3075499140,10cyclictest32683-21chrt07:10:341
3075499140,10cyclictest32010-21sh11:00:431
3075499140,10cyclictest31045-21/usr/sbin/munin08:15:211
3075499140,10cyclictest28629-21sh11:16:511
3075499140,10cyclictest28629-21sh11:16:511
3075499140,10cyclictest28538-21ssh10:23:511
3075499140,10cyclictest27217-21wget08:10:121
3075499140,10cyclictest23622-21/usr/sbin/munin09:10:191
3075499140,10cyclictest23602-21sendmail_mailqu08:00:211
3075499140,10cyclictest22033-21ssh11:49:241
3075499140,10cyclictest21418-21ssh11:30:301
3075499140,10cyclictest21418-21ssh11:30:301
3075499140,10cyclictest20976-21/usr/sbin/munin09:05:181
3075499140,10cyclictest19523-21runrttasks07:53:231
3075499140,10cyclictest18600-21grep12:05:151
3075499140,10cyclictest17945-21chrt08:55:531
3075499140,10cyclictest17387-21ssh12:04:571
3075499140,10cyclictest17135-21ssh09:41:371
3075499140,10cyclictest16776-21ssh10:16:591
3075499140,10cyclictest16017-21ssh10:34:551
3075499140,10cyclictest13901-21chrt08:50:101
3075499140,10cyclictest12160-21ssh09:56:451
3075499140,10cyclictest11646-21ssh12:37:001
3075499140,10cyclictest10330-21processes08:40:201
3075099147,6cyclictest30745-21cyclictest10:53:060
3075099146,6cyclictest326-21systemd-journal08:12:170
3075099146,6cyclictest20903-21ls10:55:150
3075099146,6cyclictest12798-21ssh12:37:500
3075099145,8cyclictest15305-21/usr/sbin/munin07:45:120
3075099143,8cyclictest326-21systemd-journal07:29:280
3075099143,8cyclictest23084-21mailstats12:25:220
3075099141,9cyclictest4981-21vmstat07:20:250
3075099141,9cyclictest13470-21sh09:21:490
3075099141,7cyclictest8879-21latency_hist08:40:000
3075099141,10cyclictest174-1kworker/0:1H+kblockd08:30:460
3075099141,10cyclictest174-1kworker/0:1H+kblockd08:09:000
3075099140,9cyclictest23598-21awk08:00:210
3075099140,7cyclictest9467-21diskstats12:00:140
3075099140,7cyclictest31074-21cut10:25:110
3075099140,7cyclictest27324-21/usr/sbin/munin10:40:220
3075099140,7cyclictest24510-21/usr/sbin/munin09:10:160
3075099140,7cyclictest22685-21/usr/sbin/munin10:20:170
3075099140,12cyclictest758-21ssh11:55:140
3075099140,12cyclictest4196-21perl12:15:150
3075099140,11cyclictest9940-21grep07:33:360
3075099140,11cyclictest9940-21grep07:33:350
3075099140,10cyclictest7855-21ssh11:40:480
3075099140,10cyclictest30323-21switchtime11:35:230
3075099140,10cyclictest19330-21apt-get11:30:100
3075099140,10cyclictest19330-21apt-get11:30:100
3075099140,10cyclictest18451-21sh12:05:140
3075099140,10cyclictest15272-21ls08:50:240
3075099140,10cyclictest14810-21sh12:20:350
3075099140,10cyclictest13331-21rm09:40:080
3075099140,10cyclictest13056-21aten2_r5power_v07:40:130
3053599140,12tDemoTimingTask30668-21taskset07:09:445
2894329140,12tAtEmLog_029324-21chrt10:41:295
2288799141,10tDemoTimingTask27012-21chrt12:10:105
1436499141,11tDemoTimingTask18387-21chrt11:29:435
1436499141,11tDemoTimingTask18387-21chrt11:29:435
644599130,11tDemoTimingTask6530-21sleep08:35:005
3076799139,3cyclictest29006-21cpuspeed_turbos11:35:124
3076799131,9cyclictest7650-21sh10:47:424
3076799130,9cyclictest9315-21runrttasks09:20:054
3076799130,9cyclictest7581-21ssh10:30:074
3076799130,9cyclictest6200-21diskmemload11:05:094
3076799130,9cyclictest5690-21/usr/sbin/munin07:25:124
3076799130,9cyclictest5431-21sh11:04:494
3076799130,9cyclictest3557-21cpuspeed_turbos07:20:144
3076799130,9cyclictest3440-21chrt12:15:034
3076799130,9cyclictest32210-21sh11:55:014
3076799130,9cyclictest31018-21/usr/sbin/munin07:10:204
3076799130,9cyclictest29785-21/usr/sbin/munin08:15:134
3076799130,9cyclictest27129-21/usr/sbin/munin08:10:114
3076799130,9cyclictest26776-21sshd10:40:164
3076799130,9cyclictest2624-21chrt07:15:324
3076799130,9cyclictest24779-21/usr/sbin/munin08:05:144
3076799130,9cyclictest23680-21sh09:27:354
3076799130,9cyclictest23407-21runrttasks09:10:014
3076799130,9cyclictest23377-21ssh11:50:084
3076799130,9cyclictest22429-21/usr/sbin/munin08:00:254
3076799130,9cyclictest19805-21sh11:47:514
3076799130,9cyclictest19284-21runrttasks11:30:094
3076799130,9cyclictest19284-21runrttasks11:30:084
3076799130,9cyclictest18895-21sensors07:50:214
3076799130,9cyclictest18624-21/usr/sbin/munin09:00:124
3076799130,9cyclictest18434-21cstates12:05:144
3076799130,9cyclictest16879-21sh10:52:514
3076799130,9cyclictest15304-21/usr/sbin/munin07:45:154
3076799130,9cyclictest1514-21taskset08:21:444
3076799130,9cyclictest13427-21/usr/sbin/munin09:40:244
3076799130,9cyclictest12633-21latency_hist07:40:014
3076799130,9cyclictest1096-21rm11:20:054
3076799130,10cyclictest8629-21grep07:30:154
3076799130,10cyclictest8629-21grep07:30:144
3076799130,10cyclictest14997-21sh12:20:444
3076299139,3cyclictest2162-21aten2_r5power_e08:25:123
3076299135,6cyclictest22733-21expr08:00:143
3076299135,6cyclictest14402-21sed09:40:173
3076299131,9cyclictest5189-21/usr/sbin/munin08:30:163
3076299131,9cyclictest18071-21runrttasks08:57:363
3076299131,9cyclictest1444-21runrttasks08:20:473
3076299131,9cyclictest13289-21cstates07:40:133
3076299131,7cyclictest8135-21ssh09:36:413
3076299130,9cyclictest780-21runrttasks09:05:123
3076299130,9cyclictest7497-21smartctl08:35:143
3076299130,9cyclictest3417-21/usr/sbin/munin10:10:123
3076299130,9cyclictest3337-21/usr/sbin/munin07:20:133
3076299130,9cyclictest330-21taskset07:12:063
3076299130,9cyclictest27129-21/usr/sbin/munin08:10:173
3076299130,9cyclictest26858-21/usr/sbin/munin10:05:133
3076299130,9cyclictest25489-21awk09:10:243
3076299130,9cyclictest18015-21/usr/sbin/munin07:50:153
3076299130,9cyclictest15304-21/usr/sbin/munin07:45:143
3076299130,9cyclictest1525-21sh11:55:223
3076299130,9cyclictest14180-21sh11:45:033
3076299130,10cyclictest3571-21rm12:15:093
3076299130,10cyclictest26453-21chrt08:05:403
3076299130,10cyclictest21533-21sed07:55:243
3076299130,10cyclictest19130-21fschecks_time09:00:133
3076299130,10cyclictest12412-21ssh10:15:043
3076299130,10cyclictest12213-21sed08:45:153
3076299130,10cyclictest10562-21ssh11:42:413
3076299130,10cyclictest10407-21mailstats08:40:203
3075999131,9cyclictest9085-21nfs4_client07:30:182
3075999131,9cyclictest9085-21nfs4_client07:30:182
3075999130,9cyclictest9199-21/usr/sbin/munin08:40:142
3075999130,9cyclictest780-21runrttasks08:00:292
3075999130,9cyclictest6822-21/usr/sbin/munin08:35:162
3075999130,9cyclictest4125-21chrt09:35:012
3075999130,9cyclictest32168-21/usr/sbin/munin08:20:182
3075999130,9cyclictest29785-21/usr/sbin/munin08:15:182
3075999130,9cyclictest27233-21aten2_r5power_v08:10:132
3075999130,9cyclictest26176-21wc08:05:242
3075999130,9cyclictest21526-21sh12:25:082
3075999130,9cyclictest21363-21wc07:55:242
3075999130,9cyclictest20976-21/usr/sbin/munin09:05:112
3075999130,9cyclictest18613-21taskset09:00:002
3075999130,9cyclictest17652-21runrttasks07:50:102
3075999130,9cyclictest16587-21ssh10:35:062
3075999130,9cyclictest13910-21cut12:20:182
3075999130,9cyclictest10981-21gltestperf07:35:152
3075999130,8cyclictest286-21jbd2/md0-807:29:142
3075999130,10cyclictest609-21mailstats09:50:212
3075999130,10cyclictest5110-21runrttasks07:22:012
3075999130,10cyclictest4803-21cstates08:30:132
3075999130,10cyclictest29578-21rm11:00:092
3075999130,10cyclictest26184-21ssh10:40:122
3075999130,10cyclictest15882-21runintdemo5min08:54:452
3075999130,10cyclictest14206-21python307:40:202
3075999130,10cyclictest12221-21ssh10:50:152
3075499133,7cyclictest3539-21cpuspeed_turbos07:20:141
3075499132,6cyclictest2405-21cpuspeed_turbos08:25:131
30754991310,2cyclictest10720-21cpuspeed_turbos07:35:131
3075499130,9cyclictest7407-21grep08:35:141
3075499130,9cyclictest5514-21sh11:57:531
3075499130,9cyclictest5123-21ssh10:45:571
3075499130,9cyclictest4530-21cut08:30:121
3075499130,9cyclictest32177-21/usr/sbin/munin09:50:151
3075499130,9cyclictest30600-21sh12:30:111
3075499130,9cyclictest24779-21/usr/sbin/munin08:05:171
3075499130,9cyclictest24692-21ssh09:45:321
3075499130,9cyclictest21810-21taskset07:57:311
3075499130,9cyclictest20016-21sendmail_mailst09:25:211
3075499130,9cyclictest16363-21grep07:45:191
3075499130,9cyclictest14409-21ssh10:51:081
3075499130,9cyclictest10304-21ssh09:20:151
3075499130,10cyclictest780-21runrttasks07:30:281
3075499130,10cyclictest780-21runrttasks07:30:271
3075499130,10cyclictest6461-21uname07:25:171
3075499130,10cyclictest6321-21aten2_r5power_e11:05:121
3075499130,10cyclictest574-21grep09:15:131
3075499130,10cyclictest28811-21grep09:30:171
3075499130,10cyclictest2742-21chrt07:17:051
3075099137,6cyclictest30745-21cyclictest07:35:130
3075099131,6cyclictest174-1kworker/0:1H+kblockd08:41:020
3075099130,9cyclictest31005-21runrttasks07:10:010
3075099130,9cyclictest21371-21sort07:55:240
3075099130,9cyclictest18563-21missed_timers07:50:180
3075099130,7cyclictest174-1kworker/0:1H+kblockd08:55:540
3075099130,7cyclictest174-1kworker/0:1H+kblockd08:25:380
3075099130,7cyclictest174-1kworker/0:1H+kblockd08:20:370
3075099130,7cyclictest174-1kworker/0:1H+kblockd07:15:100
3075099130,11cyclictest12274-21cat08:45:160
3075099130,10cyclictest29878-21aten2_r5power_v08:15:130
3075099130,10cyclictest174-1kworker/0:1H+kblockd09:05:330
2672229130,11tAtEmLog_028999-21chrt08:13:195
1479999130,11tDemoTimingTask20635-21chrt10:55:135
135539130,0EcMasterDemoSyn0-21swapper/509:50:325
520199121,9tDemoTimingTask7506-21chrt11:23:245
3076799120,9cyclictest4463-21runrttasks08:30:084
3076799120,8cyclictest6821-21taskset08:35:104
3076299120,9cyclictest8046-21/usr/sbin/munin07:30:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional