You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 00:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Sat Jul 04, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1668339940,1EcMasterDemoSyn16692-21runintdemo5min11:07:544
2039939910,0EcMasterDemoSyn2040929tAtEmLog_011:28:115
49839820,0EcMasterDemoSyn51129tAtEmLog_011:53:335
49839820,0EcMasterDemoSyn51129tAtEmLog_011:53:325
1963839820,0EcMasterDemoSyn1964829tAtEmLog_008:45:555
1746339820,0EcMasterDemoSyn1747329tAtEmLog_010:32:245
782039810,0EcMasterDemoSyn783029tAtEmLog_008:20:335
2265539810,0EcMasterDemoSyn2266529tAtEmLog_010:17:115
1411739810,0EcMasterDemoSyn1412729tAtEmLog_007:29:515
145512610,0sleep20-21swapper/209:36:392
477199210,10cyclictest10921-21sh10:29:050
477199210,10cyclictest10921-21sh10:29:050
463539190,4EcMasterDemoSyn0-21swapper/507:09:345
477699181,12cyclictest16-1pr/legacy07:50:081
477199184,11cyclictest5760-21sh11:38:080
477199180,14cyclictest26569-21sh11:13:340
477199180,10cyclictest18248-21sh10:15:130
477199180,10cyclictest174-1kworker/0:1H+kblockd09:35:020
478899170,10cyclictest17843-21sh12:02:574
478499178,8cyclictest21622-21sh09:59:123
477999177,5cyclictest21861-21wc07:45:132
477999170,9cyclictest29890-21sh10:20:542
477999170,9cyclictest29890-21sh10:20:542
477699171,12cyclictest16-1pr/legacy09:41:401
4771991712,4cyclictest326-21systemd-journal12:20:010
477199170,9cyclictest28328-21sh10:20:180
477199170,9cyclictest28328-21sh10:20:170
477199170,9cyclictest19236-21sh11:09:420
477199170,14cyclictest780-21runrttasks10:38:200
477199170,14cyclictest32719-21sh09:10:440
477199170,14cyclictest28585-21sh12:26:550
477199170,14cyclictest25247-21sh11:49:170
477199170,14cyclictest25247-21sh11:49:160
354199170,7tDemoTimingTask6379-21chrt10:44:335
354199170,7tDemoTimingTask12386-21chrt10:47:165
1349399170,10tDemoTimingTask13605-21taskset12:18:575
478899161,11cyclictest16-1pr/legacy08:20:334
478899160,9cyclictest15754-21sh10:13:394
478499168,6cyclictest17289-21runintdemo5min08:40:503
478499164,8cyclictest28247-21timerwakeupswit07:55:253
478499160,9cyclictest25403-21sh10:19:053
477999160,9cyclictest28839-21ssh11:32:492
477699164,9cyclictest716-21snmpd09:07:241
477199161,6cyclictest19807-21taskset12:22:030
477199160,9cyclictest32695-21sh10:58:580
477199160,9cyclictest16145-21runrttasks07:30:340
477199160,9cyclictest13671-21runrttasks09:54:550
477199160,8cyclictest24220-21ssh11:30:150
477199160,14cyclictest14342-21ssh09:19:030
477199160,10cyclictest174-1kworker/0:1H+kblockd10:49:350
1177099160,8tDemoTimingTask12080-21taskset07:25:005
1019399160,10tDemoTimingTask10224-21taskset08:25:415
478899151,7cyclictest29478-21diskmemload12:11:424
478899150,9cyclictest7696-21sh12:33:504
478899150,9cyclictest29478-21diskmemload09:49:024
478899150,9cyclictest25959-21sh11:30:454
478899150,9cyclictest21787-21rm11:29:114
478499154,8cyclictest11413-21users07:20:233
478499151,10cyclictest3312-21rm09:12:503
478499151,10cyclictest26877-21sh11:31:243
478499151,10cyclictest19314-21sh12:21:413
478499150,11cyclictest8495-21/usr/sbin/munin08:25:163
478499150,10cyclictest13682-21ssh12:18:593
477999154,8cyclictest22726-21mailstats12:05:202
477999154,8cyclictest19219-21sed07:40:002
477999153,9cyclictest711-21gdbus11:05:202
477999151,10cyclictest780-21runrttasks09:04:452
477999151,10cyclictest20286-21/usr/sbin/munin08:50:192
477999150,9cyclictest6125-21sh10:25:422
477999150,9cyclictest6125-21sh10:25:412
477999150,9cyclictest10660-21ssh09:16:252
477999150,11cyclictest30319-21ssh10:39:552
477699155,5cyclictest20656-21forks08:50:141
477699151,10cyclictest29693-21latency_hist12:10:011
477699151,10cyclictest28841-21/usr/sbin/munin09:45:201
477699150,8cyclictest780-21runrttasks07:33:551
477699150,10cyclictest5299-21ssh09:14:151
477199156,7cyclictest14652-21grep09:55:130
477199156,7cyclictest10156-21uname11:40:180
477199153,8cyclictest5172-21vmstat11:55:270
477199153,10cyclictest17980-21timerwakeupswit09:20:250
477199151,12cyclictest412-21grep10:05:140
477199151,10cyclictest25511-21sh10:00:340
477199150,9cyclictest29478-21diskmemload09:41:530
477199150,8cyclictest18736-21runrttasks07:36:240
450199150,9tDemoTimingTask6086-21chrt12:14:575
2687199150,9tDemoTimingTask30347-21taskset10:39:565
107499150,9tDemoTimingTask6293-21taskset09:14:565
478899142,9cyclictest326-21systemd-journal08:29:554
478899142,8cyclictest14408-21aten2_r5power_e09:55:134
478899141,9cyclictest7902-21ssh11:20:364
478899141,9cyclictest7646-21ssh09:50:394
478899141,9cyclictest5786-21ssh09:31:474
478899141,9cyclictest3053-21ssh10:42:134
478899140,9cyclictest15583-21/usr/sbin/munin08:40:124
478899140,10cyclictest9866-21ssh10:28:204
478899140,10cyclictest9866-21ssh10:28:194
478899140,10cyclictest716-21snmpd12:37:134
478899140,10cyclictest716-21snmpd10:49:534
478899140,10cyclictest6492-21sh12:15:014
478899140,10cyclictest5976-21ssh11:56:024
478899140,10cyclictest594-21rm10:23:094
478899140,10cyclictest594-21rm10:23:084
478899140,10cyclictest26026-21/usr/sbin/munin12:25:234
478899140,10cyclictest25585-21ssh11:12:534
478899140,10cyclictest2502-21sh09:12:154
478899140,10cyclictest23084-21ssh09:23:524
478899140,10cyclictest22758-21ssh10:53:174
478899140,10cyclictest22628-21chrt08:55:044
478899140,10cyclictest22022-21/usr/sbin/munin10:35:214
478899140,10cyclictest2199-21ssh11:00:074
478899140,10cyclictest20710-21fschecks_count08:50:144
478899140,10cyclictest17293-21sh09:38:364
478499145,7cyclictest326-21systemd-journal09:05:243
478499143,6cyclictest7225-21sed09:50:253
478499143,6cyclictest17066-21if_enp6s009:20:163
478499141,9cyclictest5667-21sh11:55:493
478499141,9cyclictest4959-21/usr/sbin/munin10:25:213
478499141,9cyclictest4959-21/usr/sbin/munin10:25:203
478499141,9cyclictest4003-21sh11:19:133
478499141,9cyclictest29478-21diskmemload11:20:353
478499141,9cyclictest29429-21diskmemload12:27:333
478499141,9cyclictest29117-21/usr/sbin/munin08:00:193
478499141,9cyclictest25271-21/usr/sbin/munin09:25:173
478499141,9cyclictest2252-21ssh09:48:093
478499141,9cyclictest19383-21/usr/sbin/munin07:40:153
478499141,9cyclictest16116-21sh12:01:413
478499141,9cyclictest12158-21runrttasks10:47:063
478499141,8cyclictest11272-21/usr/sbin/munin11:05:133
478499141,10cyclictest6141-21/usr/sbin/munin08:20:223
478499140,9cyclictest8957-21ssh11:40:113
478499140,8cyclictest29478-21diskmemload11:38:383
478499140,11cyclictest880-21chrt08:07:063
478499140,10cyclictest780-21runrttasks08:16:053
478499140,10cyclictest5865-21latency07:10:183
478499140,10cyclictest3583-21ssh11:00:203
478499140,10cyclictest3471-21sh12:30:463
478499140,10cyclictest32328-21/usr/sbin/munin10:05:153
478499140,10cyclictest31775-21latency_hist10:05:003
478499140,10cyclictest31746-21awk12:10:243
478499140,10cyclictest30298-21ssh10:21:123
478499140,10cyclictest30298-21ssh10:21:113
478499140,10cyclictest28934-21ssh10:56:173
478499140,10cyclictest26679-21/usr/sbin/munin11:50:193
478499140,10cyclictest26679-21/usr/sbin/munin11:50:183
478499140,10cyclictest25797-21sh10:36:433
478499140,10cyclictest25351-21ssh12:06:543
478499140,10cyclictest2514-21grep09:30:153
478499140,10cyclictest24527-21ssh11:48:453
478499140,10cyclictest24527-21ssh11:48:453
478499140,10cyclictest24116-21grep07:50:093
478499140,10cyclictest23653-21grep09:41:453
478499140,10cyclictest22855-21ps07:45:193
478499140,10cyclictest19959-21ssh11:10:023
478499140,10cyclictest18984-21runrttasks07:39:463
478499140,10cyclictest1800-21ssh10:41:193
478499140,10cyclictest16890-21sh11:25:403
478499140,10cyclictest16772-21/usr/sbin/munin10:50:193
478499140,10cyclictest16765-21sh09:38:143
478499140,10cyclictest12961-21ssh09:18:053
478499140,10cyclictest12731-21/usr/sbin/munin10:30:203
478499140,10cyclictest12126-21/usr/sbin/munin07:25:173
478499140,10cyclictest10928-21timerwakeupswit10:10:233
478499140,10cyclictest10195-21/usr/sbin/munin12:35:123
477999141,9cyclictest9992-21sh10:45:342
477999141,9cyclictest2262-21sh11:00:102
477999141,11cyclictest16-1pr/legacy09:21:232
4779991410,3cyclictest25271-21/usr/sbin/munin09:25:202
477999140,9cyclictest29282-21aten2_r5power_v11:15:132
477999140,9cyclictest16776-21ssh11:25:362
477999140,8cyclictest18461-21diskmemload12:21:042
477999140,12cyclictest26740-21ssh11:13:422
477999140,10cyclictest9029-21rm11:58:142
477999140,10cyclictest8429-21date08:25:002
477999140,10cyclictest8019-21sh12:34:042
477999140,10cyclictest7517-21sh12:15:152
477999140,10cyclictest7491-21ssh11:39:202
477999140,10cyclictest7327-21threads11:20:242
477999140,10cyclictest5199-21sh09:50:042
477999140,10cyclictest477-21sh09:10:552
477999140,10cyclictest4635-21missed_timers08:15:182
477999140,10cyclictest3898-21sh09:30:302
477999140,10cyclictest30641-21diskstats12:10:142
477999140,10cyclictest2916-21sh10:42:062
477999140,10cyclictest28190-21ssh12:26:382
477999140,10cyclictest27569-21ssh11:50:162
477999140,10cyclictest27569-21ssh11:50:162
477999140,10cyclictest23236-21ssh10:00:072
477999140,10cyclictest23151-21sh10:17:322
477999140,10cyclictest21390-21sh09:40:222
477999140,10cyclictest19220-21find11:45:212
477999140,10cyclictest19220-21find11:45:202
477999140,10cyclictest1758-21ssh09:47:472
477999140,10cyclictest17355-21ssh10:32:192
477999140,10cyclictest16772-21/usr/sbin/munin10:50:172
477999140,10cyclictest14845-21sh12:00:462
477999140,10cyclictest12574-21sh12:35:432
477999140,10cyclictest11644-21ssh10:10:452
477999140,10cyclictest11091-21ssh11:40:332
477999140,10cyclictest10268-21runrttasks08:26:172
477699146,6cyclictest19671-21tr07:40:131
477699143,8cyclictest21888-21cat11:10:251
477699141,9cyclictest780-21runrttasks08:46:211
477699141,9cyclictest3209-21runrttasks08:11:451
477699141,9cyclictest30607-21ssh12:28:231
477699141,9cyclictest26795-21switchtime09:25:231
477699141,9cyclictest21541-21sh11:46:401
477699141,9cyclictest21541-21sh11:46:391
477699141,9cyclictest15017-21ssh09:37:001
477699141,9cyclictest11412-21ssh10:46:351
477699141,10cyclictest16-1pr/legacy08:15:281
477699141,10cyclictest10449-21ssh10:28:461
477699141,10cyclictest10449-21ssh10:28:451
477699140,8cyclictest6365-21sh10:08:351
477699140,12cyclictest6121-21ssh09:50:151
477699140,11cyclictest26861-21ssh11:31:231
477699140,10cyclictest8895-21ssh11:03:421
477699140,10cyclictest7963-21taskset08:21:571
477699140,10cyclictest780-21runrttasks11:50:281
477699140,10cyclictest780-21runrttasks11:50:281
477699140,10cyclictest7200-21/usr/sbin/munin09:15:111
477699140,10cyclictest716-21snmpd11:29:371
477699140,10cyclictest5793-21ssh10:44:071
477699140,10cyclictest5035-21chrt07:10:121
477699140,10cyclictest3968-21sh11:36:511
477699140,10cyclictest3659-21ssh12:13:131
477699140,10cyclictest32226-21ssh11:16:141
477699140,10cyclictest31819-21df08:05:131
477699140,10cyclictest31023-21ssh10:57:471
477699140,10cyclictest30091-21sh10:03:481
477699140,10cyclictest28539-21runrttasks07:56:421
477699140,10cyclictest27376-21latency_hist09:05:011
477699140,10cyclictest23757-21ssh09:24:211
477699140,10cyclictest21735-21/usr/sbin/munin07:45:121
477699140,10cyclictest18922-21ssh10:50:321
477699140,10cyclictest18779-21chrt07:36:581
477699140,10cyclictest18563-21sh12:21:091
477699140,10cyclictest18322-21ssh09:56:521
477699140,10cyclictest17970-21ssh10:15:011
477699140,10cyclictest15583-21/usr/sbin/munin08:40:121
477699140,10cyclictest15565-21ssh10:31:031
477699140,10cyclictest15439-21ssh12:01:121
477699140,10cyclictest14877-21sh10:13:011
477699140,10cyclictest1435-21ssh10:23:421
477699140,10cyclictest1435-21ssh10:23:421
477699140,10cyclictest13707-21sh11:05:461
477699140,10cyclictest12060-21ssh11:23:341
477699140,10cyclictest10195-21/usr/sbin/munin12:35:141
477699140,10cyclictest1018-21/usr/sbin/munin12:30:251
477199145,7cyclictest9201-21chrt07:17:300
477199143,8cyclictest32597-21processes08:05:190
477199143,8cyclictest18069-21processes10:50:180
477199142,10cyclictest21432-21cat10:35:010
477199141,9cyclictest780-21runrttasks08:19:120
477199141,9cyclictest1771-21diskmemload12:30:160
477199141,7cyclictest174-1kworker/0:1H+kblockd08:31:530
477199141,11cyclictest31645-21plymouth12:10:200
477199141,11cyclictest26470-21netstat09:25:180
477199141,10cyclictest3227-21sh10:42:200
477199141,10cyclictest31087-21runrttasks08:04:030
477199140,9cyclictest3037-21ssh09:30:180
477199140,7cyclictest28179-21ssh11:50:240
477199140,7cyclictest28179-21ssh11:50:230
477199140,7cyclictest25178-21ssh12:06:470
477199140,7cyclictest12802-21df_inode12:00:130
477199140,6cyclictest174-1kworker/0:1H+kblockd07:29:580
477199140,12cyclictest9941-21grep10:10:140
477199140,10cyclictest780-21runrttasks09:46:380
477199140,10cyclictest780-21runrttasks08:50:590
477199140,10cyclictest5043-21ssh11:00:570
477199140,10cyclictest3374-21sh11:18:450
477199140,10cyclictest14434-21ssh11:25:050
477199140,10cyclictest11379-21ssh12:35:170
477199140,10cyclictest10191-21wc08:25:380
2750899140,11tDemoTimingTask3151-21chrt10:06:195
107329140,5tAtEmLog_010353-21taskset09:16:155
478899135,6cyclictest19959-21/usr/sbin/munin07:40:154
478899132,8cyclictest32302-21ssh10:05:114
478899131,9cyclictest9391-21runrttasks07:19:444
478899131,9cyclictest21998-21diskmemload09:40:374
478899131,9cyclictest13792-21runrttasks07:25:334
478899130,9cyclictest9769-21/usr/sbin/munin07:20:114
478899130,9cyclictest8988-21/usr/sbin/munin11:40:184
478899130,9cyclictest780-21runrttasks10:15:204
478899130,9cyclictest5036-21/usr/sbin/munin07:10:134
478899130,9cyclictest4308-21runrttasks08:15:154
478899130,9cyclictest32330-21diskmemload11:35:054
478899130,9cyclictest31468-21/usr/sbin/munin08:05:114
478899130,9cyclictest29568-21diskstats11:15:154
478899130,9cyclictest29117-21/usr/sbin/munin08:00:124
478899130,9cyclictest28261-21sh09:26:104
478899130,9cyclictest27731-21missed_timers07:55:204
478899130,9cyclictest27416-21/usr/sbin/munin09:05:124
478899130,9cyclictest26496-21runrttasks11:50:034
478899130,9cyclictest26496-21runrttasks11:50:024
478899130,9cyclictest25063-21/usr/sbin/munin09:00:134
478899130,9cyclictest24120-21/usr/sbin/munin07:50:184
478899130,9cyclictest23529-21diskmemload12:05:374
478899130,9cyclictest23141-21ssh10:00:044
478899130,9cyclictest21835-21aten2_r5power_v07:45:134
478899130,9cyclictest20212-21sh11:45:424
478899130,9cyclictest20212-21sh11:45:424
478899130,9cyclictest18075-21cpu08:45:134
478899130,9cyclictest16774-21needreboot12:20:174
478899130,9cyclictest1456-21aten2_r5power_e08:10:114
478899130,9cyclictest13209-21/usr/sbin/munin08:35:244
478899130,9cyclictest10968-21aten2_r5power_v08:30:124
478899130,10cyclictest9638-21ssh09:15:464
478899130,10cyclictest26066-21grep10:55:134
478899130,10cyclictest13295-21cut10:30:144
478499130,9cyclictest7388-21/usr/sbin/munin07:15:203
478499130,9cyclictest25063-21/usr/sbin/munin09:00:153
478499130,9cyclictest23452-21cat08:55:173
478499130,9cyclictest15163-21taskset08:38:473
478499130,9cyclictest1466-21wget08:10:113
478499130,9cyclictest11110-21cpuspeed_turbos08:30:123
478499130,10cyclictest20703-21grep08:50:143
478499130,10cyclictest14827-21df07:30:133
477999135,6cyclictest30640-21timerwakeupswit08:00:242
477999131,7cyclictest27952-21ssh10:55:342
477999130,9cyclictest9821-21aten2_r5power_e07:20:112
477999130,9cyclictest8829-21runrttasks07:15:252
477999130,9cyclictest780-21runrttasks08:55:102
477999130,9cyclictest780-21runrttasks07:50:012
477999130,9cyclictest716-21snmpd09:55:012
477999130,9cyclictest31518-21aten2_r5power_e08:05:132
477999130,9cyclictest26748-21/usr/sbin/munin07:55:172
477999130,9cyclictest19688-21runrttasks08:46:052
477999130,9cyclictest19494-21aten2_r5power_v07:40:122
477999130,9cyclictest15751-21cpuspeed08:40:122
477999130,9cyclictest1405-21/usr/sbin/munin08:10:142
477999130,9cyclictest14048-21chrt07:29:052
477999130,9cyclictest10845-21runrttasks08:30:072
477999130,10cyclictest6025-21grep07:10:192
477999130,10cyclictest32291-21ssh10:05:102
477999130,10cyclictest27746-21tr09:05:132
477999130,10cyclictest15541-21ntpq07:30:182
477999130,10cyclictest14107-21sed08:35:172
477699131,9cyclictest8914-21sh12:15:351
477699130,9cyclictest9769-21/usr/sbin/munin07:20:161
477699130,9cyclictest7388-21/usr/sbin/munin07:15:131
477699130,9cyclictest5517-21ssh11:55:431
477699130,9cyclictest21787-21sh10:35:021
477699130,9cyclictest1768-21diskmemload09:30:081
477699130,9cyclictest12126-21/usr/sbin/munin07:25:141
477699130,9cyclictest11264-21fschecks_count08:30:141
477699130,10cyclictest9249-21/usr/sbin/munin08:25:161
477699130,10cyclictest9080-21aten2_r5power_p11:40:131
477699130,10cyclictest780-21runrttasks08:36:491
477699130,10cyclictest29581-21chrt08:00:141
477699130,10cyclictest22632-21chrt08:55:081
477199135,6cyclictest5728-21cat11:20:140
477199134,5cyclictest2554-21processes08:10:180
4771991310,2cyclictest22740-21needreboot07:45:180
477199130,9cyclictest6554-21unixbench-2d07:10:250
477199130,9cyclictest6133-21runrttasks08:20:060
477199130,9cyclictest15699-21grep08:40:120
477199130,7cyclictest780-21runrttasks09:00:160
477199130,7cyclictest174-1kworker/0:1H+kblockd09:05:220
477199130,7cyclictest174-1kworker/0:1H+kblockd08:55:590
477199130,7cyclictest174-1kworker/0:1H+kblockd07:51:270
477199130,12cyclictest18247-21tr08:45:130
477199130,10cyclictest716-21snmpd07:42:010
477199130,10cyclictest27074-21cpuspeed_turbos07:55:140
477199130,10cyclictest13378-21cpuspeed08:35:120
477199130,10cyclictest10339-21tune2fs07:20:140
3150999131,10tDemoTimingTask3488-21chrt12:30:475
2678339130,3EcMasterDemoSyn27125-21turbostat09:05:015
2249099131,10tDemoTimingTask29061-21chrt12:27:175
1648899130,10tDemoTimingTask18082-21chrt07:35:205
763499120,10tDemoTimingTask16428-21taskset11:07:445
478899123,8cyclictest15723-21/usr/sbin/munin07:30:204
478899121,6cyclictest4847-21cat07:10:014
478899120,9cyclictest18633-21update-cracklib07:36:184
478499120,9cyclictest286-21jbd2/md0-808:45:063
477199120,9cyclictest4781-21latency_hist07:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional