You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 17:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Sat Dec 06, 2025 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21622391080,2EcMasterDemoSyn32-21ksoftirqd/110:18:261
2772739830,0EcMasterDemoSyn2773729tAtEmLog_009:07:265
1878139830,0EcMasterDemoSyn1879129tAtEmLog_009:27:435
1658339830,0EcMasterDemoSyn1659329tAtEmLog_012:30:175
3198239820,0EcMasterDemoSyn3199229tAtEmLog_009:37:525
2697139820,0EcMasterDemoSyn2698129tAtEmLog_007:56:275
2431239820,0EcMasterDemoSyn2432229tAtEmLog_007:51:225
2062739820,0EcMasterDemoSyn2063729tAtEmLog_008:52:135
1703839820,0EcMasterDemoSyn1704829tAtEmLog_007:36:095
3138039810,0EcMasterDemoSyn3138929tAtEmLog_012:20:085
1827039810,0EcMasterDemoSyn1828029tAtEmLog_008:47:095
1688239810,0EcMasterDemoSyn1689229tAtEmLog_011:29:265
1353439810,0EcMasterDemoSyn1354429tAtEmLog_008:37:015
194642740,0sleep20-21swapper/208:50:232
402539650,1EcMasterDemoSyn0-21swapper/108:16:441
1658339620,0EcMasterDemoSyn0-21swapper/112:30:161
3228992118,2cyclictest27301-21kworker/4:2+events07:20:564
252852210,0sleep10-21swapper/111:10:241
322499189,7cyclictest7877-21cron07:20:003
321399180,9cyclictest17646-21smartctl12:30:230
321399180,14cyclictest6588-21sh10:06:170
321399180,10cyclictest5307-21sh11:44:070
194232180,0sleep014-21ksoftirqd/010:16:080
321399174,6cyclictest31551-21aten2_r5power_e12:20:120
321399170,9cyclictest16124-21ssh10:39:330
321399170,9cyclictest13524-21sh12:28:260
204799170,8tDemoTimingTask7134-21taskset10:57:205
204799170,8tDemoTimingTask2233-21chrt10:54:075
166999170,7tDemoTimingTask3757-21taskset08:15:265
166999170,7tDemoTimingTask1899-21chrt08:14:255
322899165,8cyclictest24097-21awk12:15:184
322899164,8cyclictest752-21ntpd11:15:204
3228991612,3cyclictest7905-21cpuspeed_turbos12:25:164
3228991612,3cyclictest719-21rs:main4
322899160,10cyclictest13731-21ssh10:37:014
322499160,9cyclictest11345-21/usr/sbin/munin11:25:363
321999169,5cyclictest7249-21grep12:05:222
321999160,8cyclictest29426-21runrttasks10:24:272
321399165,8cyclictest13254-21cat08:35:240
321399160,9cyclictest805-21runrttasks08:29:270
321399160,9cyclictest25081-21sh09:56:070
321399160,9cyclictest10633-21diskmemload09:20:350
321399160,6cyclictest17510-21latency_hist11:30:000
321399160,13cyclictest805-21runrttasks07:18:200
321399160,13cyclictest146-1kworker/0:1H+kblockd12:35:130
1260529160,9tAtEmLog_014755-21taskset09:24:565
322899153,8cyclictest8704-21aten2_r5power_e09:20:134
3228991511,3cyclictest31320-21needreboot10:25:204
322899151,10cyclictest805-21runrttasks09:25:474
322899151,10cyclictest32689-21/usr/sbin/munin12:20:184
322899150,9cyclictest21899-21runrttasks07:45:424
322899150,11cyclictest5396-21runrttasks11:44:114
322899150,11cyclictest14123-21/usr/sbin/munin08:40:134
322899150,10cyclictest18307-21ssh12:11:574
322499158,5cyclictest15631-21wc11:50:193
322499155,8cyclictest24590-21/usr/sbin/munin11:10:193
322499155,8cyclictest10434-21/usr/sbin/munin09:20:253
322499154,8cyclictest21247-21netstat07:45:183
3224991511,3cyclictest717-21in:imuxsock12:30:003
322499151,10cyclictest23254-21idleruntime07:50:173
322499151,10cyclictest21254-21runrttasks10:43:213
3224991510,3cyclictest16463-21cron10:39:593
321999155,8cyclictest740-21/usr/sbin/munin11:40:222
321999151,10cyclictest29371-21sh12:37:322
321999150,9cyclictest24389-21sh09:31:532
321999150,11cyclictest16710-21cat11:05:002
321599158,5cyclictest4896-21tr08:20:141
321599156,7cyclictest28092-21postgres12:36:341
321599151,10cyclictest7036-21ssh09:43:351
321599151,10cyclictest17934-21sh09:50:391
321599150,9cyclictest26442-21ssh09:33:581
321599150,11cyclictest5096-21ssh09:15:541
321599150,10cyclictest8203-21/usr/sbin/munin07:20:201
321399157,6cyclictest8252-21latency_hist09:20:000
321399157,6cyclictest6128-21wc10:30:260
321399156,7cyclictest509-21ssh11:16:100
321399156,7cyclictest29334-21sh12:18:490
321399151,11cyclictest10136-21runrttasks07:23:310
321399151,10cyclictest21564-21sh12:14:250
321399150,9cyclictest31881-21ssh09:37:470
321399150,9cyclictest27621-21ssh11:36:420
321399150,9cyclictest20461-21sh09:53:160
321399150,9cyclictest15466-21ps11:04:030
321399150,8cyclictest805-21runrttasks09:09:590
321399150,6cyclictest805-21runrttasks07:58:030
321399150,11cyclictest31972-21runrttasks08:09:390
321399150,11cyclictest24208-21sshd09:31:430
321399150,11cyclictest16065-21runrttasks08:43:390
2168499150,9tDemoTimingTask16482-21sleep10:44:545
2024299150,9tDemoTimingTask22023-21chrt09:54:555
1550729150,13tAtEmLog_021990-21chrt11:08:525
322899145,7cyclictest13413-21kworker/u24:3+nfsiod12:00:484
322899141,10cyclictest6296-21df_inode12:05:154
322899141,10cyclictest18538-21sh09:51:164
322899140,9cyclictest738-21snmpd11:10:404
322899140,9cyclictest16477-21/usr/sbin/munin08:45:164
322899140,11cyclictest13906-21sh11:26:234
322899140,10cyclictest8637-21ssh10:08:204
322899140,10cyclictest8532-21sh11:22:524
322899140,10cyclictest805-21runrttasks10:55:484
322899140,10cyclictest805-21runrttasks09:56:254
322899140,10cyclictest7917-21ssh10:32:094
322899140,10cyclictest738-21snmpd11:48:354
322899140,10cyclictest7088-21aten2_r5power_v08:25:144
322899140,10cyclictest5446-21diskmemload09:17:064
322899140,10cyclictest3476-21/usr/sbin/munin07:10:164
322899140,10cyclictest28856-21latency_hist10:50:014
322899140,10cyclictest27595-21ssh12:36:114
322899140,10cyclictest23550-21ssh10:20:014
322899140,10cyclictest23549-21runrttasks09:00:074
322899140,10cyclictest23161-21ssh09:30:404
322899140,10cyclictest22576-21/usr/sbin/munin07:50:134
322899140,10cyclictest2254-21/usr/sbin/munin08:15:164
322899140,10cyclictest2031-21chrt09:40:044
322899140,10cyclictest20147-21chrt10:16:544
322899140,10cyclictest18667-21unixbench_multi11:05:254
322899140,10cyclictest18227-21ssh12:30:324
322899140,10cyclictest1592-21runrttasks08:10:534
322899140,10cyclictest13923-21sh10:11:574
322899140,10cyclictest10835-21chrt09:45:294
322899140,10cyclictest10835-21chrt09:45:294
322899140,10cyclictest10454-21chrt08:30:214
322499145,7cyclictest30694-21fschecks_count10:25:163
322499142,8cyclictest752-21ntpd11:05:203
322499141,9cyclictest805-21runrttasks08:14:023
322499141,9cyclictest4818-21uname10:05:183
322499141,9cyclictest32737-21sh10:52:033
322499141,9cyclictest31409-21ssh12:20:083
322499141,9cyclictest22463-21sh12:33:463
322499141,9cyclictest18148-21ssh12:11:503
3224991411,2cyclictest19418-21systemctl07:40:313
3224991411,2cyclictest19418-21systemctl07:40:313
322499141,10cyclictest32565-21sh09:12:433
322499141,10cyclictest13840-21/usr/sbin/munin07:30:193
322499140,9cyclictest7579-21ssh09:44:093
322499140,9cyclictest738-21snmpd09:45:063
322499140,9cyclictest738-21snmpd09:45:063
322499140,9cyclictest20466-21sh09:29:493
322499140,10cyclictest9605-21rm11:46:113
322499140,10cyclictest805-21runrttasks08:03:153
322499140,10cyclictest738-21snmpd10:34:333
322499140,10cyclictest738-21snmpd09:36:063
322499140,10cyclictest738-21snmpd09:32:123
322499140,10cyclictest6534-21sh11:20:283
322499140,10cyclictest6323-21chrt08:20:483
322499140,10cyclictest6298-21sh12:05:153
322499140,10cyclictest6265-21ssh09:18:013
322499140,10cyclictest31635-21ssh11:40:043
322499140,10cyclictest28338-21ssh12:36:443
322499140,10cyclictest27668-21runrttasks09:06:463
322499140,10cyclictest26606-21sh11:58:013
322499140,10cyclictest2578-21ssh10:04:053
322499140,10cyclictest23731-21/usr/sbin/munin10:20:203
322499140,10cyclictest22552-21rm09:55:093
322499140,10cyclictest20620-21sh11:30:573
322499140,10cyclictest20620-21sh11:30:563
322499140,10cyclictest18827-21chrt08:50:123
322499140,10cyclictest18814-21ssh09:51:313
322499140,10cyclictest1874-21sh12:02:253
321999145,8cyclictest18652-21/usr/sbin/munin11:30:152
321999145,8cyclictest18652-21/usr/sbin/munin11:30:142
321999141,9cyclictest22906-21/usr/sbin/munin12:15:232
321999141,9cyclictest2208-21cut08:15:012
321999141,10cyclictest25120-21fschecks_time11:35:172
321999141,10cyclictest25052-21sh10:45:482
321999141,10cyclictest2342-21wget08:15:142
3219991410,3cyclictest20550-21cpuspeed_turbos07:45:132
3219991410,3cyclictest1-21systemd09:05:222
321999140,9cyclictest11423-21ssh12:26:532
321999140,11cyclictest738-21snmpd10:01:012
321999140,10cyclictest9186-21ls09:45:132
321999140,10cyclictest9186-21ls09:45:132
321999140,10cyclictest8632-21/usr/sbin/munin09:20:172
321999140,10cyclictest805-21runrttasks10:25:582
321999140,10cyclictest5651-21ntpq10:30:212
321999140,10cyclictest4815-21kernelversion10:05:182
321999140,10cyclictest420-21sh12:01:212
321999140,10cyclictest3476-21/usr/sbin/munin07:10:212
321999140,10cyclictest32687-21sh12:20:182
321999140,10cyclictest3177-21sh11:19:012
321999140,10cyclictest31598-21ssh10:51:022
321999140,10cyclictest28385-21rm09:35:162
321999140,10cyclictest27489-21sh11:58:442
321999140,10cyclictest27431-21date08:00:002
321999140,10cyclictest22567-21sh09:55:102
321999140,10cyclictest19693-21runrttasks07:41:592
321999140,10cyclictest19693-21runrttasks07:41:592
321999140,10cyclictest19316-21sh11:06:002
321999140,10cyclictest18782-21ssh09:51:302
321999140,10cyclictest17174-21runrttasks09:25:282
321999140,10cyclictest15974-21runrttasks08:42:242
321999140,10cyclictest14405-21sh11:26:532
321999140,10cyclictest14273-21rm12:10:042
321999140,10cyclictest10340-21/usr/sbin/munin10:35:212
321599148,5cyclictest5174-21cut10:30:171
321599141,9cyclictest3161-21latency_hist07:10:001
321599140,11cyclictest16567-21wget08:45:161
321599140,11cyclictest15137-21ssh09:25:021
321599140,11cyclictest13702-21rm09:23:501
321599140,10cyclictest805-21runrttasks11:55:201
321599140,10cyclictest805-21runrttasks10:06:351
321599140,10cyclictest805-21runrttasks09:11:011
321599140,10cyclictest805-21runrttasks08:51:021
321599140,10cyclictest805-21runrttasks08:34:431
321599140,10cyclictest7870-21taskset07:19:591
321599140,10cyclictest766-21ssh11:16:221
321599140,10cyclictest7631-21/usr/sbin/munin12:25:201
321599140,10cyclictest738-21snmpd10:20:371
321599140,10cyclictest6991-21/usr/sbin/munin08:25:201
321599140,10cyclictest6849-21sh11:45:111
321599140,10cyclictest6648-21ssh10:56:501
321599140,10cyclictest5907-21/usr/sbin/munin12:05:141
321599140,10cyclictest5368-21chrt07:12:581
321599140,10cyclictest4976-21ssh12:23:271
321599140,10cyclictest3574-21ssh12:03:421
321599140,10cyclictest32308-21/usr/sbin/munin08:10:161
321599140,10cyclictest32208-21ssh10:01:071
321599140,10cyclictest32140-21ssh10:25:341
321599140,10cyclictest31702-21rm11:40:091
321599140,10cyclictest30367-21ssh09:36:031
321599140,10cyclictest29925-21ssh10:50:181
321599140,10cyclictest27744-21ssh10:48:371
321599140,10cyclictest27309-21runrttasks12:17:161
321599140,10cyclictest26697-21ssh09:57:421
321599140,10cyclictest26648-21ssh11:35:411
321599140,10cyclictest22958-21sh11:33:541
321599140,10cyclictest22958-21sh11:33:531
321599140,10cyclictest22576-21/usr/sbin/munin07:50:191
321599140,10cyclictest22164-21runrttasks07:48:391
321599140,10cyclictest18908-21ssh10:40:401
321599140,10cyclictest17617-21latency_hist11:30:001
321599140,10cyclictest17015-21runrttasks07:35:591
321599140,10cyclictest16922-21/usr/sbin/munin11:05:211
321599140,10cyclictest14402-21/usr/sbin/munin12:10:171
321599140,10cyclictest14394-21ssh11:50:121
321599140,10cyclictest14394-21ssh10:12:281
321599140,10cyclictest14244-21wc07:30:251
321599140,10cyclictest12356-21apache209:05:201
321599140,10cyclictest12010-21timerwakeupswit10:35:251
321599140,10cyclictest11918-21ssh09:46:351
321599140,10cyclictest11918-21ssh09:46:351
321599140,10cyclictest11696-21/usr/sbin/munin08:35:151
321599140,10cyclictest11339-21grep11:00:221
321399146,6cyclictest9961-21cron10:10:020
321399146,6cyclictest28472-21atemtest09:10:130
321399146,6cyclictest24131-21diskstats10:20:150
321399145,7cyclictest26663-21sh11:11:400
321399144,8cyclictest28906-21switchtime08:00:240
321399143,8cyclictest16785-21cat09:25:240
321399143,8cyclictest1156-21runrttasks10:27:050
321399143,6cyclictest18400-21which07:40:160
321399143,6cyclictest18400-21which07:40:160
321399141,7cyclictest805-21runrttasks07:32:430
321399140,7cyclictest31901-21sh10:51:190
321399140,7cyclictest19816-21/usr/sbin/munin11:30:250
321399140,7cyclictest19816-21/usr/sbin/munin11:30:250
321399140,7cyclictest17112-21grep11:05:150
321399140,7cyclictest10127-21ntpq09:45:200
321399140,7cyclictest10127-21ntpq09:45:190
321399140,12cyclictest29583-21sh10:00:020
321399140,12cyclictest23181-21cut10:45:130
321399140,12cyclictest17690-21hddtemp_smartct10:40:180
321399140,11cyclictest805-21runrttasks07:10:380
321399140,10cyclictest8355-21sh11:45:260
321399140,10cyclictest805-21runrttasks09:01:520
321399140,10cyclictest7367-21sh12:05:240
321399140,10cyclictest7333-21sh10:57:310
321399140,10cyclictest4734-21basename11:20:140
321399140,10cyclictest3378-21ssh12:03:330
321399140,10cyclictest2919-21hddtemp_smartct08:15:170
321399140,10cyclictest24576-21sh11:56:220
321399140,10cyclictest24353-21runintdemo5min07:51:260
321399140,10cyclictest21577-21threads07:45:230
321399140,10cyclictest2105-21diskmemload09:40:080
321399140,10cyclictest17731-21python308:45:230
321399140,10cyclictest1582-21taskset08:10:440
321399140,10cyclictest14397-21aten2_r5power_c11:50:120
321399140,10cyclictest10843-21grep07:25:130
2163399140,8tDemoTimingTask23141-21taskset10:19:555
990939130,2EcMasterDemoSyn10264-21sleep07:25:005
322899139,3cyclictest26089-21switchtime11:35:254
322899131,9cyclictest13148-21cpuspeed07:30:144
322899130,9cyclictest6281-21vmstat08:20:254
322899130,9cyclictest30506-21mailstats10:50:224
322899130,9cyclictest30468-21runrttasks10:00:164
322899130,9cyclictest29958-21/usr/sbin/munin08:05:144
322899130,9cyclictest29260-21if_enp5s009:10:184
322899130,9cyclictest27606-21/usr/sbin/munin08:00:144
322899130,9cyclictest25077-21apt-key07:55:014
322899130,9cyclictest21985-21fschecks_count11:55:154
322899130,9cyclictest21182-21/usr/sbin/munin08:55:144
322899130,9cyclictest18833-21/usr/sbin/munin08:50:244
322899130,9cyclictest18797-21tune2fs11:30:164
322899130,9cyclictest18797-21tune2fs11:30:164
322899130,9cyclictest16980-21/usr/sbin/munin10:40:224
322899130,9cyclictest15318-21/usr/sbin/munin07:35:204
322899130,9cyclictest12618-21taskset07:29:344
322899130,9cyclictest10125-21/usr/sbin/munin11:00:154
322899130,10cyclictest20479-21rm11:54:314
322899130,10cyclictest13530-21runintdemo5min08:37:014
322499139,3cyclictest3629-21aten2_r5power_e10:55:173
322499131,8cyclictest24392-21sh11:35:023
322499130,9cyclictest8203-21/usr/sbin/munin07:20:153
322499130,9cyclictest805-21runrttasks11:00:093
322499130,9cyclictest7351-21diskstats08:25:153
322499130,9cyclictest4534-21/usr/sbin/munin07:10:213
322499130,9cyclictest29996-21/usr/sbin/munin08:05:123
322499130,9cyclictest25259-21taskset09:01:013
322499130,9cyclictest22743-21ssh10:45:023
322499130,9cyclictest2254-21/usr/sbin/munin08:15:213
322499130,9cyclictest17154-21cpuspeed_turbos10:15:143
322499130,9cyclictest15676-21df07:35:153
322499130,9cyclictest14624-21fschecks_time08:40:153
322499130,9cyclictest13351-21awk08:35:253
322499130,9cyclictest11019-21fschecks_time07:25:153
322499130,10cyclictest805-21runrttasks08:56:543
322499130,10cyclictest30809-21cut11:15:153
322499130,10cyclictest25813-21gltestperf07:55:173
322499130,10cyclictest22847-21ssh12:15:083
322499130,10cyclictest16477-21/usr/sbin/munin08:45:223
322499130,10cyclictest10890-21wget10:10:193
322499130,10cyclictest10335-21needreboot08:30:203
321999133,8cyclictest16576-21/usr/sbin/munin07:35:232
321999131,9cyclictest17884-21missed_timers10:15:192
321999131,7cyclictest6832-21ssh11:45:122
321999130,9cyclictest805-21runrttasks08:01:462
321999130,9cyclictest7666-21runrttasks07:17:132
321999130,9cyclictest7056-21aten2_r5power_p08:25:142
321999130,9cyclictest5159-21grep10:55:292
321999130,9cyclictest4638-21/usr/sbin/munin08:20:132
321999130,9cyclictest3021-21/usr/sbin/munin09:40:192
321999130,9cyclictest29958-21/usr/sbin/munin08:05:132
321999130,9cyclictest28456-21/usr/sbin/munin09:10:152
321999130,9cyclictest23658-21apt11:10:112
321999130,9cyclictest17837-21timerandwakeup08:45:262
321999130,9cyclictest16973-21runrttasks10:40:142
321999130,9cyclictest15880-21sh12:30:012
321999130,9cyclictest14079-21proc_pri07:30:212
321999130,9cyclictest10644-21wget07:25:132
321999130,10cyclictest9837-21sed07:20:252
321999130,10cyclictest9669-21cut08:30:152
321999130,10cyclictest805-21runrttasks09:02:022
321999130,10cyclictest7452-21sh11:21:372
321999130,10cyclictest4153-21mailstats09:15:222
321999130,10cyclictest22664-21wget07:50:132
321999130,10cyclictest21270-21wget08:55:142
321999130,10cyclictest14254-21sh11:50:052
321999130,10cyclictest10577-21rm10:10:022
321599131,9cyclictest5064-21sh11:20:151
321599130,9cyclictest805-21runrttasks08:02:281
321599130,9cyclictest11807-21python307:25:211
321599130,10cyclictest805-21runrttasks07:40:571
321599130,10cyclictest805-21runrttasks07:40:571
321599130,10cyclictest30716-21kernelversion08:05:171
321599130,10cyclictest25232-21/usr/sbin/munin07:55:141
321599130,10cyclictest23556-21/usr/sbin/munin09:00:201
321599130,10cyclictest21498-21cpuspeed_turbos08:55:151
321599130,10cyclictest14623-21perl08:40:151
321399134,7cyclictest16230-21sed07:35:190
321399130,9cyclictest5512-21memory08:20:180
321399130,9cyclictest21802-21grep08:55:170
321399130,10cyclictest9410-21aten2_r5power_p08:30:140
321399130,10cyclictest20587-21runrttasks08:51:480
3172199130,7tDemoTimingTask31859-21taskset08:08:065
2852129130,2tAtEmLog_028570-21chrt10:23:325
281299130,11tDemoTimingTask3047-21chrt07:08:375
1960799130,11tDemoTimingTask19848-21chrt07:44:075
1960799130,11tDemoTimingTask19848-21chrt07:44:075
865499120,10tDemoTimingTask15075-21chrt11:03:405
587839120,0EcMasterDemoSyn0-21swapper/511:44:385
403529120,9tAtEmLog_06293-21chrt08:20:265
3231099120,10tDemoTimingTask5697-21taskset09:17:245
3231099120,10tDemoTimingTask1539-21chrt09:14:125
322899120,9cyclictest5916-21wget07:15:134
322899120,9cyclictest26001-21cut09:05:144
322899120,8cyclictest17766-21grep07:40:124
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional