You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 09:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Thu Dec 25, 2025 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2115721140,1sleep50-21swapper/523:11:095
1257339910,0EcMasterDemoSyn1258329tAtEmLog_021:21:235
2140339840,0EcMasterDemoSyn2141329tAtEmLog_021:06:105
2109139830,0EcMasterDemoSyn2110129tAtEmLog_020:00:135
1632339830,0EcMasterDemoSyn1633329tAtEmLog_000:39:095
456039820,0EcMasterDemoSyn457029tAtEmLog_023:38:185
38239820,0EcMasterDemoSyn39229tAtEmLog_023:18:005
1766939820,0EcMasterDemoSyn1767929tAtEmLog_000:03:395
1451839820,0EcMasterDemoSyn1452829tAtEmLog_023:07:535
1367739820,0EcMasterDemoSyn1368729tAtEmLog_023:43:225
1159739820,0EcMasterDemoSyn1160729tAtEmLog_020:45:525
333339810,0EcMasterDemoSyn334329tAtEmLog_000:13:485
3219539720,4EcMasterDemoSyn32201-21ps20:20:311
222682330,0sleep50-21swapper/522:36:025
1159739300,1EcMasterDemoSyn11604-21runintdemo5min20:45:530
30202240,0sleep40-21swapper/423:55:174
30202240,0sleep40-21swapper/423:55:164
1871239190,1EcMasterDemoSyn18717-21runintdemo5min19:55:103
167352190,0sleep00-21swapper/022:15:230
2932399180,10cyclictest5805-21rm23:20:241
2931799185,9cyclictest21958-21sh22:35:480
2931799180,14cyclictest19497-21runrttasks23:46:050
2931799180,10cyclictest4882-21sh00:32:330
2931799180,10cyclictest3860-21sh22:09:100
2931799180,10cyclictest27615-21sh23:33:030
2931799180,10cyclictest10895-21sh00:17:460
1372399180,8tDemoTimingTask16053-21chrt19:50:005
1372399180,8tDemoTimingTask16053-21chrt19:50:005
538099170,10tDemoTimingTask8413-21chrt23:04:555
2933899170,14cyclictest327-21systemd-journal19:21:384
29334991710,5cyclictest817-21head19:15:173
2933099179,6cyclictest29889-21find22:40:192
2933099173,7cyclictest27968-21kworker/u24:4+nfsiod22:58:142
2932399175,7cyclictest26789-21/usr/sbin/munin23:50:191
2931799170,9cyclictest8830-21sh23:05:010
2931799170,9cyclictest31450-21sh00:10:420
2931799170,9cyclictest31305-21sh22:40:590
2931799170,9cyclictest20148-21sh22:53:040
2931799170,14cyclictest26470-21sh00:26:070
2931799170,14cyclictest20024-21sh00:05:050
2931799170,14cyclictest18200-21sh00:21:350
2931799170,10cyclictest9941-21rm22:47:220
2670599170,10tDemoTimingTask28431-21chrt00:09:565
2280829170,7tAtEmLog_023159-21chrt23:48:415
71529160,6tAtEmLog_02425-21taskset22:08:095
420699160,9tDemoTimingTask4210-21taskset19:24:435
40552160,0sleep00-21swapper/023:20:120
3220699161,8tDemoTimingTask362-21taskset20:25:015
29338991612,3cyclictest22963-21sh00:25:004
2933899161,11cyclictest16-1pr/legacy20:30:384
2933499160,9cyclictest27881-21ssh00:27:093
2933499160,9cyclictest12583-21ssh00:36:263
2933099160,8cyclictest22679-21sh00:24:482
2931799168,6cyclictest11675-21find22:30:230
2931799164,9cyclictest28553-21latency_hist22:05:000
2931799160,8cyclictest22751-21sh21:44:420
2931799160,8cyclictest14896-21runrttasks20:55:050
2931799160,10cyclictest2929-21ssh23:55:170
2931799160,10cyclictest2929-21ssh23:55:160
2931799160,10cyclictest20658-21sh23:29:310
3046999150,9tDemoTimingTask22972-21sleep00:29:545
2933899154,8cyclictest25431-21awk22:55:264
2933899151,9cyclictest28049-21sh22:21:504
29338991511,3cyclictest22133-21head20:00:204
2933899150,9cyclictest744-21snmpd23:25:024
2933899150,10cyclictest22895-21ssh22:19:364
2933499158,6cyclictest22634-21grep23:30:173
2933499157,6cyclictest32664-21tail21:15:153
2933499155,8cyclictest2108-21/usr/sbin/munin20:25:253
2933499155,5cyclictest644-21dbus-daemon21:35:053
2933499151,10cyclictest14056-21runrttasks22:31:423
2933499150,9cyclictest30387-21taskset21:14:313
2933499150,9cyclictest23222-21latency_hist00:25:003
2933499150,11cyclictest26771-21ssh21:45:563
2933099157,6cyclictest12265-21grep21:55:252
29330991511,3cyclictest338-21cpuspeed_turbos23:00:142
2933099151,10cyclictest2215-21/usr/sbin/munin19:20:112
2933099150,8cyclictest27348-21ssh23:32:532
2933099150,13cyclictest18669-21aten2_r5power_p21:25:112
2933099150,11cyclictest12419-21latency_hist23:25:002
2932399154,8cyclictest10474-21sh23:59:581
2932399154,8cyclictest10474-21sh23:59:571
2932399153,8cyclictest4593-21aten2_r5power_c19:25:101
29323991512,2cyclictest1-21systemd20:00:001
2932399151,10cyclictest7076-21runrttasks20:38:051
2932399151,10cyclictest24279-21sh00:07:001
2932399151,10cyclictest13420-21ssh22:14:251
2932399150,10cyclictest16554-21/usr/sbin/munin23:45:181
2931799157,6cyclictest26401-21tr20:10:160
2931799156,7cyclictest466-21cstates23:00:140
2931799152,9cyclictest30055-21ssh21:48:100
2931799151,8cyclictest175-1kworker/0:1H+kblockd21:17:210
2931799151,10cyclictest831-21runrttasks23:35:130
2931799150,9cyclictest12299-21sh00:36:130
2931799150,8cyclictest29877-21runrttasks19:10:020
2931799150,8cyclictest24376-21sh21:27:590
2931799150,7cyclictest25452-21mailstats22:20:190
2933899147,5cyclictest7023-21grep23:40:004
2933899143,8cyclictest1035-21smartctl21:15:214
2933899141,9cyclictest831-21runrttasks00:26:034
2933899141,10cyclictest2150-21sh23:00:274
2933899140,8cyclictest21741-21diskmemload00:01:064
2933899140,12cyclictest29229-21ssh23:15:284
2933899140,10cyclictest9072-21/usr/sbin/munin23:05:214
2933899140,10cyclictest8901-21sh22:29:404
2933899140,10cyclictest744-21snmpd23:22:194
2933899140,10cyclictest5375-21wget22:45:124
2933899140,10cyclictest32488-21ssh22:06:334
2933899140,10cyclictest24345-21ssh23:13:224
2933899140,10cyclictest21955-21/usr/sbin/munin23:30:154
2933899140,10cyclictest19379-21sh22:35:094
2933899140,10cyclictest18387-21ssh22:51:554
2933899140,10cyclictest18351-21ssh21:25:034
2933899140,10cyclictest1765-21sh22:42:584
2933899140,10cyclictest17623-21cstates21:00:134
2933899140,10cyclictest12589-21ssh21:55:344
2933899140,10cyclictest11733-21ssh21:38:324
2933899140,10cyclictest10063-21latency00:35:164
2933499143,8cyclictest10207-21grep23:05:173
2933499141,9cyclictest957-21latency00:30:193
2933499141,9cyclictest8804-21sh22:46:343
2933499141,9cyclictest3813-21sh21:34:293
2933499141,9cyclictest3093-21sh23:37:163
2933499141,9cyclictest30388-21fschecks_time19:10:143
2933499141,9cyclictest29820-21ssh22:05:163
2933499141,9cyclictest18288-21sh21:25:013
2933499141,10cyclictest1250-21runrttasks22:25:133
2933499140,9cyclictest831-21runrttasks19:20:153
2933499140,9cyclictest16639-21sh22:50:423
2933499140,12cyclictest12619-21grep19:40:193
2933499140,10cyclictest9186-21/usr/sbin/munin21:20:133
2933499140,10cyclictest831-21runrttasks23:40:393
2933499140,10cyclictest831-21runrttasks21:51:203
2933499140,10cyclictest831-21runrttasks20:31:003
2933499140,10cyclictest831-21runrttasks20:17:373
2933499140,10cyclictest6664-21sh23:57:163
2933499140,10cyclictest6664-21sh23:57:153
2933499140,10cyclictest6555-21ssh23:20:563
2933499140,10cyclictest32547-21/usr/sbin/munin23:00:173
2933499140,10cyclictest32382-21sh22:41:453
2933499140,10cyclictest32140-21rm00:11:123
2933499140,10cyclictest28225-21ssh23:15:193
2933499140,10cyclictest26677-21ssh22:20:523
2933499140,10cyclictest26647-21sh23:15:003
2933499140,10cyclictest24759-21ssh22:55:203
2933499140,10cyclictest24138-21sh00:06:543
2933499140,10cyclictest23432-21/usr/sbin/munin20:05:253
2933499140,10cyclictest23280-21cat20:05:003
2933499140,10cyclictest22930-21sh23:48:313
2933499140,10cyclictest19439-21/usr/sbin/munin22:35:273
2933499140,10cyclictest18334-21/usr/sbin/munin21:00:183
2933499140,10cyclictest15933-21sensors_fan21:40:213
2933499140,10cyclictest13998-21/usr/sbin/munin19:45:143
2933499140,10cyclictest13998-21/usr/sbin/munin19:45:143
2933499140,10cyclictest13367-21ssh21:56:073
2933499140,10cyclictest12782-21ssh23:25:073
2933499140,10cyclictest12191-21wc20:50:003
2933499140,10cyclictest12174-21sh00:18:413
2933499140,10cyclictest1139-21sh23:54:413
2933499140,10cyclictest11027-21ssh00:00:023
2933099143,8cyclictest357-21systemd-udevd23:56:182
2933099143,8cyclictest357-21systemd-udevd23:56:172
2933099141,9cyclictest6358-21/usr/sbin/munin21:35:192
2933099141,9cyclictest6332-21runrttasks19:26:542
2933099141,9cyclictest10592-40mandb00:00:012
2933099141,10cyclictest831-21runrttasks23:07:152
2933099141,10cyclictest16-1pr/legacy21:46:422
2933099141,10cyclictest16-1pr/legacy00:34:042
2933099141,10cyclictest13681-21hddtemp_smartct23:25:172
2933099140,11cyclictest31246-21ssh23:16:542
2933099140,10cyclictest9222-21ssh00:35:102
2933099140,10cyclictest831-21runrttasks22:06:222
2933099140,10cyclictest831-21runrttasks19:36:552
2933099140,10cyclictest8038-21sh00:15:452
2933099140,10cyclictest8008-21sh22:10:412
2933099140,10cyclictest7403-21rm22:28:372
2933099140,10cyclictest691-21ssh21:32:232
2933099140,10cyclictest2819-21ssh23:37:042
2933099140,10cyclictest28152-21ssh21:13:002
2933099140,10cyclictest28132-21/usr/sbin/munin20:15:122
2933099140,10cyclictest25613-21cut23:50:122
2933099140,10cyclictest24821-21sh22:02:342
2933099140,10cyclictest24059-21/usr/sbin/munin22:20:252
2933099140,10cyclictest21637-21runrttasks21:43:582
2933099140,10cyclictest20151-21/usr/sbin/munin00:05:222
2933099140,10cyclictest19095-21sh23:45:482
2933099140,10cyclictest16956-21gltestperf19:50:142
2933099140,10cyclictest13451-21sh21:21:562
2933099140,10cyclictest13212-21ssh22:31:072
2932399143,8cyclictest8768-21ntpq23:40:191
2932399143,8cyclictest760-21lldpd19:23:111
2932399141,9cyclictest32474-21apt00:30:131
2932399141,9cyclictest1614-21ssh23:36:121
2932399141,10cyclictest31197-21sh22:40:541
2932399141,10cyclictest14765-21rm00:38:011
2932399140,9cyclictest1968-21timerwakeupswit20:25:251
2932399140,9cyclictest10532-21ssh22:30:151
2932399140,12cyclictest16968-21ssh00:03:101
2932399140,10cyclictest9900-21/usr/sbin/munin20:45:131
2932399140,10cyclictest8984-21sh00:16:271
2932399140,10cyclictest785-21fw_packets23:00:161
2932399140,10cyclictest5168-21/usr/sbin/munin21:35:241
2932399140,10cyclictest4805-21runrttasks20:34:111
2932399140,10cyclictest3951-21diskmemload22:26:131
2932399140,10cyclictest31882-21ssh22:06:081
2932399140,10cyclictest30625-21diskmemload22:59:041
2932399140,10cyclictest30402-21ssh23:16:181
2932399140,10cyclictest29560-21sort00:10:151
2932399140,10cyclictest2894-21ssh21:33:511
2932399140,10cyclictest28227-21basename20:15:121
2932399140,10cyclictest25243-21chrt20:06:531
2932399140,10cyclictest25094-21ssh23:31:161
2932399140,10cyclictest24013-21/usr/sbin/munin21:45:141
2932399140,10cyclictest22448-21sh22:19:171
2932399140,10cyclictest22327-21/usr/sbin/munin21:10:141
2932399140,10cyclictest21517-21rm00:23:571
2932399140,10cyclictest2085-21ntp_kernel_err21:50:181
2932399140,10cyclictest20338-21irqstats22:35:181
2932399140,10cyclictest19186-21ssh23:10:171
2932399140,10cyclictest18498-21cut21:00:201
2932399140,10cyclictest16609-21ssh22:50:391
2932399140,10cyclictest16317-21ssh23:26:291
2932399140,10cyclictest14989-21ssh21:57:121
2932399140,10cyclictest14484-21/usr/sbin/munin21:40:161
2932399140,10cyclictest14124-21runrttasks20:52:411
2932399140,10cyclictest13998-21/usr/sbin/munin19:45:121
2932399140,10cyclictest13998-21/usr/sbin/munin19:45:121
2932399140,10cyclictest10201-21ssh22:47:331
2931799146,6cyclictest7103-21/usr/sbin/munin22:10:190
2931799145,7cyclictest27865-21apt-config21:30:000
2931799143,6cyclictest29527-21apt-key19:10:000
2931799142,9cyclictest20156-21sh23:10:270
2931799142,8cyclictest24157-21basename20:05:180
2931799141,9cyclictest8543-21unixbench_singl19:30:230
2931799141,9cyclictest831-21runrttasks21:10:520
29317991411,2cyclictest30202-21latency_hist20:20:000
2931799141,10cyclictest26827-21sh22:56:250
2931799140,8cyclictest175-1kworker/0:1H+kblockd23:16:040
2931799140,7cyclictest13093-21ssh21:55:550
2931799140,12cyclictest20624-21sshd19:58:200
2931799140,10cyclictest9218-21taskset20:40:350
2931799140,10cyclictest864-21runintdemo5min19:50:060
2931799140,10cyclictest8634-21ssh21:36:270
2931799140,10cyclictest831-21runrttasks19:36:020
2931799140,10cyclictest831-21runrttasks19:17:060
2931799140,10cyclictest7986-21df_inode23:40:150
2931799140,10cyclictest671-21rm21:50:040
2931799140,10cyclictest6128-21cat20:35:180
2931799140,10cyclictest3859-21sh22:26:100
2931799140,10cyclictest3780-21needreboot20:30:180
2931799140,10cyclictest25364-21sh23:50:020
2931799140,10cyclictest17620-21cstates21:00:130
2931799140,10cyclictest15050-21sh21:23:010
2931799140,10cyclictest13006-21irqstats20:50:180
2931799140,10cyclictest11172-21sh00:00:100
1128499140,11tDemoTimingTask13394-21chrt19:41:415
106782140,7sleep110706-21ssh21:20:221
892599130,11tDemoTimingTask11204-21chrt19:39:105
547739130,0EcMasterDemoSyn0-21swapper/522:27:185
451829130,11tAtEmLog_04735-21chrt20:33:145
2933899131,9cyclictest1510-21/usr/sbin/munin00:30:214
2933899131,9cyclictest11570-21runrttasks20:45:374
2933899131,7cyclictest273350cat20:30:014
2933899130,9cyclictest9273-21/usr/sbin/munin19:35:184
2933899130,9cyclictest8497-21ssh23:40:174
2933899130,9cyclictest831-21runrttasks20:53:474
2933899130,9cyclictest7547-21/usr/sbin/munin20:40:104
2933899130,9cyclictest747-21cat19:15:174
2933899130,9cyclictest607-21ssh21:50:024
2933899130,9cyclictest6025-21ssh00:15:134
2933899130,9cyclictest5175-21/usr/sbin/munin20:35:244
2933899130,9cyclictest29887-21/usr/sbin/munin19:10:164
2933899130,9cyclictest28132-21/usr/sbin/munin20:15:234
2933899130,9cyclictest28127-21sh21:30:084
2933899130,9cyclictest25781-21/usr/sbin/munin20:10:144
2933899130,9cyclictest25578-21/usr/sbin/munin23:50:194
2933899130,9cyclictest24013-21/usr/sbin/munin21:45:234
2933899130,9cyclictest23992-21fschecks_time20:05:174
2933899130,9cyclictest22914-21ssh22:01:174
2933899130,9cyclictest22684-21grep21:10:144
2933899130,9cyclictest20151-21/usr/sbin/munin00:05:154
2933899130,9cyclictest19706-21sh23:46:154
2933899130,9cyclictest18857-21aten2_r5power_v19:55:144
2933899130,9cyclictest17077-21sh22:33:474
2933899130,9cyclictest16349-21/usr/sbin/munin19:50:204
2933899130,9cyclictest15262-21df_inode20:55:134
2933899130,9cyclictest14728-21if_err_enp5s019:45:164
2933899130,9cyclictest14728-21if_err_enp5s019:45:164
2933899130,9cyclictest14571-21wget21:40:134
2933899130,9cyclictest13776-21sh21:22:104
2933899130,9cyclictest12714-21ntp_offset19:40:204
2933899130,9cyclictest1027-21sh00:12:094
2933899130,10cyclictest7042-21mailstats22:10:194
2933899130,10cyclictest32698-21sed20:25:004
2933899130,10cyclictest21715-21runrttasks21:09:524
2933499131,9cyclictest16323-21grep19:50:053
2933499130,9cyclictest8461-21/usr/sbin/munin19:30:233
2933499130,9cyclictest8347-21cat20:40:153
2933499130,9cyclictest831-21runrttasks19:25:013
2933499130,9cyclictest771-21sshd21:08:203
2933499130,9cyclictest6967-21chrt20:36:373
2933499130,9cyclictest32541-21chrt20:24:413
2933499130,9cyclictest19540-21ssh22:00:053
2933499130,9cyclictest14840-21cat20:55:003
2933499130,9cyclictest11288-21taskset19:39:563
2933499130,10cyclictest831-21runrttasks22:10:083
2933499130,10cyclictest26204-21fschecks_count20:10:153
2933499130,10cyclictest14867-21hostname22:15:113
2933499130,10cyclictest12358-21aten2_r5power_v20:50:143
2933099137,2cyclictest0-21swapper/222:45:132
2933099135,6cyclictest644-21dbus-daemon21:00:062
2933099135,6cyclictest3177-21df_inode20:30:142
2933099130,9cyclictest831-21runrttasks20:42:052
2933099130,9cyclictest831-21runrttasks20:07:052
2933099130,9cyclictest831-21runrttasks19:33:272
2933099130,9cyclictest8094-21fschecks_count23:40:162
2933099130,9cyclictest771-21sshd19:11:202
2933099130,9cyclictest32254-21tr21:15:142
2933099130,9cyclictest28828-21sh00:10:002
2933099130,9cyclictest25870-21wget20:10:132
2933099130,9cyclictest19684-21/usr/sbin/munin21:05:162
2933099130,9cyclictest19646-21sensors_volt23:10:202
2933099130,9cyclictest19374-21gltestperf19:55:162
2933099130,9cyclictest19265-21sh22:35:052
2933099130,9cyclictest14904-21/usr/sbin/munin20:55:202
2933099130,9cyclictest14325-21ssh22:50:132
2933099130,9cyclictest14162-21/usr/sbin/munin19:45:132
2933099130,9cyclictest14162-21/usr/sbin/munin19:45:132
2933099130,9cyclictest13299-21ntp_kernel_err20:50:202
2933099130,9cyclictest10731-21latency20:45:182
2933099130,10cyclictest409-21chrt20:25:102
2933099130,10cyclictest3268-21sh21:50:422
2933099130,10cyclictest31185-21/usr/sbin/munin20:20:152
2933099130,10cyclictest25447-21sh00:25:242
2933099130,10cyclictest17072-21ssh22:15:372
2933099130,10cyclictest1625-21taskset19:17:102
2932399136,6cyclictest21764-21cut20:00:171
2932399135,6cyclictest23555-21cut00:25:111
2932399130,9cyclictest8935-21diskmemload23:05:051
2932399130,9cyclictest32476-21grep19:15:131
2932399130,9cyclictest31967-21ssh21:15:111
2932399130,9cyclictest29883-21taskset19:10:071
2932399130,9cyclictest27644-21runrttasks20:12:341
2932399130,9cyclictest24802-21hddtemp_smartct22:20:161
2932399130,9cyclictest21374-21taskset21:05:541
2932399130,9cyclictest20338-21fschecks_time22:00:161
2932399130,9cyclictest18565-21/usr/sbin/munin21:25:161
2932399130,9cyclictest16339-21ps19:50:081
2932399130,9cyclictest14904-21/usr/sbin/munin20:55:191
2932399130,10cyclictest7598-21aten2_r5power_e20:40:101
2932399130,10cyclictest11649-21/usr/sbin/munin19:40:151
2931799133,7cyclictest175-1kworker/0:1H+kblockd21:05:270
2931799130,9cyclictest745-21cpuspeed_turbos20:25:140
2931799130,9cyclictest4562-21chrt19:25:080
2931799130,7cyclictest175-1kworker/0:1H+kblockd20:20:230
2931799130,7cyclictest175-1kworker/0:1H+kblockd19:40:210
2931799130,7cyclictest175-1kworker/0:1H+kblockd19:24:000
2931799130,11cyclictest15796-21sshd19:47:200
2931799130,11cyclictest15796-21sshd19:47:200
2931799130,10cyclictest831-21runrttasks20:02:250
2919629130,3tAtEmLog_031774-21chrt19:13:295
2684099130,11tDemoTimingTask28913-21chrt19:05:585
2109139130,1EcMasterDemoSyn21100-21runintdemo5min20:00:132
1905799130,11tDemoTimingTask19348-21chrt21:04:405
152182130,0sleep50-21swapper/523:25:425
1445829130,10tAtEmLog_021952-21chrt22:00:385
853239120,0EcMasterDemoSyn0-21swapper/523:58:355
853239120,0EcMasterDemoSyn0-21swapper/523:58:345
420699120,10tDemoTimingTask4560-21taskset19:25:075
392291211,0tAtEmLog_00-21swapper/523:20:245
3187599120,10tDemoTimingTask1686-21chrt19:18:005
2933899120,9cyclictest831-21runrttasks19:30:014
2933899120,9cyclictest4802-21grep19:25:114
2933499120,9cyclictest29391-21cat19:10:003
2933099124,6cyclictest5552-21fschecks_count20:35:152
2933099120,9cyclictest12606-21needreboot19:40:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional