You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 04:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Mon Sep 14, 2026 00:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
236792860,1sleep50-21swapper/500:35:185
289002630,0sleep50-21swapper/519:10:235
2739599180,14cyclictest774-21runrttasks21:13:050
2739599180,14cyclictest16813-21sh00:31:000
2739599180,10cyclictest6010-21sh21:57:020
2739599180,10cyclictest26311-21sh21:31:400
2739599180,10cyclictest25827-21sh23:59:520
2739599180,10cyclictest25425-21sendmail_mailqu23:40:200
2739599180,10cyclictest1963-21sh22:13:320
2739599180,10cyclictest15279-21sh22:39:520
27406991713,3cyclictest6698-21head21:20:283
2740199176,8cyclictest1959-21sh00:04:402
2739599174,10cyclictest7342-21sh22:16:000
2739599173,10cyclictest20169-21sh23:37:320
2739599170,9cyclictest32371-21sh00:03:100
2739599170,9cyclictest31898-21sh22:49:140
2739599170,9cyclictest26633-21sh22:27:180
2739599170,9cyclictest12378-21sh00:29:090
2739599170,9cyclictest1115-21sh00:22:140
2739599170,13cyclictest774-21runrttasks20:53:530
2741099164,8cyclictest27758-21latency_hist22:09:594
2741099164,8cyclictest15393-21netstat19:50:184
2740699163,9cyclictest29186-21missed_timers22:10:163
2740199164,9cyclictest22956-21timerwakeupswit23:20:252
2740199163,9cyclictest13604-21hostname21:25:112
27401991612,3cyclictest5353-21cpuspeed_turbos20:40:132
2739799164,8cyclictest31764-21unixbench-2d23:25:241
27397991612,3cyclictest683-21dbus-daemon20:00:001
2739599169,6cyclictest1700-21grep22:50:140
2739599160,9cyclictest18707-21sh22:22:530
27410991511,3cyclictest32285-21sh23:45:004
2741099151,12cyclictest27344-21sh21:14:414
2741099151,10cyclictest6230-21sh21:57:114
2741099151,10cyclictest1609-21/usr/sbin/munin23:45:194
2741099151,10cyclictest10287-21cpuspeed_turbos20:50:154
2741099150,8cyclictest13794-21sh22:01:194
2741099150,13cyclictest27553-21sh22:46:024
2741099150,11cyclictest15334-21ssh22:20:254
2740699154,8cyclictest728-21lldpd23:39:013
2740699154,8cyclictest14357-21latency22:20:173
2740699153,8cyclictest6813-21tr00:25:203
2740699153,8cyclictest27556-21cpu23:05:143
2740699151,10cyclictest819-21diskstats23:45:143
2740699151,10cyclictest774-21runrttasks00:01:083
2740699150,11cyclictest11563-21sh23:32:373
2740699150,10cyclictest16123-21latency_hist21:45:003
2740199156,5cyclictest12393-21tr19:45:132
2740199155,7cyclictest22616-21kworker/u24:4+nfsiod22:12:382
2740199153,9cyclictest711-21snmpd21:57:282
2740199150,13cyclictest15545-21diskmemload00:30:202
2739799154,8cyclictest13049-21latency_hist21:24:591
2739799153,9cyclictest23185-21vmstat23:20:271
2739799152,9cyclictest16350-21expr22:40:151
27397991511,3cyclictest29393-21cpuspeed_turbos00:20:121
2739799151,10cyclictest397-21/usr/sbin/munin20:30:181
2739799150,11cyclictest20812-21ssh22:24:271
2739599156,7cyclictest9844-21head23:50:130
2739599156,7cyclictest4079-21ssh21:37:380
2739599156,7cyclictest26733-21ssh22:09:220
2739599156,7cyclictest18603-21/usr/sbin/munin21:45:250
2739599156,7cyclictest11465-21/usr/sbin/munin22:00:170
2739599151,7cyclictest23194-21cstates00:35:150
2739599151,10cyclictest774-21runrttasks20:16:200
2739599151,10cyclictest19692-21sh21:28:260
2739599150,13cyclictest5205-21cstates21:20:160
2739599150,11cyclictest4082-21ssh23:28:440
2739599150,10cyclictest9294-21sh23:13:030
2741099146,6cyclictest683-21dbus-daemon21:45:204
2741099146,6cyclictest15104-21memory00:30:184
2741099141,9cyclictest7450-21idleruntime23:30:164
2741099141,9cyclictest4525-21runrttasks22:15:104
2741099141,9cyclictest24799-21runrttasks00:35:284
2741099141,9cyclictest21372-21taskset23:56:344
2741099141,9cyclictest20863-21sh21:29:184
2741099141,9cyclictest19567-21ssh22:41:364
27410991411,2cyclictest697-21polkitd19:29:594
2741099141,10cyclictest8602-21ssh22:54:294
2741099140,11cyclictest2451-21chrt22:13:534
2741099140,10cyclictest932-21sh22:30:494
2741099140,10cyclictest9127-21/usr/sbin/munin23:50:114
2741099140,10cyclictest8771-21/usr/sbin/munin22:35:224
2741099140,10cyclictest774-21runrttasks23:35:564
2741099140,10cyclictest711-21snmpd19:36:214
2741099140,10cyclictest6617-21ssh00:25:194
2741099140,10cyclictest4758-21sh23:10:174
2741099140,10cyclictest31228-21runrttasks20:25:154
2741099140,10cyclictest29617-21sh00:01:104
2741099140,10cyclictest25310-21chrt23:22:004
2741099140,10cyclictest24455-21sed20:10:184
2741099140,10cyclictest23813-21ssh00:16:324
2741099140,10cyclictest2277-21ssh21:36:224
2741099140,10cyclictest1788-21sh21:18:174
2741099140,10cyclictest16680-21munin-run21:05:004
2741099140,10cyclictest16442-21rm00:12:304
2741099140,10cyclictest13245-21/usr/sbin/munin19:45:204
2741099140,10cyclictest11836-21ssh21:41:524
2740699143,8cyclictest24554-21unixbench_singl21:30:253
2740699143,8cyclictest24231-21grep23:40:123
2740699141,9cyclictest3971-21runrttasks19:26:303
2740699141,9cyclictest31542-21sh00:20:453
2740699141,9cyclictest281-21jbd2/md0-822:55:023
2740699141,9cyclictest25398-21sh21:50:073
2740699141,9cyclictest14695-21runrttasks00:11:143
2740699141,9cyclictest13904-21python323:15:193
2740699140,8cyclictest2014650python323:00:243
2740699140,10cyclictest9488-21sh23:13:123
2740699140,10cyclictest9127-21/usr/sbin/munin23:50:223
2740699140,10cyclictest8558-21sh22:16:543
2740699140,10cyclictest852-21ssh22:50:013
2740699140,10cyclictest774-21runrttasks19:50:213
2740699140,10cyclictest7076-21ssh22:35:023
2740699140,10cyclictest589-21kernelversion19:20:173
2740699140,10cyclictest5621-21grep20:40:153
2740699140,10cyclictest5132-21sh23:29:313
2740699140,10cyclictest4291-21wc00:05:203
2740699140,10cyclictest32061-21cat20:25:233
2740699140,10cyclictest30985-21apt-get22:30:163
2740699140,10cyclictest30115-21chrt20:23:163
2740699140,10cyclictest29957-21/usr/sbin/munin19:15:113
2740699140,10cyclictest29855-21ssh21:15:233
2740699140,10cyclictest26865-21cat20:15:193
2740699140,10cyclictest2528-21ssh21:36:333
2740699140,10cyclictest24667-21sh22:45:083
2740699140,10cyclictest24396-21cat00:35:253
2740699140,10cyclictest23615-21/usr/sbin/munin20:10:213
2740699140,10cyclictest22838-21sh21:11:243
2740699140,10cyclictest22679-21ssh21:48:223
2740699140,10cyclictest22348-21ssh00:15:273
2740699140,10cyclictest22020-21ssh22:25:073
2740699140,10cyclictest21307-21/usr/sbin/munin20:05:133
2740699140,10cyclictest21135-21sh23:20:073
2740699140,10cyclictest19392-21ssh22:05:103
2740699140,10cyclictest19223-21grep20:00:153
2740699140,10cyclictest1842-21/usr/sbin/munin21:55:173
2740699140,10cyclictest18047-21ssh00:31:543
2740699140,10cyclictest17841-21ssh23:55:093
2740699140,10cyclictest17091-21missed_timers22:40:203
2740699140,10cyclictest17058-21fschecks_count19:55:133
2740699140,10cyclictest15677-21ssh21:25:333
2740699140,10cyclictest13988-21/usr/sbin/munin20:55:253
2740699140,10cyclictest13472-21sh22:01:053
2740699140,10cyclictest12337-21cpuspeed_turbos19:45:133
2740699140,10cyclictest11865-21runrttasks20:52:393
2740199145,7cyclictest20110-21fschecks_time21:10:152
2740199142,8cyclictest31986-21load22:30:212
2740199141,9cyclictest8620-21ssh21:21:502
2740199141,9cyclictest7146-21/usr/sbin/munin19:35:182
2740199141,9cyclictest29957-21/usr/sbin/munin19:15:122
2740199141,9cyclictest16245-21runrttasks19:53:182
2740199141,9cyclictest13469-21ssh22:01:052
2740199141,9cyclictest10097-21sh00:09:142
27401991410,3cyclictest15582-21cpuspeed_turbos23:35:122
2740199140,9cyclictest18087-21munin-run23:00:002
2740199140,10cyclictest8762-21sh22:17:022
2740199140,10cyclictest7910-21/usr/sbin/munin21:40:122
2740199140,10cyclictest7312-21/usr/sbin/munin22:35:162
2740199140,10cyclictest711-21snmpd21:15:062
2740199140,10cyclictest6882-21rm23:30:142
2740199140,10cyclictest4275-21ssh22:51:192
2740199140,10cyclictest397-21/usr/sbin/munin20:30:192
2740199140,10cyclictest3540-21sh23:10:002
2740199140,10cyclictest29879-21ssh23:25:072
2740199140,10cyclictest27838-21runrttasks20:18:522
2740199140,10cyclictest25554-21wget21:50:132
2740199140,10cyclictest24382-21grep23:40:132
2740199140,10cyclictest22842-21rm22:06:312
2740199140,10cyclictest21002-21sh23:00:432
2740199140,10cyclictest20029-21ssh21:46:272
2740199140,10cyclictest16973-21/usr/sbin/munin21:05:252
2740199140,10cyclictest15752-21sh23:53:512
2740199140,10cyclictest14131-21/usr/sbin/munin22:20:152
2740199140,10cyclictest13195-21chrt00:29:452
2740199140,10cyclictest11781-21/usr/sbin/munin00:10:232
2739799143,8cyclictest730-21ntpd20:15:201
2739799143,8cyclictest728-21lldpd22:05:271
2739799141,9cyclictest7503-21sh19:35:131
2739799141,9cyclictest4593-21/usr/sbin/munin22:15:141
2739799141,9cyclictest3624-21ssh23:10:041
2739799141,9cyclictest27202-21taskset23:41:171
2739799141,9cyclictest23108-21sh23:57:521
2739799141,9cyclictest22359-21sh21:11:041
27397991411,2cyclictest0-21swapper/122:05:001
2739799141,10cyclictest6528-21runrttasks23:30:071
27397991410,3cyclictest683-21dbus-daemon20:40:001
27397991410,3cyclictest683-21dbus-daemon20:40:001
2739799140,10cyclictest9128-21ssh23:50:091
2739799140,10cyclictest8792-21irqstats21:40:171
2739799140,10cyclictest863-21ssh23:08:201
2739799140,10cyclictest8197-21uname20:45:181
2739799140,10cyclictest774-21runrttasks20:05:431
2739799140,10cyclictest711-21snmpd21:03:481
2739799140,10cyclictest711-21snmpd19:24:331
2739799140,10cyclictest6341-21latency00:25:171
2739799140,10cyclictest4647-21aten2_r5power_v19:30:131
2739799140,10cyclictest31933-21sh21:16:371
2739799140,10cyclictest31659-21ssh22:11:341
2739799140,10cyclictest30718-21sh22:30:041
2739799140,10cyclictest26167-21ssh22:45:191
2739799140,10cyclictest2600-21latency_hist00:04:591
2739799140,10cyclictest25742-21sh21:31:141
2739799140,10cyclictest25500-21/usr/sbin/munin21:50:251
2739799140,10cyclictest24370-21ssh22:25:391
2739799140,10cyclictest22959-21chrt00:35:151
2739799140,10cyclictest20869-21chrt20:03:151
2739799140,10cyclictest20127-21runrttasks00:15:001
2739799140,10cyclictest1973-21aten2_r5power_v21:55:131
2739799140,10cyclictest19425-21sh23:19:061
2739799140,10cyclictest16377-21ssh21:26:031
2739799140,10cyclictest16081-21sh00:30:271
2739799140,10cyclictest15445-21rm22:58:051
2739799140,10cyclictest14118-21chrt20:57:011
2739799140,10cyclictest11642-21ssh00:10:101
2739599146,6cyclictest21615-21tr23:20:130
2739599145,7cyclictest25899-21df21:50:140
2739599143,8cyclictest23677-21grep20:10:130
2739599141,7cyclictest11534-21cat19:45:000
2739599141,10cyclictest32596-21sh23:45:020
2739599140,9cyclictest10055-21cpu22:55:120
2739599140,8cyclictest103-1kworker/0:1H+kblockd20:29:170
2739599140,7cyclictest22877-21grep20:05:240
2739599140,7cyclictest14737-21/usr/sbin/munin19:50:140
2739599140,12cyclictest28865-21fschecks_count21:15:160
2739599140,12cyclictest20462-21aten2_r5power_p00:15:120
2739599140,12cyclictest19663-21/usr/sbin/munin23:00:180
2739599140,11cyclictest774-21runrttasks21:00:360
2739599140,11cyclictest11594-21ssh00:10:080
2739599140,10cyclictest8065-21wc19:35:170
2739599140,10cyclictest774-21runrttasks23:30:210
2739599140,10cyclictest774-21runrttasks23:05:240
2739599140,10cyclictest774-21runrttasks19:16:250
2739599140,10cyclictest5890-21ssh00:06:070
2739599140,10cyclictest4546-21apt-get19:30:120
2739599140,10cyclictest32566-21cpuspeed_turbos19:20:130
2739599140,10cyclictest30905-21ssh22:30:130
2739599140,10cyclictest2543-21/usr/sbin/munin19:25:130
2739599140,10cyclictest15955-21sh22:40:080
2739599140,10cyclictest1560-21proc_pri20:30:200
2739599140,10cyclictest13784-21timerwakeupswit20:55:230
2739599140,10cyclictest13231-21idleruntime23:15:160
2739599140,10cyclictest11793-21runrttasks21:41:490
2741099135,6cyclictest3993-21mailstats20:35:194
2741099135,6cyclictest3993-21mailstats20:35:194
2741099131,9cyclictest12705-21sh22:56:064
2741099130,9cyclictest7441-21/usr/sbin/munin20:45:164
2741099130,9cyclictest5136-21/usr/sbin/munin20:40:124
2741099130,9cyclictest2998-21/usr/sbin/munin00:05:154
2741099130,9cyclictest28990-21sh00:20:044
2741099130,9cyclictest27660-21/usr/sbin/munin19:10:234
2741099130,9cyclictest25919-21/usr/sbin/munin20:15:144
2741099130,9cyclictest20812-21runrttasks20:02:274
2741099130,9cyclictest19089-21forks23:00:154
2741099130,9cyclictest16973-21/usr/sbin/munin21:05:124
2741099130,9cyclictest13586-21sensors_fan20:55:214
2741099130,9cyclictest1106-21sed20:30:164
2741099130,10cyclictest9869-21grep19:40:154
2741099130,10cyclictest7636-21ssh21:21:064
2741099130,10cyclictest597-21ssh23:26:164
2741099130,10cyclictest4539-21runrttasks19:30:094
2741099130,10cyclictest321-21systemd-journal19:55:254
2741099130,10cyclictest30653-21basename19:15:164
2741099130,10cyclictest29416-21sh23:05:304
2741099130,10cyclictest28243-21chrt20:20:044
2741099130,10cyclictest25408-21sh21:50:084
2741099130,10cyclictest22690-21/usr/sbin/munin21:30:194
2741099130,10cyclictest21993-21ssh22:25:054
2741099130,10cyclictest21929-21gltestperf20:05:154
2741099130,10cyclictest14683-21ssh23:15:374
2741099130,10cyclictest1082-21mailstats19:20:204
2740699135,6cyclictest4938-21fschecks_count19:30:153
2740699131,9cyclictest4038-21mailstats20:35:193
2740699131,9cyclictest4038-21mailstats20:35:193
2740699131,8cyclictest711-21snmpd20:32:253
2740699130,9cyclictest9460-21taskset19:40:023
2740699130,9cyclictest8333-21run-parts19:35:203
2740699130,9cyclictest711-21snmpd21:05:063
2740699130,9cyclictest27660-21/usr/sbin/munin19:10:143
2740699130,9cyclictest14768-21aten2_r5power_v21:00:123
2740199136,6cyclictest711-21snmpd20:35:042
2740199136,6cyclictest711-21snmpd20:35:042
2740199135,6cyclictest19449-21tune2fs20:00:162
2740199135,6cyclictest15174-21fschecks_time21:00:142
2740199132,8cyclictest24362-21interrupts20:10:172
2740199132,7cyclictest2965850latency_hist19:15:012
2740199131,9cyclictest774-21runrttasks20:55:072
2740199131,9cyclictest23896-21/usr/sbin/munin21:30:192
2740199131,9cyclictest23710-21cut00:35:192
2740199130,9cyclictest30553-21/usr/sbin/munin20:25:182
2740199130,9cyclictest29132-21sh00:20:102
2740199130,9cyclictest27421-21latency_hist19:10:002
2740199130,9cyclictest27388-21/usr/sbin/munin23:05:222
2740199130,9cyclictest2689-21sh21:36:402
2740199130,9cyclictest25127-21sh22:45:132
2740199130,9cyclictest22955-21ssh00:15:532
2740199130,9cyclictest21907-21rm22:25:032
2740199130,9cyclictest2181-21/usr/sbin/munin19:25:192
2740199130,9cyclictest17799-21/usr/sbin/munin23:55:122
2740199130,9cyclictest16680-21/usr/sbin/munin19:55:162
2740199130,9cyclictest16096-21/usr/sbin/munin22:40:282
2740199130,9cyclictest12292-21ssh23:15:032
2740199130,9cyclictest10506-21tune2fs20:50:162
2740199130,10cyclictest9970-21tune2fs19:40:162
2740199130,10cyclictest8467-21netstat20:45:192
2740199130,10cyclictest774-21runrttasks19:30:022
2740199130,10cyclictest32349-21wget19:20:132
2740199130,10cyclictest28648-21fschecks_count20:20:142
2740199130,10cyclictest1035-21fschecks_time23:45:162
2739799133,7cyclictest14674-21tr19:50:141
2739799131,9cyclictest32534-21runrttasks20:29:481
2739799130,9cyclictest9475-21/usr/sbin/munin19:40:201
2739799130,9cyclictest825-21sh22:50:011
2739799130,9cyclictest774-21runrttasks00:05:001
2739799130,9cyclictest5130-21runrttasks20:40:061
2739799130,9cyclictest4112-21sh23:46:421
2739799130,9cyclictest31280-21ssh21:35:031
2739799130,9cyclictest30991-21awk19:15:181
2739799130,9cyclictest28554-21sed19:10:211
2739799130,9cyclictest23615-21/usr/sbin/munin20:10:141
2739799130,9cyclictest2189-21atemtest19:25:111
2739799130,9cyclictest18668-21/usr/sbin/munin23:00:141
2739799130,9cyclictest17139-21grep21:05:131
2739799130,9cyclictest12076-21/usr/sbin/munin19:45:131
2739799130,9cyclictest10475-21fschecks_count20:50:161
2739799130,8cyclictest26896-21kworker/u24:2+rpciod22:35:051
2739799130,10cyclictest28668-21grep20:20:141
2739799130,10cyclictest16668-21/usr/sbin/munin21:45:201
2739799130,10cyclictest15142-21ssh23:35:021
2739599130,9cyclictest28708-21ntp_kernel_pll_19:10:210
2739599130,9cyclictest18226-21python321:05:200
2739599130,7cyclictest103-1kworker/0:1H+kblockd20:35:470
2739599130,7cyclictest103-1kworker/0:1H+kblockd20:35:470
2739599130,10cyclictest774-21runrttasks20:46:310
2739599130,10cyclictest774-21runrttasks19:55:300
2739599130,10cyclictest5261-21grep20:40:120
2739599130,10cyclictest29337-21open_inodes20:20:190
2739599130,10cyclictest20670-21runrttasks20:00:320
2739599130,10cyclictest12444-21entropy19:45:140
2740699120,9cyclictest7853-21fschecks_count20:45:153
2740199124,6cyclictest21642-21cstates20:05:142
2739599120,7cyclictest27343-21latency_hist19:10:010
63952110,1sleep50-21swapper/522:34:475
2741099110,8cyclictest27418-21latency_hist19:10:004
2739799114,5cyclictest27484-21date19:10:011
257962110,1sleep50-21swapper/522:45:195
112152110,1sleep50-21swapper/521:41:255
91702100,1sleep50-21swapper/520:46:285
27592100,1sleep50-21swapper/523:27:515
30713290,7sleep50-21swapper/521:15:455
274069990,7cyclictest27343-21latency_hist19:10:003
24094290,0sleep50-21swapper/521:12:215
22966280,0sleep50-21swapper/520:05:275
22911280,0sleep50-21swapper/522:06:355
21052280,7sleep50-21swapper/522:42:415
18840280,1sleep50-21swapper/521:08:205
16488280,7sleep50-21swapper/521:02:375
3604270,5sleep50-21swapper/523:10:055
30214270,0sleep50-21swapper/520:24:365
9188260,1sleep50-21swapper/522:54:555
29288260,1sleep50-21swapper/523:24:555
22097260,1sleep50-21swapper/500:34:565
7204250,1sleep50-21swapper/521:39:555
3904250,1sleep50-21swapper/522:14:555
26688252,1sleep50-21swapper/500:00:145
9632240,1sleep50-21swapper/522:55:025
4698240,2sleep50-21swapper/521:20:095
4324240,1sleep50-21swapper/522:15:025
32541240,1sleep50-21swapper/520:29:555
31955240,1sleep50-21swapper/519:20:015
29757240,1sleep50-21swapper/523:05:455
25338240,2sleep50-21swapper/523:59:315
23993240,3sleep50-21swapper/500:16:415
2367240,3sleep50-21swapper/520:33:565
20431240,2sleep50-21swapper/523:37:465
16348241,1sleep50-21swapper/523:54:195
14067240,1sleep50-21swapper/519:50:005
13758240,1sleep50-21swapper/500:10:335
13144240,1sleep50-21swapper/522:20:025
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional