You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 15:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Fri Sep 04, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
247842860,0sleep30-21swapper/309:25:223
105832360,1sleep50-21swapper/509:55:005
349199195,10cyclictest20882-21sh09:23:510
349199186,9cyclictest5583-21sh11:40:580
349199185,9cyclictest24480-21sh12:29:230
349199181,14cyclictest2266-21latency_hist10:45:010
349199180,9cyclictest774-21runrttasks09:31:370
349199180,14cyclictest25308-21sh09:25:420
349199180,10cyclictest31099-21sh10:24:430
349199180,10cyclictest28343-21latency_hist09:09:590
349199180,10cyclictest17096-21sh10:53:040
349199180,10cyclictest16747-21sh09:58:050
349199180,10cyclictest16027-21sh12:24:490
3496991713,3cyclictest6928-21head11:05:161
349199179,6cyclictest1528-21grep08:10:240
349199175,10cyclictest13737-21grep12:05:000
349199173,10cyclictest2650-21ssh09:13:280
349199170,9cyclictest3247-21sh10:08:450
349199170,9cyclictest3247-21sh10:08:450
349199170,9cyclictest31618-21sh11:00:480
349199170,9cyclictest2928-21sh12:16:390
349199170,9cyclictest2928-21sh12:16:390
349199170,9cyclictest28346-21diskmemload11:13:060
349199170,9cyclictest25083-21sh09:44:490
349199170,9cyclictest12944-21sh10:14:220
349199170,9cyclictest11443-21sh10:30:570
349199170,10cyclictest774-21runrttasks08:01:310
350299164,9cyclictest711-21snmpd10:14:414
350099163,9cyclictest12629-21uptime07:25:252
349199166,8cyclictest7269-21ssh12:37:430
350299153,8cyclictest9860-21latency11:25:164
350299153,8cyclictest16326-21uptime08:40:244
350299151,10cyclictest774-21runrttasks08:45:154
350299151,10cyclictest29058-21/usr/sbin/munin10:05:234
350299151,10cyclictest29058-21/usr/sbin/munin10:05:224
350299150,6cyclictest764-21diskmemload09:30:194
350199158,6cyclictest9032-21grep10:30:113
350199157,6cyclictest12810-21ntpq10:50:223
350199153,8cyclictest28688-21latency_hist11:55:003
350199151,10cyclictest31349-21ssh11:19:463
350199151,10cyclictest28868-21ssh10:05:013
350199151,10cyclictest28868-21ssh10:05:013
350099152,9cyclictest321-21systemd-journal09:09:412
350099152,9cyclictest26254-21load07:55:132
350099151,10cyclictest24977-21runrttasks07:53:402
350099151,10cyclictest1788-21runrttasks11:57:412
350099150,11cyclictest23248-21ssh10:20:092
349699155,8cyclictest13957-21/usr/sbin/munin08:35:261
349199156,7cyclictest16591-21sh10:15:360
349199154,8cyclictest15737-21ntpq08:40:170
349199151,7cyclictest28262-21latency_hist10:05:000
349199151,7cyclictest21076-21sh11:31:250
349199151,10cyclictest774-21runrttasks11:57:570
349199150,8cyclictest774-21runrttasks07:18:290
349199150,8cyclictest5778-21runrttasks07:11:150
350299146,6cyclictest683-21dbus-daemon10:50:234
350299144,7cyclictest10036-21kworker/u24:1+nfsiod10:31:574
350299143,8cyclictest23079-21aten2_r5power_p09:25:114
350299142,8cyclictest26881-21fschecks_count10:40:134
350299141,9cyclictest7670-21runrttasks09:52:544
350299141,9cyclictest25005-21ssh12:10:274
350299141,10cyclictest25833-21/usr/sbin/munin12:30:174
350299140,10cyclictest7546-21ssh10:29:454
350299140,10cyclictest7073-21ssh10:47:094
350299140,10cyclictest5277-21cat11:05:004
350299140,10cyclictest32233-21sh11:20:114
350299140,10cyclictest31936-21ssh11:56:014
350299140,10cyclictest30404-21sh10:24:134
350299140,10cyclictest2518-21/usr/sbin/munin08:15:224
350299140,10cyclictest25177-21ssh10:57:324
350299140,10cyclictest23193-21ssh10:38:054
350299140,10cyclictest2106-21sed08:15:004
350299140,10cyclictest16770-21ssh09:20:554
350299140,10cyclictest14508-21ssh11:46:054
350299140,10cyclictest10777-21sh12:20:584
350199148,5cyclictest20735-21cut10:00:153
350199145,8cyclictest20620-21/usr/sbin/munin10:55:133
350199145,7cyclictest12006-21cstates11:45:123
350199142,8cyclictest12578-21kworker/u24:0+xprtiod12:24:253
350199141,9cyclictest9734-21sh10:49:053
350199141,9cyclictest8966-21ssh09:35:153
350199141,9cyclictest3511-21sh11:03:563
350199141,9cyclictest32419-21taskset09:11:323
350199141,9cyclictest28752-21ssh10:40:443
350199141,9cyclictest26979-21unixbench_singl07:55:203
350199141,9cyclictest25355-21sh12:10:433
350199141,9cyclictest17670-21smartctl08:45:153
350199141,10cyclictest5512-21sh09:33:273
350199140,10cyclictest8694-21/usr/sbin/munin07:20:193
350199140,10cyclictest774-21runrttasks08:12:273
350199140,10cyclictest711-21snmpd08:41:323
350199140,10cyclictest6146-21chrt12:00:153
350199140,10cyclictest5763-21grep10:10:173
350199140,10cyclictest5210-21df08:20:133
350199140,10cyclictest5210-21df08:20:133
350199140,10cyclictest5088-21ssh09:51:003
350199140,10cyclictest4473-21chrt08:19:193
350199140,10cyclictest4063-21/usr/sbin/munin07:10:173
350199140,10cyclictest32399-21ssh12:33:463
350199140,10cyclictest32148-21aten2_r5power_p10:25:113
350199140,10cyclictest31726-21/usr/sbin/munin12:15:183
350199140,10cyclictest31726-21/usr/sbin/munin12:15:183
350199140,10cyclictest30187-21memory11:55:183
350199140,10cyclictest28685-21sh10:22:573
350199140,10cyclictest28152-21chrt09:08:213
350199140,10cyclictest2735-21ssh11:40:053
350199140,10cyclictest25863-21/usr/sbin/munin09:45:123
350199140,10cyclictest21154-21ssh09:41:573
350199140,10cyclictest18907-21sh11:12:053
350199140,10cyclictest18902-21cat12:25:243
350199140,10cyclictest18434-21uname10:35:183
350199140,10cyclictest18196-21sh11:30:173
350199140,10cyclictest17794-21ssh12:06:363
350199140,10cyclictest17644-21chrt07:36:363
350199140,10cyclictest17264-21sh10:16:063
350199140,10cyclictest14000-21basename07:30:143
350199140,10cyclictest13171-21ssh09:19:443
350199140,10cyclictest13116-21diskmemload09:55:273
350199140,10cyclictest12787-21ssh11:09:033
350199140,10cyclictest10389-21latency_hist12:40:013
350099146,6cyclictest18922-21grep12:25:242
350099144,8cyclictest28245-21/usr/sbin/munin08:00:152
350099144,8cyclictest17456-21/usr/sbin/munin09:40:142
350099143,8cyclictest9512-21sed07:20:172
350099141,9cyclictest8005-21ssh09:15:582
350099141,9cyclictest6517-21/usr/sbin/munin10:10:202
350099141,9cyclictest4715-21ssh12:35:492
350099141,9cyclictest27160-21sh12:12:032
350099141,10cyclictest32690-21sh10:06:362
350099141,10cyclictest32690-21sh10:06:362
350099141,10cyclictest22810-21rm09:25:032
350099141,10cyclictest15398-21/usr/sbin/munin11:10:202
350099141,10cyclictest11374-21runrttasks09:36:172
350099140,12cyclictest19468-21cat11:30:262
350099140,10cyclictest8295-21chrt07:19:082
350099140,10cyclictest7695-21rm12:00:352
350099140,10cyclictest7145-21rm10:29:272
350099140,10cyclictest711-21snmpd08:36:172
350099140,10cyclictest6790-21memory11:05:162
350099140,10cyclictest5627-21runrttasks11:41:002
350099140,10cyclictest5569-21ssh09:51:212
350099140,10cyclictest4635-21ssh11:04:462
350099140,10cyclictest3207-21idleruntime08:15:152
350099140,10cyclictest31841-21wget12:15:122
350099140,10cyclictest31841-21wget12:15:122
350099140,10cyclictest31712-21sh09:30:082
350099140,10cyclictest30225-21ssh09:47:092
350099140,10cyclictest2934-21/usr/sbin/munin10:45:122
350099140,10cyclictest28852-21ssh09:10:092
350099140,10cyclictest26983-21perl10:40:142
350099140,10cyclictest26866-21ssh11:16:302
350099140,10cyclictest26537-21ssh10:58:312
350099140,10cyclictest23572-21runrttasks08:58:582
350099140,10cyclictest22837-21sh10:01:032
350099140,10cyclictest21377-21irqstats11:50:202
350099140,10cyclictest19354-21/usr/sbin/munin08:50:132
350099140,10cyclictest19320-21ssh10:17:322
350099140,10cyclictest19230-21grep07:40:162
350099140,10cyclictest17464-21sh09:21:262
350099140,10cyclictest17303-21sh10:35:012
350099140,10cyclictest1626-21chrt08:11:172
350099140,10cyclictest15902-21/usr/sbin/munin07:35:162
350099140,10cyclictest14645-21diskstats12:05:132
350099140,10cyclictest13871-21ssh09:56:002
350099140,10cyclictest13722-21ssh12:23:082
350099140,10cyclictest13588-21ssh10:50:292
350099140,10cyclictest1264-21ssh12:34:432
350099140,10cyclictest12488-21sh11:26:352
350099140,10cyclictest11625-21/usr/sbin/munin11:45:172
350099140,10cyclictest11031-21grep08:30:172
349699143,8cyclictest25298-21vmstat11:15:211
349699142,8cyclictest13262-21sed07:29:591
349699141,9cyclictest6585-21sh11:41:421
349699141,9cyclictest3907-21/usr/sbin/munin10:45:171
349699141,9cyclictest26447-21runrttasks11:53:241
349699141,9cyclictest22910-21rm11:32:461
349699141,9cyclictest22596-21sh10:37:401
349699141,9cyclictest20763-21ssh10:00:141
349699141,9cyclictest15706-21switchtime09:20:231
349699141,10cyclictest14848-21wget11:10:171
349699140,12cyclictest32057-21cut12:15:121
349699140,12cyclictest32057-21cut12:15:121
349699140,10cyclictest979-21ssh11:57:051
349699140,10cyclictest774-21runrttasks10:22:291
349699140,10cyclictest774-21runrttasks07:16:571
349699140,10cyclictest6898-21ssh12:37:271
349699140,10cyclictest6294-21taskset08:20:231
349699140,10cyclictest6294-21taskset08:20:221
349699140,10cyclictest5287-21/usr/sbin/munin09:15:111
349699140,10cyclictest32392-21aten2_r5power_p08:10:121
349699140,10cyclictest32201-21ssh10:43:151
349699140,10cyclictest28873-21/usr/sbin/munin09:10:231
349699140,10cyclictest26283-21sh11:35:001
349699140,10cyclictest26278-21runrttasks09:05:071
349699140,10cyclictest25007-21ssh10:57:241
349699140,10cyclictest24932-21ssh09:44:431
349699140,10cyclictest22978-21/usr/sbin/munin09:25:141
349699140,10cyclictest22975-21/usr/sbin/munin12:10:131
349699140,10cyclictest2261-21ssh10:08:021
349699140,10cyclictest2261-21ssh10:08:021
349699140,10cyclictest21105-21runrttasks08:51:431
349699140,10cyclictest21098-21rm12:08:591
349699140,10cyclictest18079-21latency12:25:181
349699140,10cyclictest15392-21ssh09:57:061
349699140,10cyclictest14692-21/usr/sbin/munin08:40:131
349699140,10cyclictest13875-21ssh10:50:421
349699140,10cyclictest1339-21ssh09:30:261
349699140,10cyclictest13008-21sh12:22:371
349699140,10cyclictest11725-21ssh12:03:321
349699140,10cyclictest11354-21ssh10:30:541
349699140,10cyclictest11248-21ssh11:25:421
349699140,10cyclictest10137-21ssh10:12:201
349699140,10cyclictest10004-21cmp08:30:011
349199146,6cyclictest5621-21ssh11:05:030
349199146,6cyclictest16074-21ssh11:29:130
349199145,7cyclictest24194-21ssh10:56:480
349199145,7cyclictest23520-21ssh11:15:100
349199145,7cyclictest14461-21/usr/sbin/munin12:05:120
349199141,9cyclictest26924-21/usr/sbin/munin07:55:210
349199141,9cyclictest23396-21/usr/sbin/munin12:10:120
349199141,7cyclictest103-1kworker/0:1H+kblockd07:34:350
349199141,11cyclictest26155-21cat09:05:010
349199141,10cyclictest11628-21gltestperf07:25:140
349199140,7cyclictest4117-21cat09:50:250
349199140,7cyclictest3622-21sh11:21:450
349199140,7cyclictest28137-21taskset09:45:390
349199140,11cyclictest11966-21sh09:36:450
349199140,10cyclictest9280-21expr07:20:150
349199140,10cyclictest774-21runrttasks10:26:440
349199140,10cyclictest7141-21runrttasks10:47:120
349199140,10cyclictest5683-21df09:15:120
349199140,10cyclictest321-21systemd-journal08:51:410
349199140,10cyclictest29933-21rm11:36:290
349199140,10cyclictest25763-21sh12:30:060
349199140,10cyclictest24546-21ssh11:52:010
349199140,10cyclictest21566-21latency07:45:160
349199140,10cyclictest20380-21sh10:36:020
349199140,10cyclictest14958-21ssh11:46:250
350299135,6cyclictest26471-21perl09:45:134
350299132,8cyclictest22516-21cat08:55:164
350299131,9cyclictest8139-21sh12:00:554
350299131,9cyclictest14760-21/usr/sbin/munin11:10:174
350299130,9cyclictest8360-21chrt07:19:594
350299130,9cyclictest7280-21ssh09:15:254
350299130,9cyclictest7170-21apt-config08:25:024
350299130,9cyclictest711-21snmpd12:25:024
350299130,9cyclictest6113-21taskset08:20:204
350299130,9cyclictest6113-21taskset08:20:194
350299130,9cyclictest5775-21/usr/sbin/munin11:05:144
350299130,9cyclictest5217-21diskmemload11:40:414
350299130,9cyclictest3849-21apt-key07:10:034
350299130,9cyclictest31497-21sh12:15:014
350299130,9cyclictest31497-21sh12:15:014
350299130,9cyclictest30946-21ssh09:10:304
350299130,9cyclictest30122-21aten2_r5power_v08:05:134
350299130,9cyclictest28289-21fw_packets08:00:154
350299130,9cyclictest26282-21/usr/sbin/munin09:05:134
350299130,9cyclictest25385-21/usr/sbin/munin07:55:104
350299130,9cyclictest25306-21rm11:15:214
350299130,9cyclictest25048-21sh10:02:404
350299130,9cyclictest24203-21cpuspeed_turbos09:00:124
350299130,9cyclictest23163-21aten2_r5power_p07:50:124
350299130,9cyclictest20789-21aten2_r5power_c07:45:104
350299130,9cyclictest20348-21sh11:50:074
350299130,9cyclictest19354-21/usr/sbin/munin08:50:174
350299130,9cyclictest18417-21/usr/sbin/munin07:40:204
350299130,9cyclictest17465-21sh11:30:014
350299130,9cyclictest17046-21/usr/sbin/munin09:40:134
350299130,9cyclictest14373-21sh10:15:114
350299130,9cyclictest14250-21/usr/sbin/munin12:05:124
350299130,9cyclictest12321-21sh09:37:004
350299130,9cyclictest1-21systemd08:35:024
350299130,9cyclictest11011-21sh09:55:074
350299130,9cyclictest10996-21taskset07:25:124
350299130,9cyclictest10455-21fschecks_count08:30:144
350299130,10cyclictest29276-21ssh11:36:004
350299130,10cyclictest2915-21ssh12:35:134
350299130,10cyclictest15988-21aten2_r5power_p07:35:104
350199131,9cyclictest32432-21wget11:20:143
350199130,9cyclictest8878-21sh11:25:103
350199130,9cyclictest8505-21ntp_kernel_err08:25:183
350199130,9cyclictest30018-21/usr/sbin/munin08:05:133
350199130,9cyclictest27714-21/usr/sbin/munin08:00:173
350199130,9cyclictest26534-21/usr/sbin/munin11:35:153
350199130,9cyclictest23978-21/usr/sbin/munin09:00:173
350199130,9cyclictest21227-21chrt08:53:243
350199130,9cyclictest20772-21/usr/sbin/munin07:45:153
350199130,9cyclictest18417-21/usr/sbin/munin07:40:133
350199130,9cyclictest13986-21ssh09:20:043
350199130,9cyclictest10063-21/usr/sbin/munin08:30:123
350199130,10cyclictest23483-21fschecks_count07:50:143
350199130,10cyclictest13411-21runrttasks08:35:203
350199130,10cyclictest10997-21/usr/sbin/munin07:25:133
350099131,9cyclictest14682-21runrttasks08:40:022
350099130,9cyclictest774-21runrttasks08:20:062
350099130,9cyclictest774-21runrttasks08:20:052
350099130,9cyclictest7463-21/usr/sbin/munin08:25:122
350099130,9cyclictest3450-21latency_hist07:10:012
350099130,9cyclictest25664-21runrttasks09:00:482
350099130,9cyclictest20772-21/usr/sbin/munin07:45:132
350099130,9cyclictest13660-21df07:30:122
350099130,9cyclictest10068-21sendmail_mailst10:30:182
350099130,10cyclictest4656-21expr07:10:162
350099130,10cyclictest32539-21grep11:20:142
350099130,10cyclictest31085-21runrttasks08:05:192
350099130,10cyclictest28812-21rm11:35:402
350099130,10cyclictest18759-21chrt08:46:522
349699135,6cyclictest9922-21tr07:20:191
349699135,6cyclictest29868-21sh11:00:141
349699131,9cyclictest13826-21fschecks_time07:30:141
349699130,9cyclictest8155-21ssh09:35:081
349699130,9cyclictest774-21runrttasks07:11:041
349699130,9cyclictest572-21memory10:25:171
349699130,9cyclictest4349-21runrttasks08:17:391
349699130,9cyclictest3450-21latency_hist07:10:011
349699130,9cyclictest32285-21/usr/sbin/munin11:20:151
349699130,9cyclictest27702-21taskset08:00:021
349699130,9cyclictest25863-21/usr/sbin/munin09:45:121
349699130,9cyclictest25385-21/usr/sbin/munin07:55:161
349699130,9cyclictest23978-21/usr/sbin/munin09:00:121
349699130,9cyclictest23373-21grep07:50:131
349699130,9cyclictest21655-21/usr/sbin/munin08:55:171
349699130,9cyclictest20768-21taskset07:45:101
349699130,9cyclictest18940-21fschecks_time07:40:141
349699130,9cyclictest16994-21/usr/sbin/munin08:45:151
349699130,9cyclictest15576-21gpgv07:35:011
349699130,9cyclictest14416-21/usr/sbin/munin10:15:211
349699130,9cyclictest11518-21ssh11:45:061
349699130,10cyclictest4346-21ssh09:50:291
349699130,10cyclictest30188-21cpuspeed08:05:121
349699130,10cyclictest25738-21rm12:30:041
349199135,6cyclictest16968-21ntpq07:35:170
349199131,9cyclictest7883-21fschecks_count08:25:140
349199131,9cyclictest774-21runrttasks08:15:570
349199131,9cyclictest7072-21latency_hist08:25:010
349199131,9cyclictest7072-21latency_hist08:25:000
349199131,10cyclictest3575-21cat07:10:010
349199130,9cyclictest23434-21df07:50:130
349199130,9cyclictest23127-21timerwakeupswit08:55:220
349199130,9cyclictest18257-21/usr/sbin/munin08:45:230
349199130,11cyclictest19228-21/usr/sbin/munin07:40:160
349199130,10cyclictest9961-21apt-config08:30:010
349199130,10cyclictest30115-21basename08:05:120
349199130,10cyclictest103-1kworker/0:1H+kblockd08:36:280
350299120,9cyclictest9045-21df07:20:124
350299120,9cyclictest14090-21latency07:30:154
350199120,9cyclictest774-21runrttasks08:57:253
350199120,9cyclictest6431-21/usr/sbin/munin07:15:113
349699128,3cyclictest8467-21cut08:25:181
85182110,1sleep50-21swapper/512:01:125
350199110,8cyclictest3694-21sed07:10:003
214792100,8sleep50-21swapper/507:45:165
6681290,7sleep50-21swapper/512:37:185
35029990,7cyclictest3503-21apt-get07:10:004
1011290,0sleep50-21swapper/510:07:095
1011290,0sleep50-21swapper/510:07:095
29611280,1sleep50-21swapper/508:03:435
25727280,0sleep50-21swapper/509:45:065
8134270,0sleep50-21swapper/507:17:005
1819270,0sleep50-21swapper/508:13:515
22329260,1sleep50-21swapper/512:09:565
19339260,2sleep50-21swapper/509:59:565
5319250,3sleep50-21swapper/507:10:235
31352250,1sleep50-21swapper/510:24:565
28448250,1sleep50-21swapper/510:59:565
17714251,1sleep50-21swapper/511:30:135
16052252,1sleep50-21swapper/509:20:265
13423250,1sleep50-21swapper/509:19:565
9481240,2sleep50-21swapper/510:11:525
8361240,1sleep50-21swapper/507:20:005
8043240,1sleep50-21swapper/511:25:005
4613241,1sleep50-21swapper/510:27:385
28686240,1sleep50-21swapper/511:00:025
28328240,1sleep50-21swapper/509:10:005
26286240,1sleep50-21swapper/511:35:025
21458240,2sleep50-21swapper/512:27:105
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional