You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 21:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Mon May 25, 2026 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18282207182,21sleep10-21swapper/107:07:351
17582197180,12sleep30-21swapper/307:06:413
18422191173,13sleep00-21swapper/007:07:470
16802177161,12sleep20-21swapper/207:05:392
91152480,0sleep00-21swapper/010:17:580
260212480,0sleep20-21swapper/212:33:512
41302450,0sleep10-21swapper/109:12:301
281402450,0sleep10-21swapper/109:05:011
314692420,0sleep10-21swapper/111:16:121
177902340,1sleep1220299cyclictest11:41:141
233702100,0sleep30-21swapper/311:28:393
123932100,0sleep10-21swapper/110:19:591
21979991,4cyclictest14222-21munin-run10:05:010
17875290,0sleep10-21swapper/109:35:081
21979982,3cyclictest7219-21awk11:05:020
21979981,3cyclictest8974-21munin-run10:50:010
22069960,6cyclictest0-21swapper/210:00:122
21979960,3cyclictest5710-21sendmail-msp08:20:000
21979960,3cyclictest25507-21sendmail-msp09:00:000
21931260,0sleep00-21swapper/010:08:290
4269250,0sleep340-21ksoftirqd/312:06:383
28920250,1sleep028946-21ssh12:03:080
22129950,5cyclictest28963-21diskstats12:35:133
22129950,5cyclictest0-21swapper/311:03:333
22129950,5cyclictest0-21swapper/310:10:183
22129950,4cyclictest0-21swapper/309:30:103
22069952,3cyclictest15379-21cron11:25:002
22069951,2cyclictest0-21swapper/208:25:132
22069951,2cyclictest0-21swapper/208:15:122
22069950,5cyclictest25723-21/usr/sbin/munin09:00:192
22069950,5cyclictest0-21swapper/210:27:002
22069950,0cyclictest0-21swapper/209:20:382
22029951,2cyclictest0-21swapper/112:00:111
22029951,2cyclictest0-21swapper/109:40:111
22029950,5cyclictest0-21swapper/111:56:221
22029950,5cyclictest0-21swapper/108:35:161
21979950,5cyclictest0-21swapper/009:49:340
21979950,5cyclictest0-21swapper/007:40:210
21979950,0cyclictest8421-21hddtemp_smartct09:30:130
21979950,0cyclictest0-21swapper/011:05:230
18547250,1sleep318550-21fschecks_time11:10:133
22129944,0cyclictest0-21swapper/312:27:143
22129944,0cyclictest0-21swapper/311:43:163
22129944,0cyclictest0-21swapper/309:44:503
22129942,1cyclictest802-21snmpd10:43:123
22129941,3cyclictest802-21snmpd09:50:263
22129941,2cyclictest5664-21cron08:20:003
22129940,4cyclictest21941-21ssh09:36:293
22129940,4cyclictest0-21swapper/312:23:403
22129940,4cyclictest0-21swapper/312:15:513
22129940,4cyclictest0-21swapper/312:11:273
22129940,4cyclictest0-21swapper/311:45:443
22129940,4cyclictest0-21swapper/311:36:263
22129940,4cyclictest0-21swapper/311:30:113
22129940,4cyclictest0-21swapper/310:51:023
22129940,4cyclictest0-21swapper/310:51:023
22129940,4cyclictest0-21swapper/310:26:103
22129940,4cyclictest0-21swapper/310:15:033
22129940,4cyclictest0-21swapper/309:55:123
22129940,4cyclictest0-21swapper/309:45:143
22129940,4cyclictest0-21swapper/309:20:363
22129940,4cyclictest0-21swapper/308:50:133
22129940,3cyclictest9834-21ssh11:53:503
22129940,3cyclictest802-21snmpd12:00:463
22129940,3cyclictest707-21ssh10:30:013
22129940,3cyclictest29552-21cat11:00:013
22129940,3cyclictest25080-21users08:55:203
22129940,3cyclictest21705-21ssh10:24:243
22129940,3cyclictest19068-21df_inode07:40:123
22129940,3cyclictest1681-21ssh10:45:333
22129940,3cyclictest14738-21ssh10:05:123
22129940,3cyclictest12953-21apt-get07:30:013
22129940,3cyclictest12475-21grep10:35:163
22129940,3cyclictest11237-21/usr/sbin/munin07:25:153
22129940,0cyclictest0-21swapper/308:10:143
22069944,0cyclictest0-21swapper/210:06:102
22069941,2cyclictest0-21swapper/210:40:112
22069941,2cyclictest0-21swapper/210:35:112
22069941,2cyclictest0-21swapper/210:30:112
22069941,2cyclictest0-21swapper/210:10:112
22069941,1cyclictest0-21swapper/208:45:112
22069940,4cyclictest26633-21df11:30:122
22069940,4cyclictest18967-21ssh11:25:562
22069940,4cyclictest0-21swapper/212:25:112
22069940,4cyclictest0-21swapper/211:15:022
22069940,4cyclictest0-21swapper/211:00:122
22069940,4cyclictest0-21swapper/210:55:102
22069940,4cyclictest0-21swapper/209:25:122
22069940,4cyclictest0-21swapper/208:05:122
22069940,4cyclictest0-21swapper/207:50:132
22069940,4cyclictest0-21swapper/207:10:112
22069940,3cyclictest8294-21df_inode11:05:142
22069940,3cyclictest802-21snmpd11:55:182
22069940,3cyclictest6297-21sh09:45:132
22069940,3cyclictest3378-21ssh10:15:132
22069940,3cyclictest30610-21aten2_r5power_v12:20:122
22069940,3cyclictest27485-21sh11:45:582
22069940,3cyclictest27194-21diskstats09:55:142
22069940,3cyclictest2412-21ssh12:05:302
22069940,3cyclictest23750-21df08:55:122
22069940,3cyclictest2273-21sh12:38:002
22069940,3cyclictest21534-21/usr/sbin/munin12:15:162
22069940,3cyclictest2120-21apt-get11:50:112
22069940,3cyclictest21015-21sh11:11:012
22069940,3cyclictest20119-21ssh10:23:262
22069940,3cyclictest17265-21latency_hist09:35:012
22069940,3cyclictest15618-21latency_hist07:35:022
22069940,3cyclictest12916-21ssh12:10:432
22069940,3cyclictest10971-21sh11:38:262
22069940,3cyclictest0-21swapper/210:50:122
22069940,3cyclictest0-21swapper/210:50:112
22069940,3cyclictest0-21swapper/207:20:112
22069940,2cyclictest17423-21ssh09:50:162
22069940,2cyclictest0-21swapper/207:25:122
22069940,1cyclictest9519-21awk09:30:192
22069940,1cyclictest949-21/usr/sbin/munin08:10:192
22069940,1cyclictest5743-21/usr/sbin/munin07:15:132
22069940,1cyclictest28438-21/usr/sbin/munin08:00:202
22069940,1cyclictest15821-21/usr/sbin/munin08:40:172
22069940,1cyclictest0-21swapper/211:40:022
22029944,0cyclictest0-21swapper/110:13:301
22029941,2cyclictest0-21swapper/112:25:111
22029941,2cyclictest0-21swapper/109:20:131
22029941,2cyclictest0-21swapper/109:15:131
22029941,2cyclictest0-21swapper/108:40:111
22029941,2cyclictest0-21swapper/108:15:121
22029940,2cyclictest0-21swapper/110:45:111
22029940,0cyclictest0-21swapper/112:16:371
22029940,0cyclictest0-21swapper/112:14:421
22029940,0cyclictest0-21swapper/110:31:161
22029940,0cyclictest0-21swapper/109:46:261
21979943,1cyclictest26274-21fschecks_count09:00:130
21979942,2cyclictest16703-21kworker/0:112:15:530
21979942,2cyclictest16703-21kworker/0:109:35:290
21979942,1cyclictest802-21snmpd10:38:140
21979941,3cyclictest7417-21readlink08:20:170
21979940,4cyclictest22800-21ssh11:12:060
21979940,4cyclictest1003-21apt-get10:30:110
21979940,4cyclictest0-21swapper/011:46:000
21979940,4cyclictest0-21swapper/011:15:080
21979940,4cyclictest0-21swapper/010:57:330
21979940,4cyclictest0-21swapper/010:14:450
21979940,4cyclictest0-21swapper/009:23:320
21979940,4cyclictest0-21swapper/009:14:510
21979940,4cyclictest0-21swapper/008:50:130
21979940,3cyclictest9090-21hwlatdetect07:20:160
21979940,3cyclictest8741-21rm11:37:040
21979940,3cyclictest5753-21/usr/sbin/munin11:20:170
21979940,3cyclictest5269-21ssh12:07:160
21979940,3cyclictest405-21ssh12:36:500
21979940,3cyclictest29507-21memory09:40:160
21979940,3cyclictest28957-21df08:00:120
21979940,3cyclictest25695-21date11:30:000
21979940,3cyclictest24636-21ssh10:41:010
21979940,3cyclictest22286-21ntp_states07:45:170
21979940,3cyclictest16805-21ssh11:40:370
21979940,3cyclictest16781-21ssh11:56:520
21979940,3cyclictest16221-21ssh09:50:060
21979940,3cyclictest15854-21cat07:35:010
21979940,3cyclictest1481-21diskstats08:10:130
21979940,3cyclictest10827-21sed08:30:000
21979940,2cyclictest81rcu_preempt10:29:060
21979940,1cyclictest3955-21idleruntime-cro10:00:010
21979940,0cyclictest19220-21munin-run10:55:010
21979940,0cyclictest19220-21munin-run10:55:010
21979940,0cyclictest0-21swapper/012:29:370
21979940,0cyclictest0-21swapper/012:13:110
21979940,0cyclictest0-21swapper/007:56:220
11671240,3sleep30-21swapper/309:15:493
22129932,1cyclictest802-21snmpd11:15:033
22129932,1cyclictest802-21snmpd08:45:073
22129932,1cyclictest802-21snmpd07:10:073
22129932,1cyclictest31215-21grep08:05:123
22129931,1cyclictest802-21snmpd08:40:043
22129931,1cyclictest0-21swapper/307:55:103
22129930,3cyclictest5719-21perl07:15:013
22129930,3cyclictest5487-21ssh11:20:013
22129930,3cyclictest4214-21ssh10:00:023
22129930,3cyclictest30830-21ssh09:10:083
22129930,3cyclictest30431-21diskmemload12:30:053
22129930,3cyclictest0-21swapper/311:55:013
22129930,3cyclictest0-21swapper/311:05:133
22129930,3cyclictest0-21swapper/309:25:023
22129930,3cyclictest0-21swapper/309:05:123
22129930,3cyclictest0-21swapper/309:00:113
22129930,3cyclictest0-21swapper/308:35:123
22129930,3cyclictest0-21swapper/308:30:103
22129930,3cyclictest0-21swapper/308:25:133
22129930,3cyclictest0-21swapper/308:20:093
22129930,3cyclictest0-21swapper/308:00:103
22129930,3cyclictest0-21swapper/307:50:143
22129930,3cyclictest0-21swapper/307:45:113
22129930,3cyclictest0-21swapper/307:35:013
22129930,3cyclictest0-21swapper/307:20:113
22069931,1cyclictest0-21swapper/208:20:092
22069930,3cyclictest8552-21ssh09:15:012
22069930,3cyclictest30754-21sh09:10:042
22069930,3cyclictest20762-21/usr/sbin/munin08:50:132
22069930,3cyclictest0-21swapper/212:00:112
22069930,3cyclictest0-21swapper/209:40:102
22069930,3cyclictest0-21swapper/209:05:122
22069930,3cyclictest0-21swapper/208:35:122
22069930,3cyclictest0-21swapper/208:30:112
22069930,3cyclictest0-21swapper/207:55:082
22069930,3cyclictest0-21swapper/207:45:112
22069930,3cyclictest0-21swapper/207:40:112
22069930,3cyclictest0-21swapper/207:30:112
22069930,2cyclictest31656-21ssh10:45:102
22029933,0cyclictest0-21swapper/111:11:591
22029933,0cyclictest0-21swapper/109:55:281
22029933,0cyclictest0-21swapper/109:50:571
22029931,2cyclictest0-21swapper/110:25:111
22029931,1cyclictest0-21swapper/112:05:101
22029931,1cyclictest0-21swapper/111:25:101
22029931,1cyclictest0-21swapper/111:00:121
22029931,1cyclictest0-21swapper/110:40:111
22029931,1cyclictest0-21swapper/110:35:111
22029931,1cyclictest0-21swapper/109:30:101
22029931,1cyclictest0-21swapper/109:25:111
22029931,1cyclictest0-21swapper/109:05:121
22029931,1cyclictest0-21swapper/108:50:121
22029931,1cyclictest0-21swapper/108:45:111
22029931,1cyclictest0-21swapper/108:30:101
22029931,1cyclictest0-21swapper/108:25:131
22029931,1cyclictest0-21swapper/108:00:101
22029931,1cyclictest0-21swapper/107:55:081
22029931,1cyclictest0-21swapper/107:50:131
22029931,1cyclictest0-21swapper/107:35:011
22029931,1cyclictest0-21swapper/107:25:121
22029931,1cyclictest0-21swapper/107:15:111
22029930,3cyclictest0-21swapper/107:47:421
22029930,2cyclictest14696-21taskset11:08:231
22029930,2cyclictest0-21swapper/112:35:121
22029930,2cyclictest0-21swapper/112:30:101
22029930,2cyclictest0-21swapper/111:30:101
22029930,2cyclictest0-21swapper/111:20:131
22029930,2cyclictest0-21swapper/110:00:131
22029930,2cyclictest0-21swapper/107:10:121
21979933,0cyclictest16703-21kworker/0:109:05:010
21979933,0cyclictest0-21swapper/007:25:060
21979932,1cyclictest802-21snmpd12:20:030
21979932,1cyclictest16703-21kworker/0:109:15:050
21979931,1cyclictest0-21swapper/011:30:110
21979931,0cyclictest0-21swapper/008:30:100
21979930,3cyclictest29220-21ssh09:25:030
21979930,3cyclictest14071-21tune2fs08:35:140
21979930,3cyclictest12773-21ssh10:20:030
21979930,3cyclictest0-21swapper/012:30:100
21979930,3cyclictest0-21swapper/011:50:110
21979930,3cyclictest0-21swapper/008:45:100
21979930,3cyclictest0-21swapper/008:40:100
21979930,3cyclictest0-21swapper/008:05:110
21979930,3cyclictest0-21swapper/007:50:140
21979930,3cyclictest0-21swapper/007:35:080
21979930,3cyclictest0-21swapper/007:10:010
21979930,2cyclictest5365-21ntp_states07:15:010
12994230,1sleep10-21swapper/110:20:121
22029921,1cyclictest0-21swapper/112:20:121
22029921,1cyclictest0-21swapper/111:50:121
22029921,1cyclictest0-21swapper/110:50:111
22029921,1cyclictest0-21swapper/110:50:111
22029921,1cyclictest0-21swapper/110:05:041
22029921,1cyclictest0-21swapper/107:20:111
22029920,1cyclictest25122-21chrt08:55:431
22029920,1cyclictest0-21swapper/111:45:111
22029920,1cyclictest0-21swapper/111:35:101
22029920,1cyclictest0-21swapper/110:55:091
22029920,1cyclictest0-21swapper/108:20:091
22029920,1cyclictest0-21swapper/108:10:021
22029920,1cyclictest0-21swapper/108:05:011
22029920,1cyclictest0-21swapper/107:40:111
22029920,1cyclictest0-21swapper/107:30:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional