You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 00:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Tue Nov 25, 2025 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
175652200183,12sleep30-21swapper/307:06:493
175982199182,12sleep10-21swapper/107:07:151
175872196177,14sleep00-21swapper/007:07:050
156002174157,12sleep20-21swapper/207:05:122
255842480,0sleep30-21swapper/310:52:163
144232450,0sleep10-21swapper/109:10:141
195682430,0sleep20-21swapper/209:45:062
134612420,0sleep20-21swapper/210:46:032
109452420,0sleep10-21swapper/110:29:201
273482300,1sleep11802099cyclictest10:36:571
23914290,0sleep10-21swapper/108:25:131
180139973,4cyclictest3723-21munin-run08:50:000
180139971,3cyclictest11152-21munin-run09:05:010
180139962,4cyclictest22547-21sendmail-msp11:40:010
180139960,3cyclictest1298-21basename07:40:010
8825250,0sleep10-21swapper/111:00:151
23979250,0sleep00-21swapper/011:56:070
180299950,5cyclictest23955-21sed11:40:153
180299950,5cyclictest0-21swapper/311:53:323
180299950,5cyclictest0-21swapper/311:19:303
180299950,5cyclictest0-21swapper/310:48:223
180299950,5cyclictest0-21swapper/309:29:043
180299950,4cyclictest0-21swapper/309:55:023
180299950,3cyclictest0-21swapper/311:34:123
180299950,3cyclictest0-21swapper/309:51:293
180299950,1cyclictest2125-21ssh12:35:003
180249954,1cyclictest0-21swapper/212:20:172
180249950,5cyclictest0-21swapper/212:00:142
180249950,5cyclictest0-21swapper/211:57:522
180249950,5cyclictest0-21swapper/210:34:392
180249950,5cyclictest0-21swapper/210:15:142
180249950,5cyclictest0-21swapper/210:08:102
180249950,5cyclictest0-21swapper/207:35:222
180249950,4cyclictest6741-21memory11:15:172
180249950,4cyclictest21342-21ssh11:06:072
180249950,4cyclictest18036-21ssh12:10:122
180249950,4cyclictest0-21swapper/209:15:112
180209951,2cyclictest0-21swapper/109:50:131
180209951,2cyclictest0-21swapper/109:35:131
180209950,5cyclictest0-21swapper/112:00:421
180209950,5cyclictest0-21swapper/111:50:571
180139950,5cyclictest0-21swapper/012:27:400
180139950,5cyclictest0-21swapper/011:04:010
180139950,5cyclictest0-21swapper/010:18:280
180139950,5cyclictest0-21swapper/010:06:240
180139950,5cyclictest0-21swapper/009:58:060
180139950,5cyclictest0-21swapper/009:31:450
180139950,1cyclictest7545-21munin-run11:00:010
180139950,1cyclictest20544-21latency_hist07:15:000
13522250,0sleep10-21swapper/110:30:161
5037240,0sleep10-21swapper/111:46:511
4496240,0sleep00-21swapper/012:19:490
180299944,0cyclictest32624-21kworker/3:112:00:113
180299944,0cyclictest32003-21kworker/3:209:12:163
180299944,0cyclictest32003-21kworker/3:208:05:073
180299944,0cyclictest0-21swapper/311:45:153
180299943,1cyclictest28732-21/usr/sbin/munin08:35:153
180299942,1cyclictest714-21snmpd08:00:083
180299942,1cyclictest4743-21ssh10:10:023
180299942,1cyclictest18582-21diskstats12:10:143
180299941,3cyclictest714-21snmpd07:45:203
180299941,3cyclictest55950irq/130-eth011:55:133
180299941,3cyclictest55950irq/130-eth011:35:183
180299941,2cyclictest0-21swapper/310:30:123
180299941,2cyclictest0-21swapper/307:10:023
180299941,1cyclictest0-21swapper/309:20:133
180299941,1cyclictest0-21swapper/307:30:133
180299940,4cyclictest8926-21apt-get07:55:133
180299940,4cyclictest3762-21munin-run07:45:013
180299940,4cyclictest14760-21ssh09:42:133
180299940,4cyclictest0-21swapper/312:37:543
180299940,4cyclictest0-21swapper/311:25:133
180299940,4cyclictest0-21swapper/311:05:393
180299940,4cyclictest0-21swapper/310:00:123
180299940,4cyclictest0-21swapper/309:38:343
180299940,4cyclictest0-21swapper/309:30:123
180299940,4cyclictest0-21swapper/309:15:133
180299940,4cyclictest0-21swapper/308:50:113
180299940,4cyclictest0-21swapper/308:45:113
180299940,4cyclictest0-21swapper/308:20:133
180299940,4cyclictest0-21swapper/307:50:103
180299940,4cyclictest0-21swapper/307:50:093
180299940,4cyclictest0-21swapper/307:20:103
180299940,3cyclictest7850-21sh12:20:373
180299940,3cyclictest5979-21ssh10:26:113
180299940,3cyclictest30172-21ssh10:55:023
180299940,3cyclictest27101-21hddtemp_smartct08:30:143
180299940,3cyclictest26502-21/usr/sbin/munin07:25:163
180299940,3cyclictest22487-21ssh10:35:023
180299940,3cyclictest21808-21users09:45:223
180299940,3cyclictest15398-21sh11:03:413
180299940,3cyclictest15136-21ssh10:15:143
180299940,1cyclictest8909-21/usr/sbin/munin09:00:173
180299940,1cyclictest23791-21/usr/sbin/munin08:25:133
180299940,1cyclictest2082-21python10:40:213
180299940,1cyclictest18829-21/usr/sbin/munin08:15:193
180299940,1cyclictest15265-21/usr/sbin/munin12:25:143
180249944,0cyclictest0-21swapper/211:28:292
180249944,0cyclictest0-21swapper/210:27:482
180249942,2cyclictest714-21snmpd08:13:142
180249942,1cyclictest711-21runrttasks12:15:122
180249942,1cyclictest0-21swapper/211:45:122
180249941,3cyclictest0-21swapper/211:52:252
180249940,4cyclictest19577-21ntp_states07:10:172
180249940,4cyclictest0-21swapper/212:05:112
180249940,4cyclictest0-21swapper/211:35:112
180249940,4cyclictest0-21swapper/210:55:022
180249940,4cyclictest0-21swapper/210:50:122
180249940,4cyclictest0-21swapper/210:35:122
180249940,4cyclictest0-21swapper/210:00:132
180249940,4cyclictest0-21swapper/209:55:112
180249940,4cyclictest0-21swapper/209:40:122
180249940,4cyclictest0-21swapper/209:10:132
180249940,4cyclictest0-21swapper/209:05:132
180249940,4cyclictest0-21swapper/208:55:122
180249940,4cyclictest0-21swapper/208:35:152
180249940,4cyclictest0-21swapper/208:00:152
180249940,4cyclictest0-21swapper/207:45:102
180249940,3cyclictest8894-21taskset09:00:022
180249940,3cyclictest8856-21perl11:00:142
180249940,3cyclictest7999-21ssh12:37:232
180249940,3cyclictest4906-21ssh09:37:212
180249940,3cyclictest3141-21ssh10:40:492
180249940,3cyclictest29749-21ssh09:50:122
180249940,3cyclictest29640-21perl07:30:142
180249940,3cyclictest28915-21ssh12:31:262
180249940,3cyclictest28643-21cat08:35:002
180249940,3cyclictest26139-21sort08:30:002
180249940,3cyclictest25539-21cat10:20:132
180249940,3cyclictest23999-21sed07:20:012
180249940,3cyclictest23031-21ssh11:40:122
180249940,3cyclictest22082-21/usr/sbin/munin09:30:122
180249940,3cyclictest19316-21cat08:15:132
180249940,3cyclictest18714-21ssh12:26:122
180249940,3cyclictest17812-21ssh11:20:222
180249940,3cyclictest14585-21date10:15:002
180249940,3cyclictest14132-21users09:25:232
180249940,3cyclictest0-21swapper/211:31:482
180249940,3cyclictest0-21swapper/211:10:092
180209944,0cyclictest0-21swapper/112:15:411
180209944,0cyclictest0-21swapper/112:10:271
180209944,0cyclictest0-21swapper/111:25:561
180209944,0cyclictest0-21swapper/111:16:021
180209944,0cyclictest0-21swapper/110:42:341
180209944,0cyclictest0-21swapper/110:15:131
180209944,0cyclictest0-21swapper/109:43:301
180209944,0cyclictest0-21swapper/109:30:421
180209944,0cyclictest0-21swapper/109:22:241
180209941,2cyclictest0-21swapper/111:55:131
180209941,2cyclictest0-21swapper/110:45:121
180209941,2cyclictest0-21swapper/110:10:121
180209941,2cyclictest0-21swapper/107:35:121
180209941,2cyclictest0-21swapper/107:10:111
180209940,4cyclictest0-21swapper/110:22:461
180209940,0cyclictest0-21swapper/109:26:111
180139944,0cyclictest0-21swapper/011:10:510
180139944,0cyclictest0-21swapper/009:15:110
180139942,1cyclictest25702-21ssh12:30:130
180139942,1cyclictest23710-21latency_hist09:15:010
180139942,1cyclictest0-21swapper/010:35:120
180139942,1cyclictest0-21swapper/008:04:560
180139941,3cyclictest0-21swapper/007:25:120
180139941,2cyclictest0-21swapper/011:40:120
180139941,2cyclictest0-21swapper/011:30:110
180139941,2cyclictest0-21swapper/011:15:130
180139941,2cyclictest0-21swapper/010:40:130
180139941,1cyclictest0-21swapper/008:35:120
180139940,4cyclictest28071-21sed08:30:200
180139940,4cyclictest13625-21diskmemload11:21:210
180139940,4cyclictest10192-21ssh10:28:510
180139940,4cyclictest0-21swapper/012:35:120
180139940,4cyclictest0-21swapper/012:22:260
180139940,4cyclictest0-21swapper/012:00:140
180139940,4cyclictest0-21swapper/011:50:110
180139940,4cyclictest0-21swapper/010:45:120
180139940,4cyclictest0-21swapper/010:20:120
180139940,4cyclictest0-21swapper/010:10:120
180139940,4cyclictest0-21swapper/009:49:480
180139940,4cyclictest0-21swapper/009:35:130
180139940,4cyclictest0-21swapper/008:43:440
180139940,4cyclictest0-21swapper/007:55:130
180139940,4cyclictest0-21swapper/007:15:150
180139940,3cyclictest4682-21perl07:45:120
180139940,3cyclictest24515-21perl08:25:150
180139940,3cyclictest22432-21ssh12:11:510
180139940,3cyclictest21325-21/usr/sbin/munin08:20:160
180139940,3cyclictest1690-21ssh09:20:010
180139940,3cyclictest14134-21users09:25:230
180139940,3cyclictest11381-21apt-get09:05:130
180139940,1cyclictest0-21swapper/008:10:100
180299932,1cyclictest27632-21ssh12:15:013
180299930,3cyclictest8677-21/usr/sbin/munin12:05:123
180299930,3cyclictest28364-21expr11:10:133
180299930,3cyclictest25018-21apt-get10:20:123
180299930,3cyclictest16878-21df_inode08:10:123
180299930,3cyclictest0-21swapper/311:20:013
180299930,3cyclictest0-21swapper/310:05:093
180299930,3cyclictest0-21swapper/309:05:033
180299930,3cyclictest0-21swapper/308:55:013
180299930,3cyclictest0-21swapper/308:40:123
180299930,3cyclictest0-21swapper/307:35:023
180299930,3cyclictest0-21swapper/307:15:013
180249930,3cyclictest3945-21/usr/sbin/munin08:50:112
180249930,3cyclictest0-21swapper/208:45:012
180249930,3cyclictest0-21swapper/208:40:142
180249930,3cyclictest0-21swapper/208:20:132
180249930,3cyclictest0-21swapper/208:05:122
180249930,3cyclictest0-21swapper/207:55:212
180249930,3cyclictest0-21swapper/207:50:102
180249930,3cyclictest0-21swapper/207:50:102
180249930,3cyclictest0-21swapper/207:40:142
180249930,3cyclictest0-21swapper/207:25:122
180249930,3cyclictest0-21swapper/207:20:112
180249930,2cyclictest2548-21df09:20:142
180209933,0cyclictest0-21swapper/112:35:551
180209933,0cyclictest0-21swapper/112:20:561
180209933,0cyclictest0-21swapper/110:07:391
180209933,0cyclictest0-21swapper/109:18:371
180209931,1cyclictest0-21swapper/111:25:011
180209931,1cyclictest0-21swapper/111:15:001
180209931,1cyclictest0-21swapper/110:50:021
180209931,1cyclictest0-21swapper/109:05:131
180209931,1cyclictest0-21swapper/108:55:111
180209931,1cyclictest0-21swapper/108:35:001
180209931,1cyclictest0-21swapper/108:00:151
180209931,1cyclictest0-21swapper/107:40:131
180209931,1cyclictest0-21swapper/107:20:111
180209930,2cyclictest287192sleep108:35:021
180209930,2cyclictest181482sleep108:10:201
180209930,2cyclictest11057-21chrt09:04:041
180209930,2cyclictest0-21swapper/108:40:131
180209930,2cyclictest0-21swapper/107:55:131
180209930,1cyclictest0-21swapper/110:00:121
180209930,0cyclictest0-21swapper/107:53:031
180209930,0cyclictest0-21swapper/107:53:031
180139932,1cyclictest6719-21expr07:50:110
180139932,1cyclictest6719-21expr07:50:110
180139931,2cyclictest0-21swapper/007:20:110
180139931,1cyclictest18514-21kernelversion10:00:160
180139931,1cyclictest0-21swapper/009:40:120
180139930,3cyclictest29617-21sh09:50:070
180139930,3cyclictest1138-21df_inode11:45:120
180139930,3cyclictest0-21swapper/012:05:110
180139930,3cyclictest0-21swapper/011:05:020
180139930,3cyclictest0-21swapper/010:50:000
180139930,3cyclictest0-21swapper/008:55:120
180139930,3cyclictest0-21swapper/008:50:110
180139930,3cyclictest0-21swapper/008:15:120
180139930,3cyclictest0-21swapper/008:05:020
180139930,3cyclictest0-21swapper/007:40:130
180139930,3cyclictest0-21swapper/007:30:130
180139930,2cyclictest13625-21diskmemload11:25:010
180139930,2cyclictest0-21swapper/010:30:150
180209922,0cyclictest0-21swapper/108:54:531
180209921,1cyclictest288432chrt11:42:421
180209921,1cyclictest207932chrt08:16:401
180209921,1cyclictest0-21swapper/111:05:131
180209921,1cyclictest0-21swapper/108:45:011
180209921,1cyclictest0-21swapper/107:45:101
180209921,1cyclictest0-21swapper/107:30:131
180209921,1cyclictest0-21swapper/107:15:011
180209920,1cyclictest20846-21chrt11:38:581
180209920,1cyclictest15189-21chrt12:25:101
180209920,1cyclictest0-21swapper/112:30:111
180209920,1cyclictest0-21swapper/112:05:101
180209920,1cyclictest0-21swapper/111:30:111
180209920,1cyclictest0-21swapper/110:55:131
180209920,1cyclictest0-21swapper/109:55:011
180209920,1cyclictest0-21swapper/109:45:131
180209920,1cyclictest0-21swapper/108:25:011
180209920,1cyclictest0-21swapper/108:05:121
180209910,1cyclictest0-21swapper/107:25:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional