You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-16 - 15:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Mon Jun 16, 2025 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
170312208192,11sleep10-21swapper/107:06:031
173352188170,13sleep00-21swapper/007:10:000
151212184167,12sleep30-21swapper/307:05:083
17129210892,11sleep20-21swapper/207:07:202
16182510,0sleep20-21swapper/211:45:312
92062480,0sleep30-21swapper/311:16:583
1750399102,4cyclictest31389-21ssh09:35:010
175039992,3cyclictest12973-21munin-run12:25:010
11358290,0sleep10-21swapper/110:13:141
21204280,0sleep00-21swapper/007:15:150
175039982,3cyclictest28246-21awk08:34:590
175089970,6cyclictest0-21swapper/210:20:152
175089970,6cyclictest0-21swapper/208:25:132
175039970,3cyclictest8221-21munin-run07:55:000
175039960,3cyclictest25840-21munin-run12:15:010
175039960,3cyclictest25602-21munin-run07:25:010
5539250,0sleep30-21swapper/309:54:233
32509250,0sleep10-21swapper/109:35:161
175139955,0cyclictest31864-21kworker/3:211:35:593
175139951,3cyclictest30997-21snmpd09:13:003
175139950,5cyclictest0-21swapper/312:19:423
175139950,5cyclictest0-21swapper/311:04:203
175139950,5cyclictest0-21swapper/310:44:413
175139950,5cyclictest0-21swapper/310:00:023
175139950,5cyclictest0-21swapper/309:55:123
175139950,0cyclictest0-21swapper/312:20:353
175139950,0cyclictest0-21swapper/312:09:133
175089955,0cyclictest0-21swapper/210:45:212
175089950,5cyclictest23386-21ntpq11:40:232
175089950,5cyclictest0-21swapper/212:19:372
175089950,5cyclictest0-21swapper/210:51:092
175089950,5cyclictest0-21swapper/210:30:562
175049955,0cyclictest0-21swapper/109:47:331
175049951,3cyclictest0-21swapper/111:00:131
175049951,2cyclictest0-21swapper/110:50:151
175049950,5cyclictest0-21swapper/112:02:261
175049950,5cyclictest0-21swapper/110:16:301
175049950,5cyclictest0-21swapper/110:05:441
175049950,5cyclictest0-21swapper/109:26:281
175039950,5cyclictest0-21swapper/010:55:290
175039950,5cyclictest0-21swapper/010:16:460
175039950,4cyclictest22228-21ssh10:35:180
175039950,4cyclictest0-21swapper/012:15:170
175039950,4cyclictest0-21swapper/007:25:130
175039950,1cyclictest20825-21sendmail08:20:000
175039950,1cyclictest13173-21latency_hist08:04:590
175139944,0cyclictest0-21swapper/310:57:043
175139944,0cyclictest0-21swapper/309:21:363
175139943,1cyclictest29296-21tune2fs08:35:173
175139943,1cyclictest24699-21ssh09:15:173
175139942,1cyclictest9258-21ssh10:45:023
175139942,1cyclictest14904-21ssh12:25:203
175139940,4cyclictest9088-21ssh11:50:123
175139940,4cyclictest14500-21ssh10:15:063
175139940,4cyclictest0-21swapper/312:36:593
175139940,4cyclictest0-21swapper/312:04:243
175139940,4cyclictest0-21swapper/311:48:583
175139940,4cyclictest0-21swapper/311:40:163
175139940,4cyclictest0-21swapper/311:30:083
175139940,4cyclictest0-21swapper/311:22:313
175139940,4cyclictest0-21swapper/311:05:233
175139940,4cyclictest0-21swapper/310:30:323
175139940,4cyclictest0-21swapper/309:45:423
175139940,4cyclictest0-21swapper/309:35:533
175139940,4cyclictest0-21swapper/309:30:173
175139940,4cyclictest0-21swapper/308:26:173
175139940,4cyclictest0-21swapper/307:27:143
175139940,3cyclictest32425-21ntp_states08:40:203
175139940,3cyclictest32405-21ssh10:07:203
175139940,3cyclictest27523-21ssh11:25:583
175139940,3cyclictest26129-21ntp_states10:20:203
175139940,3cyclictest23857-21df12:30:163
175139940,3cyclictest2309-21ntp_states07:40:173
175139940,3cyclictest22285-21wget10:35:193
175139940,3cyclictest1745-21ssh11:13:333
175139940,3cyclictest16119-21apt-config12:10:003
175139940,3cyclictest12215-21cat09:05:223
175139940,3cyclictest11727-21sh10:13:293
175139940,3cyclictest0-21swapper/310:28:173
175139940,3cyclictest0-21swapper/310:28:163
175139940,2cyclictest0-21swapper/311:58:183
175089944,0cyclictest0-21swapper/212:01:092
175089944,0cyclictest0-21swapper/211:25:032
175089944,0cyclictest0-21swapper/210:57:422
175089944,0cyclictest0-21swapper/210:02:162
175089944,0cyclictest0-21swapper/209:43:312
175089943,1cyclictest32016-21/usr/sbin/munin10:40:242
175089942,1cyclictest30997-21snmpd11:01:482
175089940,4cyclictest9533-21ssh09:23:562
175089940,4cyclictest792-21munin-run07:40:012
175089940,4cyclictest29486-21irqstats07:30:172
175089940,4cyclictest0-21swapper/212:38:122
175089940,4cyclictest0-21swapper/212:25:152
175089940,4cyclictest0-21swapper/210:10:272
175089940,4cyclictest0-21swapper/209:30:172
175089940,4cyclictest0-21swapper/208:45:252
175089940,4cyclictest0-21swapper/207:57:202
175089940,3cyclictest30708-21sh09:18:132
175089940,3cyclictest2092-21taskset11:30:152
175089940,3cyclictest20833-21sh11:23:022
175089940,3cyclictest18598-21cut11:55:002
175089940,3cyclictest18249-21cat11:05:182
175089940,3cyclictest1733-21perl07:40:132
175089940,3cyclictest13735-21rm09:10:082
175089940,3cyclictest0-21swapper/212:10:002
175089940,1cyclictest29940-21ntp_states08:35:212
175089940,1cyclictest16159-21ntp_states10:15:212
175089940,1cyclictest13610-21/usr/sbin/munin08:05:192
175089940,1cyclictest12657-21tune2fs11:35:162
175089940,1cyclictest11890-21/usr/sbin/munin09:25:232
175089940,1cyclictest11450-21cat08:00:132
175049944,0cyclictest0-21swapper/111:32:271
175049941,2cyclictest0-21swapper/111:25:141
175049941,2cyclictest0-21swapper/109:05:171
175049941,2cyclictest0-21swapper/108:40:141
175049941,2cyclictest0-21swapper/108:35:161
175049941,2cyclictest0-21swapper/107:55:111
175049941,2cyclictest0-21swapper/107:30:121
175049941,2cyclictest0-21swapper/107:15:141
175049941,1cyclictest0-21swapper/111:05:121
175049941,1cyclictest0-21swapper/108:20:131
175049940,4cyclictest0-21swapper/110:56:571
175049940,2cyclictest0-21swapper/111:20:161
175049940,0cyclictest0-21swapper/112:11:191
175049940,0cyclictest0-21swapper/110:26:071
175049940,0cyclictest0-21swapper/110:26:071
175039944,0cyclictest0-21swapper/009:14:480
175039943,1cyclictest32123-21tr10:40:130
175039943,1cyclictest1942-21tr09:20:150
175039942,1cyclictest0-21swapper/008:55:140
175039941,3cyclictest0-21swapper/012:32:300
175039941,1cyclictest0-21swapper/011:50:180
175039941,1cyclictest0-21swapper/009:40:140
175039941,1cyclictest0-21swapper/008:50:150
175039940,4cyclictest29203-21ssh11:43:450
175039940,4cyclictest15950-21ssh10:31:280
175039940,4cyclictest15806-21ssh12:25:300
175039940,4cyclictest13348-21diskmemload09:55:120
175039940,4cyclictest0-21swapper/012:35:150
175039940,4cyclictest0-21swapper/012:05:130
175039940,4cyclictest0-21swapper/012:00:140
175039940,4cyclictest0-21swapper/011:47:370
175039940,4cyclictest0-21swapper/011:10:160
175039940,4cyclictest0-21swapper/010:50:150
175039940,4cyclictest0-21swapper/010:25:150
175039940,4cyclictest0-21swapper/010:25:140
175039940,4cyclictest0-21swapper/010:10:050
175039940,4cyclictest0-21swapper/010:00:150
175039940,4cyclictest0-21swapper/009:50:140
175039940,4cyclictest0-21swapper/009:45:120
175039940,4cyclictest0-21swapper/009:35:140
175039940,4cyclictest0-21swapper/009:16:220
175039940,4cyclictest0-21swapper/009:00:160
175039940,4cyclictest0-21swapper/008:40:140
175039940,4cyclictest0-21swapper/008:25:110
175039940,4cyclictest0-21swapper/008:10:150
175039940,4cyclictest0-21swapper/007:35:110
175039940,4cyclictest0-21swapper/007:10:120
175039940,3cyclictest6699-21rm11:00:030
175039940,3cyclictest5107-21ssh11:31:000
175039940,3cyclictest4700-21/usr/sbin/munin11:15:140
175039940,3cyclictest26634-21ssh11:59:000
175039940,3cyclictest25622-21/usr/sbin/munin10:20:170
175039940,3cyclictest14289-21ssh11:20:030
175039940,3cyclictest0-21swapper/011:35:130
175039940,3cyclictest0-21swapper/010:07:580
175039940,3cyclictest0-21swapper/008:40:000
175039940,3cyclictest0-21swapper/007:35:000
16259240,0sleep30-21swapper/309:26:493
23945230,2sleep00-21swapper/011:25:010
175139931,1cyclictest0-21swapper/308:20:143
175139931,1cyclictest0-21swapper/308:10:143
175139930,3cyclictest6667-21df_inode08:55:153
175139930,3cyclictest25985-21sshd08:30:103
175139930,3cyclictest20534-21fschecks_time07:15:013
175139930,3cyclictest19271-21ssh10:50:063
175139930,3cyclictest0-21swapper/309:40:073
175139930,3cyclictest0-21swapper/309:00:203
175139930,3cyclictest0-21swapper/308:50:163
175139930,3cyclictest0-21swapper/308:45:163
175139930,3cyclictest0-21swapper/308:15:023
175139930,3cyclictest0-21swapper/308:05:053
175139930,3cyclictest0-21swapper/308:00:133
175139930,3cyclictest0-21swapper/307:55:023
175139930,3cyclictest0-21swapper/307:50:143
175139930,3cyclictest0-21swapper/307:45:133
175139930,3cyclictest0-21swapper/307:35:083
175139930,3cyclictest0-21swapper/307:30:023
175139930,3cyclictest0-21swapper/307:20:143
175139930,3cyclictest0-21swapper/307:10:113
175089932,1cyclictest30997-21snmpd09:35:112
175089931,2cyclictest57250irq/125-eth011:10:092
175089931,1cyclictest0-21swapper/208:20:142
175089930,3cyclictest6947-21rm09:55:092
175089930,3cyclictest5647-21apt-get12:05:012
175089930,3cyclictest4667-21ssh11:15:132
175089930,3cyclictest26344-21df07:25:142
175089930,3cyclictest23297-21apt-get12:30:152
175089930,3cyclictest20296-21tail07:15:012
175089930,3cyclictest1911-21rm10:25:022
175089930,3cyclictest1911-21rm10:25:022
175089930,3cyclictest11108-21apt-get09:05:162
175089930,3cyclictest0-21swapper/212:20:122
175089930,3cyclictest0-21swapper/210:05:132
175089930,3cyclictest0-21swapper/209:50:152
175089930,3cyclictest0-21swapper/209:45:132
175089930,3cyclictest0-21swapper/209:00:132
175089930,3cyclictest0-21swapper/208:55:152
175089930,3cyclictest0-21swapper/208:50:162
175089930,3cyclictest0-21swapper/208:40:182
175089930,3cyclictest0-21swapper/208:30:132
175089930,3cyclictest0-21swapper/208:15:112
175089930,3cyclictest0-21swapper/208:10:142
175089930,3cyclictest0-21swapper/207:50:132
175089930,3cyclictest0-21swapper/207:45:122
175089930,3cyclictest0-21swapper/207:20:152
175089930,3cyclictest0-21swapper/207:11:122
175089930,1cyclictest21997-21ssh10:35:092
175089930,1cyclictest19583-21df_inode11:55:182
175049933,0cyclictest0-21swapper/110:46:121
175049933,0cyclictest0-21swapper/108:59:411
175049932,1cyclictest0-21swapper/111:10:181
175049931,1cyclictest0-21swapper/112:20:111
175049931,1cyclictest0-21swapper/112:15:171
175049931,1cyclictest0-21swapper/111:50:171
175049931,1cyclictest0-21swapper/111:40:171
175049931,1cyclictest0-21swapper/111:35:141
175049931,1cyclictest0-21swapper/110:40:121
175049931,1cyclictest0-21swapper/110:35:171
175049931,1cyclictest0-21swapper/110:30:141
175049931,1cyclictest0-21swapper/110:20:151
175049931,1cyclictest0-21swapper/110:00:031
175049931,1cyclictest0-21swapper/109:50:151
175049931,1cyclictest0-21swapper/109:40:131
175049931,1cyclictest0-21swapper/109:30:181
175049931,1cyclictest0-21swapper/109:00:171
175049931,1cyclictest0-21swapper/108:45:151
175049931,1cyclictest0-21swapper/108:30:131
175049931,1cyclictest0-21swapper/108:15:111
175049931,1cyclictest0-21swapper/108:05:011
175049931,1cyclictest0-21swapper/108:00:111
175049931,1cyclictest0-21swapper/107:50:131
175049931,1cyclictest0-21swapper/107:45:131
175049931,1cyclictest0-21swapper/107:35:121
175049931,1cyclictest0-21swapper/107:10:121
175049930,2cyclictest32058-21taskset09:19:021
175049930,2cyclictest0-21swapper/112:30:151
175049930,2cyclictest0-21swapper/112:05:151
175049930,2cyclictest0-21swapper/111:55:151
175049930,2cyclictest0-21swapper/111:45:171
175049930,2cyclictest0-21swapper/109:55:141
175049930,2cyclictest0-21swapper/109:20:151
175049930,0cyclictest0-21swapper/107:41:421
175039931,1cyclictest0-21swapper/007:40:110
175039930,3cyclictest9422-21ssh10:45:080
175039930,3cyclictest11548-21ssh09:25:010
175039930,3cyclictest0-21swapper/011:05:120
175039930,3cyclictest0-21swapper/009:05:170
175039930,3cyclictest0-21swapper/008:45:160
175039930,3cyclictest0-21swapper/008:20:140
175039930,3cyclictest0-21swapper/008:05:000
175039930,3cyclictest0-21swapper/007:55:100
175039930,3cyclictest0-21swapper/007:45:020
175049921,1cyclictest0-21swapper/112:35:151
175049921,1cyclictest0-21swapper/107:20:131
175049920,1cyclictest25404-21chrt08:25:381
175049920,1cyclictest0-21swapper/112:25:141
175049920,1cyclictest0-21swapper/111:15:011
175049920,1cyclictest0-21swapper/109:10:011
175049920,1cyclictest0-21swapper/108:50:151
175049920,1cyclictest0-21swapper/108:10:151
175049920,1cyclictest0-21swapper/107:25:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional