You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-25 - 23:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Tue Jun 25, 2024 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16154995822,0cyclictest0-21swapper/007:28:050
1615499320,31cyclictest2411-21systemd-journal09:45:000
16164993130,1cyclictest13536-21sh11:37:173
1616499310,30cyclictest11496-21ssh09:47:243
16159993127,3cyclictest27246-21diskmemload09:29:562
1615999310,30cyclictest25007-21ssh10:38:292
1615999310,30cyclictest0-21swapper/210:30:002
1615599311,30cyclictest22-21ksoftirqd/110:18:401
1615599311,29cyclictest6469-21ssh09:41:211
1615599310,30cyclictest31327-21sh12:33:021
1615599310,30cyclictest20324-21cron08:25:011
1615599310,30cyclictest19435-21sh11:45:001
16154993128,2cyclictest11528-21ssh09:10:500
1615499310,30cyclictest9201-21diskmemload09:15:390
1615499310,30cyclictest29158-21ssh10:06:400
1616499300,2cyclictest30241-21ssh09:32:013
1616499300,29cyclictest8090-21sh10:20:103
1616499300,29cyclictest31210-21ssh12:32:483
1616499300,1cyclictest9201-21diskmemload09:43:573
1616499300,1cyclictest0-21swapper/311:25:103
16159993028,1cyclictest1409-21/usr/sbin/munin12:35:232
16159993028,1cyclictest0-21swapper/209:53:132
16159993028,1cyclictest0-21swapper/209:48:542
1615999300,29cyclictest3976-21apt-get07:50:142
1615999300,29cyclictest21076-21apt-get07:20:132
1615999300,1cyclictest7475-21apt-get10:20:022
16155993029,1cyclictest19801-21apt-get11:45:121
16155993028,1cyclictest0-21swapper/111:51:011
1615599300,29cyclictest9201-21diskmemload12:11:251
1615599300,29cyclictest9201-21diskmemload11:58:011
1615599300,29cyclictest9201-21diskmemload11:27:311
1615599300,29cyclictest9201-21diskmemload10:35:391
1615599300,29cyclictest9201-21diskmemload09:56:321
1615599300,29cyclictest24936-21munin-run11:15:011
1615599300,29cyclictest10143-21sh10:20:551
1615599300,29cyclictest0-21swapper/112:36:211
1615599300,29cyclictest0-21swapper/112:20:301
1615599300,29cyclictest0-21swapper/111:37:171
1615599300,29cyclictest0-21swapper/110:57:201
1615599300,29cyclictest0-21swapper/110:05:461
1615599300,29cyclictest0-21swapper/109:30:421
1615599300,29cyclictest0-21swapper/109:11:461
1615599300,1cyclictest20422-21cron11:10:001
1615599300,1cyclictest15100-21rm11:03:231
1615599300,1cyclictest0-21swapper/112:03:431
16154993029,1cyclictest9201-21diskmemload10:21:490
16154993028,2cyclictest0-21swapper/011:06:090
16154993028,1cyclictest24283-21apt-get11:50:140
16154993028,1cyclictest0-21swapper/011:20:530
16154993028,1cyclictest0-21swapper/011:20:530
16154993027,2cyclictest13862-21ssh11:37:550
1615499300,29cyclictest21721-21ssh11:45:440
1615499300,29cyclictest12183-21sh11:00:140
1615499300,29cyclictest0-21swapper/010:57:050
1615499300,29cyclictest0-21swapper/010:37:220
1615499300,29cyclictest0-21swapper/009:20:090
1615499300,1cyclictest9201-21diskmemload12:32:240
1615499300,1cyclictest2529-21ssh12:00:390
1615499300,1cyclictest24909-21cron11:15:000
1615499300,1cyclictest0-21swapper/012:25:240
1615499300,0cyclictest0-21swapper/010:47:420
16164992929,0cyclictest0-21swapper/311:50:263
16164992928,1cyclictest9201-21diskmemload12:00:423
16164992928,1cyclictest9201-21diskmemload11:16:593
16164992928,1cyclictest8871-21ssh11:32:013
16164992928,1cyclictest5337-21diskmemload10:15:573
16164992928,1cyclictest28687-21ssh10:05:463
16164992928,1cyclictest24125-21ssh10:36:443
16164992928,1cyclictest20330-21awk08:25:013
16164992928,1cyclictest12005-21ssh09:11:463
1616499290,29cyclictest9201-21diskmemload11:02:343
1616499290,29cyclictest9201-21diskmemload10:28:093
1616499290,29cyclictest9201-21diskmemload09:16:423
1616499290,29cyclictest25049-21kworker/u8:109:37:073
1616499290,29cyclictest23003-21sh09:25:013
1616499290,29cyclictest0-21swapper/312:38:493
1616499290,29cyclictest0-21swapper/312:26:243
1616499290,29cyclictest0-21swapper/311:40:143
1616499290,29cyclictest0-21swapper/310:54:373
1616499290,29cyclictest0-21swapper/310:35:013
1616499290,29cyclictest0-21swapper/310:11:203
1616499290,29cyclictest0-21swapper/309:56:083
1616499290,28cyclictest0-21swapper/312:15:113
1616499290,0cyclictest9201-21diskmemload12:22:263
1616499290,0cyclictest9201-21diskmemload11:55:503
1616499290,0cyclictest9201-21diskmemload11:45:033
1616499290,0cyclictest9201-21diskmemload10:40:483
1616499290,0cyclictest0-21swapper/311:22:273
1616499290,0cyclictest0-21swapper/311:22:273
1616499290,0cyclictest0-21swapper/310:59:263
1616499290,0cyclictest0-21swapper/309:50:213
1616499290,0cyclictest0-21swapper/309:23:023
16159992929,0cyclictest9201-21diskmemload11:15:212
16159992929,0cyclictest0-21swapper/211:35:362
16159992929,0cyclictest0-21swapper/211:05:032
16159992928,0cyclictest4503-21cron09:00:002
16159992927,1cyclictest0-21swapper/212:30:572
16159992927,1cyclictest0-21swapper/210:00:422
1615999290,29cyclictest9201-21diskmemload12:20:422
1615999290,29cyclictest9201-21diskmemload12:08:202
1615999290,29cyclictest9201-21diskmemload12:08:202
1615999290,29cyclictest9201-21diskmemload11:26:012
1615999290,29cyclictest9201-21diskmemload10:06:282
1615999290,29cyclictest0-21swapper/212:29:042
1615999290,29cyclictest0-21swapper/212:16:342
1615999290,29cyclictest0-21swapper/211:45:042
1615999290,29cyclictest0-21swapper/211:40:202
1615999290,29cyclictest0-21swapper/211:20:142
1615999290,29cyclictest0-21swapper/211:20:132
1615999290,29cyclictest0-21swapper/210:45:022
1615999290,29cyclictest0-21swapper/210:12:042
1615999290,29cyclictest0-21swapper/209:35:022
1615999290,29cyclictest0-21swapper/209:31:002
1615999290,29cyclictest0-21swapper/209:15:532
1615999290,29cyclictest0-21swapper/209:12:542
1615999290,28cyclictest9201-21diskmemload11:51:052
1615999290,28cyclictest8853-21sh10:55:392
1615999290,1cyclictest5395-21ssh10:52:102
1615999290,1cyclictest0-21swapper/209:20:162
1615999290,0cyclictest9201-21diskmemload11:00:402
1615999290,0cyclictest9201-21diskmemload10:41:002
1615999290,0cyclictest9201-21diskmemload09:57:032
1615999290,0cyclictest0-21swapper/212:00:222
1615999290,0cyclictest0-21swapper/211:56:052
1615999290,0cyclictest0-21swapper/211:11:332
1615999290,0cyclictest0-21swapper/210:32:392
1615999290,0cyclictest0-21swapper/210:15:012
1615999290,0cyclictest0-21swapper/209:41:572
1615999290,0cyclictest0-21swapper/207:30:132
16155992929,0cyclictest0-21swapper/110:40:121
16155992929,0cyclictest0-21swapper/109:25:181
16155992929,0cyclictest0-21swapper/109:20:101
16155992928,1cyclictest9201-21diskmemload10:10:141
1615599290,29cyclictest9201-21diskmemload09:38:231
1615599290,29cyclictest0-21swapper/112:26:401
1615599290,29cyclictest0-21swapper/111:20:121
1615599290,29cyclictest0-21swapper/111:20:121
1615599290,29cyclictest0-21swapper/111:15:511
1615599290,29cyclictest0-21swapper/110:00:401
1615599290,29cyclictest0-21swapper/109:50:431
1615599290,1cyclictest0-21swapper/111:32:001
1615599290,0cyclictest9201-21diskmemload10:49:401
1615599290,0cyclictest0-21swapper/112:15:131
1615599290,0cyclictest0-21swapper/110:30:111
1615599290,0cyclictest0-21swapper/110:25:091
16154992929,0cyclictest0-21swapper/010:41:200
16154992929,0cyclictest0-21swapper/007:55:120
16154992928,1cyclictest0-21swapper/012:20:320
16154992927,2cyclictest0-21swapper/011:43:230
16154992927,1cyclictest31174-21munin-run07:40:010
16154992927,1cyclictest0-21swapper/010:50:150
1615499290,29cyclictest9201-21diskmemload12:05:290
1615499290,29cyclictest9201-21diskmemload12:05:290
1615499290,29cyclictest9201-21diskmemload11:56:260
1615499290,29cyclictest9201-21diskmemload11:28:050
1615499290,29cyclictest9201-21diskmemload10:00:090
1615499290,29cyclictest9201-21diskmemload09:35:490
1615499290,29cyclictest9201-21diskmemload09:25:450
1615499290,29cyclictest0-21swapper/010:25:450
1615499290,29cyclictest0-21swapper/010:15:150
1615499290,29cyclictest0-21swapper/010:12:340
1615499290,29cyclictest0-21swapper/009:55:580
1615499290,1cyclictest754-21runrttasks12:35:130
1615499290,1cyclictest58550irq/126-eno111:31:070
1615499290,1cyclictest25284-21apt-get11:15:130
1615499290,1cyclictest17426-21ssh12:17:190
1615499290,0cyclictest9201-21diskmemload09:54:230
1615499290,0cyclictest27663-21apt-get09:30:110
1615499290,0cyclictest0-21swapper/010:30:570
1615499290,0cyclictest0-21swapper/009:46:150
16164992828,0cyclictest0-21swapper/311:10:113
1616499280,28cyclictest0-21swapper/312:06:223
1616499280,28cyclictest0-21swapper/312:06:223
1616499280,28cyclictest0-21swapper/311:05:163
1616499280,0cyclictest10955-21apt-get08:05:143
1616499280,0cyclictest0-21swapper/310:45:133
1616499280,0cyclictest0-21swapper/308:55:143
16159992826,1cyclictest0-21swapper/208:15:012
1615999280,28cyclictest0-21swapper/211:30:302
16155992828,0cyclictest8632-21apt-get08:00:101
16155992828,0cyclictest0-21swapper/112:05:541
16155992828,0cyclictest0-21swapper/112:05:541
1615599280,28cyclictest0-21swapper/109:15:091
1615599280,0cyclictest0-21swapper/110:50:491
16154992828,0cyclictest0-21swapper/009:05:120
16154992828,0cyclictest0-21swapper/008:15:150
16164992727,0cyclictest0-21swapper/308:00:103
16159992725,1cyclictest0-21swapper/208:10:012
16155992727,0cyclictest0-21swapper/109:00:131
16154992727,0cyclictest27948-21apt-get08:40:150
16154992727,0cyclictest0-21swapper/007:45:140
16159992626,0cyclictest23284-21apt-get08:30:112
16155992626,0cyclictest0-21swapper/108:55:141
16155992626,0cyclictest0-21swapper/108:35:121
16155992625,1cyclictest25704-21lspci07:28:061
16164992525,0cyclictest4825-21apt-get09:00:133
16159992523,1cyclictest15644-21apt-get08:15:162
16154992525,0cyclictest0-21swapper/008:35:120
16154992525,0cyclictest0-21swapper/008:25:120
16154992525,0cyclictest0-21swapper/008:05:140
16154992525,0cyclictest0-21swapper/008:00:110
16154992525,0cyclictest0-21swapper/007:15:130
16154992524,1cyclictest23145-21munin-run07:25:010
16164992424,0cyclictest25608-21apt-get08:35:123
16159992424,0cyclictest0-21swapper/207:35:142
16155992424,0cyclictest0-21swapper/107:40:031
16155992424,0cyclictest0-21swapper/107:10:111
16155992423,0cyclictest0-21swapper/108:30:011
16154992424,0cyclictest0-21swapper/007:30:130
16154992421,2cyclictest5995-21cron07:55:000
16164992323,0cyclictest0-21swapper/307:28:053
16159992322,1cyclictest25859-21lspci07:28:052
16159992320,2cyclictest3691-21cron07:50:002
16164992221,1cyclictest22702-21apt-get08:30:023
16159992222,0cyclictest6911-21perf09:05:002
16164992121,0cyclictest0-21swapper/307:40:043
16164992121,0cyclictest0-21swapper/307:10:113
16155992121,0cyclictest0-21swapper/108:30:111
16154992121,0cyclictest0-21swapper/008:45:140
16164991919,0cyclictest0-21swapper/308:30:113
16159991919,0cyclictest0-21swapper/208:25:122
1615499196,0cyclictest0-21swapper/008:11:100
16159991614,1cyclictest0-21swapper/209:10:012
16155991615,1cyclictest0-21swapper/108:10:141
16159991513,1cyclictest28373-21diskstats08:40:182
1615999150,14cyclictest7261-21/usr/sbin/munin07:55:232
1615599150,14cyclictest646-21grep08:50:171
1615499150,14cyclictest0-21swapper/008:55:140
1616499140,14cyclictest0-21swapper/308:46:523
1616499140,14cyclictest0-21swapper/308:17:303
1616499140,14cyclictest0-21swapper/308:12:053
1616499140,14cyclictest0-21swapper/307:56:573
1616499140,14cyclictest0-21swapper/307:47:453
1616499140,14cyclictest0-21swapper/307:36:103
1616499140,14cyclictest0-21swapper/307:31:043
1616499140,14cyclictest0-21swapper/307:20:183
1616499140,14cyclictest0-21swapper/307:15:363
1616499140,0cyclictest0-21swapper/309:06:003
1616499140,0cyclictest0-21swapper/308:50:083
1616499140,0cyclictest0-21swapper/307:50:013
1615999140,14cyclictest0-21swapper/208:45:172
1615999140,14cyclictest0-21swapper/208:37:272
1615999140,14cyclictest0-21swapper/208:23:422
1615999140,14cyclictest0-21swapper/208:04:332
1615999140,14cyclictest0-21swapper/207:41:132
1615999140,14cyclictest0-21swapper/207:19:352
1615999140,14cyclictest0-21swapper/207:11:452
1615999140,0cyclictest0-21swapper/208:54:362
16155991414,0cyclictest0-21swapper/108:40:211
16155991414,0cyclictest0-21swapper/108:05:581
1615599140,14cyclictest0-21swapper/109:05:011
1615599140,14cyclictest0-21swapper/108:45:321
1615599140,14cyclictest0-21swapper/108:16:011
1615599140,14cyclictest0-21swapper/107:56:021
1615599140,14cyclictest0-21swapper/107:50:031
1615599140,14cyclictest0-21swapper/107:35:511
1615599140,14cyclictest0-21swapper/107:30:201
1615599140,14cyclictest0-21swapper/107:20:211
1615599140,14cyclictest0-21swapper/107:16:041
1615599140,0cyclictest0-21swapper/107:48:331
16154991414,0cyclictest0-21swapper/008:50:180
16154991414,0cyclictest0-21swapper/008:30:180
1615499140,14cyclictest0-21swapper/007:41:080
1615499140,14cyclictest0-21swapper/007:13:080
1615499140,0cyclictest0-21swapper/008:20:490
16164991313,0cyclictest0-21swapper/308:41:323
16154991313,0cyclictest0-21swapper/009:00:370
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional