You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-25 - 13:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Thu Apr 25, 2024 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14840993129,1cyclictest0-21swapper/323:10:003
1484099310,30cyclictest1100-21diskmemload21:17:593
1483999310,2cyclictest431-21ssh23:30:222
1483799310,30cyclictest2411-21systemd-journal22:30:010
14840993028,1cyclictest0-21swapper/323:41:053
14840993028,1cyclictest0-21swapper/323:27:153
14840993028,1cyclictest0-21swapper/300:28:223
1484099300,29cyclictest14879-21ssh21:24:473
1484099300,29cyclictest13035-21apt-get23:10:093
1484099300,29cyclictest1100-21diskmemload23:50:103
1484099300,29cyclictest1100-21diskmemload23:35:073
1484099300,29cyclictest1100-21diskmemload23:23:463
1484099300,29cyclictest1100-21diskmemload22:18:093
1484099300,29cyclictest1100-21diskmemload21:40:443
1484099300,29cyclictest1100-21diskmemload21:10:153
1484099300,29cyclictest1100-21diskmemload00:04:363
1484099300,29cyclictest10985-21cut21:55:183
1484099300,29cyclictest0-21swapper/322:57:153
1484099300,29cyclictest0-21swapper/322:31:563
1484099300,29cyclictest0-21swapper/322:25:173
1484099300,29cyclictest0-21swapper/322:00:183
1484099300,29cyclictest0-21swapper/321:53:503
1484099300,29cyclictest0-21swapper/321:39:013
1484099300,29cyclictest0-21swapper/321:39:013
1484099300,1cyclictest936-21perf20:00:013
1484099300,1cyclictest31002-21awk19:55:013
1484099300,1cyclictest1100-21diskmemload23:58:073
1484099300,1cyclictest1100-21diskmemload22:51:513
1484099300,1cyclictest1100-21diskmemload22:39:133
1484099300,1cyclictest1100-21diskmemload00:35:423
14839993028,1cyclictest3754-21ssh22:24:042
14839993028,0cyclictest0-21swapper/200:09:402
1483999300,29cyclictest28883-21sh00:01:452
1483999300,29cyclictest0-21swapper/222:05:112
1483999300,1cyclictest21791-21apt-get23:55:092
1483999300,1cyclictest1100-21diskmemload21:36:122
1483999300,1cyclictest1100-21diskmemload21:36:122
1483999300,1cyclictest1100-21diskmemload21:19:592
14838993028,2cyclictest8079-21ssh23:04:531
14838993028,1cyclictest7385-21ssh23:38:521
14838993028,1cyclictest0-21swapper/123:30:211
14838993028,1cyclictest0-21swapper/100:25:011
1483899300,30cyclictest1100-21diskmemload21:25:421
1483899300,29cyclictest8280-21ssh22:29:001
1483899300,29cyclictest21928-21ssh22:44:071
1483899300,29cyclictest19089-21sh23:15:281
1483899300,29cyclictest1100-21diskmemload23:50:411
1483899300,1cyclictest25804-21taskset22:11:271
1483899300,1cyclictest1100-21diskmemload23:47:101
1483899300,1cyclictest0-21swapper/123:40:151
14837993029,1cyclictest9193-21grep22:30:120
14837993028,2cyclictest0-21swapper/021:16:330
14837993028,1cyclictest0-21swapper/022:51:330
14837993028,1cyclictest0-21swapper/022:45:130
1483799300,30cyclictest0-21swapper/023:33:200
1483799300,30cyclictest0-21swapper/021:56:030
1483799300,29cyclictest58550irq/126-eno121:41:080
1483799300,29cyclictest19955-21sh00:28:290
1483799300,29cyclictest1100-21diskmemload00:21:400
1483799300,29cyclictest0-21swapper/023:55:100
1483799300,29cyclictest0-21swapper/023:26:570
1483799300,29cyclictest0-21swapper/023:22:550
1483799300,29cyclictest0-21swapper/023:05:100
1483799300,29cyclictest0-21swapper/022:10:110
1483799300,29cyclictest0-21swapper/000:04:010
1483799300,1cyclictest1615-21chrt22:56:190
1483799300,1cyclictest1100-21diskmemload22:39:300
1483799300,0cyclictest1100-21diskmemload00:33:370
14840992929,0cyclictest0-21swapper/321:25:123
14840992928,1cyclictest1100-21diskmemload00:16:193
14840992928,1cyclictest0-21swapper/321:46:133
14840992928,0cyclictest0-21swapper/319:25:013
14840992927,1cyclictest0-21swapper/300:20:163
1484099290,29cyclictest0-21swapper/323:16:053
1484099290,29cyclictest0-21swapper/322:40:493
1484099290,29cyclictest0-21swapper/300:30:093
1484099290,29cyclictest0-21swapper/300:05:363
1484099290,28cyclictest0-21swapper/322:10:213
1484099290,1cyclictest0-21swapper/323:46:523
1484099290,0cyclictest1100-21diskmemload22:46:083
1484099290,0cyclictest1100-21diskmemload21:30:193
1484099290,0cyclictest0-21swapper/323:31:413
1484099290,0cyclictest0-21swapper/323:01:053
1484099290,0cyclictest0-21swapper/322:23:183
1484099290,0cyclictest0-21swapper/322:05:183
1484099290,0cyclictest0-21swapper/320:35:113
1484099290,0cyclictest0-21swapper/300:11:413
14839992929,0cyclictest0-21swapper/223:21:292
14839992928,1cyclictest23406-21munin-run19:35:012
14839992928,1cyclictest1100-21diskmemload23:17:452
14839992928,1cyclictest0-21swapper/200:22:462
1483999290,29cyclictest1100-21diskmemload22:56:212
1483999290,29cyclictest1100-21diskmemload22:50:472
1483999290,29cyclictest1100-21diskmemload21:56:072
1483999290,29cyclictest1100-21diskmemload21:27:392
1483999290,29cyclictest1100-21diskmemload00:15:212
1483999290,29cyclictest10974-21ssh23:06:462
1483999290,29cyclictest0-21swapper/223:44:252
1483999290,29cyclictest0-21swapper/223:39:402
1483999290,29cyclictest0-21swapper/223:13:112
1483999290,29cyclictest0-21swapper/222:43:092
1483999290,29cyclictest0-21swapper/222:35:292
1483999290,29cyclictest0-21swapper/222:28:132
1483999290,29cyclictest0-21swapper/222:15:122
1483999290,29cyclictest0-21swapper/222:11:412
1483999290,29cyclictest0-21swapper/222:01:492
1483999290,29cyclictest0-21swapper/221:46:232
1483999290,29cyclictest0-21swapper/221:31:292
1483999290,29cyclictest0-21swapper/221:10:012
1483999290,29cyclictest0-21swapper/200:35:462
1483999290,29cyclictest0-21swapper/200:30:142
1483999290,28cyclictest3084-21apt-get00:10:132
1483999290,28cyclictest1100-21diskmemload23:01:312
1483999290,28cyclictest0-21swapper/221:41:392
1483999290,1cyclictest19166-21ssh23:50:362
1483999290,1cyclictest1100-21diskmemload21:52:092
1483999290,1cyclictest1100-21diskmemload00:26:392
1483999290,1cyclictest0-21swapper/221:24:122
1483999290,0cyclictest1100-21diskmemload22:45:352
1483999290,0cyclictest0-21swapper/223:46:042
1483999290,0cyclictest0-21swapper/223:25:182
1483999290,0cyclictest0-21swapper/220:50:122
14838992929,0cyclictest0-21swapper/100:28:111
14838992928,1cyclictest1100-21diskmemload21:45:531
14838992928,1cyclictest0-21swapper/123:55:101
14838992927,2cyclictest3387-21ssh21:10:401
1483899290,29cyclictest15728-21ssh23:12:101
1483899290,29cyclictest1100-21diskmemload22:35:561
1483899290,29cyclictest1100-21diskmemload22:31:011
1483899290,29cyclictest1100-21diskmemload21:55:191
1483899290,29cyclictest1100-21diskmemload21:21:351
1483899290,29cyclictest0-21swapper/123:28:571
1483899290,29cyclictest0-21swapper/123:21:221
1483899290,29cyclictest0-21swapper/122:51:021
1483899290,29cyclictest0-21swapper/122:46:021
1483899290,29cyclictest0-21swapper/122:05:091
1483899290,29cyclictest0-21swapper/121:40:031
1483899290,29cyclictest0-21swapper/121:30:241
1483899290,29cyclictest0-21swapper/121:15:241
1483899290,29cyclictest0-21swapper/119:50:151
1483899290,29cyclictest0-21swapper/100:30:101
1483899290,29cyclictest0-21swapper/100:17:151
1483899290,29cyclictest0-21swapper/100:10:531
1483899290,29cyclictest0-21swapper/100:05:291
1483899290,29cyclictest0-21swapper/100:00:271
1483899290,28cyclictest28001-21apt-get22:15:111
1483899290,0cyclictest0-21swapper/123:07:461
1483899290,0cyclictest0-21swapper/121:53:291
1483899290,0cyclictest0-21swapper/121:35:361
1483899290,0cyclictest0-21swapper/121:35:361
1483899290,0cyclictest0-21swapper/100:35:491
14837992929,0cyclictest0-21swapper/023:00:380
14837992929,0cyclictest0-21swapper/021:45:330
14837992929,0cyclictest0-21swapper/000:05:040
14837992927,1cyclictest561-21dbus-daemon20:25:000
1483799290,29cyclictest1100-21diskmemload22:22:160
1483799290,29cyclictest0-21swapper/023:11:040
1483799290,29cyclictest0-21swapper/022:40:560
1483799290,29cyclictest0-21swapper/022:06:560
1483799290,29cyclictest0-21swapper/021:50:430
1483799290,29cyclictest0-21swapper/021:26:440
1483799290,29cyclictest0-21swapper/019:40:070
1483799290,29cyclictest0-21swapper/000:11:200
1483799290,28cyclictest0-21swapper/021:11:290
1483799290,28cyclictest0-21swapper/020:10:130
1483799290,0cyclictest1100-21diskmemload23:35:030
1483799290,0cyclictest1100-21diskmemload00:36:290
1483799290,0cyclictest0-21swapper/023:50:100
1483799290,0cyclictest0-21swapper/023:41:180
1483799290,0cyclictest0-21swapper/023:15:100
1483799290,0cyclictest0-21swapper/022:16:560
1483799290,0cyclictest0-21swapper/022:00:260
1483799290,0cyclictest0-21swapper/021:35:140
1483799290,0cyclictest0-21swapper/021:35:140
1483799290,0cyclictest0-21swapper/021:30:050
1483799290,0cyclictest0-21swapper/021:20:190
1483799290,0cyclictest0-21swapper/000:15:500
1484099280,28cyclictest0-21swapper/320:55:013
14839992828,0cyclictest31291-21apt-get19:55:112
1483999280,0cyclictest0-21swapper/220:30:142
14838992828,0cyclictest0-21swapper/122:55:211
1483899280,0cyclictest0-21swapper/122:22:181
1483899280,0cyclictest0-21swapper/122:00:131
14837992828,0cyclictest0-21swapper/019:55:120
14840992727,0cyclictest0-21swapper/321:05:143
14838992727,0cyclictest0-21swapper/120:50:121
14840992626,0cyclictest0-21swapper/320:10:123
14839992625,1cyclictest12891-21apt-get20:25:122
14838992626,0cyclictest0-21swapper/120:55:131
14838992626,0cyclictest0-21swapper/120:10:131
14840992524,0cyclictest0-21swapper/320:05:133
14840992523,2cyclictest10279-21sendmail-msp20:20:013
14837992525,0cyclictest0-21swapper/020:25:110
14839992423,1cyclictest1209-21apt-get20:00:132
14838992323,0cyclictest0-21swapper/120:00:151
14838992323,0cyclictest0-21swapper/119:55:121
14837992323,0cyclictest28975-21apt-get19:50:160
14838992222,0cyclictest8229-21apt-get20:15:131
14839992119,1cyclictest5562-21awk20:10:002
14838992121,0cyclictest0-21swapper/120:35:101
14838992121,0cyclictest0-21swapper/119:20:081
14837992120,1cyclictest24517-21apt-get20:50:120
14840992020,0cyclictest0-21swapper/320:45:133
14839992020,0cyclictest5904-21apt-get20:10:132
14838992019,1cyclictest10574-21apt-get20:20:141
14838991919,0cyclictest5585-21perf20:10:011
14838991919,0cyclictest0-21swapper/120:45:141
14837991919,0cyclictest0-21swapper/020:55:130
14837991817,0cyclictest1209-21apt-get20:00:150
14840991616,0cyclictest0-21swapper/320:55:123
14840991614,1cyclictest17815-21munin-run19:20:003
14838991614,1cyclictest0-21swapper/121:00:241
1483799160,15cyclictest0-21swapper/020:20:020
14840991513,1cyclictest0-21swapper/320:00:193
14839991515,0cyclictest22201-21apt-get20:45:132
14839991514,1cyclictest12619-21perf20:25:012
14838991515,0cyclictest0-21swapper/120:25:111
1483899150,1cyclictest0-21swapper/120:30:201
1483899150,14cyclictest0-21swapper/120:40:101
14837991515,0cyclictest0-21swapper/019:20:080
1483799150,15cyclictest0-21swapper/019:28:070
1483799150,14cyclictest17818-21awk19:20:010
1483799150,14cyclictest0-21swapper/020:40:130
14840991414,0cyclictest0-21swapper/319:45:193
1484099140,14cyclictest0-21swapper/320:30:383
1484099140,14cyclictest0-21swapper/320:25:523
1484099140,14cyclictest0-21swapper/319:24:403
1484099140,14cyclictest0-21swapper/319:11:553
1484099140,0cyclictest0-21swapper/321:03:383
1484099140,0cyclictest0-21swapper/320:42:373
1484099140,0cyclictest0-21swapper/319:37:273
1483999140,14cyclictest0-21swapper/219:48:332
1483999140,14cyclictest0-21swapper/219:40:292
1483999140,14cyclictest0-21swapper/219:37:302
1483999140,14cyclictest0-21swapper/219:27:392
1483999140,14cyclictest0-21swapper/219:20:152
1483999140,14cyclictest0-21swapper/219:13:402
1483999140,0cyclictest0-21swapper/221:05:232
1483999140,0cyclictest0-21swapper/220:39:092
1483999140,0cyclictest0-21swapper/219:16:582
14838991414,0cyclictest0-21swapper/121:05:141
14838991414,0cyclictest0-21swapper/119:45:001
14838991414,0cyclictest0-21swapper/119:37:111
1483899140,14cyclictest0-21swapper/119:41:151
1483899140,14cyclictest0-21swapper/119:15:231
1483899140,14cyclictest0-21swapper/119:11:491
1483899140,0cyclictest0-21swapper/119:32:391
1483899140,0cyclictest0-21swapper/119:27:041
14837991414,0cyclictest0-21swapper/020:35:110
14837991414,0cyclictest0-21swapper/020:30:130
1483799140,14cyclictest0-21swapper/021:00:180
1483799140,14cyclictest0-21swapper/020:46:570
1483799140,14cyclictest0-21swapper/019:47:500
1483799140,14cyclictest0-21swapper/019:11:220
1483799140,13cyclictest0-21swapper/020:05:270
1483799140,0cyclictest0-21swapper/021:05:160
1483799140,0cyclictest0-21swapper/019:35:230
1483799140,0cyclictest0-21swapper/019:30:380
14840991313,0cyclictest0-21swapper/320:20:033
14840991313,0cyclictest0-21swapper/319:30:443
14839991313,0cyclictest0-21swapper/219:50:152
1483999130,13cyclictest0-21swapper/220:17:342
1483999130,0cyclictest0-21swapper/221:03:372
1483999130,0cyclictest0-21swapper/220:40:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional