You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-03-02 - 08:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5.osadl.org (updated Sat Mar 02, 2024 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2462399310,30cyclictest8449-21sh22:47:593
2462399310,30cyclictest8081-21latency_hist00:00:013
2462399310,30cyclictest12737-21grep22:15:303
2462299310,30cyclictest16269-21diskmemload21:38:492
24620993130,1cyclictest14489-21sh21:42:140
24623993029,1cyclictest16269-21diskmemload23:36:063
24623993028,1cyclictest12306-21time-dir00:04:113
24623993028,1cyclictest0-21swapper/322:20:323
24623993028,1cyclictest0-21swapper/322:00:003
2462399300,29cyclictest20920-21sh23:00:493
2462399300,29cyclictest16269-21diskmemload22:40:113
2462399300,29cyclictest16269-21diskmemload21:33:053
2462399300,29cyclictest0-21swapper/322:36:433
2462399300,29cyclictest0-21swapper/321:11:573
2462399300,1cyclictest0-21swapper/300:16:273
24622993028,1cyclictest21942-21awk00:15:012
24622993028,1cyclictest15393-21ssh00:06:242
24622993028,1cyclictest0-21swapper/223:40:102
24622993028,1cyclictest0-21swapper/223:25:512
24622993028,1cyclictest0-21swapper/222:28:342
24622993028,1cyclictest0-21swapper/222:05:012
2462299300,29cyclictest6001-21sh23:56:112
2462299300,29cyclictest16269-21diskmemload22:05:292
2462299300,29cyclictest16269-21diskmemload00:18:002
2462299300,29cyclictest0-21swapper/223:15:432
2462299300,29cyclictest0-21swapper/222:30:482
2462299300,29cyclictest0-21swapper/221:16:322
2462299300,29cyclictest0-21swapper/220:20:202
2462299300,1cyclictest16269-21diskmemload23:22:002
2462299300,1cyclictest0-21swapper/222:40:002
24621993027,2cyclictest382-21sendmail22:40:001
2462199300,30cyclictest16269-21diskmemload21:54:051
2462199300,29cyclictest8095-40mandb00:00:021
2462199300,29cyclictest16269-21diskmemload22:12:491
2462199300,29cyclictest12740-21sed22:15:291
2462199300,29cyclictest0-21swapper/100:17:341
2462199300,1cyclictest8485-21munin-run19:45:011
24620993029,1cyclictest6535-21apt-get22:10:200
24620993029,1cyclictest16269-21diskmemload21:38:280
24620993029,1cyclictest16269-21diskmemload21:26:350
24620993028,1cyclictest3511-21perf23:55:020
24620993028,1cyclictest0-21swapper/000:06:060
2462099300,30cyclictest16269-21diskmemload21:34:170
2462099300,29cyclictest30504-21ssh23:11:290
2462099300,29cyclictest27200-21apt-get19:15:180
2462099300,29cyclictest24068-21sh21:53:320
2462099300,29cyclictest22275-21ssh00:15:100
2462099300,29cyclictest0-21swapper/000:35:540
2462099300,1cyclictest16269-21diskmemload22:52:320
2462099300,1cyclictest0-21swapper/023:00:200
24623992928,1cyclictest16269-21diskmemload21:27:513
24623992928,1cyclictest16269-21diskmemload00:10:103
24623992927,1cyclictest29448-21perf20:30:023
2462399290,29cyclictest16269-21diskmemload23:15:093
2462399290,29cyclictest16269-21diskmemload22:59:343
2462399290,29cyclictest16269-21diskmemload22:25:203
2462399290,29cyclictest16269-21diskmemload21:50:033
2462399290,29cyclictest16269-21diskmemload21:44:173
2462399290,29cyclictest16269-21diskmemload21:37:533
2462399290,29cyclictest0-21swapper/323:52:363
2462399290,29cyclictest0-21swapper/323:41:173
2462399290,29cyclictest0-21swapper/323:30:523
2462399290,29cyclictest0-21swapper/323:25:553
2462399290,29cyclictest0-21swapper/323:22:093
2462399290,29cyclictest0-21swapper/323:13:573
2462399290,29cyclictest0-21swapper/322:32:513
2462399290,29cyclictest0-21swapper/322:05:493
2462399290,29cyclictest0-21swapper/322:00:193
2462399290,29cyclictest0-21swapper/321:49:503
2462399290,29cyclictest0-21swapper/321:21:543
2462399290,29cyclictest0-21swapper/300:30:363
2462399290,29cyclictest0-21swapper/300:25:283
2462399290,29cyclictest0-21swapper/300:20:353
2462399290,29cyclictest0-21swapper/300:05:073
2462399290,1cyclictest12032-21sh22:51:043
2462399290,1cyclictest0-21swapper/319:45:003
2462399290,0cyclictest16269-21diskmemload23:47:423
2462399290,0cyclictest16269-21diskmemload21:15:293
2462399290,0cyclictest0-21swapper/323:05:583
2462399290,0cyclictest0-21swapper/322:10:093
2462399290,0cyclictest0-21swapper/300:35:373
24622992927,1cyclictest29422-21sh20:30:012
24622992927,0cyclictest0-21swapper/200:20:592
2462299290,29cyclictest16269-21diskmemload23:45:022
2462299290,29cyclictest16269-21diskmemload23:31:562
2462299290,29cyclictest16269-21diskmemload22:50:512
2462299290,29cyclictest16269-21diskmemload21:42:322
2462299290,29cyclictest16269-21diskmemload21:25:542
2462299290,29cyclictest16269-21diskmemload00:35:082
2462299290,29cyclictest0-21swapper/223:11:132
2462299290,29cyclictest0-21swapper/222:55:082
2462299290,29cyclictest0-21swapper/222:49:202
2462299290,29cyclictest0-21swapper/222:42:032
2462299290,29cyclictest0-21swapper/222:16:402
2462299290,29cyclictest0-21swapper/221:57:532
2462299290,28cyclictest16269-21diskmemload00:01:112
2462299290,28cyclictest0-21swapper/223:35:082
2462299290,1cyclictest16551-21taskset21:10:032
2462299290,1cyclictest0-21swapper/223:05:022
2462299290,1cyclictest0-21swapper/221:45:192
2462299290,0cyclictest16269-21diskmemload23:50:492
2462299290,0cyclictest16269-21diskmemload21:31:022
2462299290,0cyclictest0-21swapper/223:00:162
2462299290,0cyclictest0-21swapper/222:21:062
2462299290,0cyclictest0-21swapper/222:10:212
2462299290,0cyclictest0-21swapper/221:53:432
2462299290,0cyclictest0-21swapper/221:21:492
2462299290,0cyclictest0-21swapper/200:30:272
2462299290,0cyclictest0-21swapper/200:26:372
24621992929,0cyclictest0-21swapper/121:56:011
24621992929,0cyclictest0-21swapper/100:11:241
24621992928,1cyclictest17231-21taskset22:20:311
24621992928,1cyclictest10925-21ssh00:36:221
24621992928,1cyclictest10857-21ssh00:01:331
24621992928,1cyclictest0-21swapper/120:35:221
24621992928,0cyclictest16269-21diskmemload22:00:151
24621992927,1cyclictest29451-21munin-run20:30:011
2462199290,29cyclictest16269-21diskmemload23:52:371
2462199290,29cyclictest16269-21diskmemload23:35:231
2462199290,29cyclictest16269-21diskmemload23:22:081
2462199290,29cyclictest16269-21diskmemload21:30:571
2462199290,29cyclictest0-21swapper/123:25:561
2462199290,29cyclictest0-21swapper/123:13:561
2462199290,29cyclictest0-21swapper/122:55:541
2462199290,29cyclictest0-21swapper/122:45:061
2462199290,29cyclictest0-21swapper/122:40:121
2462199290,29cyclictest0-21swapper/122:25:191
2462199290,29cyclictest0-21swapper/122:05:501
2462199290,29cyclictest0-21swapper/121:46:201
2462199290,29cyclictest0-21swapper/121:40:371
2462199290,29cyclictest0-21swapper/121:37:231
2462199290,29cyclictest0-21swapper/121:25:131
2462199290,29cyclictest0-21swapper/121:20:461
2462199290,29cyclictest0-21swapper/121:10:041
2462199290,29cyclictest0-21swapper/100:30:361
2462199290,29cyclictest0-21swapper/100:25:271
2462199290,29cyclictest0-21swapper/100:05:081
2462199290,28cyclictest26977-21apt-get00:20:161
2462199290,28cyclictest0-21swapper/123:30:111
2462199290,28cyclictest0-21swapper/123:00:171
2462199290,0cyclictest0-21swapper/123:47:431
2462199290,0cyclictest0-21swapper/123:41:181
2462199290,0cyclictest0-21swapper/123:15:401
2462199290,0cyclictest0-21swapper/123:05:571
2462199290,0cyclictest0-21swapper/122:50:071
2462199290,0cyclictest0-21swapper/122:30:091
2462199290,0cyclictest0-21swapper/121:15:301
24620992929,0cyclictest0-21swapper/023:30:450
24620992929,0cyclictest0-21swapper/023:21:160
24620992929,0cyclictest0-21swapper/021:21:590
24620992929,0cyclictest0-21swapper/000:00:230
24620992928,1cyclictest19942-21ssh00:11:170
24620992928,1cyclictest16269-21diskmemload00:31:330
2462099290,29cyclictest16269-21diskmemload22:01:120
2462099290,29cyclictest16269-21diskmemload21:16:210
2462099290,29cyclictest0-21swapper/023:40:490
2462099290,29cyclictest0-21swapper/023:25:020
2462099290,29cyclictest0-21swapper/023:05:510
2462099290,29cyclictest0-21swapper/022:55:230
2462099290,29cyclictest0-21swapper/022:22:320
2462099290,29cyclictest0-21swapper/019:55:220
2462099290,28cyclictest0-21swapper/021:45:350
2462099290,1cyclictest4012-21ssh22:06:280
2462099290,1cyclictest0-21swapper/022:40:160
2462099290,0cyclictest16269-21diskmemload23:59:420
2462099290,0cyclictest16269-21diskmemload23:45:170
2462099290,0cyclictest16269-21diskmemload23:17:170
2462099290,0cyclictest16269-21diskmemload22:45:230
2462099290,0cyclictest16269-21diskmemload22:30:520
2462099290,0cyclictest16269-21diskmemload22:25:360
2462099290,0cyclictest16269-21diskmemload21:10:230
2462099290,0cyclictest16269-21diskmemload00:26:010
2462099290,0cyclictest0-21swapper/023:38:460
2462099290,0cyclictest0-21swapper/021:57:370
2462099290,0cyclictest0-21swapper/019:30:260
2462099290,0cyclictest0-21swapper/000:20:380
24623992828,0cyclictest13443-21apt-get19:55:223
24623992828,0cyclictest0-21swapper/320:35:213
24623992827,1cyclictest26932-21munin-run19:15:003
24621992828,0cyclictest0-21swapper/119:55:231
24620992828,0cyclictest0-21swapper/022:35:050
24620992828,0cyclictest0-21swapper/022:15:580
24620992828,0cyclictest0-21swapper/020:10:190
24623992727,0cyclictest0-21swapper/320:50:253
24623992726,1cyclictest3999-21apt-get20:45:033
24623992725,1cyclictest584-21gdbus19:50:013
24622992727,0cyclictest0-21swapper/220:05:012
24622992725,1cyclictest15503-21munin-run20:00:012
24621992727,0cyclictest0-21swapper/120:50:251
24621992727,0cyclictest0-21swapper/120:10:191
24621992727,0cyclictest0-21swapper/119:15:011
24621992725,1cyclictest10763-21cron19:50:021
24623992626,0cyclictest0-21swapper/320:10:203
24621992626,0cyclictest0-21swapper/120:45:031
24620992626,0cyclictest0-21swapper/021:05:230
24620992626,0cyclictest0-21swapper/021:00:220
24620992626,0cyclictest0-21swapper/019:25:200
24623992525,0cyclictest0-21swapper/320:20:213
24621992525,0cyclictest0-21swapper/120:20:201
24623992422,1cyclictest0-21swapper/320:05:013
24621992422,1cyclictest17832-21munin-run20:05:011
24622992222,0cyclictest0-21swapper/221:00:232
24620992222,0cyclictest27410-21apt-get20:25:230
24622992121,0cyclictest0-21swapper/219:45:192
24620992121,0cyclictest0-21swapper/019:40:200
24622992020,0cyclictest0-21swapper/220:45:032
24622992020,0cyclictest0-21swapper/220:30:232
24620992018,1cyclictest11367-21sendmail-msp20:59:590
24622991917,1cyclictest0-21swapper/219:35:002
24622991818,0cyclictest0-21swapper/219:50:202
24621991817,1cyclictest11935-21apt-get21:00:221
24623991717,0cyclictest0-21swapper/321:00:233
2462199170,16cyclictest27378-21cpuspeed_turbos19:15:201
24620991717,0cyclictest0-21swapper/020:30:240
24623991616,0cyclictest0-21swapper/320:30:233
24621991615,0cyclictest29727-21apt-get20:30:241
2462099160,15cyclictest24788-21cron20:20:010
24623991514,1cyclictest2208-21kworker/3:319:51:323
24623991514,0cyclictest0-21swapper/321:05:233
2462399150,1cyclictest27376-21grep19:15:203
24622991513,1cyclictest564-21rs:main2
24621991514,1cyclictest14454-21cpuspeed_turbos21:05:221
2462199150,14cyclictest18100-21apt-get20:05:231
2462199150,14cyclictest0-21swapper/119:21:031
24620991515,0cyclictest0-21swapper/020:50:240
2462099150,1cyclictest20114-21awk20:10:000
2462099150,14cyclictest25089-21apt-get20:20:200
2462399140,14cyclictest0-21swapper/320:55:393
2462399140,14cyclictest0-21swapper/320:41:483
2462399140,14cyclictest0-21swapper/319:35:023
2462399140,14cyclictest0-21swapper/319:32:313
2462399140,14cyclictest0-21swapper/319:26:143
2462399140,14cyclictest0-21swapper/319:21:033
2462399140,0cyclictest0-21swapper/320:05:243
24622991414,0cyclictest0-21swapper/219:20:312
2462299140,14cyclictest0-21swapper/221:08:482
2462299140,14cyclictest0-21swapper/220:57:282
2462299140,14cyclictest0-21swapper/220:52:252
2462299140,14cyclictest0-21swapper/220:35:162
2462299140,14cyclictest0-21swapper/220:06:292
2462299140,14cyclictest0-21swapper/219:43:292
2462299140,14cyclictest0-21swapper/219:15:402
2462299140,14cyclictest0-21swapper/219:12:002
2462299140,0cyclictest0-21swapper/220:40:542
2462299140,0cyclictest0-21swapper/220:10:322
2462299140,0cyclictest0-21swapper/219:36:052
24621991414,0cyclictest0-21swapper/120:17:541
24621991414,0cyclictest0-21swapper/119:50:051
2462199140,14cyclictest0-21swapper/120:55:381
2462199140,14cyclictest0-21swapper/120:41:491
2462199140,14cyclictest0-21swapper/119:35:031
2462199140,0cyclictest0-21swapper/119:32:301
2462199140,0cyclictest0-21swapper/119:26:001
24620991414,0cyclictest0-21swapper/020:35:220
24620991414,0cyclictest0-21swapper/019:35:410
2462099140,14cyclictest0-21swapper/020:00:090
2462099140,14cyclictest0-21swapper/019:51:030
2462099140,14cyclictest0-21swapper/019:45:210
2462099140,14cyclictest0-21swapper/019:22:280
2462099140,14cyclictest0-21swapper/019:11:260
2462099140,0cyclictest0-21swapper/020:40:090
24623991313,0cyclictest0-21swapper/320:17:503
24622991313,0cyclictest0-21swapper/219:25:042
24620991313,0cyclictest0-21swapper/020:47:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional