You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-21 - 07:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5.osadl.org (updated Mon Apr 21, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
895099300,2cyclictest2922-21idleruntime-cro21:15:003
895099290,28cyclictest30108-21apt-get19:55:143
895099290,1cyclictest0-21swapper/320:05:143
8945992927,1cyclictest16788-21munin-run21:50:002
894599290,28cyclictest31036-21apt-get23:50:152
894599290,28cyclictest0-21swapper/223:35:122
894299290,28cyclictest16666-21apt-get20:35:151
894299290,28cyclictest0-21swapper/120:00:131
8940992927,1cyclictest0-21swapper/023:10:000
894099290,28cyclictest0-21swapper/021:34:590
894099290,1cyclictest17520-21cron23:15:000
894099290,1cyclictest15876-21cron19:25:000
895099280,27cyclictest0-21swapper/300:00:133
895099280,0cyclictest0-21swapper/321:40:133
8945992828,0cyclictest0-21swapper/219:35:172
8945992828,0cyclictest0-21swapper/219:35:172
8945992827,1cyclictest11448-21apt-get21:35:152
8945992827,0cyclictest29329-21apt-get22:20:132
894599280,28cyclictest0-21swapper/223:40:122
8942992828,0cyclictest0-21swapper/123:10:121
8942992827,1cyclictest5491-21awk00:05:011
8942992827,0cyclictest0-21swapper/121:30:131
8942992826,1cyclictest30343-21awk21:05:001
8942992826,1cyclictest0-21swapper/119:50:021
894299280,28cyclictest0-21swapper/122:20:121
894299280,0cyclictest0-21swapper/121:15:161
894099280,28cyclictest0-21swapper/023:30:070
894099280,28cyclictest0-21swapper/022:15:120
894099280,28cyclictest0-21swapper/020:55:130
894099280,0cyclictest0-21swapper/021:50:080
894099280,0cyclictest0-21swapper/020:00:120
8950992727,0cyclictest28073-21apt-get23:40:123
8950992727,0cyclictest25431-21apt-get23:35:133
8950992727,0cyclictest0-21swapper/322:35:013
8950992727,0cyclictest0-21swapper/320:55:133
8945992727,0cyclictest9906-21perf22:55:002
8945992727,0cyclictest0-21swapper/222:10:092
8945992727,0cyclictest0-21swapper/219:55:152
894599270,0cyclictest0-21swapper/220:55:122
8942992727,0cyclictest5554-21apt-get21:20:131
8942992727,0cyclictest0-21swapper/123:40:121
8942992727,0cyclictest0-21swapper/123:20:131
8942992727,0cyclictest0-21swapper/122:35:141
894299270,0cyclictest0-21swapper/121:55:161
894299270,0cyclictest0-21swapper/120:35:011
894299270,0cyclictest0-21swapper/119:55:141
8940992727,0cyclictest16164-21apt-get19:25:130
8940992727,0cyclictest0-21swapper/022:30:080
8940992727,0cyclictest0-21swapper/019:10:140
8940992725,1cyclictest20553-21munin-run19:35:010
8940992725,1cyclictest0-21swapper/020:44:590
8950992626,0cyclictest27788-21apt-get19:50:153
8950992626,0cyclictest0-21swapper/323:10:123
8950992626,0cyclictest0-21swapper/321:15:143
8950992625,1cyclictest24661-21apt-get22:10:083
8950992625,1cyclictest0-21swapper/322:55:003
8945992626,0cyclictest0-21swapper/223:10:132
8945992626,0cyclictest0-21swapper/222:00:102
8945992626,0cyclictest0-21swapper/220:35:152
8945992625,0cyclictest987-21apt-get23:55:142
8942992626,0cyclictest0-21swapper/123:40:011
8942992625,1cyclictest28036-21perf21:00:001
8940992626,0cyclictest2406-21apt-get20:05:120
8940992626,0cyclictest0-21swapper/020:30:150
8940992626,0cyclictest0-21swapper/019:45:120
8940992626,0cyclictest0-21swapper/000:35:130
8940992625,1cyclictest21329-21apt-get20:45:120
8940992624,1cyclictest18690-21cron20:40:000
8940992623,2cyclictest303-21systemd-journal21:10:010
8950992525,0cyclictest16780-21perf21:50:013
8950992525,0cyclictest0-21swapper/322:20:133
8950992525,0cyclictest0-21swapper/321:35:153
8945992525,0cyclictest0-21swapper/219:20:142
8945992525,0cyclictest0-21swapper/200:30:082
8942992525,0cyclictest0-21swapper/123:50:161
8942992525,0cyclictest0-21swapper/121:40:121
8942992525,0cyclictest0-21swapper/100:15:141
8942992525,0cyclictest0-21swapper/100:15:141
8942992523,1cyclictest0-21swapper/100:00:011
8940992525,0cyclictest0-21swapper/022:40:130
8950992424,0cyclictest13840-21apt-get19:20:143
8950992424,0cyclictest0-21swapper/322:00:103
8950992424,0cyclictest0-21swapper/320:35:143
8945992424,0cyclictest19374-21apt-get21:55:152
8945992422,1cyclictest0-21swapper/220:35:012
8942992423,1cyclictest0-21swapper/120:20:031
8940992424,0cyclictest0-21swapper/023:20:130
8940992424,0cyclictest0-21swapper/000:10:080
8950992323,0cyclictest0-21swapper/323:55:133
8950992323,0cyclictest0-21swapper/300:30:093
8945992323,0cyclictest0-21swapper/221:05:122
8945992323,0cyclictest0-21swapper/220:25:102
8945992323,0cyclictest0-21swapper/200:15:152
8945992323,0cyclictest0-21swapper/200:15:152
8942992323,0cyclictest0-21swapper/120:40:131
8942992323,0cyclictest0-21swapper/119:30:171
8942992323,0cyclictest0-21swapper/100:30:091
8940992323,0cyclictest0-21swapper/021:35:140
8950992222,0cyclictest0-21swapper/321:55:153
8945992222,0cyclictest32501-21apt-get20:00:142
8945992222,0cyclictest0-21swapper/221:15:162
8945992220,1cyclictest22843-21perf23:30:012
8940992222,0cyclictest0-21swapper/022:00:110
8940992222,0cyclictest0-21swapper/020:20:150
8940992222,0cyclictest0-21swapper/000:20:160
8950992121,0cyclictest0-21swapper/321:05:123
8950992121,0cyclictest0-21swapper/320:40:143
8950992121,0cyclictest0-21swapper/320:25:103
8950992121,0cyclictest0-21swapper/319:35:173
8950992121,0cyclictest0-21swapper/319:35:173
8950992121,0cyclictest0-21swapper/300:15:153
8950992121,0cyclictest0-21swapper/300:15:153
8945992121,0cyclictest0-21swapper/219:30:172
8945992119,1cyclictest0-21swapper/200:05:012
8942992121,0cyclictest0-21swapper/123:15:141
8942992121,0cyclictest0-21swapper/120:25:111
8940992121,0cyclictest3423-21apt-get00:00:130
8950992020,0cyclictest16407-21perf20:35:003
8950992020,0cyclictest0-21swapper/320:00:143
8945992020,0cyclictest0-21swapper/223:20:142
8945992020,0cyclictest0-21swapper/221:30:142
8950991919,0cyclictest18491-21apt-get19:30:183
8950991918,1cyclictest9885-21nvmesmart_nvme021:30:143
8950991916,2cyclictest303-21systemd-journal21:05:013
8945991919,0cyclictest0-21swapper/222:35:142
8945991919,0cyclictest0-21swapper/221:20:132
8945991918,1cyclictest0-21swapper/221:40:122
8940991919,0cyclictest0-21swapper/021:00:110
8950991818,0cyclictest0-21swapper/323:30:013
8950991818,0cyclictest0-21swapper/323:20:143
8950991816,1cyclictest27530-21munin-run19:50:013
8945991818,0cyclictest27518-21perf19:50:022
8945991818,0cyclictest0-21swapper/221:05:002
8942991818,0cyclictest24661-21apt-get22:10:091
8942991818,0cyclictest0-21swapper/123:00:151
8950991717,0cyclictest2555-21apt-get22:35:153
8950991717,0cyclictest0-21swapper/321:20:123
8942991716,1cyclictest882-21apt-get21:10:121
894299170,16cyclictest8289-21apt-config21:30:001
8950991616,0cyclictest0-21swapper/323:50:153
895099160,15cyclictest8281-21apt-config21:30:013
8945991616,0cyclictest0-21swapper/220:20:022
8942991614,1cyclictest0-21swapper/121:55:011
894299160,15cyclictest7782-21modprobe20:15:151
8940991616,0cyclictest0-21swapper/021:20:120
895099150,14cyclictest23155-21apt-get19:40:183
894599150,1cyclictest0-21swapper/223:00:202
894599150,14cyclictest8088-21ntp_states20:15:172
894599150,14cyclictest0-21swapper/220:50:162
8942991514,1cyclictest18729-21latency_hist00:40:011
8942991514,1cyclictest0-21swapper/122:55:171
8942991513,1cyclictest29890-21latency_hist19:55:021
8942991513,1cyclictest0-21swapper/120:50:251
8942991513,1cyclictest0-21swapper/119:40:241
894299150,1cyclictest0-21swapper/121:35:151
894299150,1cyclictest0-21swapper/119:20:141
894299150,14cyclictest0-21swapper/122:00:121
8940991515,0cyclictest0-21swapper/019:40:190
8940991513,1cyclictest5260-21sendmail-msp21:20:000
8940991513,1cyclictest0-21swapper/020:25:200
894099150,14cyclictest3607-21ntp_states22:35:210
8950991414,0cyclictest9122-21apt-get20:20:023
8950991414,0cyclictest0-21swapper/319:11:213
8950991413,1cyclictest21376-21cpu20:45:143
895099140,14cyclictest178932sleep319:26:173
895099140,14cyclictest0-21swapper/323:49:093
895099140,14cyclictest0-21swapper/323:30:023
895099140,14cyclictest0-21swapper/323:09:243
895099140,14cyclictest0-21swapper/323:02:283
895099140,14cyclictest0-21swapper/322:46:343
895099140,14cyclictest0-21swapper/322:29:013
895099140,14cyclictest0-21swapper/322:18:313
895099140,14cyclictest0-21swapper/322:06:043
895099140,14cyclictest0-21swapper/320:50:513
895099140,14cyclictest0-21swapper/320:10:293
895099140,14cyclictest0-21swapper/319:16:193
895099140,14cyclictest0-21swapper/300:26:273
895099140,14cyclictest0-21swapper/300:06:453
895099140,0cyclictest0-21swapper/322:55:373
895099140,0cyclictest0-21swapper/320:18:453
895099140,0cyclictest0-21swapper/300:10:163
8945991414,0cyclictest0-21swapper/219:27:502
8945991414,0cyclictest0-21swapper/200:14:542
8945991412,1cyclictest0-21swapper/222:30:102
894599140,14cyclictest0-21swapper/223:45:532
894599140,14cyclictest0-21swapper/223:30:042
894599140,14cyclictest0-21swapper/222:55:462
894599140,14cyclictest0-21swapper/222:44:022
894599140,14cyclictest0-21swapper/222:10:002
894599140,14cyclictest0-21swapper/221:51:252
894599140,14cyclictest0-21swapper/221:26:212
894599140,14cyclictest0-21swapper/220:45:242
894599140,14cyclictest0-21swapper/220:11:322
894599140,14cyclictest0-21swapper/220:05:052
894599140,14cyclictest0-21swapper/219:18:532
894599140,14cyclictest0-21swapper/219:11:352
894599140,14cyclictest0-21swapper/200:20:192
894599140,14cyclictest0-21swapper/200:08:432
894599140,0cyclictest0-21swapper/222:45:522
894599140,0cyclictest0-21swapper/222:17:272
894599140,0cyclictest0-21swapper/219:50:172
894599140,0cyclictest0-21swapper/219:40:062
8942991414,0cyclictest0-21swapper/122:32:291
8942991414,0cyclictest0-21swapper/121:05:131
8942991414,0cyclictest0-21swapper/120:10:291
8942991414,0cyclictest0-21swapper/119:15:141
8942991414,0cyclictest0-21swapper/100:11:161
8942991413,1cyclictest16367-21kworker/1:122:05:241
894299140,14cyclictest0-21swapper/123:32:501
894299140,14cyclictest0-21swapper/122:52:081
894299140,14cyclictest0-21swapper/122:46:091
894299140,14cyclictest0-21swapper/122:42:381
894299140,14cyclictest0-21swapper/122:18:291
894299140,14cyclictest0-21swapper/121:45:471
894299140,14cyclictest0-21swapper/120:06:431
894299140,14cyclictest0-21swapper/119:35:021
894299140,14cyclictest0-21swapper/119:35:011
894299140,14cyclictest0-21swapper/119:25:201
894299140,14cyclictest0-21swapper/100:26:211
894299140,14cyclictest0-21swapper/100:20:511
894299140,14cyclictest0-21swapper/100:05:191
894299140,0cyclictest0-21swapper/123:45:261
894299140,0cyclictest0-21swapper/123:26:081
894299140,0cyclictest0-21swapper/123:09:261
894299140,0cyclictest0-21swapper/120:45:181
894299140,0cyclictest0-21swapper/119:11:441
8940991414,0cyclictest0-21swapper/023:27:330
8940991414,0cyclictest0-21swapper/019:51:020
8940991413,1cyclictest12091-21gltestperf19:15:160
894099140,14cyclictest0-21swapper/023:55:220
894099140,14cyclictest0-21swapper/023:50:150
894099140,14cyclictest0-21swapper/023:46:390
894099140,14cyclictest0-21swapper/023:42:000
894099140,14cyclictest0-21swapper/023:35:200
894099140,14cyclictest0-21swapper/023:17:360
894099140,14cyclictest0-21swapper/023:00:290
894099140,14cyclictest0-21swapper/022:55:160
894099140,14cyclictest0-21swapper/022:50:490
894099140,14cyclictest0-21swapper/022:46:390
894099140,14cyclictest0-21swapper/022:20:200
894099140,14cyclictest0-21swapper/022:10:220
894099140,14cyclictest0-21swapper/021:56:590
894099140,14cyclictest0-21swapper/021:46:020
894099140,14cyclictest0-21swapper/021:29:310
894099140,14cyclictest0-21swapper/021:10:560
894099140,14cyclictest0-21swapper/020:10:170
894099140,14cyclictest0-21swapper/019:55:120
894099140,14cyclictest0-21swapper/000:32:000
894099140,14cyclictest0-21swapper/000:26:450
894099140,14cyclictest0-21swapper/000:06:390
894099140,0cyclictest0-21swapper/022:25:530
894099140,0cyclictest0-21swapper/021:43:460
894099140,0cyclictest0-21swapper/020:51:020
894099140,0cyclictest0-21swapper/019:36:530
894099140,0cyclictest0-21swapper/019:36:530
894099140,0cyclictest0-21swapper/000:16:250
894099140,0cyclictest0-21swapper/000:16:250
8950991313,0cyclictest0-21swapper/323:15:363
8950991313,0cyclictest0-21swapper/322:44:033
8950991313,0cyclictest0-21swapper/321:51:243
8950991313,0cyclictest0-21swapper/300:36:493
8950991313,0cyclictest0-21swapper/300:20:063
8945991313,0cyclictest0-21swapper/223:15:012
8945991313,0cyclictest0-21swapper/222:25:482
8945991313,0cyclictest0-21swapper/200:25:092
8945991311,1cyclictest0-21swapper/221:11:442
894599130,0cyclictest0-21swapper/223:07:502
894599130,0cyclictest0-21swapper/200:36:492
8942991313,0cyclictest16367-21kworker/1:122:27:471
8940991313,0cyclictest0-21swapper/022:08:250
8940991313,0cyclictest0-21swapper/020:15:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional