You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-14 - 16:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Sat Sep 14, 2024 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14226992927,1cyclictest1-21systemd10:50:012
1422699290,28cyclictest31456-21apt-get08:55:122
1422299290,28cyclictest4008-21apt-get09:05:111
1422299290,28cyclictest0-21swapper/110:35:031
1422299290,1cyclictest3418-21apt-get09:05:001
1422799280,0cyclictest26756-21apt-get08:45:123
1422799280,0cyclictest0-21swapper/310:40:113
14226992828,0cyclictest3039-21apt-get12:30:122
14226992828,0cyclictest21465-21apt-get07:25:122
14226992828,0cyclictest13855-21apt-get10:35:122
1422699280,28cyclictest0-21swapper/207:45:122
1422699280,27cyclictest29896-21perf11:10:002
1422699280,0cyclictest0-21swapper/208:20:142
14222992828,0cyclictest0-21swapper/112:00:131
14222992827,1cyclictest29631-21apt-get10:00:131
14222992826,1cyclictest0-21swapper/111:25:011
1422299280,28cyclictest0-21swapper/108:25:121
1422299280,0cyclictest691-21apt-get12:25:111
14221992828,0cyclictest0-21swapper/008:15:120
14221992827,1cyclictest141rcuc/007:45:000
14221992827,1cyclictest0-21swapper/012:05:140
1422199280,28cyclictest0-21swapper/008:20:140
14227992727,0cyclictest0-21swapper/310:55:133
14227992727,0cyclictest0-21swapper/309:10:103
14227992726,1cyclictest4233-21apt-get10:15:123
14227992725,1cyclictest27771-21idleruntime-cro12:15:003
1422799270,0cyclictest0-21swapper/312:35:143
14226992727,0cyclictest0-21swapper/209:45:122
14226992727,0cyclictest0-21swapper/209:05:112
14222992727,0cyclictest0-21swapper/110:10:111
14222992727,0cyclictest0-21swapper/108:35:101
14222992727,0cyclictest0-21swapper/107:30:121
14221992727,0cyclictest28057-21apt-get12:15:110
14221992727,0cyclictest0-21swapper/012:10:110
14221992727,0cyclictest0-21swapper/009:20:110
14221992727,0cyclictest0-21swapper/009:05:110
14221992727,0cyclictest0-21swapper/008:10:140
14221992726,1cyclictest24435-21apt-get08:40:120
14221992726,1cyclictest0-21swapper/011:20:130
14221992726,0cyclictest31456-21apt-get08:55:130
1422199270,27cyclictest0-21swapper/012:35:140
14227992626,0cyclictest0-21swapper/312:25:123
14227992626,0cyclictest0-21swapper/310:45:123
14227992626,0cyclictest0-21swapper/310:30:223
14227992626,0cyclictest0-21swapper/309:45:123
14226992626,0cyclictest23172-21apt-get10:55:132
14226992626,0cyclictest0-21swapper/210:15:122
14222992626,0cyclictest0-21swapper/112:15:121
14222992625,1cyclictest27783-21perf12:15:011
14221992626,0cyclictest0-21swapper/011:10:120
14221992626,0cyclictest0-21swapper/007:50:110
14227992525,0cyclictest15127-21apt-get08:20:133
14227992525,0cyclictest0-21swapper/311:45:133
14227992525,0cyclictest0-21swapper/311:40:133
14227992525,0cyclictest0-21swapper/308:30:123
14227992524,1cyclictest30153-21apt-get11:10:113
14227992523,1cyclictest3973-21perf10:15:013
14226992525,0cyclictest0-21swapper/208:30:122
14222992525,0cyclictest30452-21apt-get12:20:121
14222992525,0cyclictest22646-21apt-get09:45:131
14222992525,0cyclictest0-21swapper/111:15:121
14222992525,0cyclictest0-21swapper/108:30:121
14222992523,1cyclictest1608-21cron10:10:011
14221992525,0cyclictest0-21swapper/007:45:110
1422799247,13cyclictest151rcu_preempt11:07:393
14227992424,0cyclictest0-21swapper/312:15:123
14227992424,0cyclictest0-21swapper/311:20:013
14227992424,0cyclictest0-21swapper/307:25:123
14226992424,0cyclictest0-21swapper/211:10:112
14226992424,0cyclictest0-21swapper/209:15:112
14226992423,0cyclictest0-21swapper/212:20:132
14222992424,0cyclictest9430-21apt-get11:35:111
14222992424,0cyclictest0-21swapper/110:30:131
14221992423,1cyclictest0-21swapper/012:00:130
14227992323,0cyclictest23786-21apt-get07:30:113
14227992323,0cyclictest0-21swapper/309:05:103
14227992323,0cyclictest0-21swapper/308:55:123
14227992323,0cyclictest0-21swapper/307:45:123
14226992323,0cyclictest0-21swapper/208:15:122
14222992323,0cyclictest24967-21apt-get09:50:131
14221992323,0cyclictest0-21swapper/009:25:100
14221992322,0cyclictest0-21swapper/011:45:000
14221992321,1cyclictest609-21dbus-daemon09:35:010
14227992222,0cyclictest0-21swapper/312:30:123
14226992222,0cyclictest13271-21cron10:35:002
14226992222,0cyclictest0-21swapper/212:35:132
14226992222,0cyclictest0-21swapper/212:10:122
14226992222,0cyclictest0-21swapper/212:10:022
14226992221,1cyclictest271rcuc/207:45:012
14222992222,0cyclictest0-21swapper/110:40:121
14222992222,0cyclictest0-21swapper/108:40:111
14222992221,1cyclictest0-21swapper/111:55:131
14222992220,1cyclictest0-21swapper/111:35:011
14221992222,0cyclictest0-21swapper/010:15:110
14221992222,0cyclictest0-21swapper/009:00:120
14221992222,0cyclictest0-21swapper/007:15:120
14221992221,0cyclictest0-21swapper/010:55:120
1422799217,13cyclictest34-21ksoftirqd/308:08:303
14227992121,0cyclictest0-21swapper/310:35:123
14226992121,0cyclictest11005-21apt-get09:20:122
14226992121,0cyclictest0-21swapper/212:15:122
14226992120,0cyclictest0-21swapper/208:40:112
14222992121,0cyclictest0-21swapper/107:55:111
14221992121,0cyclictest0-21swapper/010:40:120
14221992121,0cyclictest0-21swapper/010:35:010
14226992020,0cyclictest2461-21apt-get11:20:132
14226992020,0cyclictest0-21swapper/208:10:132
14222992018,1cyclictest20850-21apt-get10:50:131
14221992020,0cyclictest0-21swapper/010:05:110
14221992020,0cyclictest0-21swapper/007:30:110
14226991919,0cyclictest0-21swapper/207:50:112
14222991919,0cyclictest0-21swapper/109:15:111
14222991918,1cyclictest29077-21apt-get08:50:131
14227991818,0cyclictest0-21swapper/309:15:113
14227991817,0cyclictest12774-21apt-get08:15:113
14222991818,0cyclictest0-21swapper/111:25:121
14222991818,0cyclictest0-21swapper/108:10:051
14221991818,0cyclictest0-21swapper/012:20:120
14221991818,0cyclictest0-21swapper/011:05:140
14221991817,1cyclictest21212-21munin-run07:25:020
14227991717,0cyclictest0-21swapper/312:20:133
14226991717,0cyclictest0-21swapper/209:25:112
14226991716,1cyclictest13811-21awk11:45:012
14226991716,0cyclictest21097-21apt-get12:00:122
14222991717,0cyclictest0-21swapper/107:35:121
14222991717,0cyclictest0-21swapper/107:15:121
14222991717,0cyclictest0-21swapper/107:10:101
14222991715,1cyclictest30931-21apt-get07:45:111
14222991715,1cyclictest18501-21munin-run11:55:001
14221991717,0cyclictest0-21swapper/009:45:130
14221991717,0cyclictest0-21swapper/007:25:120
14227991615,1cyclictest23419-21apt-get12:05:133
14227991613,2cyclictest25694-21grep11:00:133
1422799160,15cyclictest28237-21cron07:40:013
14226991616,0cyclictest17726-21perf09:35:012
14226991615,1cyclictest16205-21apt-get10:40:122
14222991614,1cyclictest0-21swapper/110:25:591
1422299160,15cyclictest29193-21cut07:40:151
14221991616,0cyclictest0-21swapper/012:25:100
14221991616,0cyclictest0-21swapper/010:10:100
14221991616,0cyclictest0-21swapper/010:05:000
14221991615,1cyclictest19738-21/usr/sbin/munin08:30:160
14227991514,1cyclictest0-21swapper/311:20:123
14227991513,1cyclictest0-21swapper/311:35:213
1422799150,1cyclictest1889-21ntp_states07:50:173
1422799150,1cyclictest0-21swapper/311:55:023
14226991515,0cyclictest16797-21apt-get07:15:112
14226991515,0cyclictest0-21swapper/209:00:112
1422699150,14cyclictest2352-21unixbench_singl12:25:202
1422699150,14cyclictest0-21swapper/207:15:012
14222991514,1cyclictest1070-21kworker/1:110:22:511
14222991513,1cyclictest31112-21memory11:10:171
14222991513,1cyclictest22522-21munin-run09:45:011
1422299150,1cyclictest13197-21diskstats08:15:131
14221991513,1cyclictest303-21systemd-journal09:14:590
1422199150,1cyclictest0-21swapper/009:40:140
1422199150,14cyclictest0-21swapper/010:45:110
1422199150,14cyclictest0-21swapper/009:56:180
14227991414,0cyclictest0-21swapper/309:20:123
14227991414,0cyclictest0-21swapper/308:40:123
14227991414,0cyclictest0-21swapper/308:10:133
14227991413,1cyclictest0-21swapper/310:05:123
1422799140,14cyclictest0-21swapper/312:02:353
1422799140,14cyclictest0-21swapper/311:58:453
1422799140,14cyclictest0-21swapper/311:26:343
1422799140,14cyclictest0-21swapper/310:20:233
1422799140,14cyclictest0-21swapper/309:50:413
1422799140,14cyclictest0-21swapper/309:31:113
1422799140,14cyclictest0-21swapper/309:25:143
1422799140,14cyclictest0-21swapper/308:25:313
1422799140,14cyclictest0-21swapper/307:55:373
1422799140,14cyclictest0-21swapper/307:22:183
1422799140,14cyclictest0-21swapper/307:11:373
1422799140,0cyclictest0-21swapper/311:30:473
1422799140,0cyclictest0-21swapper/310:53:213
1422799140,0cyclictest0-21swapper/310:01:353
1422799140,0cyclictest0-21swapper/309:40:253
1422799140,0cyclictest0-21swapper/309:38:023
1422799140,0cyclictest0-21swapper/309:01:363
1422799140,0cyclictest0-21swapper/308:50:353
1422799140,0cyclictest0-21swapper/308:36:473
1422799140,0cyclictest0-21swapper/308:02:283
1422799140,0cyclictest0-21swapper/307:40:033
1422799140,0cyclictest0-21swapper/307:15:103
14226991414,0cyclictest0-21swapper/211:28:192
14226991414,0cyclictest0-21swapper/210:05:122
14226991414,0cyclictest0-21swapper/207:20:182
14226991413,1cyclictest19029-21ntp_states09:35:182
1422699140,14cyclictest0-21swapper/211:55:252
1422699140,14cyclictest0-21swapper/211:53:242
1422699140,14cyclictest0-21swapper/211:46:172
1422699140,14cyclictest0-21swapper/211:35:042
1422699140,14cyclictest0-21swapper/211:32:202
1422699140,14cyclictest0-21swapper/211:19:482
1422699140,14cyclictest0-21swapper/211:01:072
1422699140,14cyclictest0-21swapper/210:52:032
1422699140,14cyclictest0-21swapper/210:25:092
1422699140,14cyclictest0-21swapper/210:23:352
1422699140,14cyclictest0-21swapper/210:03:532
1422699140,14cyclictest0-21swapper/209:50:522
1422699140,14cyclictest0-21swapper/209:41:372
1422699140,14cyclictest0-21swapper/209:10:122
1422699140,14cyclictest0-21swapper/208:53:262
1422699140,14cyclictest0-21swapper/208:47:062
1422699140,14cyclictest0-21swapper/208:37:062
1422699140,14cyclictest0-21swapper/208:27:552
1422699140,14cyclictest0-21swapper/208:09:012
1422699140,14cyclictest0-21swapper/207:36:332
1422699140,14cyclictest0-21swapper/207:31:422
1422699140,0cyclictest0-21swapper/209:55:092
1422699140,0cyclictest0-21swapper/208:02:572
1422699140,0cyclictest0-21swapper/207:56:512
14222991414,0cyclictest0-21swapper/111:40:171
14222991414,0cyclictest0-21swapper/111:05:381
14222991414,0cyclictest0-21swapper/110:55:001
14222991414,0cyclictest0-21swapper/109:31:091
14222991414,0cyclictest0-21swapper/109:25:361
14222991414,0cyclictest0-21swapper/109:20:121
14222991414,0cyclictest0-21swapper/107:20:141
14222991412,1cyclictest0-21swapper/108:55:171
1422299140,14cyclictest0-21swapper/112:31:221
1422299140,14cyclictest0-21swapper/111:45:131
1422299140,14cyclictest0-21swapper/111:00:351
1422299140,14cyclictest0-21swapper/110:16:241
1422299140,14cyclictest0-21swapper/109:55:291
1422299140,14cyclictest0-21swapper/109:10:131
1422299140,14cyclictest0-21swapper/108:05:261
1422299140,14cyclictest0-21swapper/108:00:371
1422299140,0cyclictest0-21swapper/112:35:171
1422299140,0cyclictest0-21swapper/112:05:271
1422299140,0cyclictest0-21swapper/110:48:301
1422299140,0cyclictest0-21swapper/109:36:101
1422299140,0cyclictest0-21swapper/108:46:171
1422299140,0cyclictest0-21swapper/108:20:261
1422299140,0cyclictest0-21swapper/107:50:331
1422299140,0cyclictest0-21swapper/107:26:221
14221991414,0cyclictest0-21swapper/011:35:120
14221991414,0cyclictest0-21swapper/010:50:120
14221991413,1cyclictest0-21swapper/011:00:190
1422199140,14cyclictest0-21swapper/012:30:410
1422199140,14cyclictest0-21swapper/011:45:400
1422199140,14cyclictest0-21swapper/011:15:280
1422199140,14cyclictest0-21swapper/010:25:130
1422199140,14cyclictest0-21swapper/009:51:190
1422199140,14cyclictest0-21swapper/009:15:350
1422199140,14cyclictest0-21swapper/007:55:300
1422199140,14cyclictest0-21swapper/007:35:080
1422199140,14cyclictest0-21swapper/007:13:400
1422199140,0cyclictest0-21swapper/011:56:210
1422199140,0cyclictest0-21swapper/011:50:330
1422199140,0cyclictest0-21swapper/011:31:160
1422199140,0cyclictest0-21swapper/011:26:480
1422199140,0cyclictest0-21swapper/010:20:380
1422199140,0cyclictest0-21swapper/008:52:030
1422199140,0cyclictest0-21swapper/008:45:380
1422199140,0cyclictest0-21swapper/008:35:520
1422199140,0cyclictest0-21swapper/008:26:230
1422199140,0cyclictest0-21swapper/008:05:400
1422799130,0cyclictest0-21swapper/310:25:303
1422699130,0cyclictest0-21swapper/210:10:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional