You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-17 - 06:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Fri Jan 17, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1355199310,30cyclictest27641-21cron23:35:012
13551993028,1cyclictest3436-21apt-get23:55:112
13551993027,2cyclictest626-21gdbus21:35:012
1355399290,28cyclictest16158-21munin-run19:15:023
13551992927,1cyclictest303-21systemd-journal22:25:002
1355199290,1cyclictest3142-21cron23:55:012
1355199290,1cyclictest18509-21http19:20:012
1355199290,1cyclictest11510-21cron21:30:012
1355099290,28cyclictest10584-21apt-get21:25:011
1355099290,28cyclictest0-21swapper/121:30:071
1354499290,28cyclictest1537-21apt-get21:05:110
1354499290,1cyclictest8536-21apt-get21:20:110
1354499290,1cyclictest11799-21apt-get21:30:080
1354499290,1cyclictest0-21swapper/021:20:000
1354499290,1cyclictest0-21swapper/021:20:000
13553992826,1cyclictest5005-21cron20:00:023
13553992826,1cyclictest23740-21perf20:40:013
1355399280,28cyclictest0-21swapper/322:35:103
1355399280,0cyclictest16964-21apt-get20:25:123
13550992826,1cyclictest9685-21cron20:10:001
1355099280,0cyclictest12296-21apt-get22:55:101
1354499280,28cyclictest0-21swapper/019:25:130
1354499280,0cyclictest0-21swapper/020:00:120
13553992727,0cyclictest29298-21apt-get20:55:113
13553992726,1cyclictest1103-21apt-get23:50:093
13551992727,0cyclictest28430-21apt-get19:40:122
13551992727,0cyclictest0-21swapper/222:30:072
13551992727,0cyclictest0-21swapper/221:44:592
13551992727,0cyclictest0-21swapper/220:55:102
13551992727,0cyclictest0-21swapper/220:50:092
13551992727,0cyclictest0-21swapper/220:25:122
13551992727,0cyclictest0-21swapper/220:10:152
13551992727,0cyclictest0-21swapper/220:05:102
13551992726,0cyclictest21616-21apt-get20:35:112
13551992725,1cyclictest0-21swapper/223:45:012
1355199270,27cyclictest0-21swapper/222:35:092
1355199270,0cyclictest0-21swapper/221:25:012
1355199270,0cyclictest0-21swapper/220:35:012
13550992727,0cyclictest5874-21apt-get00:00:131
13550992727,0cyclictest0-21swapper/100:20:111
13550992726,1cyclictest27122-21apt-get22:10:081
13544992727,0cyclictest0-21swapper/020:05:110
13544992727,0cyclictest0-21swapper/000:10:090
1354499270,27cyclictest0-21swapper/021:35:100
1354499270,0cyclictest0-21swapper/022:15:100
1354499270,0cyclictest0-21swapper/000:30:080
13553992626,0cyclictest0-21swapper/322:30:083
13553992625,1cyclictest12009-21idleruntime-cro22:55:003
13553992625,1cyclictest0-21swapper/300:15:113
13551992626,0cyclictest0-21swapper/219:25:122
13550992626,0cyclictest0-21swapper/122:20:101
13550992624,1cyclictest609-21dbus-daemon22:10:011
13544992626,0cyclictest0-21swapper/019:15:120
13544992626,0cyclictest0-21swapper/019:10:010
13544992625,0cyclictest23697-21cron20:40:000
13553992523,1cyclictest0-21swapper/321:10:003
13551992525,0cyclictest0-21swapper/223:15:122
13551992524,1cyclictest22281-21apt-get23:20:102
13550992525,0cyclictest0-21swapper/100:10:091
13544992525,0cyclictest4408-21perf22:35:010
13544992525,0cyclictest0-21swapper/019:50:170
13544992524,1cyclictest21475-21cron21:55:010
13553992424,0cyclictest23769-21apt-get19:30:163
13551992424,0cyclictest3875-21apt-get21:10:152
13551992424,0cyclictest0-21swapper/220:15:102
13550992424,0cyclictest0-21swapper/123:30:021
13550992424,0cyclictest0-21swapper/121:10:151
13550992424,0cyclictest0-21swapper/100:30:091
13550992422,1cyclictest8242-21sendmail-msp21:20:011
13550992422,1cyclictest8242-21sendmail-msp21:20:001
13544992424,0cyclictest0-21swapper/023:40:120
13544992424,0cyclictest0-21swapper/020:20:140
13553992323,0cyclictest6188-21apt-get21:15:103
13553992323,0cyclictest6188-21apt-get21:15:103
13553992323,0cyclictest0-21swapper/323:30:113
13553992323,0cyclictest0-21swapper/322:00:113
13553992323,0cyclictest0-21swapper/320:10:153
13553992323,0cyclictest0-21swapper/320:05:113
13553992321,1cyclictest14377-21munin-run20:20:003
13551992323,0cyclictest19438-21apt-get21:50:082
13551992323,0cyclictest0-21swapper/222:10:082
13551992323,0cyclictest0-21swapper/221:05:112
13551992323,0cyclictest0-21swapper/219:30:162
13551992322,0cyclictest28225-21apt-get23:35:122
13551992322,0cyclictest0-21swapper/221:55:122
13550992323,0cyclictest0-21swapper/121:05:111
13550992323,0cyclictest0-21swapper/120:20:131
13550992323,0cyclictest0-21swapper/119:55:131
13550992323,0cyclictest0-21swapper/100:35:131
13544992323,0cyclictest0-21swapper/020:30:140
13544992321,1cyclictest0-21swapper/023:05:000
13553992222,0cyclictest0-21swapper/323:35:113
13553992222,0cyclictest0-21swapper/319:40:103
13553992220,1cyclictest16166-21sh21:40:003
13550992222,0cyclictest0-21swapper/123:40:121
13550992222,0cyclictest0-21swapper/122:50:011
13550992222,0cyclictest0-21swapper/121:20:101
13550992222,0cyclictest0-21swapper/119:35:131
13544992222,0cyclictest0-21swapper/020:40:110
13553992121,0cyclictest0-21swapper/323:15:123
13553992119,1cyclictest5464-21cron00:00:023
13550992121,0cyclictest0-21swapper/122:15:101
13550992121,0cyclictest0-21swapper/120:40:101
13550992121,0cyclictest0-21swapper/119:15:111
13544992121,0cyclictest0-21swapper/019:35:130
13553992020,0cyclictest0-21swapper/320:30:153
13553992018,1cyclictest2695-21cron19:55:023
13553992018,1cyclictest10572-21cron21:25:013
13551992020,0cyclictest0-21swapper/222:00:112
13550992020,0cyclictest0-21swapper/120:00:111
13550992020,0cyclictest0-21swapper/119:25:131
13544992020,0cyclictest0-21swapper/000:35:120
1355399192,4cyclictest0-21swapper/321:31:213
13553991919,0cyclictest21388-21apt-get19:25:133
13550991919,0cyclictest0-21swapper/121:40:121
13550991918,1cyclictest0-21swapper/121:35:101
13544991919,0cyclictest0-21swapper/022:55:010
13544991918,1cyclictest7014-21apt-get22:40:140
13553991818,0cyclictest0-21swapper/319:20:103
13553991816,1cyclictest25024-21apt-get23:30:003
13551991818,0cyclictest0-21swapper/219:20:102
13551991818,0cyclictest0-21swapper/200:20:112
13551991816,1cyclictest2724-21perf19:55:022
13550991816,1cyclictest23721-21cron20:40:011
13550991816,1cyclictest0-21swapper/122:35:011
13544991818,0cyclictest0-21swapper/023:10:090
13544991818,0cyclictest0-21swapper/020:25:120
13544991818,0cyclictest0-21swapper/019:55:140
13544991818,0cyclictest0-21swapper/000:15:020
13553991717,0cyclictest0-21swapper/321:50:073
13553991715,1cyclictest14337-21sendmail23:00:013
13550991717,0cyclictest0-21swapper/119:10:021
13550991715,1cyclictest303-21systemd-journal21:55:011
13544991717,0cyclictest0-21swapper/019:45:130
13553991614,1cyclictest609-21dbus-daemon21:30:013
13553991614,1cyclictest0-21swapper/322:20:013
13551991614,1cyclictest30753-21apt-get19:45:142
13550991616,0cyclictest0-21swapper/119:50:181
13550991614,1cyclictest0-21swapper/123:55:181
13550991614,1cyclictest0-21swapper/120:30:191
1355099160,15cyclictest19709-21cat23:15:001
13544991616,0cyclictest0-21swapper/021:40:130
1354499160,15cyclictest23996-21munin-run22:00:010
13553991514,1cyclictest337-21perf19:50:013
13553991513,1cyclictest26706-21perf20:50:003
13553991513,1cyclictest0-21swapper/319:20:013
1355399150,1cyclictest17527-21ntp_states21:40:183
1355399150,14cyclictest0-21swapper/321:00:193
1355199150,14cyclictest26089-21apt-get19:35:132
1355099150,1cyclictest0-21swapper/120:15:171
13544991514,1cyclictest21348-21kworker/0:123:08:540
13544991514,1cyclictest0-21swapper/023:15:120
13544991512,2cyclictest26690-21apt20:50:000
1354499150,1cyclictest141rcuc/023:40:010
1354499150,14cyclictest0-21swapper/019:30:170
13553991414,0cyclictest0-21swapper/323:00:013
13553991414,0cyclictest0-21swapper/322:10:063
13553991414,0cyclictest0-21swapper/320:24:313
13553991412,1cyclictest0-21swapper/300:00:163
1355399140,14cyclictest0-21swapper/323:45:563
1355399140,14cyclictest0-21swapper/323:41:383
1355399140,14cyclictest0-21swapper/323:10:023
1355399140,14cyclictest0-21swapper/323:08:403
1355399140,14cyclictest0-21swapper/322:23:393
1355399140,14cyclictest0-21swapper/321:56:393
1355399140,14cyclictest0-21swapper/321:11:153
1355399140,14cyclictest0-21swapper/320:50:053
1355399140,14cyclictest0-21swapper/319:38:203
1355399140,14cyclictest0-21swapper/300:37:323
1355399140,14cyclictest0-21swapper/300:32:213
1355399140,14cyclictest0-21swapper/300:26:343
1355399140,14cyclictest0-21swapper/300:23:463
1355399140,14cyclictest0-21swapper/300:10:223
1355399140,14cyclictest0-21swapper/300:07:533
1355399140,0cyclictest0-21swapper/323:20:263
1355399140,0cyclictest0-21swapper/322:46:473
1355399140,0cyclictest0-21swapper/322:40:263
1355399140,0cyclictest0-21swapper/322:06:123
1355399140,0cyclictest0-21swapper/321:46:013
1355399140,0cyclictest0-21swapper/320:43:463
1355399140,0cyclictest0-21swapper/320:00:163
13551991414,0cyclictest0-21swapper/223:00:122
13551991414,0cyclictest0-21swapper/200:35:542
1355199140,14cyclictest0-21swapper/223:45:212
1355199140,14cyclictest0-21swapper/223:25:382
1355199140,14cyclictest0-21swapper/223:05:582
1355199140,14cyclictest0-21swapper/222:56:582
1355199140,14cyclictest0-21swapper/222:42:242
1355199140,14cyclictest0-21swapper/222:26:132
1355199140,14cyclictest0-21swapper/222:15:042
1355199140,14cyclictest0-21swapper/222:05:372
1355199140,14cyclictest0-21swapper/221:46:192
1355199140,14cyclictest0-21swapper/221:35:032
1355199140,14cyclictest0-21swapper/221:16:422
1355199140,14cyclictest0-21swapper/221:16:422
1355199140,14cyclictest0-21swapper/221:00:422
1355199140,14cyclictest0-21swapper/220:45:052
1355199140,14cyclictest0-21swapper/220:20:492
1355199140,14cyclictest0-21swapper/219:57:082
1355199140,14cyclictest0-21swapper/200:32:512
1355199140,14cyclictest0-21swapper/200:25:272
1355199140,14cyclictest0-21swapper/200:10:102
1355199140,14cyclictest0-21swapper/200:06:522
1355199140,0cyclictest0-21swapper/223:10:102
1355199140,0cyclictest0-21swapper/222:50:142
1355199140,0cyclictest0-21swapper/222:47:212
1355199140,0cyclictest0-21swapper/220:41:352
1355199140,0cyclictest0-21swapper/200:16:322
1355199140,0cyclictest0-21swapper/200:01:242
13550991414,0cyclictest0-21swapper/123:26:021
13550991414,0cyclictest0-21swapper/123:15:381
13550991414,0cyclictest0-21swapper/119:30:251
13550991414,0cyclictest0-21swapper/100:05:061
1355099140,14cyclictest0-21swapper/123:51:341
1355099140,14cyclictest0-21swapper/123:45:551
1355099140,14cyclictest0-21swapper/123:20:071
1355099140,14cyclictest0-21swapper/123:06:051
1355099140,14cyclictest0-21swapper/123:00:361
1355099140,14cyclictest0-21swapper/122:50:211
1355099140,14cyclictest0-21swapper/122:02:451
1355099140,14cyclictest0-21swapper/121:45:021
1355099140,14cyclictest0-21swapper/120:56:001
1355099140,14cyclictest0-21swapper/120:45:171
1355099140,14cyclictest0-21swapper/119:40:201
1355099140,14cyclictest0-21swapper/100:15:091
1355099140,0cyclictest0-21swapper/123:35:111
1355099140,0cyclictest0-21swapper/122:42:371
1355099140,0cyclictest0-21swapper/122:36:101
1355099140,0cyclictest0-21swapper/122:26:441
1355099140,0cyclictest0-21swapper/121:56:281
1355099140,0cyclictest0-21swapper/121:00:081
1355099140,0cyclictest0-21swapper/120:50:201
1355099140,0cyclictest0-21swapper/120:14:261
1355099140,0cyclictest0-21swapper/119:49:191
1355099140,0cyclictest0-21swapper/119:22:371
1355099140,0cyclictest0-21swapper/100:26:141
13544991414,0cyclictest0-21swapper/023:50:090
13544991414,0cyclictest0-21swapper/023:45:060
13544991414,0cyclictest0-21swapper/022:12:530
13544991414,0cyclictest0-21swapper/021:10:040
13544991414,0cyclictest0-21swapper/000:22:000
1354499140,14cyclictest0-21swapper/023:30:530
1354499140,14cyclictest0-21swapper/023:20:100
1354499140,14cyclictest0-21swapper/022:46:330
1354499140,14cyclictest0-21swapper/022:22:550
1354499140,14cyclictest0-21swapper/022:00:310
1354499140,14cyclictest0-21swapper/021:26:130
1354499140,14cyclictest0-21swapper/021:00:300
1354499140,14cyclictest0-21swapper/020:55:270
1354499140,14cyclictest0-21swapper/020:50:100
1354499140,14cyclictest0-21swapper/020:16:190
1354499140,14cyclictest0-21swapper/019:20:020
1354499140,14cyclictest0-21swapper/000:05:030
1354499140,14cyclictest0-21swapper/000:00:530
1354499140,0cyclictest0-21swapper/023:57:090
1354499140,0cyclictest0-21swapper/023:26:510
1354499140,0cyclictest0-21swapper/022:55:490
1354499140,0cyclictest0-21swapper/022:35:140
1354499140,0cyclictest0-21swapper/022:26:450
1354499140,0cyclictest0-21swapper/022:05:180
1354499140,0cyclictest0-21swapper/021:47:120
1354499140,0cyclictest0-21swapper/020:14:130
1354499140,0cyclictest0-21swapper/019:40:330
1354499140,0cyclictest0-21swapper/000:25:450
13553991313,0cyclictest0-21swapper/322:25:373
13551991313,0cyclictest0-21swapper/220:01:002
13551991313,0cyclictest0-21swapper/219:13:432
13550991313,0cyclictest0-21swapper/120:25:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional