You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-05 - 20:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Wed Nov 05, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1083699311,29cyclictest609-21dbus-daemon12:10:012
10830993128,2cyclictest11133-21awk10:35:011
1082499310,2cyclictest303-21systemd-journal11:00:000
10842993027,2cyclictest12315-21sh08:20:003
1083699300,29cyclictest28339-21munin-run12:20:002
1083099300,29cyclictest10568-21awk09:25:001
10824993028,1cyclictest0-21swapper/012:25:010
1082499300,29cyclictest579-21cron07:55:000
1084299290,28cyclictest24834-21apt-get09:55:113
1084299290,28cyclictest0-21swapper/308:05:153
10836992928,1cyclictest1-21systemd09:30:002
10836992927,2cyclictest1179-21cron09:05:012
10836992926,2cyclictest303-21systemd-journal09:20:012
1083699290,2cyclictest25718-21apt-get11:05:172
1083699290,28cyclictest23891-21apt-get07:35:162
1083699290,1cyclictest2966-21perf08:00:012
1083099290,28cyclictest23389-21apt-get11:00:121
1083099290,28cyclictest22508-21apt-get09:50:111
1083099290,28cyclictest0-21swapper/108:55:121
1082499290,28cyclictest0-21swapper/011:30:150
10842992827,0cyclictest840-21apt-get12:30:153
10842992826,1cyclictest609-21dbus-daemon11:55:013
10842992826,1cyclictest31279-21sendmail-msp09:00:003
1084299280,0cyclictest0-21swapper/312:35:133
10836992828,0cyclictest26340-21apt-get07:40:142
10836992828,0cyclictest16945-21apt-get11:55:122
10836992828,0cyclictest16945-21apt-get11:55:112
10836992827,1cyclictest17016-21perf08:30:002
10836992827,1cyclictest0-21swapper/210:50:012
1083699280,28cyclictest0-21swapper/208:00:102
1083699280,28cyclictest0-21swapper/207:15:142
1083699280,0cyclictest18415-21apt-get10:50:142
10830992828,0cyclictest0-21swapper/107:50:131
10830992827,1cyclictest0-21swapper/108:29:591
1083099280,28cyclictest0-21swapper/112:05:101
1083099280,28cyclictest0-21swapper/112:00:141
1083099280,28cyclictest0-21swapper/111:45:141
10824992828,0cyclictest0-21swapper/011:25:120
10824992827,1cyclictest23675-21perf12:10:020
1082499280,0cyclictest0-21swapper/010:10:110
10842992727,0cyclictest0-21swapper/311:30:153
10842992727,0cyclictest0-21swapper/308:45:123
10842992727,0cyclictest0-21swapper/308:45:113
10842992727,0cyclictest0-21swapper/307:35:153
10842992725,1cyclictest0-21swapper/312:15:013
1084299270,27cyclictest0-21swapper/309:45:003
1084299270,0cyclictest23389-21apt-get11:00:133
1084299270,0cyclictest0-21swapper/307:55:173
10836992727,0cyclictest0-21swapper/208:50:112
1083699270,27cyclictest12630-21apt-get08:20:142
10830992727,0cyclictest0-21swapper/111:40:151
10830992727,0cyclictest0-21swapper/110:20:121
10830992727,0cyclictest0-21swapper/109:15:111
10830992727,0cyclictest0-21swapper/108:45:121
10830992727,0cyclictest0-21swapper/108:45:121
10830992727,0cyclictest0-21swapper/107:10:121
10824992727,0cyclictest3173-21apt-get12:35:130
10824992727,0cyclictest0-21swapper/011:50:130
10824992727,0cyclictest0-21swapper/011:40:140
10824992727,0cyclictest0-21swapper/009:15:110
10824992727,0cyclictest0-21swapper/008:45:130
10824992727,0cyclictest0-21swapper/008:45:130
10824992726,1cyclictest0-21swapper/011:40:000
1082499270,0cyclictest30083-21apt-get11:15:000
10842992626,0cyclictest10726-21apt-get07:10:023
10842992626,0cyclictest0-21swapper/312:25:153
10842992626,0cyclictest0-21swapper/312:15:133
10842992626,0cyclictest0-21swapper/311:35:123
10842992626,0cyclictest0-21swapper/308:25:133
10842992625,1cyclictest28670-21apt-get07:45:133
10842992624,1cyclictest3761-21cron10:20:013
10836992626,0cyclictest5244-21apt-get11:30:162
10836992625,1cyclictest23095-21cron11:00:012
10830992626,0cyclictest0-21swapper/111:15:131
10830992626,0cyclictest0-21swapper/111:10:091
10830992626,0cyclictest0-21swapper/110:40:141
10830992626,0cyclictest0-21swapper/108:35:121
10824992626,0cyclictest0-21swapper/012:10:130
10824992626,0cyclictest0-21swapper/010:45:150
10842992525,0cyclictest0-21swapper/311:40:143
10842992525,0cyclictest0-21swapper/311:25:113
10842992525,0cyclictest0-21swapper/311:10:103
10842992525,0cyclictest0-21swapper/307:40:133
10842992523,1cyclictest0-21swapper/309:35:013
10836992525,0cyclictest0-21swapper/210:05:142
10836992524,1cyclictest7951-21apt-get08:10:142
10830992525,0cyclictest0-21swapper/107:55:161
10830992525,0cyclictest0-21swapper/107:30:131
10830992517,8cyclictest0-21swapper/112:15:231
10824992525,0cyclictest0-21swapper/009:05:110
10824992525,0cyclictest0-21swapper/007:10:120
10824992524,1cyclictest0-21swapper/008:50:120
10842992424,0cyclictest31826-21apt-get10:10:123
10842992424,0cyclictest0-21swapper/309:50:103
10842992424,0cyclictest0-21swapper/309:20:133
10842992424,0cyclictest0-21swapper/308:20:133
10842992424,0cyclictest0-21swapper/307:25:013
10842992423,1cyclictest15759-21http07:20:013
10836992424,0cyclictest11337-21apt-get07:10:122
10836992424,0cyclictest0-21swapper/211:40:152
10836992424,0cyclictest0-21swapper/210:15:132
10836992424,0cyclictest0-21swapper/209:55:132
10836992424,0cyclictest0-21swapper/207:25:122
10836992422,1cyclictest609-21dbus-daemon07:55:002
10830992424,0cyclictest10862-21apt-get09:25:111
10830992424,0cyclictest0-21swapper/109:45:151
10824992423,1cyclictest26920-21munin-run10:00:000
10842992323,0cyclictest0-21swapper/311:55:123
10842992323,0cyclictest0-21swapper/311:55:123
10842992323,0cyclictest0-21swapper/308:30:123
10842992323,0cyclictest0-21swapper/307:25:123
10842992321,1cyclictest9979-21cron08:15:013
10836992323,0cyclictest0-21swapper/212:35:142
10830992323,0cyclictest20489-21http10:55:011
10830992323,0cyclictest15513-21apt-get09:35:111
10830992323,0cyclictest0-21swapper/109:55:131
10830992323,0cyclictest0-21swapper/108:30:111
10830992323,0cyclictest0-21swapper/108:15:021
10830992323,0cyclictest0-21swapper/107:35:021
10830992323,0cyclictest0-21swapper/107:20:041
10830992323,0cyclictest0-21swapper/107:15:141
10824992323,0cyclictest0-21swapper/011:55:110
10824992323,0cyclictest0-21swapper/011:55:110
10824992323,0cyclictest0-21swapper/011:05:170
10824992323,0cyclictest0-21swapper/007:15:150
10824992322,1cyclictest0-21swapper/010:50:130
10842992222,0cyclictest6129-21apt-get09:15:123
10842992222,0cyclictest30993-21apt-get07:50:143
10836992222,0cyclictest0-21swapper/210:10:122
10836992222,0cyclictest0-21swapper/209:35:112
10836992222,0cyclictest0-21swapper/209:10:132
10824992222,0cyclictest0-21swapper/009:00:100
10836992119,2cyclictest30652-21cron12:25:002
10830992121,0cyclictest0-21swapper/111:05:171
10830992121,0cyclictest0-21swapper/108:20:141
10830992121,0cyclictest0-21swapper/108:05:161
10830992119,1cyclictest5845-21sh09:14:591
10842992019,1cyclictest0-21swapper/310:45:153
10836992020,0cyclictest0-21swapper/211:15:002
10836992020,0cyclictest0-21swapper/210:25:132
10836992019,1cyclictest0-21swapper/208:45:122
10836992019,1cyclictest0-21swapper/208:45:122
1083099208,12cyclictest17625-21munin-node07:26:441
10830992019,1cyclictest8827-21munin-run10:30:011
10824992020,0cyclictest0-21swapper/008:40:130
10842991919,0cyclictest22260-21apt-get08:40:143
10842991919,0cyclictest0-21swapper/310:50:133
10836991918,1cyclictest9693-21perf11:40:012
10836991918,1cyclictest14624-21apt-get11:50:142
10824991919,0cyclictest0-21swapper/012:25:160
10824991918,1cyclictest0-21swapper/007:40:130
10836991818,0cyclictest0-21swapper/212:10:122
10830991818,0cyclictest0-21swapper/109:30:151
10830991816,1cyclictest303-21systemd-journal10:10:001
10824991818,0cyclictest0-21swapper/009:40:120
10824991818,0cyclictest0-21swapper/009:35:120
10836991716,1cyclictest1471-21apt-get09:05:122
10830991717,0cyclictest0-21swapper/112:30:161
10830991717,0cyclictest0-21swapper/111:50:131
10842991614,1cyclictest13502-21munin-run10:40:013
1084299160,15cyclictest22258-21perf09:50:003
1084299160,15cyclictest20201-21memory12:00:203
10836991614,1cyclictest7652-21cron08:10:012
1083699160,15cyclictest20825-21tail09:45:162
10830991616,0cyclictest0-21swapper/107:40:121
10830991614,1cyclictest511-21cron12:30:011
10830991614,1cyclictest0-21swapper/108:15:171
10824991616,0cyclictest1730-21apt-get10:15:130
10824991614,1cyclictest0-21swapper/009:20:200
10824991614,1cyclictest0-21swapper/008:10:020
1082499160,15cyclictest23139-21head09:50:120
1084299150,1cyclictest0-21swapper/310:05:163
1084299150,14cyclictest27539-21sed08:50:133
10836991513,1cyclictest10700-21diskstats08:15:162
1083699150,14cyclictest0-21swapper/207:20:562
10824991515,0cyclictest27182-21apt-get10:00:110
1082499150,1cyclictest5345-21latency_hist08:05:020
1082499150,1cyclictest0-21swapper/008:10:170
1082499150,14cyclictest0-21swapper/009:13:220
1082499150,14cyclictest0-21swapper/007:30:170
10842991414,0cyclictest6708-21apt-get10:25:133
10842991414,0cyclictest0-21swapper/312:20:053
10842991414,0cyclictest0-21swapper/311:45:153
10842991412,1cyclictest2524-21ntp_states09:05:173
1084299140,14cyclictest0-21swapper/312:05:233
1084299140,14cyclictest0-21swapper/311:16:403
1084299140,14cyclictest0-21swapper/310:56:393
1084299140,14cyclictest0-21swapper/310:21:013
1084299140,14cyclictest0-21swapper/310:01:213
1084299140,14cyclictest0-21swapper/309:01:383
1084299140,14cyclictest0-21swapper/308:38:053
1084299140,0cyclictest0-21swapper/311:20:143
1084299140,0cyclictest0-21swapper/311:06:053
1084299140,0cyclictest0-21swapper/310:31:093
1084299140,0cyclictest0-21swapper/309:10:523
1084299140,0cyclictest0-21swapper/308:04:083
1084299140,0cyclictest0-21swapper/307:31:083
10836991414,0cyclictest0-21swapper/207:30:552
1083699140,14cyclictest0-21swapper/212:30:532
1083699140,14cyclictest0-21swapper/212:25:382
1083699140,14cyclictest0-21swapper/212:01:122
1083699140,14cyclictest0-21swapper/211:45:302
1083699140,14cyclictest0-21swapper/211:16:482
1083699140,14cyclictest0-21swapper/210:44:282
1083699140,14cyclictest0-21swapper/210:38:502
1083699140,14cyclictest0-21swapper/209:54:192
1083699140,14cyclictest0-21swapper/209:33:152
1083699140,14cyclictest0-21swapper/209:21:392
1083699140,14cyclictest0-21swapper/209:00:002
1083699140,14cyclictest0-21swapper/208:41:422
1083699140,14cyclictest0-21swapper/208:36:002
1083699140,14cyclictest0-21swapper/208:31:472
1083699140,10cyclictest0-21swapper/209:40:112
1083699140,0cyclictest9091-21apt-get10:30:152
1083699140,0cyclictest0-21swapper/211:21:282
1083699140,0cyclictest0-21swapper/207:45:052
10830991414,0cyclictest0-21swapper/112:36:061
10830991414,0cyclictest0-21swapper/111:37:061
10830991414,0cyclictest0-21swapper/111:30:161
10830991414,0cyclictest0-21swapper/110:10:141
10830991414,0cyclictest0-21swapper/108:51:061
10830991414,0cyclictest0-21swapper/107:45:161
10830991412,1cyclictest31981-21df09:00:121
1083099140,14cyclictest0-21swapper/112:21:071
1083099140,14cyclictest0-21swapper/111:55:171
1083099140,14cyclictest0-21swapper/111:55:171
1083099140,14cyclictest0-21swapper/110:46:241
1083099140,14cyclictest0-21swapper/110:19:411
1083099140,14cyclictest0-21swapper/109:40:331
1083099140,14cyclictest0-21swapper/108:00:031
1083099140,0cyclictest0-21swapper/112:10:311
1083099140,0cyclictest0-21swapper/111:25:381
1083099140,0cyclictest0-21swapper/111:20:121
1083099140,0cyclictest0-21swapper/110:35:101
1083099140,0cyclictest0-21swapper/110:02:101
1083099140,0cyclictest0-21swapper/109:05:091
1083099140,0cyclictest0-21swapper/108:40:011
10824991414,0cyclictest0-21swapper/012:15:140
10824991414,0cyclictest0-21swapper/011:20:370
10824991414,0cyclictest0-21swapper/011:15:110
10824991414,0cyclictest0-21swapper/009:31:430
1082499140,14cyclictest0-21swapper/012:00:030
1082499140,14cyclictest0-21swapper/011:46:160
1082499140,14cyclictest0-21swapper/011:00:110
1082499140,14cyclictest0-21swapper/010:43:050
1082499140,14cyclictest0-21swapper/009:25:270
1082499140,14cyclictest0-21swapper/008:37:380
1082499140,14cyclictest0-21swapper/008:30:020
1082499140,14cyclictest0-21swapper/008:25:220
1082499140,14cyclictest0-21swapper/008:15:080
1082499140,14cyclictest0-21swapper/007:45:240
1082499140,14cyclictest0-21swapper/007:25:070
1082499140,0cyclictest0-21swapper/012:31:220
1082499140,0cyclictest0-21swapper/010:35:510
1082499140,0cyclictest0-21swapper/010:33:500
1082499140,0cyclictest0-21swapper/010:27:040
1082499140,0cyclictest0-21swapper/010:21:000
1082499140,0cyclictest0-21swapper/010:08:280
1082499140,0cyclictest0-21swapper/009:47:280
1082499140,0cyclictest0-21swapper/008:55:120
1082499140,0cyclictest0-21swapper/008:20:530
1082499140,0cyclictest0-21swapper/007:56:460
1082499140,0cyclictest0-21swapper/007:36:010
1082499140,0cyclictest0-21swapper/007:21:300
10842991313,0cyclictest0-21swapper/310:41:423
10842991313,0cyclictest0-21swapper/309:36:043
10842991313,0cyclictest0-21swapper/309:25:163
10836991313,0cyclictest0-21swapper/211:01:232
10836991313,0cyclictest0-21swapper/210:00:512
1083699130,13cyclictest0-21swapper/210:20:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional