You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-12-09 - 18:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5.osadl.org (updated Mon Dec 09, 2024 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1191999310,30cyclictest8114-21cron08:10:020
1192999290,1cyclictest3181-21apt-get08:00:023
11924992928,1cyclictest0-21swapper/212:35:122
11924992927,1cyclictest0-21swapper/209:10:002
1192499290,28cyclictest24772-21apt-get08:45:122
1192499290,28cyclictest0-21swapper/212:30:102
1192199290,28cyclictest0-21swapper/112:05:121
1191999290,28cyclictest0-21swapper/011:10:150
1191999290,28cyclictest0-21swapper/009:40:140
1191999290,28cyclictest0-21swapper/008:15:140
11924992827,1cyclictest8962-21apt-get09:20:112
11924992827,1cyclictest11981-21apt-get09:30:072
1192499280,0cyclictest0-21swapper/208:15:142
1192199280,27cyclictest0-21swapper/107:10:121
11919992827,1cyclictest20421-21cron12:10:020
11919992827,1cyclictest18934-21perf10:55:000
11919992827,0cyclictest0-21swapper/010:55:130
11919992826,1cyclictest609-21dbus-daemon10:35:020
1191999280,27cyclictest0-21swapper/008:20:110
1191999280,1cyclictest13150-21munin-run11:55:000
11929992727,0cyclictest0-21swapper/311:30:083
11929992726,1cyclictest764-21cron11:25:013
1192999270,0cyclictest0-21swapper/311:10:143
1192999270,0cyclictest0-21swapper/308:35:103
11924992727,0cyclictest31212-21apt-get07:50:132
11924992727,0cyclictest0-21swapper/210:50:152
1192499270,27cyclictest0-21swapper/210:15:112
1192499270,0cyclictest16608-21perf10:50:012
1192499270,0cyclictest0-21swapper/209:55:122
11921992727,0cyclictest468-21apt-get10:15:111
11921992727,0cyclictest10728-21apt-get08:15:131
11921992727,0cyclictest0-21swapper/111:30:091
11921992727,0cyclictest0-21swapper/111:15:141
1192199270,0cyclictest0-21swapper/112:35:111
11919992727,0cyclictest20103-21apt-get08:35:100
1191999270,0cyclictest0-21swapper/009:35:120
11929992626,0cyclictest0-21swapper/311:55:173
11929992626,0cyclictest0-21swapper/311:45:133
11929992626,0cyclictest0-21swapper/309:45:123
11929992626,0cyclictest0-21swapper/309:35:113
11929992625,0cyclictest0-21swapper/307:40:123
11924992626,0cyclictest23818-21apt-get07:35:142
11924992626,0cyclictest0-21swapper/210:05:012
11924992626,0cyclictest0-21swapper/208:05:132
11921992626,0cyclictest3764-21apt-get08:00:121
11921992626,0cyclictest0-21swapper/107:15:121
11921992624,1cyclictest11713-21munin-run09:30:001
11919992626,0cyclictest0-21swapper/009:45:120
11919992626,0cyclictest0-21swapper/007:20:120
11919992625,1cyclictest23024-21apt-get12:15:130
11929992525,0cyclictest3997-21apt-get09:10:173
11924992525,0cyclictest0-21swapper/211:45:132
11921992525,0cyclictest0-21swapper/112:30:101
11921992525,0cyclictest0-21swapper/109:40:141
11921992524,0cyclictest28892-21apt-get07:45:131
11919992525,0cyclictest0-21swapper/007:40:020
11929992424,0cyclictest16656-21apt-get09:40:133
11929992424,0cyclictest0-21swapper/312:10:123
11924992424,0cyclictest14495-21apt-get07:15:122
11924992424,0cyclictest0-21swapper/209:50:162
11924992424,0cyclictest0-21swapper/209:45:122
11924992421,2cyclictest17486-21sh08:29:592
11921992424,0cyclictest0-21swapper/110:05:111
11921992424,0cyclictest0-21swapper/109:15:131
11921992423,1cyclictest19812-21idleruntime-cro08:35:001
11921992423,1cyclictest18980-21apt-get09:45:131
11919992424,0cyclictest0-21swapper/010:20:130
11919992423,1cyclictest25923-21perf11:10:000
11924992323,0cyclictest0-21swapper/208:00:122
11924992322,1cyclictest18378-21apt-get12:05:112
11921992323,0cyclictest19167-21apt-get07:25:121
11921992323,0cyclictest0-21swapper/110:45:121
11921992323,0cyclictest0-21swapper/110:10:121
11919992323,0cyclictest0-21swapper/011:45:120
11919992323,0cyclictest0-21swapper/010:35:120
11924992222,0cyclictest0-21swapper/210:40:132
11924992222,0cyclictest0-21swapper/210:05:112
11924992222,0cyclictest0-21swapper/207:45:132
11921992222,0cyclictest8699-21apt-get11:45:121
11921992222,0cyclictest13412-21apt-get11:55:161
11921992222,0cyclictest0-21swapper/110:50:141
11919992220,1cyclictest609-21dbus-daemon08:55:010
11929992121,0cyclictest20440-21perf12:10:013
11929992120,1cyclictest19204-21apt-get10:55:143
11921992121,0cyclictest0-21swapper/108:20:111
11921992121,0cyclictest0-21swapper/107:40:121
11921992120,1cyclictest15457-21apt-get08:25:121
11919992121,0cyclictest0-21swapper/012:00:120
11919992119,1cyclictest609-21dbus-daemon09:00:000
11919992119,1cyclictest3965-21/usr/sbin/munin09:10:230
11929992020,0cyclictest0-21swapper/308:20:123
11929992019,1cyclictest30609-21apt-get10:10:133
11924992020,0cyclictest0-21swapper/207:30:122
11929991919,0cyclictest0-21swapper/310:20:153
11929991919,0cyclictest0-21swapper/307:25:113
11929991917,1cyclictest626-21gdbus11:55:013
11924991919,0cyclictest31759-21apt-get09:00:132
11924991918,1cyclictest26568-21apt-get07:40:132
11921991919,0cyclictest0-21swapper/109:35:111
11921991919,0cyclictest0-21swapper/108:45:121
11921991917,1cyclictest23544-21perf07:35:011
11919991919,0cyclictest0-21swapper/010:25:120
11919991919,0cyclictest0-21swapper/010:25:120
11919991919,0cyclictest0-21swapper/007:55:140
11919991917,1cyclictest5827-21munin-run08:05:020
11929991818,0cyclictest30941-21perf07:50:013
11929991818,0cyclictest0-21swapper/308:15:143
11929991816,1cyclictest1415-21latency_hist11:30:013
11924991818,0cyclictest6616-21apt-get09:15:132
11924991818,0cyclictest0-21swapper/208:55:132
11921991818,0cyclictest0-21swapper/107:20:111
11919991818,0cyclictest0-21swapper/009:15:010
11929991717,0cyclictest0-21swapper/311:15:143
11929991717,0cyclictest0-21swapper/308:25:133
11929991715,1cyclictest30402-21munin-run12:35:003
1192999170,17cyclictest0-21swapper/309:30:033
11924991717,0cyclictest4036-21apt-get11:35:162
11921991716,1cyclictest0-21swapper/111:25:021
11921991715,1cyclictest27402-21idleruntime-cro12:25:011
11921991715,1cyclictest14270-21awk10:45:021
1192199170,16cyclictest31509-21latency_hist09:00:011
11919991717,0cyclictest0-21swapper/008:25:120
11929991616,0cyclictest0-21swapper/309:15:143
11929991614,2cyclictest16517-21taskset10:49:163
11929991614,1cyclictest7019-21hddtemp_smartct11:40:173
11929991614,1cyclictest0-21swapper/308:55:173
11924991616,0cyclictest0-21swapper/210:10:122
11924991614,1cyclictest0-21swapper/207:55:212
1192499160,2cyclictest27586-21fschecks_time08:50:142
1192499160,15cyclictest22675-21expr08:40:122
11921991614,1cyclictest855-21munin-run07:55:011
1192199160,15cyclictest9310-21memory08:10:181
11919991614,1cyclictest0-21swapper/007:40:000
1192999157,4cyclictest303-21systemd-journal09:08:403
1192999150,1cyclictest0-21swapper/308:55:003
1192999150,14cyclictest0-21swapper/308:30:243
11924991513,1cyclictest3908-21ntp_states10:20:192
11924991513,1cyclictest0-21swapper/211:55:202
1192499150,1cyclictest0-21swapper/211:17:012
11921991515,0cyclictest0-21swapper/108:35:101
11921991514,1cyclictest28255-21munin-run11:15:011
1192199150,14cyclictest0-21swapper/107:55:131
11919991513,1cyclictest16553-21cron07:20:010
1191999150,1cyclictest29795-21memory07:45:170
1191999150,1cyclictest25580-21taskset09:59:110
1191999150,14cyclictest18518-21modprobe08:30:180
1191999150,14cyclictest0-21swapper/007:50:320
1191999150,14cyclictest0-21swapper/007:25:130
11929991414,0cyclictest0-21swapper/309:26:513
11929991414,0cyclictest0-21swapper/309:21:103
11929991414,0cyclictest0-21swapper/307:23:483
11929991413,1cyclictest1112-21apt-get07:55:133
1192999140,14cyclictest0-21swapper/312:22:213
1192999140,14cyclictest0-21swapper/312:15:183
1192999140,14cyclictest0-21swapper/311:06:303
1192999140,14cyclictest0-21swapper/311:03:213
1192999140,14cyclictest0-21swapper/310:35:093
1192999140,14cyclictest0-21swapper/310:30:203
1192999140,14cyclictest0-21swapper/310:25:203
1192999140,14cyclictest0-21swapper/310:25:203
1192999140,14cyclictest0-21swapper/310:15:153
1192999140,14cyclictest0-21swapper/310:05:253
1192999140,14cyclictest0-21swapper/310:00:133
1192999140,14cyclictest0-21swapper/309:00:573
1192999140,14cyclictest0-21swapper/308:45:193
1192999140,14cyclictest0-21swapper/308:12:173
1192999140,14cyclictest0-21swapper/307:50:223
1192999140,14cyclictest0-21swapper/307:36:033
1192999140,14cyclictest0-21swapper/307:19:293
1192999140,14cyclictest0-21swapper/307:12:333
1192999140,0cyclictest0-21swapper/312:00:013
1192999140,0cyclictest0-21swapper/311:35:273
1192999140,0cyclictest0-21swapper/310:42:503
1192999140,0cyclictest0-21swapper/309:58:303
1192999140,0cyclictest0-21swapper/309:51:463
1192999140,0cyclictest0-21swapper/308:40:003
1192999140,0cyclictest0-21swapper/307:31:123
1192499140,14cyclictest0-21swapper/212:27:092
1192499140,14cyclictest0-21swapper/212:17:182
1192499140,14cyclictest0-21swapper/212:12:332
1192499140,14cyclictest0-21swapper/211:40:522
1192499140,14cyclictest0-21swapper/211:34:112
1192499140,14cyclictest0-21swapper/211:21:192
1192499140,14cyclictest0-21swapper/211:10:172
1192499140,14cyclictest0-21swapper/211:03:032
1192499140,14cyclictest0-21swapper/210:55:192
1192499140,14cyclictest0-21swapper/210:34:322
1192499140,14cyclictest0-21swapper/210:26:532
1192499140,14cyclictest0-21swapper/210:26:532
1192499140,14cyclictest0-21swapper/209:41:002
1192499140,14cyclictest0-21swapper/209:39:282
1192499140,14cyclictest0-21swapper/209:25:352
1192499140,14cyclictest0-21swapper/209:10:532
1192499140,14cyclictest0-21swapper/208:22:242
1192499140,14cyclictest0-21swapper/208:12:082
1192499140,14cyclictest0-21swapper/207:21:292
1192499140,14cyclictest0-21swapper/207:13:332
1192499140,0cyclictest0-21swapper/211:51:292
1192499140,0cyclictest0-21swapper/211:28:552
1192499140,0cyclictest0-21swapper/211:05:432
1192499140,0cyclictest0-21swapper/210:35:312
1192499140,0cyclictest0-21swapper/208:31:342
11921991414,0cyclictest0-21swapper/112:10:131
11921991414,0cyclictest0-21swapper/112:01:311
11921991414,0cyclictest0-21swapper/111:40:301
11921991414,0cyclictest0-21swapper/108:06:591
1192199140,14cyclictest0-21swapper/112:25:531
1192199140,14cyclictest0-21swapper/111:52:141
1192199140,14cyclictest0-21swapper/111:36:201
1192199140,14cyclictest0-21swapper/111:06:001
1192199140,14cyclictest0-21swapper/111:02:451
1192199140,14cyclictest0-21swapper/110:56:171
1192199140,14cyclictest0-21swapper/110:38:511
1192199140,14cyclictest0-21swapper/110:33:021
1192199140,14cyclictest0-21swapper/110:00:111
1192199140,14cyclictest0-21swapper/109:55:181
1192199140,14cyclictest0-21swapper/109:50:351
1192199140,14cyclictest0-21swapper/109:11:261
1192199140,14cyclictest0-21swapper/109:05:301
1192199140,14cyclictest0-21swapper/109:00:221
1192199140,14cyclictest0-21swapper/108:50:241
1192199140,0cyclictest0-21swapper/112:15:141
1192199140,0cyclictest0-21swapper/111:25:571
1192199140,0cyclictest0-21swapper/110:25:451
1192199140,0cyclictest0-21swapper/110:25:451
1192199140,0cyclictest0-21swapper/110:20:261
1192199140,0cyclictest0-21swapper/109:30:501
1192199140,0cyclictest0-21swapper/109:20:501
1192199140,0cyclictest0-21swapper/108:41:141
1192199140,0cyclictest0-21swapper/107:35:331
11919991414,0cyclictest0-21swapper/011:31:050
11919991414,0cyclictest0-21swapper/010:46:330
11919991414,0cyclictest0-21swapper/010:40:120
11919991414,0cyclictest0-21swapper/010:10:080
11919991414,0cyclictest0-21swapper/010:05:110
11919991414,0cyclictest0-21swapper/009:20:110
11919991413,1cyclictest26765-21irqstats10:00:150
1191999140,4cyclictest0-21swapper/007:10:120
1191999140,14cyclictest0-21swapper/012:30:050
1191999140,14cyclictest0-21swapper/012:25:420
1191999140,14cyclictest0-21swapper/012:22:300
1191999140,14cyclictest0-21swapper/011:56:130
1191999140,14cyclictest0-21swapper/011:40:480
1191999140,14cyclictest0-21swapper/011:21:120
1191999140,14cyclictest0-21swapper/011:00:120
1191999140,14cyclictest0-21swapper/010:16:450
1191999140,14cyclictest0-21swapper/009:51:150
1191999140,14cyclictest0-21swapper/009:30:230
1191999140,14cyclictest0-21swapper/009:06:300
1191999140,14cyclictest0-21swapper/008:47:380
1191999140,14cyclictest0-21swapper/008:11:220
1191999140,14cyclictest0-21swapper/007:32:250
1191999140,0cyclictest0-21swapper/012:35:430
1191999140,0cyclictest0-21swapper/012:10:230
1191999140,0cyclictest0-21swapper/011:36:350
1191999140,0cyclictest0-21swapper/011:26:350
1191999140,0cyclictest0-21swapper/011:15:050
1191999140,0cyclictest0-21swapper/009:25:360
1191999140,0cyclictest0-21swapper/009:02:530
11929991313,0cyclictest0-21swapper/312:25:393
11929991313,0cyclictest0-21swapper/310:52:253
11929991313,0cyclictest0-21swapper/308:05:123
1192999130,0cyclictest0-21swapper/312:35:103
11924991313,0cyclictest0-21swapper/207:25:062
1192499130,0cyclictest0-21swapper/212:20:192
1192499130,0cyclictest0-21swapper/212:00:102
11919991313,0cyclictest0-21swapper/008:41:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional