You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-12 - 07:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Thu Sep 12, 2024 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1205999300,29cyclictest5877-21cron20:05:012
1205999300,29cyclictest1838-21idleruntime-cro21:05:012
1205599300,29cyclictest301-21apt-get22:10:121
12053993028,1cyclictest609-21dbus-daemon19:55:010
1205399300,29cyclictest5288-21sh23:30:010
1205399300,29cyclictest32475-21cron22:10:000
12063992929,0cyclictest0-21swapper/320:30:123
1206399290,28cyclictest0-21swapper/323:55:113
1206399290,28cyclictest0-21swapper/323:00:103
1206399290,28cyclictest0-21swapper/322:10:133
1206399290,28cyclictest0-21swapper/300:15:123
1206399290,1cyclictest15809-21cron21:35:013
12059992927,1cyclictest18187-21munin-run21:40:002
1205599290,1cyclictest626-21gdbus20:29:591
1205399290,28cyclictest0-21swapper/022:35:110
1205399290,28cyclictest0-21swapper/022:30:130
1205399290,1cyclictest21326-21cron19:30:010
12063992826,1cyclictest0-21swapper/300:25:013
1206399280,0cyclictest0-21swapper/323:35:133
1206399280,0cyclictest0-21swapper/321:05:113
12059992827,0cyclictest26308-21apt-get19:40:022
12059992827,0cyclictest19000-21apt-get22:50:122
1205999280,28cyclictest0-21swapper/221:25:132
1205999280,28cyclictest0-21swapper/220:55:092
1205999280,0cyclictest0-21swapper/222:10:132
1205999280,0cyclictest0-21swapper/221:05:122
12055992828,0cyclictest0-21swapper/123:40:131
1205599280,1cyclictest0-21swapper/119:40:011
1205599280,0cyclictest0-21swapper/122:45:131
1205399280,28cyclictest0-21swapper/000:25:130
1205399280,0cyclictest0-21swapper/023:45:130
12063992726,1cyclictest24615-21apt-get00:10:123
1206399270,0cyclictest0-21swapper/323:20:123
1206399270,0cyclictest0-21swapper/320:50:113
12059992726,1cyclictest0-21swapper/219:35:022
1205999270,0cyclictest15210-21apt-get23:50:112
1205999270,0cyclictest12299-21apt-get19:10:112
12055992727,0cyclictest0-21swapper/123:25:111
12055992727,0cyclictest0-21swapper/122:40:121
12055992727,0cyclictest0-21swapper/100:35:121
12053992727,0cyclictest22293-21apt-get00:05:110
12053992727,0cyclictest0-21swapper/023:35:010
12053992727,0cyclictest0-21swapper/021:50:130
12053992727,0cyclictest0-21swapper/000:20:100
1205399270,0cyclictest0-21swapper/023:05:120
12063992626,0cyclictest22579-21perf20:40:013
12063992626,0cyclictest0-21swapper/322:45:133
12063992626,0cyclictest0-21swapper/322:30:133
12063992626,0cyclictest0-21swapper/319:20:123
12059992626,0cyclictest0-21swapper/222:25:122
12059992626,0cyclictest0-21swapper/222:00:132
12059992626,0cyclictest0-21swapper/200:30:112
12059992624,1cyclictest303-21systemd-journal20:35:002
12059992624,1cyclictest24357-21perf00:10:022
12055992626,0cyclictest5026-21apt-get22:20:101
12055992626,0cyclictest0-21swapper/100:10:111
12055992624,1cyclictest3594-21awk20:00:011
12053992626,0cyclictest21618-21apt-get19:30:110
12053992626,0cyclictest0-21swapper/022:55:110
12053992626,0cyclictest0-21swapper/021:30:120
12053992626,0cyclictest0-21swapper/020:15:110
12053992626,0cyclictest0-21swapper/020:05:110
12053992625,1cyclictest20501-21apt-get20:35:120
12063992525,0cyclictest0-21swapper/322:25:133
12063992525,0cyclictest0-21swapper/321:25:133
12063992525,0cyclictest0-21swapper/320:25:123
12059992525,0cyclictest21325-21apt-get22:55:112
12059992525,0cyclictest0-21swapper/223:30:122
12059992525,0cyclictest0-21swapper/223:15:112
12055992525,0cyclictest0-21swapper/121:30:111
12055992525,0cyclictest0-21swapper/120:07:541
12055992525,0cyclictest0-21swapper/119:45:111
12055992523,1cyclictest303-21systemd-journal00:05:021
12053992525,0cyclictest0-21swapper/020:20:120
12053992523,1cyclictest31303-21awk19:50:000
12063992424,0cyclictest0-21swapper/319:45:123
12059992424,0cyclictest0-21swapper/223:25:022
12059992424,0cyclictest0-21swapper/220:50:112
12059992424,0cyclictest0-21swapper/220:40:112
12059992424,0cyclictest0-21swapper/219:15:112
12059992424,0cyclictest0-21swapper/200:00:112
12059992422,1cyclictest3561-21cron20:00:012
12053992424,0cyclictest0-21swapper/021:10:100
12053992424,0cyclictest0-21swapper/020:25:110
12063992323,0cyclictest0-21swapper/322:40:113
12063992323,0cyclictest0-21swapper/321:35:133
12063992322,1cyclictest19296-21apt-get19:25:133
12059992323,0cyclictest28993-21sendmail-msp00:20:012
12059992322,1cyclictest0-21swapper/200:15:012
12055992323,0cyclictest7907-21apt-get23:35:121
12055992323,0cyclictest11171-21apt-get20:15:131
12055992321,1cyclictest10605-21apt-get20:15:021
12053992323,0cyclictest0-21swapper/020:45:120
12053992323,0cyclictest0-21swapper/020:45:120
12053992323,0cyclictest0-21swapper/019:35:110
1206399225,16cyclictest610-21wpa_supplicant22:22:103
12063992222,0cyclictest0-21swapper/323:40:123
12063992221,1cyclictest0-21swapper/321:20:123
12063992220,1cyclictest303-21systemd-journal19:40:013
12059992222,0cyclictest0-21swapper/221:54:592
12055992222,0cyclictest26939-21apt-get00:15:111
12055992222,0cyclictest18451-21apt-get21:40:111
12053992222,0cyclictest0-21swapper/021:45:110
12053992222,0cyclictest0-21swapper/020:55:100
12053992222,0cyclictest0-21swapper/020:10:130
12053992220,1cyclictest0-21swapper/022:30:010
12063992121,0cyclictest30997-21apt-get23:15:123
12063992121,0cyclictest0-21swapper/322:05:113
12063992121,0cyclictest0-21swapper/319:15:113
12059992121,0cyclictest0-21swapper/221:40:122
12059992121,0cyclictest0-21swapper/220:07:532
12055992121,0cyclictest0-21swapper/123:45:021
12055992121,0cyclictest0-21swapper/122:30:121
12053992121,0cyclictest28372-21apt-get23:10:130
12053992121,0cyclictest0-21swapper/000:30:120
12053992119,1cyclictest2422-21perf22:15:000
12059992020,0cyclictest0-21swapper/223:55:122
12055992020,0cyclictest14622-21apt-get19:15:111
12055992020,0cyclictest0-21swapper/121:35:121
12055992020,0cyclictest0-21swapper/121:05:121
12055992020,0cyclictest0-21swapper/120:50:121
12055992020,0cyclictest0-21swapper/100:20:101
12053992020,0cyclictest0-21swapper/000:35:130
12053992017,2cyclictest19560-21cron00:00:010
12063991919,0cyclictest0-21swapper/320:00:123
12063991917,1cyclictest27511-21idleruntime-cro21:59:593
12059991919,0cyclictest0-21swapper/222:20:112
12059991919,0cyclictest0-21swapper/220:45:102
12059991919,0cyclictest0-21swapper/220:45:102
12055991918,1cyclictest18175-21apt-get20:30:111
1205399199,10cyclictest6012-21munin-node23:02:040
12053991919,0cyclictest0-21swapper/020:30:100
12063991818,0cyclictest0-21swapper/322:50:113
12063991817,1cyclictest27231-21perf20:50:003
12063991817,1cyclictest27231-21perf20:50:003
12059991818,0cyclictest31611-21apt-get00:25:122
12059991818,0cyclictest0-21swapper/223:35:122
12059991818,0cyclictest0-21swapper/223:00:112
12055991818,0cyclictest19296-21apt-get19:25:141
12053991818,0cyclictest10251-21apt-get23:40:130
12053991816,1cyclictest0-21swapper/022:05:000
12059991717,0cyclictest4453-21apt-get21:10:112
12055991717,0cyclictest0-21swapper/123:15:021
12055991717,0cyclictest0-21swapper/122:50:121
12055991717,0cyclictest0-21swapper/121:20:111
12053991717,0cyclictest0-21swapper/021:15:110
12063991616,0cyclictest0-21swapper/320:55:093
12063991615,1cyclictest28124-21apt-get22:00:123
12063991614,1cyclictest0-21swapper/323:50:003
12059991615,1cyclictest30447-21apt-get22:05:122
1205999160,15cyclictest23003-21find19:30:202
1205999160,15cyclictest14156-21grep20:20:152
12055991616,0cyclictest0-21swapper/120:55:101
12055991614,1cyclictest24913-21munin-run20:45:001
12053991614,1cyclictest5531-21fschecks_time22:20:120
12063991515,0cyclictest0-21swapper/322:55:103
12063991515,0cyclictest0-21swapper/319:10:113
12063991514,1cyclictest0-21swapper/300:00:163
12063991512,2cyclictest3576-21perf20:00:023
1206399150,14cyclictest8316-21grep21:15:203
1206399150,14cyclictest24424-21grep20:40:203
1206399150,14cyclictest0-21swapper/321:45:143
12059991515,0cyclictest0-21swapper/222:40:112
12059991515,0cyclictest0-21swapper/219:25:142
1205999150,14cyclictest6963-21expr21:15:122
1205999150,14cyclictest22582-21munin-run20:40:012
1205999150,14cyclictest17189-21grep22:45:142
12055991515,0cyclictest23669-21apt-get23:00:111
12055991515,0cyclictest17536-21apt-get23:55:121
12055991515,0cyclictest0-21swapper/122:25:121
12055991514,1cyclictest0-21swapper/121:15:191
1205599150,1cyclictest32618-21cstates21:00:141
1205599150,1cyclictest1346-21diskstats23:20:121
12053991513,1cyclictest23035-21expr20:40:120
1205399150,1cyclictest0-21swapper/000:15:130
1206399140,14cyclictest0-21swapper/323:50:263
1206399140,14cyclictest0-21swapper/323:33:463
1206399140,14cyclictest0-21swapper/323:26:023
1206399140,14cyclictest0-21swapper/322:37:463
1206399140,14cyclictest0-21swapper/322:16:553
1206399140,14cyclictest0-21swapper/321:50:333
1206399140,14cyclictest0-21swapper/321:10:163
1206399140,14cyclictest0-21swapper/321:03:023
1206399140,14cyclictest0-21swapper/320:21:443
1206399140,14cyclictest0-21swapper/320:10:583
1206399140,14cyclictest0-21swapper/319:51:013
1206399140,14cyclictest0-21swapper/319:41:063
1206399140,14cyclictest0-21swapper/319:30:193
1206399140,14cyclictest0-21swapper/300:05:083
1206399140,0cyclictest0-21swapper/321:40:193
1206399140,0cyclictest0-21swapper/320:05:353
1206399140,0cyclictest0-21swapper/300:30:423
12059991414,0cyclictest0-21swapper/222:17:502
12059991414,0cyclictest0-21swapper/219:45:122
12059991412,1cyclictest16376-21perl20:25:142
1205999140,14cyclictest1222-21perf19:55:002
1205999140,14cyclictest0-21swapper/223:48:182
1205999140,14cyclictest0-21swapper/223:41:052
1205999140,14cyclictest0-21swapper/223:27:502
1205999140,14cyclictest0-21swapper/222:30:362
1205999140,14cyclictest0-21swapper/221:57:432
1205999140,14cyclictest0-21swapper/221:23:252
1205999140,14cyclictest0-21swapper/219:24:362
1205999140,14cyclictest0-21swapper/200:21:022
1205999140,0cyclictest0-21swapper/223:14:532
1205999140,0cyclictest0-21swapper/222:35:162
1205999140,0cyclictest0-21swapper/221:31:172
1205999140,0cyclictest0-21swapper/200:35:192
12055991414,0cyclictest0-21swapper/123:12:151
12055991414,0cyclictest0-21swapper/122:05:171
12055991414,0cyclictest0-21swapper/121:51:181
12055991414,0cyclictest0-21swapper/121:45:481
12055991414,0cyclictest0-21swapper/119:11:241
1205599140,14cyclictest0-21swapper/123:32:171
1205599140,14cyclictest0-21swapper/123:06:471
1205599140,14cyclictest0-21swapper/122:39:021
1205599140,14cyclictest0-21swapper/122:15:461
1205599140,14cyclictest0-21swapper/121:25:511
1205599140,14cyclictest0-21swapper/121:10:161
1205599140,14cyclictest0-21swapper/120:46:211
1205599140,14cyclictest0-21swapper/120:46:211
1205599140,14cyclictest0-21swapper/120:00:191
1205599140,14cyclictest0-21swapper/119:50:371
1205599140,14cyclictest0-21swapper/119:43:241
1205599140,14cyclictest0-21swapper/119:30:591
1205599140,14cyclictest0-21swapper/100:05:161
1205599140,0cyclictest0-21swapper/123:50:221
1205599140,0cyclictest0-21swapper/122:00:161
1205599140,0cyclictest0-21swapper/121:55:431
1205599140,0cyclictest0-21swapper/120:35:101
1205599140,0cyclictest0-21swapper/120:20:111
1205599140,0cyclictest0-21swapper/119:20:131
1205599140,0cyclictest0-21swapper/100:30:581
1205599140,0cyclictest0-21swapper/100:25:251
12053991414,0cyclictest0-21swapper/023:20:220
12053991414,0cyclictest0-21swapper/022:15:460
12053991414,0cyclictest0-21swapper/021:20:290
12053991414,0cyclictest0-21swapper/019:40:130
12053991414,0cyclictest0-21swapper/019:13:210
1205399140,14cyclictest0-21swapper/023:51:310
1205399140,14cyclictest0-21swapper/023:19:000
1205399140,14cyclictest0-21swapper/022:54:280
1205399140,14cyclictest0-21swapper/022:40:090
1205399140,14cyclictest0-21swapper/021:40:140
1205399140,14cyclictest0-21swapper/021:35:570
1205399140,14cyclictest0-21swapper/021:05:220
1205399140,14cyclictest0-21swapper/021:02:340
1205399140,14cyclictest0-21swapper/020:51:380
1205399140,14cyclictest0-21swapper/020:02:330
1205399140,14cyclictest0-21swapper/019:55:020
1205399140,14cyclictest0-21swapper/019:15:230
1205399140,14cyclictest0-21swapper/000:10:020
1205399140,14cyclictest0-21swapper/000:00:180
1205399140,0cyclictest0-21swapper/022:46:080
1205399140,0cyclictest0-21swapper/021:25:030
1205399140,0cyclictest0-21swapper/019:21:130
12063991313,0cyclictest26737-21modprobe23:05:153
12063991313,0cyclictest0-21swapper/320:15:433
12063991313,0cyclictest0-21swapper/300:37:183
1206399130,13cyclictest0-21swapper/300:27:423
12059991313,0cyclictest0-21swapper/223:05:212
12059991313,0cyclictest0-21swapper/221:46:082
12059991313,0cyclictest0-21swapper/220:10:022
1205999130,0cyclictest0-21swapper/220:18:272
12055991313,0cyclictest0-21swapper/122:55:171
12053991313,0cyclictest0-21swapper/023:36:110
12063991111,0cyclictest0-21swapper/323:10:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional