You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 05:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Fri May 09, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2641999310,30cyclictest19912-21turbostat.cron20:05:023
2641599310,27cyclictest13711-21apt-get00:25:132
2641399310,30cyclictest8147-21cron00:15:001
2641399310,30cyclictest12922-21sh19:50:011
26409993028,1cyclictest27442-21sh21:30:000
2640999300,1cyclictest32136-21cron21:40:010
26419992927,1cyclictest609-21dbus-daemon23:40:013
2641999290,28cyclictest16030-21apt-get00:30:133
2641999290,28cyclictest10440-21apt-get23:10:133
26415992928,0cyclictest26741-21apt-get23:45:132
2641599290,1cyclictest303-21systemd-journal00:10:012
2641599290,1cyclictest2870-21awk22:55:002
2641599290,1cyclictest18124-21apt-get21:10:122
26413992928,1cyclictest22-21ksoftirqd/122:30:011
2641399290,28cyclictest0-21swapper/100:00:171
2641399290,1cyclictest0-21swapper/121:05:001
2640999290,28cyclictest0-21swapper/019:15:130
2640999290,28cyclictest0-21swapper/000:25:130
26419992828,0cyclictest28557-21apt-get22:40:133
26419992828,0cyclictest1776-21apt-get20:35:103
26419992828,0cyclictest0-21swapper/320:25:133
26419992828,0cyclictest0-21swapper/320:10:143
26419992826,1cyclictest4391-21cron21:50:013
2641999280,0cyclictest31434-21apt-get23:55:133
2641999280,0cyclictest0-21swapper/322:55:133
26413992828,0cyclictest0-21swapper/120:40:101
2641399280,0cyclictest27734-21apt-get21:30:121
26409992828,0cyclictest11960-21apt-get22:05:140
26409992828,0cyclictest0-21swapper/023:20:170
26409992828,0cyclictest0-21swapper/019:20:090
2640999280,0cyclictest0-21swapper/022:10:120
26419992727,0cyclictest23090-21apt-get21:20:143
2641999270,0cyclictest0-21swapper/320:20:103
26415992727,0cyclictest4123-21apt-get20:40:122
26415992727,0cyclictest0-21swapper/223:00:122
26415992727,0cyclictest0-21swapper/200:00:152
2641599270,0cyclictest0-21swapper/220:50:102
26413992727,0cyclictest20440-21apt-get21:15:121
26413992727,0cyclictest0-21swapper/121:45:131
26413992727,0cyclictest0-21swapper/120:45:141
26413992727,0cyclictest0-21swapper/119:40:121
26413992725,1cyclictest611-21avahi-daemon19:20:011
26409992727,0cyclictest0-21swapper/023:55:130
26409992727,0cyclictest0-21swapper/022:55:130
26409992727,0cyclictest0-21swapper/020:25:130
2640999270,0cyclictest0-21swapper/019:55:120
26419992626,0cyclictest0-21swapper/321:50:153
26419992624,1cyclictest14794-21cron23:20:003
26419992623,2cyclictest28778-21cron23:50:013
26415992626,0cyclictest0-21swapper/223:50:112
26415992626,0cyclictest0-21swapper/220:55:142
26415992626,0cyclictest0-21swapper/200:10:152
26415992624,1cyclictest303-21systemd-journal19:40:012
26413992626,0cyclictest0-21swapper/123:25:161
26413992626,0cyclictest0-21swapper/120:30:131
26409992626,0cyclictest0-21swapper/023:10:130
26409992626,0cyclictest0-21swapper/022:45:010
26409992626,0cyclictest0-21swapper/019:35:140
26419992525,0cyclictest8566-21apt-get19:40:113
26419992525,0cyclictest25413-21apt-get21:25:183
26419992525,0cyclictest15530-21apt-get19:55:133
26415992525,0cyclictest23886-21apt-get22:30:122
26415992525,0cyclictest0-21swapper/223:05:142
26415992525,0cyclictest0-21swapper/222:00:142
26415992525,0cyclictest0-21swapper/221:15:112
26415992523,1cyclictest609-21dbus-daemon23:30:002
26413992525,0cyclictest0-21swapper/121:50:151
26415992424,0cyclictest0-21swapper/220:45:142
26415992424,0cyclictest0-21swapper/200:20:022
26415992422,1cyclictest3808-21cron20:40:012
26413992424,0cyclictest31673-21apt-get19:20:091
26413992424,0cyclictest11379-21apt-get22:05:021
26413992424,0cyclictest0-21swapper/123:30:141
26413992424,0cyclictest0-21swapper/123:15:111
26413992424,0cyclictest0-21swapper/119:25:131
26409992424,0cyclictest0-21swapper/023:15:110
26409992424,0cyclictest0-21swapper/020:20:110
26409992424,0cyclictest0-21swapper/019:45:130
26419992323,0cyclictest0-21swapper/322:10:123
26419992323,0cyclictest0-21swapper/322:05:133
26419992323,0cyclictest0-21swapper/321:05:123
26415992323,0cyclictest0-21swapper/222:05:012
26415992323,0cyclictest0-21swapper/219:10:132
26415992319,3cyclictest24410-21apt-get23:40:132
26409992323,0cyclictest0-21swapper/022:15:130
26409992323,0cyclictest0-21swapper/020:15:130
26409992323,0cyclictest0-21swapper/020:00:120
26409992323,0cyclictest0-21swapper/000:35:140
26419992222,0cyclictest18350-21apt-get00:35:133
26419992222,0cyclictest10891-21apt-get19:45:133
26419992222,0cyclictest0-21swapper/300:20:033
26419992220,1cyclictest303-21systemd-journal22:20:013
26413992222,0cyclictest0-21swapper/123:00:131
26413992222,0cyclictest0-21swapper/121:10:141
26413992221,1cyclictest16304-21cron22:15:011
26413992219,2cyclictest17132-21cron23:25:001
26409992222,0cyclictest0-21swapper/019:40:110
26409992220,1cyclictest10830-21munin-run00:20:010
26419992121,0cyclictest0-21swapper/319:15:143
26415992121,0cyclictest0-21swapper/219:25:142
26413992121,0cyclictest1094-40mandb00:00:021
26409992121,0cyclictest0-21swapper/023:35:130
26409992121,0cyclictest0-21swapper/019:30:140
26419992020,0cyclictest31879-21apt-get20:30:133
26415992020,0cyclictest0-21swapper/221:30:142
26415992018,2cyclictest4677-21apt-get21:50:152
26413992020,0cyclictest0-21swapper/122:50:131
26413992020,0cyclictest0-21swapper/100:05:131
26409992020,0cyclictest0-21swapper/021:20:140
26409992020,0cyclictest0-21swapper/000:30:130
26409992019,1cyclictest824-21apt-get22:50:140
26419991919,0cyclictest26655-21apt-get19:10:113
26419991919,0cyclictest0-21swapper/319:50:113
26415991919,0cyclictest32449-21apt-get21:40:122
26409991917,1cyclictest0-21swapper/023:45:020
26415991818,0cyclictest0-21swapper/220:05:132
26409991818,0cyclictest0-21swapper/022:30:120
2640999181,14cyclictest611-21avahi-daemon22:00:220
26419991717,0cyclictest6231-21apt-get19:35:133
26415991717,0cyclictest0-21swapper/222:20:122
26409991716,1cyclictest15276-21perf19:55:010
26409991715,1cyclictest22503-21apt-get21:20:000
26419991616,0cyclictest0-21swapper/323:20:183
26419991614,1cyclictest0-21swapper/320:40:163
2641599162,5cyclictest0-21swapper/220:30:132
26415991614,1cyclictest0-21swapper/220:15:002
2641599160,0cyclictest0-21swapper/220:16:012
26413991616,0cyclictest18942-21apt-get22:20:111
26413991616,0cyclictest0-21swapper/123:40:131
26413991614,1cyclictest17858-21munin-run21:10:001
26413991614,1cyclictest0-21swapper/123:50:141
26409991614,1cyclictest0-21swapper/000:20:150
2640999160,15cyclictest497-21fschecks_time21:40:140
2640999160,15cyclictest468-21ntp_states20:30:180
26419991515,0cyclictest0-21swapper/322:45:133
26419991515,0cyclictest0-21swapper/319:30:133
2641999150,1cyclictest0-21swapper/322:30:183
2641999150,14cyclictest7515-21perl21:55:123
2641999150,14cyclictest19365-21diskstats22:20:123
2641999150,14cyclictest0-21swapper/321:40:243
2641999150,14cyclictest0-21swapper/320:55:183
2641999150,14cyclictest0-21swapper/300:15:003
26415991515,0cyclictest26210-21apt-get22:35:132
26415991515,0cyclictest0-21swapper/222:45:132
26415991513,1cyclictest0-21swapper/221:05:122
26415991512,2cyclictest27028-21grep21:25:262
2641599150,15cyclictest0-21swapper/223:56:312
2641599150,15cyclictest0-21swapper/200:15:082
2641599150,14cyclictest0-21swapper/222:10:202
2641599150,0cyclictest0-21swapper/222:19:422
2641599150,0cyclictest0-21swapper/200:34:542
26413991515,0cyclictest0-21swapper/120:05:131
26413991514,0cyclictest0-21swapper/121:40:121
26413991513,1cyclictest0-21swapper/100:35:011
26409991515,0cyclictest0-21swapper/023:25:160
26409991513,1cyclictest6740-21perf21:55:000
26409991513,1cyclictest0-21swapper/020:35:170
2640999150,14cyclictest21843-21sed23:35:000
2640999150,14cyclictest0-21swapper/022:35:150
2641999142,8cyclictest1578-21apt-get19:25:133
26419991414,0cyclictest0-21swapper/300:05:133
2641999140,14cyclictest0-21swapper/323:52:093
2641999140,14cyclictest0-21swapper/323:00:113
2641999140,14cyclictest0-21swapper/322:53:533
2641999140,14cyclictest0-21swapper/322:36:053
2641999140,14cyclictest0-21swapper/322:25:523
2641999140,14cyclictest0-21swapper/322:01:063
2641999140,14cyclictest0-21swapper/321:39:153
2641999140,14cyclictest0-21swapper/321:30:063
2641999140,14cyclictest0-21swapper/321:18:433
2641999140,14cyclictest0-21swapper/321:10:343
2641999140,14cyclictest0-21swapper/320:50:043
2641999140,14cyclictest0-21swapper/320:05:163
2641999140,14cyclictest0-21swapper/319:22:213
2641999140,14cyclictest0-21swapper/300:01:423
2641999140,0cyclictest0-21swapper/323:41:023
2641999140,0cyclictest0-21swapper/323:32:273
2641999140,0cyclictest0-21swapper/323:25:033
2641999140,0cyclictest0-21swapper/323:09:573
2641999140,0cyclictest0-21swapper/321:00:043
2641999140,0cyclictest0-21swapper/320:45:293
2641999140,0cyclictest0-21swapper/320:15:273
2641999140,0cyclictest0-21swapper/300:25:163
2641999140,0cyclictest0-21swapper/300:16:593
26415991414,0cyclictest0-21swapper/223:11:382
26415991414,0cyclictest0-21swapper/221:55:102
26415991414,0cyclictest0-21swapper/221:21:172
26415991413,1cyclictest0-21swapper/219:40:412
26415991413,1cyclictest0-21swapper/219:24:102
2641599140,14cyclictest0-21swapper/223:30:012
2641599140,14cyclictest0-21swapper/222:56:542
2641599140,14cyclictest0-21swapper/222:27:252
2641599140,14cyclictest0-21swapper/221:45:282
2641599140,14cyclictest0-21swapper/221:00:422
2641599140,14cyclictest0-21swapper/220:27:232
2641599140,14cyclictest0-21swapper/220:20:352
2641599140,14cyclictest0-21swapper/219:56:012
2641599140,14cyclictest0-21swapper/219:50:352
2641599140,14cyclictest0-21swapper/219:31:462
2641599140,14cyclictest0-21swapper/219:15:542
2641599140,14cyclictest0-21swapper/200:35:292
2641599140,0cyclictest0-21swapper/223:35:052
2641599140,0cyclictest0-21swapper/223:20:102
2641599140,0cyclictest0-21swapper/223:16:212
2641599140,0cyclictest0-21swapper/219:47:292
26413991414,0cyclictest0-21swapper/122:41:081
26413991413,1cyclictest0-21swapper/100:25:131
2641399140,14cyclictest0-21swapper/123:09:021
2641399140,14cyclictest0-21swapper/122:36:141
2641399140,14cyclictest0-21swapper/122:30:431
2641399140,14cyclictest0-21swapper/122:01:101
2641399140,14cyclictest0-21swapper/121:56:331
2641399140,14cyclictest0-21swapper/121:28:341
2641399140,14cyclictest0-21swapper/120:35:311
2641399140,14cyclictest0-21swapper/120:25:191
2641399140,14cyclictest0-21swapper/120:21:191
2641399140,14cyclictest0-21swapper/120:16:531
2641399140,14cyclictest0-21swapper/120:10:031
2641399140,14cyclictest0-21swapper/120:02:321
2641399140,14cyclictest0-21swapper/119:55:421
2641399140,14cyclictest0-21swapper/119:50:051
2641399140,14cyclictest0-21swapper/119:36:251
2641399140,14cyclictest0-21swapper/119:30:041
2641399140,14cyclictest0-21swapper/100:35:571
2641399140,14cyclictest0-21swapper/100:21:451
2641399140,0cyclictest0-21swapper/123:46:251
2641399140,0cyclictest0-21swapper/123:36:211
2641399140,0cyclictest0-21swapper/123:10:261
2641399140,0cyclictest0-21swapper/122:55:401
2641399140,0cyclictest0-21swapper/122:49:021
2641399140,0cyclictest0-21swapper/122:15:151
2641399140,0cyclictest0-21swapper/121:35:181
2641399140,0cyclictest0-21swapper/120:55:311
2641399140,0cyclictest0-21swapper/120:52:041
2641399140,0cyclictest0-21swapper/119:12:231
2641399140,0cyclictest0-21swapper/100:15:021
26409991414,0cyclictest0-21swapper/021:55:110
26409991414,0cyclictest0-21swapper/021:30:070
26409991414,0cyclictest0-21swapper/020:50:340
26409991414,0cyclictest0-21swapper/000:10:010
26409991412,1cyclictest31555-21cut22:45:160
2640999140,14cyclictest0-21swapper/023:50:450
2640999140,14cyclictest0-21swapper/023:45:090
2640999140,14cyclictest0-21swapper/023:05:210
2640999140,14cyclictest0-21swapper/022:24:240
2640999140,14cyclictest0-21swapper/021:01:280
2640999140,14cyclictest0-21swapper/020:55:190
2640999140,14cyclictest0-21swapper/020:10:550
2640999140,14cyclictest0-21swapper/020:06:270
2640999140,14cyclictest0-21swapper/019:26:480
2640999140,14cyclictest0-21swapper/000:05:210
2640999140,0cyclictest0-21swapper/023:00:230
2640999140,0cyclictest0-21swapper/022:29:080
2640999140,0cyclictest0-21swapper/021:45:020
2640999140,0cyclictest0-21swapper/021:11:580
2640999140,0cyclictest0-21swapper/021:06:290
2640999140,0cyclictest0-21swapper/020:42:260
2640999140,0cyclictest0-21swapper/019:13:150
2640999140,0cyclictest0-21swapper/000:00:310
26415991313,0cyclictest0-21swapper/222:42:052
26415991313,0cyclictest0-21swapper/220:00:312
26415991311,1cyclictest30632-21perl21:35:142
26413991313,0cyclictest0-21swapper/121:20:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional