You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 04:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5.osadl.org (updated Mon May 05, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1177799330,15cyclictest0-21swapper/320:50:323
11766993232,0cyclictest0-21swapper/020:55:150
11773993027,2cyclictest12256-21munin-run20:20:022
1177399300,2cyclictest5193-21cron20:05:012
1177199300,29cyclictest21216-21idleruntime-cro00:05:011
1177199300,29cyclictest1-21systemd22:25:001
1176699300,29cyclictest609-21dbus-daemon23:25:020
1176699300,29cyclictest0-21swapper/019:25:020
1176699300,1cyclictest303-21systemd-journal23:45:000
1177799290,28cyclictest3870-21apt-get22:20:123
1177799290,28cyclictest0-21swapper/320:10:153
11773992928,1cyclictest0-21swapper/221:15:142
11771992928,1cyclictest20850irq/141-nvme0q221:05:001
1177199290,28cyclictest15865-21apt-get22:45:171
1177199290,28cyclictest0-21swapper/120:20:161
11766992928,1cyclictest7554-21cron20:10:020
1176699290,28cyclictest5986-21perf22:25:010
1176699290,28cyclictest0-21swapper/020:25:160
1176699290,28cyclictest0-21swapper/000:00:140
11777992828,0cyclictest0-21swapper/319:30:143
1177799280,28cyclictest0-21swapper/300:25:133
1177799280,0cyclictest2404-21apt-get23:25:123
11773992827,1cyclictest0-21swapper/223:10:022
1177399280,28cyclictest0-21swapper/223:45:152
1177399280,1cyclictest8566-21apt-get22:30:122
1177399280,0cyclictest22842-21apt-get23:00:132
11771992828,0cyclictest0-21swapper/120:50:141
11771992828,0cyclictest0-21swapper/119:35:141
11771992827,1cyclictest24359-21awk21:55:001
11771992826,1cyclictest28336-21munin-run19:45:011
11766992828,0cyclictest0-21swapper/019:15:130
1176699280,28cyclictest0-21swapper/022:15:160
1176699280,0cyclictest0-21swapper/023:35:140
11777992727,0cyclictest0-21swapper/321:25:133
1177799270,0cyclictest0-21swapper/322:55:183
11773992725,1cyclictest31336-21cron22:10:002
11773992725,1cyclictest21543-21perf20:40:002
1177399270,0cyclictest30156-21apt-get23:15:122
11771992727,0cyclictest29305-21apt-get22:05:131
11771992727,0cyclictest18183-21apt-get22:50:131
11771992727,0cyclictest0-21swapper/123:35:141
11771992727,0cyclictest0-21swapper/120:35:131
11771992727,0cyclictest0-21swapper/119:20:161
1177199270,0cyclictest0-21swapper/121:05:131
11766992727,0cyclictest0-21swapper/023:15:130
11766992727,0cyclictest0-21swapper/020:35:140
11766992727,0cyclictest0-21swapper/000:35:110
11766992726,1cyclictest23935-21apt-get19:35:140
11766992726,1cyclictest14769-21apt-get21:35:020
11766992726,1cyclictest14769-21apt-get21:35:010
11777992626,0cyclictest0-21swapper/322:40:133
11777992626,0cyclictest0-21swapper/321:00:183
11773992626,0cyclictest0-21swapper/222:35:152
11773992626,0cyclictest0-21swapper/221:55:162
11773992626,0cyclictest0-21swapper/200:00:142
11771992626,0cyclictest16717-21apt-get23:55:141
11771992626,0cyclictest0-21swapper/123:40:131
11771992626,0cyclictest0-21swapper/119:55:131
11771992625,1cyclictest3350-21apt-get21:10:121
11766992626,0cyclictest0-21swapper/022:40:130
11766992626,0cyclictest0-21swapper/022:25:130
11766992626,0cyclictest0-21swapper/021:30:160
11766992626,0cyclictest0-21swapper/020:50:130
11766992625,1cyclictest5727-21apt-get21:15:140
11766992625,1cyclictest30654-21perf19:50:000
11777992525,0cyclictest0-21swapper/320:15:183
11777992525,0cyclictest0-21swapper/300:10:153
11773992525,0cyclictest8070-21apt-get21:20:142
11773992525,0cyclictest0-21swapper/222:45:172
11773992523,1cyclictest14769-21apt-get21:35:002
11773992523,1cyclictest0-21swapper/220:30:002
11771992525,0cyclictest0-21swapper/122:15:141
11771992525,0cyclictest0-21swapper/100:25:131
11766992525,0cyclictest0-21swapper/023:25:130
11777992424,0cyclictest0-21swapper/323:45:143
11777992424,0cyclictest0-21swapper/323:30:133
11777992424,0cyclictest0-21swapper/322:25:123
11777992424,0cyclictest0-21swapper/300:00:153
11773992424,0cyclictest0-21swapper/221:10:122
11771992424,0cyclictest0-21swapper/123:05:121
11771992424,0cyclictest0-21swapper/119:10:141
11766992424,0cyclictest0-21swapper/022:30:130
11766992424,0cyclictest0-21swapper/021:40:150
11766992424,0cyclictest0-21swapper/021:25:140
11766992422,1cyclictest1-21systemd20:00:010
11777992323,0cyclictest0-21swapper/323:50:033
11777992323,0cyclictest0-21swapper/322:05:133
11777992323,0cyclictest0-21swapper/319:50:133
11777992323,0cyclictest0-21swapper/319:35:143
11777992321,1cyclictest0-21swapper/322:05:013
1177799231,4cyclictest0-21swapper/321:35:193
1177799231,4cyclictest0-21swapper/321:35:193
11773992323,0cyclictest28479-21apt-get00:20:132
11773992323,0cyclictest0-21swapper/200:15:122
11771992323,0cyclictest0-21swapper/123:00:131
11777992222,0cyclictest0-21swapper/323:15:133
11777992222,0cyclictest0-21swapper/320:30:163
11773992221,1cyclictest4724-21apt-get23:30:132
1177399220,19cyclictest28-21ksoftirqd/219:10:142
11771992222,0cyclictest0-21swapper/123:10:141
11771992222,0cyclictest0-21swapper/120:25:151
11771992222,0cyclictest0-21swapper/119:45:151
11771992221,1cyclictest615-21rs:main1
11766992221,1cyclictest12524-21apt-get20:20:160
11766992220,1cyclictest303-21systemd-journal20:34:590
11766992220,1cyclictest2741-21cron00:35:010
11777992121,0cyclictest0-21swapper/321:40:153
11773992121,0cyclictest31130-21apt-get21:00:182
11773992121,0cyclictest0-21swapper/223:20:142
11771992121,0cyclictest0-21swapper/120:05:181
11771992120,1cyclictest685-21apt-get00:30:161
11766992121,0cyclictest0-21swapper/023:05:130
11766992121,0cyclictest0-21swapper/021:45:110
11766992120,1cyclictest30801-21apt-get00:25:140
11777992020,0cyclictest0-21swapper/323:20:143
11777992020,0cyclictest0-21swapper/323:10:033
11777992020,0cyclictest0-21swapper/320:55:153
11773992020,0cyclictest14395-21apt-get23:50:152
11773992020,0cyclictest0-21swapper/219:50:132
11773992018,1cyclictest609-21dbus-daemon23:00:012
11771992020,0cyclictest0-21swapper/119:30:151
11771992019,1cyclictest0-21swapper/120:45:001
11766992020,0cyclictest0-21swapper/019:30:150
11777991919,0cyclictest0-21swapper/300:05:193
11771991919,0cyclictest0-21swapper/120:15:181
11777991818,0cyclictest0-21swapper/321:15:153
11773991816,1cyclictest23524-21cron00:10:012
11771991818,0cyclictest0-21swapper/122:00:141
11771991818,0cyclictest0-21swapper/121:30:161
11771991817,1cyclictest28788-21apt-get20:55:161
11771991817,0cyclictest14319-21apt-get19:15:131
11766991818,0cyclictest0-21swapper/020:10:170
11766991818,0cyclictest0-21swapper/000:10:150
11766991818,0cyclictest0-21swapper/000:05:180
1177799173,3cyclictest0-21swapper/319:45:153
11777991717,0cyclictest0-21swapper/321:45:113
11773991717,0cyclictest7101-21apt-get23:35:132
11771991717,0cyclictest24147-21apt-get20:45:141
1177199170,10cyclictest303-21systemd-journal23:50:011
11766991717,0cyclictest0-21swapper/023:50:020
11766991715,1cyclictest609-21dbus-daemon19:15:010
11777991616,0cyclictest0-21swapper/300:15:123
11773991616,0cyclictest26273-21apt-get19:40:132
11773991616,0cyclictest21031-21apt-get19:30:022
11773991616,0cyclictest0-21swapper/223:55:142
11773991614,1cyclictest0-21swapper/222:50:152
11773991613,3cyclictest0-21swapper/220:32:102
11773991613,2cyclictest2403-21awk19:55:222
11771991616,0cyclictest19230-21perf20:35:001
11771991616,0cyclictest0-21swapper/121:25:131
11771991616,0cyclictest0-21swapper/119:25:161
1177199160,2cyclictest13736-21cut22:40:151
1177199160,15cyclictest3455-21ntp_states23:25:181
1177199160,15cyclictest10750-21munin-run22:35:021
11766991616,0cyclictest28479-21apt-get00:20:140
11766991614,1cyclictest29822-21fschecks_time22:05:140
1176699160,15cyclictest10977-21irqstats20:15:210
11777991514,1cyclictest18760-40mandb00:00:023
1177799150,1cyclictest21259-21taskset20:36:523
1177799150,14cyclictest0-21swapper/319:20:023
11773991515,0cyclictest0-21swapper/222:25:132
11773991513,1cyclictest303-21systemd-journal22:15:002
11773991513,1cyclictest0-21swapper/220:50:212
11773991512,2cyclictest4388-21fschecks_time22:20:142
1177399150,1cyclictest0-21swapper/221:45:182
11771991515,0cyclictest11770-21apt-get23:45:151
1177199150,14cyclictest23819-21apt-get00:10:141
11766991513,1cyclictest0-21swapper/023:35:010
1176699150,1cyclictest0-21swapper/022:45:180
1176699150,14cyclictest31626-21apt-get22:10:140
1176699150,14cyclictest27786-21apt-get23:10:130
1176699150,14cyclictest1447-21diskstats21:05:150
11777991414,0cyclictest0-21swapper/322:31:093
11777991414,0cyclictest0-21swapper/300:31:023
11777991414,0cyclictest0-21swapper/300:20:293
1177799140,14cyclictest0-21swapper/323:41:233
1177799140,14cyclictest0-21swapper/323:37:423
1177799140,14cyclictest0-21swapper/323:09:083
1177799140,14cyclictest0-21swapper/322:51:563
1177799140,14cyclictest0-21swapper/322:45:553
1177799140,14cyclictest0-21swapper/322:39:023
1177799140,14cyclictest0-21swapper/322:17:173
1177799140,14cyclictest0-21swapper/322:14:053
1177799140,14cyclictest0-21swapper/321:55:543
1177799140,14cyclictest0-21swapper/321:20:483
1177799140,14cyclictest0-21swapper/321:08:193
1177799140,14cyclictest0-21swapper/320:47:143
1177799140,14cyclictest0-21swapper/320:41:013
1177799140,14cyclictest0-21swapper/320:27:503
1177799140,14cyclictest0-21swapper/320:20:183
1177799140,14cyclictest0-21swapper/320:05:133
1177799140,14cyclictest0-21swapper/320:01:343
1177799140,14cyclictest0-21swapper/319:55:033
1177799140,14cyclictest0-21swapper/319:40:093
1177799140,14cyclictest0-21swapper/319:26:003
1177799140,14cyclictest0-21swapper/319:13:043
1177799140,0cyclictest0-21swapper/323:04:523
1177799140,0cyclictest0-21swapper/321:53:173
1177799140,0cyclictest0-21swapper/321:31:013
1177799140,0cyclictest0-21swapper/300:35:103
11773991414,0cyclictest0-21swapper/220:56:432
11773991413,1cyclictest0-21swapper/200:10:212
1177399140,14cyclictest0-21swapper/223:41:272
1177399140,14cyclictest0-21swapper/222:40:132
1177399140,14cyclictest0-21swapper/222:15:322
1177399140,14cyclictest0-21swapper/221:40:232
1177399140,14cyclictest0-21swapper/221:37:182
1177399140,14cyclictest0-21swapper/221:37:182
1177399140,14cyclictest0-21swapper/221:29:032
1177399140,14cyclictest0-21swapper/221:05:202
1177399140,14cyclictest0-21swapper/220:43:062
1177399140,14cyclictest0-21swapper/220:13:102
1177399140,14cyclictest0-21swapper/220:05:052
1177399140,14cyclictest0-21swapper/219:45:362
1177399140,14cyclictest0-21swapper/219:28:212
1177399140,14cyclictest0-21swapper/219:23:442
1177399140,14cyclictest0-21swapper/219:15:212
1177399140,14cyclictest0-21swapper/200:31:572
1177399140,14cyclictest0-21swapper/200:27:502
1177399140,0cyclictest0-21swapper/221:51:002
1177399140,0cyclictest0-21swapper/220:20:202
1177399140,0cyclictest0-21swapper/219:35:142
11771991414,0cyclictest0-21swapper/122:55:171
11771991414,0cyclictest0-21swapper/122:25:151
11771991414,0cyclictest0-21swapper/121:55:021
11771991414,0cyclictest0-21swapper/121:46:251
1177199140,14cyclictest0-21swapper/123:30:461
1177199140,14cyclictest0-21swapper/123:21:311
1177199140,14cyclictest0-21swapper/122:37:241
1177199140,14cyclictest0-21swapper/122:12:211
1177199140,14cyclictest0-21swapper/121:41:451
1177199140,14cyclictest0-21swapper/121:21:131
1177199140,14cyclictest0-21swapper/120:00:161
1177199140,14cyclictest0-21swapper/119:50:501
1177199140,14cyclictest0-21swapper/100:06:321
1177199140,0cyclictest0-21swapper/123:15:451
1177199140,0cyclictest0-21swapper/121:35:421
1177199140,0cyclictest0-21swapper/121:35:421
1177199140,0cyclictest0-21swapper/121:15:061
1177199140,0cyclictest0-21swapper/100:35:451
11766991414,0cyclictest0-21swapper/020:46:580
11766991414,0cyclictest0-21swapper/020:40:090
11766991413,1cyclictest19567-21find22:50:210
1176699140,14cyclictest32125-21strings21:00:220
1176699140,14cyclictest23716-21grep21:50:230
1176699140,14cyclictest0-21swapper/023:57:040
1176699140,14cyclictest0-21swapper/023:45:130
1176699140,14cyclictest0-21swapper/023:02:210
1176699140,14cyclictest0-21swapper/022:01:490
1176699140,14cyclictest0-21swapper/019:25:330
1176699140,14cyclictest0-21swapper/000:17:480
1176699140,0cyclictest0-21swapper/022:55:450
1176699140,0cyclictest0-21swapper/022:36:020
1176699140,0cyclictest0-21swapper/021:55:160
1176699140,0cyclictest0-21swapper/021:10:390
1176699140,0cyclictest0-21swapper/020:00:260
1176699140,0cyclictest0-21swapper/019:50:120
1176699140,0cyclictest0-21swapper/019:43:310
1177799130,0cyclictest0-21swapper/321:11:553
1177799130,0cyclictest0-21swapper/319:20:203
11773991312,1cyclictest3924-21memory00:35:152
1177399130,0cyclictest0-21swapper/223:28:202
1177399130,0cyclictest0-21swapper/220:45:322
11771991313,0cyclictest0-21swapper/100:22:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional