You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 05:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Mon Dec 15, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2549799300,2cyclictest1657-21cron21:05:003
2549799290,28cyclictest4700-21apt-get21:50:133
2549799290,28cyclictest0-21swapper/319:25:133
25496992927,1cyclictest28850-21apt-get23:50:132
25496992927,1cyclictest26057-21munin-run20:20:002
2549699290,28cyclictest0-21swapper/223:15:112
2549699290,28cyclictest0-21swapper/220:10:132
2549599290,28cyclictest0-21swapper/123:50:011
2549499290,28cyclictest2889-21apt-get22:55:110
2549499290,28cyclictest21656-21apt-get20:10:140
2549499290,28cyclictest10541-21apt-get00:20:140
2549499290,28cyclictest0-21swapper/023:50:130
2549499290,28cyclictest0-21swapper/022:35:130
2549499290,1cyclictest10555-21cron20:55:010
2549499290,1cyclictest0-21swapper/023:20:010
25497992828,0cyclictest0-21swapper/320:50:123
25497992826,1cyclictest649-21gdbus23:40:013
2549799280,28cyclictest0-21swapper/323:25:123
25496992828,0cyclictest31632-21apt-get20:30:112
25496992828,0cyclictest0-21swapper/221:05:122
25496992826,1cyclictest28048-21sh22:40:002
2549699280,0cyclictest0-21swapper/222:05:252
25495992828,0cyclictest19336-21apt-get20:05:131
25495992827,0cyclictest7552-21apt-get23:05:101
25495992826,1cyclictest32207-21munin-run21:40:011
2549599280,27cyclictest0-21swapper/122:30:131
2549599280,27cyclictest0-21swapper/119:35:131
2549499280,28cyclictest0-21swapper/020:00:110
2549499280,0cyclictest0-21swapper/019:15:110
25497992727,0cyclictest0-21swapper/323:10:133
25497992727,0cyclictest0-21swapper/319:45:133
2549799270,0cyclictest0-21swapper/319:10:093
25496992727,0cyclictest0-21swapper/221:50:132
25496992727,0cyclictest0-21swapper/221:15:122
25496992727,0cyclictest0-21swapper/220:05:132
25496992724,2cyclictest27837-21cron19:15:012
2549699270,27cyclictest0-21swapper/222:25:092
25495992727,0cyclictest0-21swapper/122:50:131
25495992727,0cyclictest0-21swapper/121:30:111
25495992726,1cyclictest19484-21apt-get23:30:121
2549599270,27cyclictest0-21swapper/123:55:121
2549599270,27cyclictest0-21swapper/122:55:121
2549599270,0cyclictest7712-21apt-get19:40:111
2549599270,0cyclictest0-21swapper/121:05:001
25494992727,0cyclictest0-21swapper/019:55:120
25494992727,0cyclictest0-21swapper/019:55:120
25494992727,0cyclictest0-21swapper/019:45:130
25494992726,1cyclictest621-21dbus-daemon23:50:000
25494992725,1cyclictest0-21swapper/000:20:010
2549499270,27cyclictest0-21swapper/020:20:130
25497992626,0cyclictest25425-21apt-get21:25:123
25497992626,0cyclictest0-21swapper/322:15:013
25497992626,0cyclictest0-21swapper/320:00:103
25496992626,0cyclictest0-21swapper/223:35:122
25496992626,0cyclictest0-21swapper/222:15:132
25496992626,0cyclictest0-21swapper/200:25:112
25495992626,0cyclictest0-21swapper/122:20:131
25495992626,0cyclictest0-21swapper/120:50:121
25495992626,0cyclictest0-21swapper/100:30:011
25495992626,0cyclictest0-21swapper/100:10:121
25495992625,0cyclictest17164-21apt-get23:25:131
25494992626,0cyclictest0-21swapper/019:40:120
25494992625,1cyclictest15538-21perf21:05:000
25497992525,0cyclictest522-21apt-get22:50:133
25497992525,0cyclictest0-21swapper/321:35:263
25496992525,0cyclictest0-21swapper/222:00:122
25496992523,1cyclictest7928-21munin-run00:15:012
25495992525,0cyclictest3885-21apt-get20:40:121
25495992525,0cyclictest0-21swapper/120:30:101
25494992525,0cyclictest0-21swapper/022:30:130
25494992525,0cyclictest0-21swapper/022:15:130
25494992525,0cyclictest0-21swapper/021:55:110
25494992525,0cyclictest0-21swapper/020:35:170
25494992525,0cyclictest0-21swapper/019:35:130
25497992424,0cyclictest8188-21apt-get00:15:113
25497992424,0cyclictest0-21swapper/322:40:113
25497992424,0cyclictest0-21swapper/322:05:253
25496992424,0cyclictest0-21swapper/222:40:122
25495992424,0cyclictest0-21swapper/123:10:121
25495992424,0cyclictest0-21swapper/120:25:121
25495992422,1cyclictest9399-21munin-run22:00:001
25494992424,0cyclictest31171-21apt-get23:55:130
25494992424,0cyclictest0-21swapper/021:30:110
25494992424,0cyclictest0-21swapper/020:05:130
25494992422,1cyclictest14883-21cron00:30:010
25497992323,0cyclictest0-21swapper/322:25:103
25495992323,0cyclictest0-21swapper/120:10:141
25495992323,0cyclictest0-21swapper/119:45:131
25495992323,0cyclictest0-21swapper/119:30:121
25495992323,0cyclictest0-21swapper/100:20:141
25495992323,0cyclictest0-21swapper/100:15:131
25495992321,1cyclictest26631-21apt-get20:20:121
25494992323,0cyclictest5866-21apt-get00:10:120
25494992323,0cyclictest18975-21apt-get22:20:130
25494992323,0cyclictest0-21swapper/023:05:110
25494992323,0cyclictest0-21swapper/022:50:130
25494992323,0cyclictest0-21swapper/021:40:010
25497992222,0cyclictest30821-21apt-get19:20:133
25497992222,0cyclictest0-21swapper/320:10:133
25497992222,0cyclictest0-21swapper/319:40:123
25497992222,0cyclictest0-21swapper/319:15:113
25497992220,1cyclictest307-21systemd-journal20:50:003
25497992220,1cyclictest17242-21munin-run00:35:013
25496992222,0cyclictest1543-21apt-get20:35:172
25496992222,0cyclictest14843-21apt-get23:20:122
25496992222,0cyclictest0-21swapper/219:50:122
25496992220,1cyclictest29835-21cron21:35:002
25495992222,0cyclictest0-21swapper/123:00:131
25495992222,0cyclictest0-21swapper/122:45:121
25494992222,0cyclictest0-21swapper/023:30:120
25494992221,1cyclictest31632-21apt-get20:30:100
25497992121,0cyclictest0-21swapper/321:55:123
25497992121,0cyclictest0-21swapper/300:20:143
2549599213,17cyclictest26034-21latency_hist20:20:001
25495992121,0cyclictest0-21swapper/119:20:151
25495992121,0cyclictest0-21swapper/100:05:131
25495992121,0cyclictest0-21swapper/100:00:121
25495992120,0cyclictest23103-21apt-get21:20:111
25495992119,1cyclictest14674-21apt-get19:55:131
25495992119,1cyclictest14674-21apt-get19:55:131
25494992121,0cyclictest0-21swapper/023:25:130
25494992121,0cyclictest0-21swapper/020:40:120
25497992020,0cyclictest0-21swapper/322:20:133
25497992020,0cyclictest0-21swapper/321:50:003
25494992020,0cyclictest0-21swapper/023:10:120
25494992020,0cyclictest0-21swapper/020:25:120
25494992020,0cyclictest0-21swapper/019:30:120
25494992019,0cyclictest0-21swapper/023:00:130
25497991919,0cyclictest0-21swapper/321:40:103
25497991917,1cyclictest0-21swapper/320:35:003
25496991919,0cyclictest18133-21apt-get21:10:102
25495991919,0cyclictest0-21swapper/122:10:121
25494991919,0cyclictest30659-21apt-get22:45:120
25494991918,1cyclictest3547-21apt-get00:05:130
25497991818,0cyclictest0-21swapper/323:20:123
25497991818,0cyclictest0-21swapper/322:45:123
25497991818,0cyclictest0-21swapper/320:20:123
2549699182,15cyclictest819-21runrttasks19:17:212
25496991818,0cyclictest0-21swapper/220:25:122
25495991818,0cyclictest0-21swapper/122:25:101
2549499184,8cyclictest141rcuc/023:25:010
25497991716,1cyclictest0-21swapper/321:20:003
25497991715,1cyclictest0-21swapper/323:35:003
25496991717,0cyclictest0-21swapper/221:25:122
25496991717,0cyclictest0-21swapper/219:32:202
25495991714,2cyclictest26194-21cron23:45:011
25494991717,0cyclictest0-21swapper/021:20:120
25494991717,0cyclictest0-21swapper/019:20:150
25494991717,0cyclictest0-21swapper/000:00:120
25497991616,0cyclictest0-21swapper/319:55:133
25497991616,0cyclictest0-21swapper/319:55:133
25497991615,1cyclictest7457-21munin-run19:40:013
25497991615,0cyclictest0-21swapper/323:00:133
25496991614,1cyclictest25686-21munin-run22:35:002
2549699160,15cyclictest15149-21/usr/sbin/munin00:30:132
25495991616,0cyclictest0-21swapper/121:10:101
25495991616,0cyclictest0-21swapper/120:00:111
25495991615,1cyclictest2383-21apt-get21:45:151
25495991614,1cyclictest0-21swapper/121:40:151
2549599160,15cyclictest29032-21tr23:50:131
25494991616,0cyclictest0-21swapper/022:10:130
25494991614,1cyclictest26334-21sed23:45:000
2549499160,15cyclictest22328-21grep23:35:140
25497991513,1cyclictest0-21swapper/320:40:143
25497991513,1cyclictest0-21swapper/320:15:183
2549799150,1cyclictest12199-21ntp_states20:55:173
2549799150,14cyclictest18548-21ntp_states00:35:213
2549799150,14cyclictest0-21swapper/320:35:253
25496991515,0cyclictest0-21swapper/221:55:122
25496991514,1cyclictest19588-21gltestperf22:20:152
25496991513,1cyclictest11590-21ntp_states00:20:192
2549699150,1cyclictest621-21dbus-daemon21:00:012
2549699150,1cyclictest0-21swapper/200:15:152
2549699150,14cyclictest31319-21processes21:35:322
2549699150,14cyclictest30532sleep200:03:012
2549699150,14cyclictest15362-21ntp_states22:10:192
2549699150,14cyclictest0-21swapper/221:45:152
25495991515,0cyclictest0-21swapper/119:15:111
25495991513,1cyclictest25425-21apt-get21:25:121
2549599150,14cyclictest6197-21cat20:45:101
25494991515,0cyclictest0-21swapper/022:25:100
2549499150,1cyclictest5945-21sendmail_mailst21:50:200
2549499150,1cyclictest26122-21munin-run20:20:000
2549499150,1cyclictest0-21swapper/021:40:130
2549499150,14cyclictest29661-21switchtime22:40:200
2549499150,14cyclictest26475-21ntp_states21:25:170
25497991414,0cyclictest0-21swapper/323:18:323
25497991414,0cyclictest0-21swapper/321:20:113
2549799140,14cyclictest0-21swapper/323:55:173
2549799140,14cyclictest0-21swapper/323:53:233
2549799140,14cyclictest0-21swapper/323:06:333
2549799140,14cyclictest0-21swapper/322:59:203
2549799140,14cyclictest0-21swapper/322:30:103
2549799140,14cyclictest0-21swapper/322:15:203
2549799140,14cyclictest0-21swapper/321:13:333
2549799140,14cyclictest0-21swapper/321:06:323
2549799140,14cyclictest0-21swapper/320:29:433
2549799140,14cyclictest0-21swapper/320:06:483
2549799140,14cyclictest0-21swapper/319:54:163
2549799140,14cyclictest0-21swapper/319:31:533
2549799140,14cyclictest0-21swapper/300:10:023
2549799140,14cyclictest0-21swapper/300:08:403
2549799140,14cyclictest0-21swapper/300:03:383
2549799140,0cyclictest0-21swapper/323:47:233
2549799140,0cyclictest0-21swapper/323:40:203
2549799140,0cyclictest0-21swapper/322:00:013
2549799140,0cyclictest0-21swapper/321:30:263
2549799140,0cyclictest0-21swapper/300:25:113
25496991414,0cyclictest0-21swapper/223:07:452
2549699140,14cyclictest0-21swapper/223:46:562
2549699140,14cyclictest0-21swapper/223:40:172
2549699140,14cyclictest0-21swapper/223:33:142
2549699140,14cyclictest0-21swapper/223:25:112
2549699140,14cyclictest0-21swapper/223:03:082
2549699140,14cyclictest0-21swapper/222:45:172
2549699140,14cyclictest0-21swapper/221:41:342
2549699140,14cyclictest0-21swapper/220:50:292
2549699140,14cyclictest0-21swapper/220:01:222
2549699140,14cyclictest0-21swapper/219:59:412
2549699140,14cyclictest0-21swapper/219:59:402
2549699140,14cyclictest0-21swapper/219:45:012
2549699140,14cyclictest0-21swapper/219:44:202
2549699140,14cyclictest0-21swapper/219:26:182
2549699140,14cyclictest0-21swapper/219:23:492
2549699140,14cyclictest0-21swapper/200:05:262
2549699140,0cyclictest0-21swapper/222:57:072
2549699140,0cyclictest0-21swapper/221:21:332
2549699140,0cyclictest0-21swapper/221:04:402
2549699140,0cyclictest0-21swapper/220:47:092
2549699140,0cyclictest0-21swapper/220:20:442
2549699140,0cyclictest0-21swapper/219:36:262
2549599143,7cyclictest27479-21taskset19:10:361
25495991414,0cyclictest0-21swapper/123:22:231
25495991414,0cyclictest0-21swapper/122:17:181
25495991414,0cyclictest0-21swapper/122:02:331
25495991414,0cyclictest0-21swapper/121:06:051
25495991414,0cyclictest0-21swapper/120:56:391
25495991414,0cyclictest0-21swapper/120:36:281
2549599140,14cyclictest0-21swapper/123:38:361
2549599140,14cyclictest0-21swapper/123:17:201
2549599140,14cyclictest0-21swapper/122:40:171
2549599140,14cyclictest0-21swapper/122:37:121
2549599140,14cyclictest0-21swapper/121:51:421
2549599140,14cyclictest0-21swapper/121:15:411
2549599140,14cyclictest0-21swapper/119:50:541
2549599140,14cyclictest0-21swapper/119:25:071
2549599140,0cyclictest0-21swapper/122:08:571
2549599140,0cyclictest0-21swapper/100:30:211
25494991414,0cyclictest0-21swapper/022:00:070
25494991414,0cyclictest0-21swapper/021:05:130
25494991413,0cyclictest19184-21ntp_states21:10:160
2549499140,14cyclictest0-21swapper/021:46:000
2549499140,14cyclictest0-21swapper/021:16:190
2549499140,14cyclictest0-21swapper/020:56:360
2549499140,14cyclictest0-21swapper/020:45:520
2549499140,14cyclictest0-21swapper/019:50:350
2549499140,14cyclictest0-21swapper/019:26:030
2549499140,14cyclictest0-21swapper/000:37:310
2549499140,14cyclictest0-21swapper/000:30:500
2549499140,0cyclictest0-21swapper/022:07:080
25497991313,0cyclictest0-21swapper/322:35:393
25496991313,0cyclictest0-21swapper/223:10:282
25496991313,0cyclictest0-21swapper/222:52:182
25496991313,0cyclictest0-21swapper/200:38:362
2549699130,0cyclictest0-21swapper/220:41:432
25495991313,0cyclictest0-21swapper/100:36:271
25494991313,0cyclictest0-21swapper/019:12:450
25496991212,0cyclictest0-21swapper/223:56:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional