You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-16 - 15:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Mon Jun 16, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1751993330,2cyclictest609-21dbus-daemon22:50:010
1757993227,5cyclictest0-21swapper/222:55:172
175799320,4cyclictest0-21swapper/220:20:132
175799320,32cyclictest0-21swapper/221:55:122
1757993128,3cyclictest6664-21apt-get21:35:142
1753993127,4cyclictest0-21swapper/122:25:131
175399310,31cyclictest0-21swapper/121:35:141
175399310,27cyclictest0-21swapper/122:55:171
1757993026,4cyclictest29999-21apt-get22:25:132
175799300,2cyclictest18653-21taskset19:45:142
175799300,1cyclictest303-21systemd-journal20:49:592
175399300,29cyclictest0-21swapper/122:30:141
1751993028,1cyclictest28557-21cron00:40:000
1761992927,1cyclictest8714-21sendmail-msp21:39:593
1761992927,1cyclictest32034-21cron22:30:013
176199290,28cyclictest0-21swapper/319:15:133
175799290,28cyclictest0-21swapper/200:20:012
175399290,28cyclictest0-21swapper/119:45:141
1751992927,1cyclictest0-21swapper/000:20:010
175199290,28cyclictest748-21apt-get23:40:170
175199290,28cyclictest25638-21apt-get20:00:140
1761992828,0cyclictest0-21swapper/300:00:173
1761992827,1cyclictest14254-21apt-get23:00:163
1757992826,1cyclictest0-21swapper/223:35:012
1757992826,1cyclictest0-21swapper/220:05:012
175799280,27cyclictest0-21swapper/223:40:172
175799280,27cyclictest0-21swapper/221:25:132
175799280,27cyclictest0-21swapper/221:00:142
175799280,0cyclictest0-21swapper/223:55:162
1753992828,0cyclictest0-21swapper/120:15:141
1753992826,1cyclictest13380-21perf21:50:011
175399280,27cyclictest0-21swapper/120:50:131
175399280,0cyclictest13655-21apt-get21:50:151
1751992827,1cyclictest9827-21cron00:00:010
1751992827,1cyclictest609-21dbus-daemon22:45:010
1751992827,1cyclictest609-21dbus-daemon22:45:010
1751992827,1cyclictest141rcuc/019:40:010
1751992826,1cyclictest303-21systemd-journal21:50:000
1751992826,1cyclictest15768-21munin-run21:55:000
175199280,28cyclictest0-21swapper/023:25:190
175199280,28cyclictest0-21swapper/023:00:150
175199280,1cyclictest22754-21munin-run22:10:010
175199280,0cyclictest0-21swapper/023:20:200
1761992727,0cyclictest2595-21apt-get22:35:143
1761992727,0cyclictest0-21swapper/320:10:133
1761992727,0cyclictest0-21swapper/300:35:183
1761992727,0cyclictest0-21swapper/300:10:173
176199270,0cyclictest0-21swapper/321:00:003
1757992727,0cyclictest0-21swapper/222:15:092
1757992727,0cyclictest0-21swapper/221:50:152
1757992727,0cyclictest0-21swapper/220:50:122
175799270,27cyclictest0-21swapper/220:40:142
175799270,27cyclictest0-21swapper/220:15:142
175799270,0cyclictest0-21swapper/220:05:132
1753992727,0cyclictest30560-21perf23:35:011
1753992727,0cyclictest14843-21apt-get20:45:191
1753992727,0cyclictest0-21swapper/123:50:171
1753992727,0cyclictest0-21swapper/123:20:201
1753992727,0cyclictest0-21swapper/120:25:131
1753992727,0cyclictest0-21swapper/120:05:001
1753992725,1cyclictest609-21dbus-daemon22:10:011
175399270,27cyclictest0-21swapper/122:15:091
175399270,26cyclictest0-21swapper/121:55:111
1751992727,0cyclictest27959-21apt-get20:05:140
1751992727,0cyclictest12516-21apt-get20:40:140
1751992727,0cyclictest0-21swapper/021:35:130
175199270,27cyclictest0-21swapper/020:50:130
1761992626,0cyclictest17159-21apt-get20:50:133
1761992626,0cyclictest0-21swapper/322:15:093
1761992626,0cyclictest0-21swapper/321:50:143
1761992626,0cyclictest0-21swapper/320:55:173
1761992624,1cyclictest7252-21cron20:30:013
1757992626,0cyclictest0-21swapper/223:20:192
1757992626,0cyclictest0-21swapper/220:25:132
1757992624,1cyclictest1-21systemd22:10:002
1753992626,0cyclictest0-21swapper/120:10:131
1751992626,0cyclictest6710-21apt-get19:20:130
1751992626,0cyclictest0-21swapper/021:40:130
1751992626,0cyclictest0-21swapper/020:25:120
1751992624,1cyclictest302812sleep020:10:130
1761992525,0cyclictest440-21apt-get20:15:133
1761992523,1cyclictest25048-21cron22:15:003
1757992525,0cyclictest0-21swapper/223:50:172
1753992525,0cyclictest0-21swapper/121:25:141
1753992525,0cyclictest0-21swapper/120:20:131
1753992525,0cyclictest0-21swapper/119:25:021
1751992525,0cyclictest22130-21apt-get21:00:140
1751992525,0cyclictest1643-21apt-get21:25:140
1751992525,0cyclictest0-21swapper/023:50:160
1761992424,0cyclictest30841-21apt-get23:35:183
1761992423,1cyclictest1950-21awk22:35:013
1757992424,0cyclictest0-21swapper/221:50:012
1757992424,0cyclictest0-21swapper/220:10:122
1757992424,0cyclictest0-21swapper/219:25:012
175799240,22cyclictest0-21swapper/223:05:172
1753992424,0cyclictest0-21swapper/123:55:151
1753992421,3cyclictest0-21swapper/120:55:181
175399240,14cyclictest0-21swapper/123:05:161
1751992424,0cyclictest2895-21apt-get20:20:130
1751992424,0cyclictest19202-21apt-get23:10:160
1751992423,1cyclictest20429-21perf22:05:010
1761992323,0cyclictest0-21swapper/323:05:153
1761992323,0cyclictest0-21swapper/300:20:173
1757992320,3cyclictest0-21swapper/220:55:182
1753992323,0cyclictest0-21swapper/123:25:191
1753992323,0cyclictest0-21swapper/121:00:141
1753992323,0cyclictest0-21swapper/120:05:141
1751992323,0cyclictest11660-21apt-get19:30:130
1751992323,0cyclictest0-21swapper/000:30:110
1751992322,1cyclictest7845-21apt-get20:30:110
176199224,17cyclictest7946-21wc19:20:203
1761992221,1cyclictest4036-21apt-get21:30:133
1761992221,1cyclictest24449-21apt-get21:05:133
1761992220,1cyclictest5184-21apt23:50:013
1761992219,2cyclictest30538-21cron23:35:003
1757992222,0cyclictest0-21swapper/223:25:182
1753992222,0cyclictest0-21swapper/122:10:151
1753992221,0cyclictest0-21swapper/121:10:141
175399220,1cyclictest13771-21munin-run19:35:011
1751992222,0cyclictest19488-21apt-get20:55:180
1751992222,0cyclictest16023-21apt-get21:55:120
1761992121,0cyclictest18372-21apt-get22:00:143
1761992121,0cyclictest0-21swapper/321:55:123
1753992121,0cyclictest7262-21apt-get22:45:151
1753992121,0cyclictest0-21swapper/123:15:161
1753992121,0cyclictest0-21swapper/100:10:171
1753992119,1cyclictest609-21dbus-daemon20:44:591
1751992121,0cyclictest0-21swapper/020:15:140
1761992020,0cyclictest20690-21apt-get22:05:123
1761992020,0cyclictest11330-21apt-get21:45:123
1761992020,0cyclictest0-21swapper/320:05:143
1761992018,1cyclictest21224-21cron23:15:013
1761992018,1cyclictest13961-21idleruntime-cro23:00:013
1757992020,0cyclictest0-21swapper/223:15:152
1757992020,0cyclictest0-21swapper/222:10:152
1757992020,0cyclictest0-21swapper/200:10:162
1753992020,0cyclictest0-21swapper/122:20:131
1753992020,0cyclictest0-21swapper/120:30:121
1753992018,1cyclictest31119-21cron21:20:001
1751992020,0cyclictest0-21swapper/020:45:180
1761991919,0cyclictest0-21swapper/322:25:003
1757991919,0cyclictest7845-21apt-get20:30:122
1757991919,0cyclictest0-21swapper/222:45:152
1757991919,0cyclictest0-21swapper/222:20:132
1757991919,0cyclictest0-21swapper/221:10:142
1757991917,1cyclictest31121-21cron21:20:012
1757991917,1cyclictest13690-21cron19:35:002
1757991917,1cyclictest0-21swapper/219:55:022
1753991919,0cyclictest23034-21perf19:55:021
1753991919,0cyclictest0-21swapper/122:35:131
1753991917,1cyclictest609-21dbus-daemon20:40:001
1751991919,0cyclictest23015-21apt-get22:10:150
1751991919,0cyclictest0-21swapper/021:10:130
1761991818,0cyclictest23291-21apt-get19:55:123
1761991818,0cyclictest0-21swapper/322:45:133
1761991818,0cyclictest0-21swapper/319:30:133
1757991818,0cyclictest0-21swapper/222:35:122
1753991818,0cyclictest0-21swapper/100:15:151
1753991814,4cyclictest25490-21ntpq21:05:181
1751991818,0cyclictest10168-21apt-get20:35:140
1751991817,1cyclictest0-21swapper/019:45:140
176199170,17cyclictest0-21swapper/323:15:253
1757991716,1cyclictest12220-21sh20:40:012
1757991712,5cyclictest0-21swapper/221:05:182
1753991717,0cyclictest0-21swapper/123:40:171
1753991714,2cyclictest9028-21rm19:25:001
1751991717,0cyclictest25327-21apt-get22:15:100
1751991717,0cyclictest0-21swapper/019:40:130
1751991716,1cyclictest32323-21apt-get22:30:150
1761991616,0cyclictest5474-21apt-get23:50:173
1761991613,2cyclictest1772-21uname23:40:223
176199160,16cyclictest0-21swapper/300:33:493
176199160,15cyclictest4275-21latency_hist19:15:013
176199160,15cyclictest2278-21sed21:25:163
176199160,15cyclictest21936-21needreboot19:50:183
176199160,15cyclictest10052-21ntp_offset21:40:173
1757991613,2cyclictest6116-21latency_hist21:35:002
175799160,8cyclictest0-21swapper/219:55:122
175799160,0cyclictest0-21swapper/222:00:252
1753991614,1cyclictest0-21swapper/121:40:201
175399160,15cyclictest1069-21perf21:25:001
175199169,6cyclictest11770-21munin-node23:48:550
1751991616,0cyclictest0-21swapper/022:55:160
1751991614,1cyclictest12320-21perf00:05:010
175199160,1cyclictest6359-21apt-config21:35:000
1761991515,0cyclictest21898-21apt-get00:25:193
1761991513,1cyclictest25520-21users23:20:293
1761991513,1cyclictest10204-21gltestperf22:50:213
176199150,1cyclictest26811-21proc_pri20:00:203
176199150,1cyclictest19662-21/usr/sbin/munin19:45:193
176199150,14cyclictest14786-21irqstats19:35:173
176199150,14cyclictest0-21swapper/320:30:173
1757991513,1cyclictest0-21swapper/219:25:012
175799150,1cyclictest0-21swapper/200:00:212
175799150,15cyclictest0-21swapper/223:45:542
175799150,14cyclictest6186-21mailstats22:40:202
175799150,14cyclictest6186-21mailstats22:40:192
1753991513,1cyclictest0-21swapper/119:45:011
175399150,14cyclictest0-21swapper/119:35:191
1761991414,0cyclictest26194-21apt-get23:25:193
1761991414,0cyclictest12582-21apt-get00:05:153
176199140,14cyclictest0-21swapper/323:56:163
176199140,14cyclictest0-21swapper/322:40:273
176199140,14cyclictest0-21swapper/322:40:263
176199140,14cyclictest0-21swapper/320:45:073
176199140,14cyclictest0-21swapper/320:44:083
176199140,14cyclictest0-21swapper/319:25:143
176199140,10cyclictest0-21swapper/321:23:283
176199140,0cyclictest0-21swapper/321:14:093
176199140,0cyclictest0-21swapper/300:16:343
1757991414,0cyclictest0-21swapper/221:21:212
175799140,14cyclictest0-21swapper/223:35:392
175799140,14cyclictest0-21swapper/222:53:522
175799140,14cyclictest0-21swapper/222:31:342
175799140,14cyclictest0-21swapper/200:35:112
175799140,0cyclictest0-21swapper/223:00:152
175799140,0cyclictest0-21swapper/219:39:352
175799140,0cyclictest0-21swapper/200:33:362
175799140,0cyclictest0-21swapper/200:26:412
1753991414,0cyclictest0-21swapper/123:45:331
1753991414,0cyclictest0-21swapper/123:13:591
1753991414,0cyclictest0-21swapper/123:01:201
1753991414,0cyclictest0-21swapper/100:20:221
1753991413,1cyclictest0-21swapper/119:12:501
175399140,14cyclictest0-21swapper/122:51:491
175399140,14cyclictest0-21swapper/100:38:351
175399140,14cyclictest0-21swapper/100:28:111
175399140,0cyclictest0-21swapper/123:35:441
175399140,0cyclictest0-21swapper/119:55:071
175399140,0cyclictest0-21swapper/100:31:031
175399140,0cyclictest0-21swapper/100:08:201
175399140,0cyclictest0-21swapper/100:01:391
1751991414,0cyclictest0-21swapper/019:12:260
1751991414,0cyclictest0-21swapper/000:10:250
1751991412,1cyclictest22321-21diskstats00:25:190
175199140,14cyclictest0-21swapper/023:35:160
175199140,14cyclictest0-21swapper/023:34:030
175199140,14cyclictest0-21swapper/023:15:290
175199140,14cyclictest0-21swapper/023:08:530
175199140,14cyclictest0-21swapper/022:51:560
175199140,14cyclictest0-21swapper/022:23:360
175199140,14cyclictest0-21swapper/021:06:410
175199140,14cyclictest0-21swapper/019:50:180
175199140,14cyclictest0-21swapper/019:16:590
175199140,14cyclictest0-21swapper/000:05:230
175199140,0cyclictest0-21swapper/022:35:300
175199140,0cyclictest0-21swapper/022:25:260
175199140,0cyclictest0-21swapper/021:15:120
175199140,0cyclictest0-21swapper/019:55:160
175199140,0cyclictest0-21swapper/019:25:250
1761991313,0cyclictest0-21swapper/321:16:353
1761991313,0cyclictest0-21swapper/320:35:193
1761991313,0cyclictest0-21swapper/320:20:443
176199130,13cyclictest0-21swapper/319:41:453
1757991313,0cyclictest0-21swapper/219:41:462
1757991313,0cyclictest0-21swapper/219:20:012
1757991313,0cyclictest0-21swapper/219:10:192
1757991313,0cyclictest0-21swapper/200:21:482
175799130,1cyclictest0-21swapper/221:40:162
1753991313,0cyclictest0-21swapper/122:03:031
1753991313,0cyclictest0-21swapper/121:30:211
1753991313,0cyclictest0-21swapper/119:15:521
1751991313,0cyclictest0-21swapper/021:22:350
1751991313,0cyclictest0-21swapper/000:20:430
1757991212,0cyclictest0-21swapper/223:10:162
1757991211,1cyclictest0-21swapper/200:06:362
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional