You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-29 - 01:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot3.osadl.org (updated Sun Jun 29, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4059377991711,0cyclictest0-21swapper/322:20:133
4059377991711,0cyclictest0-21swapper/322:20:133
405937799130,1cyclictest0-21swapper/319:45:143
405937799130,12cyclictest0-21swapper/319:30:123
4059377991211,0cyclictest0-21swapper/300:00:133
4059377991210,1cyclictest0-21swapper/321:55:143
405937799120,11cyclictest0-21swapper/323:45:193
405937799120,11cyclictest0-21swapper/300:25:153
405937799120,11cyclictest0-21swapper/300:10:013
405937799120,10cyclictest0-21swapper/323:10:163
405937799119,1cyclictest0-21swapper/322:05:143
4059377991111,0cyclictest0-21swapper/322:55:023
4059377991110,0cyclictest0-21swapper/320:35:003
4059377991110,0cyclictest0-21swapper/319:20:003
405937799110,1cyclictest0-21swapper/320:00:013
405937799110,10cyclictest0-21swapper/323:25:003
405937799110,10cyclictest0-21swapper/320:15:133
405937799110,0cyclictest0-21swapper/323:15:173
405937799110,0cyclictest0-21swapper/321:45:153
405937799110,0cyclictest0-21swapper/320:00:153
405937799109,0cyclictest0-21swapper/323:05:243
405937799108,1cyclictest0-21swapper/322:40:173
4059377991010,0cyclictest0-21swapper/323:35:263
4059377991010,0cyclictest0-21swapper/322:10:153
4059377991010,0cyclictest0-21swapper/319:50:003
4059377991010,0cyclictest0-21swapper/319:10:123
4059377991010,0cyclictest0-21swapper/300:30:143
4059377991010,0cyclictest0-21swapper/300:15:223
405937799100,9cyclictest0-21swapper/323:30:203
405937799100,9cyclictest0-21swapper/322:35:213
405937799100,9cyclictest0-21swapper/321:52:333
405937799100,0cyclictest0-21swapper/320:45:133
40593779999,0cyclictest0-21swapper/321:40:203
40593779999,0cyclictest0-21swapper/320:43:113
40593779999,0cyclictest0-21swapper/319:40:183
40593779998,0cyclictest0-21swapper/322:35:013
40593779998,0cyclictest0-21swapper/321:05:013
40593779998,0cyclictest0-21swapper/320:35:183
40593779998,0cyclictest0-21swapper/320:20:143
40593779998,0cyclictest0-21swapper/320:10:143
40593779998,0cyclictest0-21swapper/300:00:013
40593779997,1cyclictest0-21swapper/322:45:193
40593779990,8cyclictest0-21swapper/322:15:163
40593779990,8cyclictest0-21swapper/322:00:163
40593779990,8cyclictest0-21swapper/300:10:253
40593779990,0cyclictest0-21swapper/321:40:013
40593779990,0cyclictest0-21swapper/319:29:593
40593779987,0cyclictest0-21swapper/323:02:343
40593779980,7cyclictest0-21swapper/320:10:003
4059169281,5sleep30-21swapper/319:09:343
40593779977,0cyclictest0-21swapper/321:30:213
40593779977,0cyclictest0-21swapper/320:55:123
40593779977,0cyclictest0-21swapper/319:20:153
40593779976,0cyclictest0-21swapper/322:25:193
13989870,3rtkit-daemon0-21swapper/119:05:021
40593779965,0cyclictest0-21swapper/321:20:163
40593779955,0cyclictest0-21swapper/322:55:153
40593779954,0cyclictest0-21swapper/321:17:363
40593779954,0cyclictest0-21swapper/321:14:283
40593779951,2cyclictest0-21swapper/323:40:193
40593779951,2cyclictest0-21swapper/321:25:133
40593779950,4cyclictest0-21swapper/319:35:153
4071053240,4sleep20-21swapper/219:37:192
40593779944,0cyclictest0-21swapper/323:50:193
40593779944,0cyclictest0-21swapper/323:25:143
40593779940,3cyclictest4098807-21chrt20:51:403
40593779940,2cyclictest0-21swapper/320:25:153
40593779940,2cyclictest0-21swapper/300:35:143
40593779940,0cyclictest0-21swapper/300:20:213
4058877242,1sleep20-21swapper/219:05:492
4057540241,1sleep00-21swapper/019:05:150
13989840,2rtkit-daemon614-21wpa_supplicant21:50:221
13989840,2rtkit-daemon4061338-21munin-node00:31:221
13989840,2rtkit-daemon4059893-21wc19:10:141
13989840,1rtkit-daemon1-21systemd23:21:021
13989840,1rtkit-daemon1-21systemd21:10:571
13989840,0rtkit-daemon0-21swapper/123:39:381
4162652230,2sleep04162803-21ntp_offset23:25:190
4151296230,1sleep14151322-21apt-get23:00:191
4102913230,0sleep00-21swapper/021:01:330
4097424230,1sleep14097555-21ntp_states20:45:171
4095304230,2sleep24095389-21uname20:40:192
4069188230,0sleep00-21swapper/019:32:560
40593779930,2cyclictest0-21swapper/321:05:153
13989830,2rtkit-daemon762-21ntpd23:05:201
13989830,2rtkit-daemon760-21snmpd22:59:531
13989830,2rtkit-daemon760-21snmpd19:33:381
13989830,2rtkit-daemon684-21gmain21:16:171
13989830,2rtkit-daemon4085017-21systemctl20:15:011
13989830,2rtkit-daemon4061338-21munin-node22:50:181
13989830,2rtkit-daemon1399-21sendmail-mta22:26:331
13989830,1rtkit-daemon765-21lldpd22:15:101
13989830,1rtkit-daemon762-21ntpd00:29:351
13989830,1rtkit-daemon760-21snmpd00:03:421
13989830,1rtkit-daemon602-21NetworkManager23:53:381
13989830,1rtkit-daemon4191458-21apt-get00:35:141
13989830,1rtkit-daemon4157110-21ssh23:13:171
13989830,1rtkit-daemon331-21plymouthd22:45:011
13989830,1rtkit-daemon331-21plymouthd22:01:531
13989830,1rtkit-daemon1-21systemd23:57:351
13989830,1rtkit-daemon1-21systemd23:32:011
13989830,1rtkit-daemon1-21systemd23:26:201
13989830,1rtkit-daemon1-21systemd22:45:351
13989830,1rtkit-daemon1-21systemd22:12:291
13989830,1rtkit-daemon1-21systemd22:07:091
13989830,1rtkit-daemon1-21systemd21:47:491
13989830,1rtkit-daemon1-21systemd21:36:181
13989830,1rtkit-daemon1-21systemd21:31:361
13989830,1rtkit-daemon1-21systemd21:21:091
13989830,1rtkit-daemon1-21systemd19:38:361
13989830,0rtkit-daemon0-21swapper/121:55:281
13989830,0rtkit-daemon0-21swapper/120:53:011
13989830,0rtkit-daemon0-21swapper/100:09:501
4191880220,1sleep04191957-21irqstats00:35:200
4179784220,1sleep24179964-21wc00:05:202
4166729220,1sleep24166853-21missed_timers23:35:212
4160375220,1sleep24160443-21awk23:20:202
4157307220,1sleep24157341-21munin-run23:15:012
4151009220,1sleep0417-21systemd-journal23:00:020
4146645220,1sleep04146647-21ssh22:48:290
4138091220,0sleep00-21swapper/022:27:040
4127528220,0sleep00-21swapper/022:01:260
4123335220,0sleep00-21swapper/021:51:330
4107490220,1sleep04107758-21df21:15:140
4104445220,0sleep00-21swapper/021:05:220
4101959220,1sleep24102033-21irqstats21:00:152
4100009220,1sleep04100091-21irqstats20:55:140
4099605220,1sleep24099743-21basename20:55:122
4096531220,1sleep00-21swapper/020:45:010
4089826220,1sleep00-21swapper/020:25:200
4081152220,1sleep24081179-21systemd-run20:05:012
4073575220,1sleep24073870-21expr19:45:152
4072054220,1sleep04072249-21cut19:40:160
4067433220,1sleep04067469-21munin-run19:30:000
4061191220,1sleep14061571-21munin-node19:15:001
13989820,1rtkit-daemon765-21lldpd22:35:101
13989820,1rtkit-daemon760-21snmpd22:30:131
13989820,1rtkit-daemon760-21snmpd21:40:021
13989820,1rtkit-daemon760-21snmpd19:55:051
13989820,1rtkit-daemon760-21snmpd19:50:561
13989820,1rtkit-daemon614-21wpa_supplicant21:06:101
13989820,1rtkit-daemon614-21wpa_supplicant20:25:081
13989820,1rtkit-daemon417-21systemd-journal20:20:501
13989820,1rtkit-daemon417-21systemd-journal19:45:011
13989820,1rtkit-daemon4158277-21strings23:15:221
13989820,1rtkit-daemon4064756-21wc19:20:191
13989820,1rtkit-daemon4061338-21munin-node20:15:301
13989820,1rtkit-daemon1-21systemd20:05:131
13989820,1rtkit-daemon0-21swapper/120:55:101
13989820,0rtkit-daemon331-21plymouthd23:41:341
13989820,0rtkit-daemon331-21plymouthd22:20:171
13989820,0rtkit-daemon331-21plymouthd22:20:161
13989820,0rtkit-daemon331-21plymouthd21:00:171
13989820,0rtkit-daemon331-21plymouthd20:00:031
13989820,0rtkit-daemon331-21plymouthd19:25:171
13989820,0rtkit-daemon0-21swapper/123:45:101
13989820,0rtkit-daemon0-21swapper/121:25:171
13989820,0rtkit-daemon0-21swapper/120:40:051
13989820,0rtkit-daemon0-21swapper/120:35:191
13989820,0rtkit-daemon0-21swapper/120:30:241
13989820,0rtkit-daemon0-21swapper/119:40:161
13989820,0rtkit-daemon0-21swapper/100:20:161
13989820,0rtkit-daemon0-21swapper/100:15:131
13989820,0rtkit-daemon0-21swapper/100:10:191
4191622210,0sleep20-21swapper/200:35:182
4190062210,1sleep00-21swapper/000:30:190
4189336210,0sleep20-21swapper/200:30:142
4188960210,0sleep00-21swapper/000:28:590
4187278210,0sleep20-21swapper/200:25:172
4186734210,0sleep00-21swapper/000:22:470
4185836210,0sleep20-21swapper/200:20:212
4183126210,0sleep20-21swapper/200:15:162
4183035210,0sleep00-21swapper/000:15:140
4182763210,1sleep00-21swapper/000:14:550
4181326210,0sleep20-21swapper/200:10:202
4180548210,0sleep00-21swapper/000:08:500
4177556210,0sleep00-21swapper/000:00:220
4176850210,0sleep20-21swapper/200:00:152
4174618210,0sleep00-21swapper/023:55:130
4173859210,0sleep20-21swapper/223:50:352
4172673210,0sleep00-21swapper/023:50:200
4171551210,0sleep20-21swapper/223:45:222
4170667210,0sleep00-21swapper/023:45:170
4170073210,0sleep20-21swapper/223:44:072
4168322210,0sleep00-21swapper/023:40:040
4166220210,0sleep00-21swapper/023:35:110
4164194210,0sleep00-21swapper/023:30:160
4163877210,0sleep20-21swapper/223:30:022
4159748210,0sleep00-21swapper/023:20:030
4159093210,1sleep00-21swapper/023:17:190
4158547210,1sleep24158814-21ssh23:15:252
4155215210,0sleep00-21swapper/023:10:010
4154329210,0sleep00-21swapper/023:05:260
4153459210,0sleep20-21swapper/223:05:192
4152548210,0sleep20-21swapper/223:00:282
4149338210,0sleep00-21swapper/022:55:160
4149172210,0sleep20-21swapper/222:55:142
4147253210,0sleep20-21swapper/222:50:192
4147112210,0sleep00-21swapper/022:50:170
4144992210,0sleep20-21swapper/222:45:192
4144332210,1sleep00-21swapper/022:41:330
4144078210,0sleep20-21swapper/222:40:252
4142175210,1sleep00-21swapper/022:36:080
4140780210,0sleep20-21swapper/222:35:142
4140074210,0sleep20-21swapper/222:31:062
4138689210,0sleep00-21swapper/022:30:150
4136587210,0sleep20-21swapper/222:25:122
4134653210,0sleep00-21swapper/022:20:150
4134653210,0sleep00-21swapper/022:20:140
4134495210,0sleep20-21swapper/222:20:132
4134495210,0sleep20-21swapper/222:20:132
4133191210,0sleep00-21swapper/022:15:230
4132444210,0sleep20-21swapper/222:15:172
4130714210,0sleep20-21swapper/222:10:172
4128286210,0sleep20-21swapper/222:05:152
4124759210,0sleep20-21swapper/221:55:202
4123732210,0sleep00-21swapper/021:55:010
4121466210,0sleep20-21swapper/221:48:312
4119928210,0sleep00-21swapper/021:45:170
4118300210,0sleep00-21swapper/021:40:200
4117979210,0sleep20-21swapper/221:40:182
4115521210,0sleep00-21swapper/021:35:160
4115266210,0sleep20-21swapper/221:35:022
4114289210,0sleep20-21swapper/221:30:222
4113997210,0sleep00-21swapper/021:30:200
4113035210,1sleep00-21swapper/021:28:440
4110730210,1sleep00-21swapper/021:20:550
4110287210,0sleep20-21swapper/221:20:212
4107336210,0sleep20-21swapper/221:15:132
4106844210,0sleep00-21swapper/021:12:270
4106802210,0sleep20-21swapper/221:11:562
4104195210,0sleep20-21swapper/221:05:202
4098797210,0sleep00-21swapper/020:51:340
4096901210,0sleep20-21swapper/220:45:142
4093130210,0sleep00-21swapper/020:35:160
4092925210,0sleep20-21swapper/220:35:152
4092313210,0sleep20-21swapper/220:30:212
4088834210,0sleep00-21swapper/020:24:550
4087655210,0sleep20-21swapper/220:20:172
4086575210,0sleep00-21swapper/020:15:510
4081898210,0sleep20-21swapper/220:05:202
4081528210,0sleep00-21swapper/020:05:190
4080530210,0sleep00-21swapper/020:00:220
4078943210,0sleep00-21swapper/019:56:330
4076248210,0sleep00-21swapper/019:50:180
4075998210,0sleep20-21swapper/219:50:162
4069673210,0sleep00-21swapper/019:35:170
4067135210,0sleep20-21swapper/219:26:132
4065440210,0sleep20-21swapper/219:24:022
4064036210,0sleep00-21swapper/019:20:160
4061572210,0sleep20-21swapper/219:15:022
4060429210,0sleep00-21swapper/019:10:190
4059547210,0sleep20-21swapper/219:10:132
4174601200,0sleep20-21swapper/223:55:032
4161780200,0sleep20-21swapper/223:25:012
4130265200,0sleep00-21swapper/022:10:020
4127939200,0sleep00-21swapper/022:05:020
4126082200,0sleep20-21swapper/222:00:042
4121874200,0sleep20-21swapper/221:50:022
4111146200,0sleep20-21swapper/221:25:012
4098682200,0sleep20-21swapper/220:50:032
4094853200,0sleep00-21swapper/020:40:050
4090998200,0sleep00-21swapper/020:30:040
4089035200,0sleep20-21swapper/220:25:022
4084985200,0sleep20-21swapper/220:15:012
4083305200,0sleep00-21swapper/020:10:030
4083070200,0sleep20-21swapper/220:10:012
4077535200,0sleep20-21swapper/219:55:042
4073205200,0sleep00-21swapper/019:45:010
4071524200,0sleep20-21swapper/219:40:022
4067670200,0sleep20-21swapper/219:30:032
4061896200,0sleep00-21swapper/019:15:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional