You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-25 - 09:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackaslot8.osadl.org (updated Sun Feb 25, 2024 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
208022288255,21sleep10-21swapper/119:09:471
188692271238,21sleep00-21swapper/019:05:100
207832264231,21sleep20-21swapper/219:09:312
205462259224,21sleep30-21swapper/319:06:273
286472640,0sleep20-21swapper/220:35:232
208002620,0sleep00-21swapper/023:38:130
307162540,0sleep20-21swapper/223:21:162
52832230,0sleep30-21swapper/320:55:263
249642190,0sleep20-21swapper/221:43:392
269282170,0sleep30-21swapper/322:08:273
12062150,0sleep20-21swapper/221:26:082
20917991412,1cyclictest28-21ksoftirqd/200:40:002
73242130,0sleep00-21swapper/022:17:290
20917991310,2cyclictest28-21ksoftirqd/223:50:002
306432120,0sleep10-21swapper/122:10:281
20917991211,1cyclictest28-21ksoftirqd/200:00:012
20917991210,1cyclictest28-21ksoftirqd/222:20:002
20917991210,1cyclictest28-21ksoftirqd/200:30:002
2091799119,1cyclictest271rcuc/222:40:002
2091799118,2cyclictest28-21ksoftirqd/222:00:012
2090799118,2cyclictest12-21ksoftirqd/020:50:000
2091799109,1cyclictest28-21ksoftirqd/220:30:002
2091799109,1cyclictest28-21ksoftirqd/200:25:012
2091799109,1cyclictest28-21ksoftirqd/200:05:002
2091799108,1cyclictest28-21ksoftirqd/221:20:002
2091799107,2cyclictest28-21ksoftirqd/219:15:012
2091799104,4cyclictest16969-21lldpd22:20:202
28081290,0sleep00-21swapper/023:20:150
209179998,1cyclictest28-21ksoftirqd/223:00:012
209179998,1cyclictest28-21ksoftirqd/222:05:012
209179998,1cyclictest28-21ksoftirqd/220:10:002
209179998,1cyclictest28-21ksoftirqd/219:40:022
209179997,1cyclictest28-21ksoftirqd/200:10:002
209179996,2cyclictest28-21ksoftirqd/223:44:592
209179996,2cyclictest28-21ksoftirqd/221:50:012
209179996,2cyclictest28-21ksoftirqd/220:15:002
209179991,6cyclictest28-21ksoftirqd/200:15:492
209219984,3cyclictest19982-21systemd-journal00:11:283
209219983,4cyclictest3758-21snmpd00:01:083
209219983,3cyclictest19982-21systemd-journal23:59:213
209219983,3cyclictest19982-21systemd-journal20:38:163
209219983,3cyclictest19982-21systemd-journal00:34:503
209219983,3cyclictest19982-21systemd-journal00:28:343
209179987,1cyclictest28-21ksoftirqd/223:05:012
209179987,1cyclictest28-21ksoftirqd/219:50:022
209179987,1cyclictest28-21ksoftirqd/219:30:012
209179987,1cyclictest28-21ksoftirqd/219:30:012
209179985,2cyclictest28-21ksoftirqd/223:55:002
209179985,2cyclictest28-21ksoftirqd/220:20:002
209179985,2cyclictest28-21ksoftirqd/220:00:012
209179985,2cyclictest28-21ksoftirqd/200:15:012
209179983,3cyclictest19982-21systemd-journal20:55:012
209179983,3cyclictest19982-21systemd-journal19:44:532
209179982,4cyclictest28-21ksoftirqd/221:50:112
209119984,3cyclictest19982-21systemd-journal19:56:331
209119982,3cyclictest2378-21ls19:40:021
209119980,5cyclictest32596-21awk19:35:021
209079983,3cyclictest19982-21systemd-journal23:57:410
209079983,3cyclictest19982-21systemd-journal20:16:100
209079982,3cyclictest6819-21idleruntime-cro19:50:010
12566280,0sleep30-21swapper/321:10:283
209219974,3cyclictest30484-21kworker/3:022:00:203
209219974,2cyclictest668-21runrttasks20:11:353
209219974,2cyclictest508-21dbus-daemon20:25:453
209219974,2cyclictest19982-21systemd-journal22:30:003
209219973,3cyclictest8134-21cat23:05:243
209219973,3cyclictest508-21dbus-daemon21:16:143
209219973,3cyclictest29741-11brltty20:00:193
209219973,3cyclictest0-21swapper/323:49:183
209219973,3cyclictest0-21swapper/323:39:203
209219973,3cyclictest0-21swapper/322:34:343
209219973,3cyclictest0-21swapper/300:09:533
209219973,2cyclictest19982-21systemd-journal19:24:553
209219973,1cyclictest0-21swapper/323:54:033
209219973,1cyclictest0-21swapper/323:25:533
209219973,1cyclictest0-21swapper/322:45:283
209219972,3cyclictest19982-21systemd-journal19:30:013
209219972,3cyclictest19982-21systemd-journal19:30:013
209219971,3cyclictest24479-21rm23:16:563
209219970,2cyclictest25482-21ntp_states21:20:253
209179976,1cyclictest28-21ksoftirqd/220:35:012
209179976,1cyclictest28-21ksoftirqd/219:15:012
209179975,1cyclictest28-21ksoftirqd/221:35:012
209179975,1cyclictest28-21ksoftirqd/219:35:022
209179975,1cyclictest271rcuc/221:20:192
209179974,2cyclictest3758-21snmpd22:40:202
209179974,2cyclictest28-21ksoftirqd/223:20:002
209179974,2cyclictest28-21ksoftirqd/222:15:002
209179974,1cyclictest28-21ksoftirqd/223:05:272
209179973,1cyclictest28-21ksoftirqd/223:26:492
209179973,1cyclictest271rcuc/222:30:242
209179972,3cyclictest28-21ksoftirqd/222:48:232
209179972,3cyclictest28-21ksoftirqd/222:26:092
209179972,3cyclictest19982-21systemd-journal22:06:182
209179972,3cyclictest19982-21systemd-journal20:57:532
209179972,3cyclictest19982-21systemd-journal20:45:222
209179972,3cyclictest19982-21systemd-journal20:40:222
209179971,4cyclictest28-21ksoftirqd/221:34:242
209179971,2cyclictest28-21ksoftirqd/220:00:202
209179970,7cyclictest271rcuc/223:10:222
209179970,5cyclictest8669-21awk19:50:282
209179970,5cyclictest28-21ksoftirqd/221:00:302
209119974,2cyclictest508-21dbus-daemon21:00:481
209119974,2cyclictest508-21dbus-daemon20:45:221
209119973,3cyclictest508-21dbus-daemon23:41:261
209119973,3cyclictest508-21dbus-daemon20:12:251
209119973,3cyclictest3758-21snmpd22:50:121
209119973,3cyclictest19982-21systemd-journal23:30:201
209119973,3cyclictest19982-21systemd-journal22:30:311
209119973,3cyclictest19982-21systemd-journal20:01:581
209119973,3cyclictest14008-21ntpq21:35:291
209119973,3cyclictest11777-21sshd21:57:081
209119973,3cyclictest0-21swapper/121:41:191
209119973,2cyclictest16969-21lldpd19:15:281
209119973,1cyclictest0-21swapper/123:37:591
209119973,1cyclictest0-21swapper/121:31:211
209119973,1cyclictest0-21swapper/100:30:581
209119973,1cyclictest0-21swapper/100:22:461
209119972,2cyclictest20816-21rm22:27:161
209119970,4cyclictest28851-21awk00:40:001
209079976,1cyclictest12-21ksoftirqd/000:35:010
209079974,2cyclictest19505-21diskstats22:50:210
209079974,2cyclictest12-21ksoftirqd/023:35:010
209079973,3cyclictest508-21dbus-daemon21:56:180
209079973,3cyclictest3758-21snmpd20:57:400
209079973,3cyclictest3758-21snmpd20:14:160
209079973,3cyclictest29741-11brltty21:23:450
209079973,3cyclictest19982-21systemd-journal22:24:160
209079973,3cyclictest0-21swapper/022:09:080
209079972,3cyclictest19982-21systemd-journal22:25:310
209079972,3cyclictest19982-21systemd-journal21:45:270
209079972,3cyclictest19982-21systemd-journal21:25:500
12455270,0chrt0-21swapper/221:10:262
209219963,3cyclictest30484-21kworker/3:020:50:033
209219963,2cyclictest6959-21ssh00:17:193
209219963,2cyclictest27089-21cat21:45:223
209219963,2cyclictest25623-21ssh00:35:493
209219963,2cyclictest2084-21ssh22:37:173
209219963,2cyclictest10333-21ssh21:55:443
209219963,1cyclictest0-21swapper/323:20:483
209219962,3cyclictest876-21ntpq20:45:283
209219962,3cyclictest8225-21seq21:01:363
209219962,3cyclictest5636-21cat22:40:223
209219962,3cyclictest5634-21packagekitd21:30:003
209219962,3cyclictest508-21dbus-daemon19:10:163
209219962,3cyclictest3758-21snmpd21:06:533
209219962,3cyclictest3758-21snmpd20:40:433
209219962,3cyclictest3758-21snmpd19:45:063
209219962,3cyclictest3758-21snmpd00:20:243
209219962,3cyclictest3330-21cat19:40:253
209219962,3cyclictest30849-21cat19:30:233
209219962,3cyclictest24664-21cat19:15:263
209219962,3cyclictest22153-21uname20:20:263
209219962,3cyclictest1444-21sh21:26:233
209219962,3cyclictest1-21systemd20:19:553
209219962,3cyclictest1091-21cat19:35:253
209219962,3cyclictest0-21swapper/323:40:443
209219962,3cyclictest0-21swapper/322:15:403
209219962,1cyclictest0-21swapper/321:50:203
209219961,4cyclictest0-21swapper/323:10:263
209219961,3cyclictest19982-21systemd-journal22:55:573
209219961,3cyclictest19982-21systemd-journal21:42:083
209219961,2cyclictest3579-21rm23:01:493
209219961,1cyclictest19082-21apt-get22:50:193
209219960,5cyclictest32013-21ssh22:11:373
209219960,5cyclictest14985-21ntp_states20:05:273
209219960,3cyclictest14740-21rm21:35:373
209219960,3cyclictest11725-21rm23:31:003
209179963,2cyclictest508-21dbus-daemon23:35:102
209179962,3cyclictest29741-11brltty00:33:092
209179962,3cyclictest271rcuc/219:20:202
209179962,3cyclictest21942-21cat20:20:242
209179962,1cyclictest141rcu_preempt23:30:252
209179960,4cyclictest0-21swapper/222:50:382
209119966,0cyclictest0-21swapper/121:50:371
209119964,1cyclictest12425-21head23:55:271
209119963,2cyclictest5883-21needreboot23:50:291
209119963,2cyclictest5380-21head19:45:201
209119963,2cyclictest29741-11brltty20:52:271
209119963,2cyclictest22003-21idleruntime23:15:241
209119963,2cyclictest19366-21tr00:00:291
209119963,2cyclictest15211-21cut23:10:261
209119963,2cyclictest10715-21diskmemload00:12:551
209119963,2cyclictest10523-21chrt21:07:441
209119962,3cyclictest3758-21snmpd23:27:011
209119962,3cyclictest3758-21snmpd23:06:151
209119962,3cyclictest3758-21snmpd22:36:061
209119962,3cyclictest3758-21snmpd22:20:041
209119962,3cyclictest3758-21snmpd22:15:251
209119962,3cyclictest3758-21snmpd21:45:121
209119962,3cyclictest3758-21snmpd21:25:121
209119962,3cyclictest3758-21snmpd21:10:521
209119962,3cyclictest3758-21snmpd19:11:251
209119962,3cyclictest32445-21cron23:00:011
209119962,3cyclictest3097-21cut19:40:251
209119962,3cyclictest28890-21cut19:25:201
209119962,3cyclictest28890-21cut19:25:201
209119962,3cyclictest24948-21fschecks_time21:20:221
209119962,3cyclictest19982-21systemd-journal23:46:081
209119962,3cyclictest18087-21cat21:15:211
209119962,3cyclictest1-21systemd20:40:011
209119962,3cyclictest0-21swapper/122:47:421
209119962,3cyclictest0-21swapper/100:26:551
209119962,1cyclictest0-21swapper/123:20:541
209119962,1cyclictest0-21swapper/122:05:111
209119962,1cyclictest0-21swapper/122:00:461
209119961,3cyclictest19982-21systemd-journal20:40:011
209119961,3cyclictest19982-21systemd-journal19:50:181
209119960,5cyclictest26276-21smart_sda00:05:341
209119960,4cyclictest19982-21systemd-journal20:15:201
209119960,0cyclictest0-21swapper/122:42:501
209119960,0cyclictest0-21swapper/120:05:281
209119960,0cyclictest0-21swapper/100:17:291
209079966,0cyclictest0-21swapper/021:40:340
209079964,1cyclictest29547-21df22:10:210
209079964,1cyclictest0-21swapper/023:48:050
209079963,2cyclictest8946-21tr21:05:210
209079963,2cyclictest8427-21sh21:31:130
209079963,2cyclictest426-21sh23:00:120
209079963,2cyclictest3905-21ssh00:15:080
209079963,2cyclictest3250-21grep23:25:240
209079963,2cyclictest32034-21sh22:59:370
209079963,2cyclictest30783-21apt00:10:220
209079963,2cyclictest23601-21sh23:16:050
209079963,2cyclictest14356-21sort00:25:220
209079963,2cyclictest14116-21sh23:10:040
209079963,2cyclictest10777-21ssh00:20:340
209079963,1cyclictest0-21swapper/021:14:430
209079962,3cyclictest8149-21cat23:05:230
209079962,3cyclictest8049-21cat19:50:220
209079962,3cyclictest7738-21mailstats21:00:300
209079962,3cyclictest3758-21snmpd21:50:280
209079962,3cyclictest3758-21snmpd21:18:030
209079962,3cyclictest3758-21snmpd20:50:010
209079962,3cyclictest3758-21snmpd20:37:330
209079962,3cyclictest3758-21snmpd20:29:460
209079962,3cyclictest3758-21snmpd20:01:090
209079962,3cyclictest3758-21snmpd19:27:590
209079962,3cyclictest3758-21snmpd19:27:590
209079962,3cyclictest3758-21snmpd19:15:110
209079962,3cyclictest3758-21snmpd19:10:040
209079962,3cyclictest31546-21cat20:40:300
209079962,3cyclictest26733-21grep19:20:240
209079962,3cyclictest25085-21expr00:05:210
209079962,3cyclictest24448-21ntpq23:40:360
209079962,3cyclictest19982-21systemd-journal00:36:300
209079962,3cyclictest18881-21expr00:00:240
209079962,3cyclictest1-21systemd19:34:020
209079962,3cyclictest10259-21cat19:55:220
209079962,3cyclictest0-21swapper/022:35:210
209079962,3cyclictest0-21swapper/021:37:580
209079962,1cyclictest0-21swapper/022:31:240
209079962,1cyclictest0-21swapper/022:00:310
209079961,3cyclictest19982-21systemd-journal23:50:060
209079961,3cyclictest19982-21systemd-journal22:45:070
209079961,3cyclictest19982-21systemd-journal22:40:070
209079961,3cyclictest19982-21systemd-journal19:37:470
209079961,3cyclictest16969-21lldpd20:30:170
209219953,1cyclictest7562-21tr19:50:203
209219953,1cyclictest26085-21seq20:30:203
209219952,2cyclictest10412-21rm22:20:133
209219951,2cyclictest19982-21systemd-journal19:55:013
209179952,2cyclictest8755-21basename21:05:192
209119952,2cyclictest3758-21snmpd20:30:041
209119952,2cyclictest23966-21fschecks_time20:25:231
209119952,2cyclictest16222-1kworker/u9:123:00:181
209119951,3cyclictest3758-21snmpd20:55:221
209119951,3cyclictest26330-21cat19:20:211
209119951,3cyclictest21527-21cat20:20:231
209079952,2cyclictest3593-21tr19:40:270
209079952,2cyclictest21413-21grep20:20:220
209079951,2cyclictest19982-21systemd-journal20:05:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional