You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-26 - 14:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack2slot0.osadl.org (updated Tue Sep 26, 2023 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
170772550,2sleep090699cyclictest10:08:390
96382540,0sleep20-21swapper/207:30:002
189052530,0sleep10-21swapper/112:35:271
101202500,1sleep1231rcuc/109:34:281
211292490,0sleep20-21swapper/211:10:012
161192490,0sleep30-21swapper/311:22:163
276852480,0sleep30-21swapper/311:04:363
189102480,0sleep20-21swapper/210:49:182
269592460,0sleep20-21swapper/209:37:452
217582460,0sleep00-21swapper/009:36:390
113362460,0sleep20-21swapper/207:31:282
13752410,0sleep10-21swapper/110:11:561
90982400,0sleep00-21swapper/009:40:320
47924028,7sleep30-21swapper/307:06:393
233632350,0sleep1231rcuc/111:23:501
5592309,7sleep10-21swapper/107:07:331
4152256,4sleep00-21swapper/007:05:520
63322313,6sleep20-21swapper/207:08:262
134312210,0sleep30-21swapper/311:35:083
228872170,1sleep00-21swapper/010:43:190
151652170,0sleep20-21swapper/212:21:342
108252170,0sleep00-21swapper/011:34:370
912991514,0cyclictest521-40kipmi009:22:243
911991514,0cyclictest31272-21lspci11:18:472
325372150,0sleep10-21swapper/110:45:211
209872150,1sleep20-21swapper/207:55:302
911991414,0cyclictest1013-21snmpd11:57:592
85552140,0sleep00-21swapper/011:14:080
182192140,0sleep00-21swapper/010:22:050
91299130,12cyclictest0-21swapper/312:01:483
90699130,12cyclictest0-21swapper/012:03:170
40392130,0sleep10-21swapper/109:46:051
255162130,0sleep00-21swapper/012:36:500
112312130,0sleep00-21swapper/009:54:170
911991212,0cyclictest521-40kipmi012:27:352
911991211,0cyclictest9348-21lspci11:47:302
241522120,0sleep024154-21gltestperf10:50:200
91299119,1cyclictest0-21swapper/311:08:493
912991110,0cyclictest5819-21lspci11:53:273
912991110,0cyclictest0-21swapper/310:59:193
912991110,0cyclictest0-21swapper/309:45:583
91299110,10cyclictest0-21swapper/310:27:593
91299110,10cyclictest0-21swapper/310:17:593
91299110,10cyclictest0-21swapper/309:16:093
911991110,0cyclictest0-21swapper/210:43:432
91199110,10cyclictest15001-21sshd10:14:522
91199110,10cyclictest0-21swapper/210:34:532
91199110,10cyclictest0-21swapper/209:43:432
91099110,10cyclictest0-21swapper/111:13:491
90699110,10cyclictest0-21swapper/009:28:460
91299109,0cyclictest0-21swapper/310:03:493
91299108,1cyclictest75050irq/24-eno1-rx-10:49:483
91299100,0cyclictest0-21swapper/311:15:293
91199109,0cyclictest0-21swapper/212:18:022
91199109,0cyclictest0-21swapper/210:22:122
91199109,0cyclictest0-21swapper/210:09:432
91199109,0cyclictest0-21swapper/209:25:032
91199109,0cyclictest0-21swapper/209:23:322
91199109,0cyclictest0-21swapper/209:10:522
91199108,1cyclictest11986-21sshd12:34:132
91199101,1cyclictest131rcu_sched12:04:042
91199100,0cyclictest0-21swapper/210:57:032
91199100,0cyclictest0-21swapper/208:52:332
91099100,0cyclictest0-21swapper/112:17:091
91099100,0cyclictest0-21swapper/111:25:091
91099100,0cyclictest0-21swapper/110:43:591
91099100,0cyclictest0-21swapper/109:21:581
91099100,0cyclictest0-21swapper/109:17:091
90699109,0cyclictest0-21swapper/012:26:370
90699109,0cyclictest0-21swapper/010:34:270
90699109,0cyclictest0-21swapper/010:16:460
90699109,0cyclictest0-21swapper/009:00:360
90699108,1cyclictest0-21swapper/010:48:370
90699102,4cyclictest661-21dbus-daemon09:35:000
90699100,0cyclictest0-21swapper/012:16:460
153122100,0sleep30-21swapper/310:35:013
9129998,0cyclictest24553-21lspci09:50:233
9129998,0cyclictest0-21swapper/312:11:293
9129998,0cyclictest0-21swapper/311:26:483
9129998,0cyclictest0-21swapper/311:14:183
9129998,0cyclictest0-21swapper/309:31:483
9129998,0cyclictest0-21swapper/308:05:283
9129990,0cyclictest0-21swapper/307:58:273
9119998,0cyclictest0-21swapper/212:39:432
9119998,0cyclictest0-21swapper/210:36:022
9119992,1cyclictest33-21ksoftirqd/210:54:302
9119991,2cyclictest33-21ksoftirqd/210:27:152
9119991,1cyclictest656-21systemd-logind11:02:462
9119991,1cyclictest33-21ksoftirqd/211:33:072
9119991,1cyclictest131rcu_sched11:50:262
9119991,1cyclictest131rcu_sched11:37:192
9119990,4cyclictest680-21polkitd11:08:042
9109998,0cyclictest0-21swapper/110:50:281
9109998,0cyclictest0-21swapper/110:02:581
9109990,0cyclictest0-21swapper/112:11:001
9069998,0cyclictest0-21swapper/010:00:260
9069997,1cyclictest0-21swapper/009:57:070
9069996,2cyclictest18091-21kworker/0:212:23:330
9069990,5cyclictest661-21dbus-daemon11:19:590
1904290,0sleep10-21swapper/110:59:151
9129987,0cyclictest0-21swapper/312:17:383
9129987,0cyclictest0-21swapper/310:52:293
9129987,0cyclictest0-21swapper/310:31:493
9129987,0cyclictest0-21swapper/310:24:083
9129987,0cyclictest0-21swapper/310:14:083
9129987,0cyclictest0-21swapper/307:16:273
9129986,1cyclictest9845-21lspci11:47:373
9129985,2cyclictest680-21polkitd09:56:213
9129985,2cyclictest650-21avahi-daemon12:09:453
9129985,2cyclictest650-21avahi-daemon09:38:483
9129984,3cyclictest661-21dbus-daemon12:27:373
9119987,0cyclictest0-21swapper/211:26:022
9119987,0cyclictest0-21swapper/210:01:122
9119987,0cyclictest0-21swapper/209:53:032
9119987,0cyclictest0-21swapper/209:45:122
9119986,1cyclictest32725-21lspci12:05:242
9119985,2cyclictest650-21avahi-daemon09:15:352
9119983,1cyclictest33-21ksoftirqd/209:55:372
9119981,1cyclictest33-21ksoftirqd/209:31:272
9119981,0cyclictest131rcu_sched10:15:012
9109987,0cyclictest0-21swapper/109:59:391
9109987,0cyclictest0-21swapper/109:51:291
9109985,2cyclictest650-21avahi-daemon11:38:431
9109985,2cyclictest650-21avahi-daemon11:16:121
9109985,2cyclictest650-21avahi-daemon10:33:011
9109985,2cyclictest650-21avahi-daemon10:18:001
9109985,2cyclictest650-21avahi-daemon09:43:201
9109985,2cyclictest650-21avahi-daemon08:05:001
9109985,1cyclictest680-21polkitd09:35:081
9109985,1cyclictest3106-21sshd12:25:361
9069987,0cyclictest0-21swapper/012:30:560
9069987,0cyclictest0-21swapper/012:11:470
9069987,0cyclictest0-21swapper/010:26:460
9069987,0cyclictest0-21swapper/009:20:570
9069987,0cyclictest0-21swapper/009:16:060
9069986,1cyclictest656-21systemd-logind12:09:530
9069985,2cyclictest661-21dbus-daemon11:24:510
9069985,2cyclictest650-21avahi-daemon11:47:020
9069985,2cyclictest650-21avahi-daemon11:08:440
9069985,2cyclictest650-21avahi-daemon09:45:130
9069980,7cyclictest0-21swapper/007:10:360
20053280,1sleep1241ktimersoftd/109:10:201
9129976,0cyclictest0-21swapper/312:21:593
9129975,1cyclictest680-21polkitd12:34:353
9129975,1cyclictest680-21polkitd11:30:023
9129975,1cyclictest680-21polkitd10:06:143
9129974,2cyclictest661-21dbus-daemon11:58:033
9129974,2cyclictest650-21avahi-daemon12:37:173
9129974,2cyclictest650-21avahi-daemon10:40:303
9129974,2cyclictest650-21avahi-daemon09:10:093
9129973,3cyclictest680-21polkitd09:28:193
9129971,1cyclictest121rcu_preempt11:40:243
9119973,3cyclictest650-21avahi-daemon11:23:172
9119972,1cyclictest131rcu_sched11:41:022
9119970,1cyclictest33-21ksoftirqd/212:12:322
9109976,1cyclictest26795-21lspci11:50:581
9109976,0cyclictest0-21swapper/112:30:091
9109976,0cyclictest0-21swapper/110:37:281
9109976,0cyclictest0-21swapper/110:28:381
9109975,1cyclictest650-21avahi-daemon11:55:051
9109975,1cyclictest650-21avahi-daemon11:46:111
9109974,2cyclictest686-21gdbus10:05:281
9109974,2cyclictest661-21dbus-daemon12:00:301
9109974,2cyclictest656-21systemd-logind09:26:061
9109974,2cyclictest650-21avahi-daemon11:34:301
9109974,2cyclictest650-21avahi-daemon11:03:311
9109974,2cyclictest1-21systemd12:06:001
9069976,0cyclictest0-21swapper/007:56:360
9069975,1cyclictest680-21polkitd11:42:400
9069974,2cyclictest686-21gdbus11:01:000
9069974,2cyclictest650-21avahi-daemon11:26:530
9069974,2cyclictest650-21avahi-daemon10:12:200
9069974,2cyclictest650-21avahi-daemon09:12:090
9069974,2cyclictest1013-21snmpd09:09:480
9069973,3cyclictest650-21avahi-daemon10:56:480
9069970,6cyclictest0-21swapper/008:00:070
21524270,0sleep00-21swapper/011:56:330
9129964,1cyclictest1013-21snmpd07:34:293
9129963,2cyclictest1013-21snmpd08:56:353
9129963,2cyclictest1013-21snmpd08:29:083
9129962,3cyclictest661-21dbus-daemon09:40:093
9129962,3cyclictest41-21ksoftirqd/308:45:003
9119964,1cyclictest33-21ksoftirqd/209:10:002
9119963,2cyclictest661-21dbus-daemon08:15:012
9119963,2cyclictest20729-21gdbus07:40:002
9119962,2cyclictest121rcu_preempt07:19:592
9109965,0cyclictest0-21swapper/108:27:191
9109965,0cyclictest0-21swapper/107:26:291
9109964,1cyclictest680-21polkitd10:20:191
9109964,1cyclictest650-21avahi-daemon12:20:571
9109964,1cyclictest650-21avahi-daemon11:40:071
9109964,1cyclictest10383-21grep08:50:211
9109963,2cyclictest680-21polkitd11:05:301
9069966,0cyclictest27953-21kworker/0:208:29:490
9069965,0cyclictest0-21swapper/007:41:070
9069965,0cyclictest0-21swapper/007:36:360
9069965,0cyclictest0-21swapper/007:24:460
9069964,1cyclictest680-21polkitd11:50:000
9069964,1cyclictest680-21polkitd11:35:220
9069963,2cyclictest650-21avahi-daemon10:35:490
9069960,5cyclictest0-21swapper/008:21:260
9069960,4cyclictest661-21dbus-daemon08:09:560
9069960,0cyclictest0-21swapper/007:46:360
9129954,0cyclictest0-21swapper/308:35:393
9129953,1cyclictest10427-21gltestperf08:50:213
9129953,1cyclictest1013-21snmpd08:20:013
9129953,1cyclictest1013-21snmpd08:15:063
9129953,1cyclictest1013-21snmpd08:03:313
9129953,1cyclictest1013-21snmpd07:51:063
9129953,1cyclictest1013-21snmpd07:48:013
9129953,1cyclictest1013-21snmpd07:41:353
9129953,1cyclictest1013-21snmpd07:37:093
9129953,1cyclictest1013-21snmpd07:26:303
9129953,1cyclictest1013-21snmpd07:21:393
9129953,1cyclictest0-21swapper/308:10:273
9129952,2cyclictest661-21dbus-daemon09:05:003
9129952,2cyclictest1407-21cat07:10:193
9119954,0cyclictest0-21swapper/208:48:522
9119954,0cyclictest0-21swapper/207:47:322
9119953,1cyclictest6796-21sendmail_mailqu07:20:252
9119953,1cyclictest650-21avahi-daemon08:36:342
9119953,1cyclictest650-21avahi-daemon07:12:512
9119953,1cyclictest33-21ksoftirqd/207:35:012
9119953,1cyclictest24594-21cat08:05:202
9119953,1cyclictest14607-21cat09:00:212
9119953,1cyclictest1013-21snmpd08:33:282
9119953,1cyclictest1013-21snmpd08:20:162
9119953,1cyclictest1013-21snmpd08:11:582
9119953,1cyclictest1013-21snmpd07:53:432
9119952,2cyclictest23427-21grep08:00:332
9119952,2cyclictest0-21swapper/208:25:182
9119951,1cyclictest0-21swapper/208:40:232
9119950,2cyclictest12390-21diskstats08:55:192
9109954,0cyclictest0-21swapper/108:12:381
9109954,0cyclictest0-21swapper/107:34:281
9109953,1cyclictest22555-21cat08:00:251
9109953,1cyclictest1641-21cat07:10:211
9109953,1cyclictest12330-21cat07:35:221
9109953,1cyclictest1102-21ntpd07:41:381
9109953,1cyclictest1013-21snmpd09:00:141
9109953,1cyclictest1013-21snmpd08:55:111
9109953,1cyclictest1013-21snmpd08:43:291
9109953,1cyclictest1013-21snmpd08:36:071
9109953,1cyclictest1013-21snmpd08:30:191
9109953,1cyclictest1013-21snmpd08:24:491
9109953,1cyclictest1013-21snmpd07:22:021
9109953,1cyclictest1013-21snmpd07:17:241
9109952,2cyclictest28469-21gltestperf08:15:231
9109952,2cyclictest21146-21wc07:55:321
9109952,2cyclictest17419-21seq07:46:151
9109950,0cyclictest0-21swapper/108:46:181
9069955,0cyclictest5793-21kworker/0:008:45:040
9069954,0cyclictest0-21swapper/007:15:370
9069953,1cyclictest6502-21cat08:40:210
9069953,1cyclictest2403-21cat08:30:250
9069953,1cyclictest1037-21lldpd07:28:030
9069953,1cyclictest1013-21snmpd08:55:240
9069953,1cyclictest1013-21snmpd08:50:150
9069953,1cyclictest1000-21runrttasks08:10:210
9069952,2cyclictest9845-21chrt07:30:170
9069952,2cyclictest656-21systemd-logind08:20:010
9069950,0cyclictest0-21swapper/007:51:470
9129942,1cyclictest41-21ksoftirqd/308:30:003
9129942,1cyclictest14416-21sh09:00:203
9129942,1cyclictest1013-21snmpd08:45:073
9109942,1cyclictest18601-21cat07:50:241
9109942,1cyclictest16410-21expr09:05:191
9069942,1cyclictest4548-21cat08:35:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional