You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-11-29 - 17:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Wed Nov 29, 2023 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
252072600,0sleep10-21swapper/110:11:471
267162580,1sleep10-21swapper/107:05:151
249472550,0sleep0111rcuc/011:23:170
288432540,4sleep228841-21sshd10:17:582
287012540,0sleep20-21swapper/211:40:212
48522530,0sleep20-21swapper/211:58:192
295682530,0sleep10-21swapper/110:29:181
145312530,1sleep214528-21lspci10:20:542
143862530,0sleep10-21swapper/109:31:031
192872520,0sleep10-21swapper/109:54:061
107332520,0sleep00-21swapper/010:03:450
156492510,0sleep315615-21sshd10:48:503
62922500,0sleep00-21swapper/009:35:180
126072500,0sleep20-21swapper/211:48:382
274662470,0sleep30-21swapper/311:23:433
162792470,0sleep30-21swapper/312:05:373
241232410,2sleep12865399cyclictest09:43:571
186162340,1sleep09-21ksoftirqd/010:38:220
265162298,7sleep30-21swapper/307:05:103
280402269,12sleep20-21swapper/207:06:092
2825222512,8sleep00-21swapper/007:07:480
68682190,0sleep1231rcuc/111:14:481
126282180,0sleep20-21swapper/210:59:202
28653991615,0cyclictest29556-21lspci12:08:021
23102160,0sleep20-21swapper/212:30:432
35102150,0sleep00-21swapper/012:14:390
28664991514,0cyclictest0-21swapper/310:12:453
2865999149,1cyclictest7850-21sshd09:24:382
28653991414,0cyclictest33150irq/27-ahci[00010:32:431
148992140,0sleep00-21swapper/011:32:300
142302140,0sleep30-21swapper/311:37:533
101602140,1sleep0111rcuc/011:26:080
139502130,1sleep00-21swapper/007:45:260
69612120,0sleep00-21swapper/009:57:260
28664991210,1cyclictest656-21systemd-logind10:23:053
28664991210,1cyclictest656-21systemd-logind09:47:253
28664991210,1cyclictest0-21swapper/311:11:363
2866499120,11cyclictest661-21dbus-daemon11:43:473
2866499120,11cyclictest22195-21bash09:32:253
2865999120,11cyclictest661-21dbus-daemon12:09:092
2865999120,11cyclictest1-21systemd11:10:082
28646991210,1cyclictest3334-21sshd11:52:290
2864699120,1cyclictest14627-21cp10:26:390
2864699120,11cyclictest656-21systemd-logind11:40:490
2864699120,11cyclictest0-21swapper/010:20:300
285432120,0sleep20-21swapper/211:07:252
56432110,0sleep20-21swapper/212:03:592
2866499110,1cyclictest13328-21sshd10:37:263
2866499110,10cyclictest0-21swapper/311:01:273
2865999110,10cyclictest3410-21lspci10:02:292
2865999110,0cyclictest0-21swapper/210:44:092
2865999110,0cyclictest0-21swapper/209:19:092
2865399119,1cyclictest0-21swapper/112:36:091
2865399119,1cyclictest0-21swapper/109:15:091
28653991110,0cyclictest33150irq/27-ahci[00012:28:031
2865399110,10cyclictest24893-21kworker/1:111:06:191
2865399110,10cyclictest0-21swapper/112:04:581
2865399110,10cyclictest0-21swapper/111:16:291
2865399110,10cyclictest0-21swapper/110:59:491
2865399110,10cyclictest0-21swapper/109:26:591
28646991110,0cyclictest0-21swapper/012:32:000
2864699110,10cyclictest0-21swapper/012:40:000
2864699110,10cyclictest0-21swapper/012:24:000
2864699110,10cyclictest0-21swapper/011:17:100
2864699110,10cyclictest0-21swapper/010:56:500
2864699110,10cyclictest0-21swapper/010:41:000
2864699110,10cyclictest0-21swapper/008:50:300
2866499109,0cyclictest0-21swapper/310:28:263
2866499109,0cyclictest0-21swapper/309:55:553
2866499109,0cyclictest0-21swapper/309:04:363
2866499100,9cyclictest0-21swapper/311:56:373
2866499100,0cyclictest0-21swapper/312:28:563
2866499100,0cyclictest0-21swapper/311:26:073
2866499100,0cyclictest0-21swapper/310:04:263
2866499100,0cyclictest0-21swapper/308:14:553
2865999109,0cyclictest5113-21sshd11:52:482
2865999109,0cyclictest0-21swapper/212:11:092
2865999109,0cyclictest0-21swapper/211:21:292
2865999109,0cyclictest0-21swapper/210:50:392
2865999109,0cyclictest0-21swapper/209:14:282
2865999100,0cyclictest0-21swapper/211:34:192
2865399109,0cyclictest33150irq/27-ahci[00010:36:401
2865399109,0cyclictest0-21swapper/111:57:491
2865399109,0cyclictest0-21swapper/111:34:091
2865399109,0cyclictest0-21swapper/110:46:491
2865399109,0cyclictest0-21swapper/109:10:381
2865399108,1cyclictest30121-21bash10:06:591
2865399108,0cyclictest0-21swapper/112:24:091
2865399107,2cyclictest661-21dbus-daemon11:23:191
2865399100,0cyclictest0-21swapper/110:17:191
2864699109,0cyclictest0-21swapper/012:28:000
2864699109,0cyclictest0-21swapper/009:48:590
2864699108,1cyclictest661-21dbus-daemon11:10:400
2864699108,1cyclictest1037-21lldpd09:07:000
2864699100,0cyclictest0-21swapper/009:10:590
286649999,0cyclictest0-21swapper/311:50:373
286649998,0cyclictest0-21swapper/311:34:573
286649998,0cyclictest0-21swapper/309:21:553
286649998,0cyclictest0-21swapper/307:52:463
286649990,0cyclictest0-21swapper/310:32:563
286599998,0cyclictest0-21swapper/210:35:582
286599998,0cyclictest0-21swapper/210:26:092
286599998,0cyclictest0-21swapper/209:57:482
286539998,0cyclictest0-21swapper/111:40:591
286539998,0cyclictest0-21swapper/110:53:191
286539998,0cyclictest0-21swapper/109:57:391
286539998,0cyclictest0-21swapper/107:30:291
286539997,1cyclictest25-21ksoftirqd/111:53:461
286539992,1cyclictest25-21ksoftirqd/111:03:191
286539991,2cyclictest131rcu_sched09:38:501
286469998,0cyclictest0-21swapper/012:01:400
286469998,0cyclictest0-21swapper/011:00:290
286469998,0cyclictest0-21swapper/010:32:000
286469997,2cyclictest5502-21kworker/0:310:46:510
286469997,2cyclictest31157-21kworker/0:111:36:470
286469997,2cyclictest31157-21kworker/0:111:08:230
286469997,2cyclictest22801-21kworker/0:011:47:070
286469997,2cyclictest21980-21kworker/0:111:55:310
286469997,2cyclictest21667-21kworker/0:312:15:500
286469997,2cyclictest17955-21kworker/0:009:20:470
286469997,2cyclictest17366-21kworker/0:209:30:190
286469997,2cyclictest15651-21kworker/0:310:07:390
286469997,2cyclictest15651-21kworker/0:309:50:070
286469997,1cyclictest20697-21sshd10:10:590
286469997,1cyclictest0-21swapper/009:04:590
286469990,5cyclictest19353-21munin-run10:55:000
286649987,0cyclictest0-21swapper/311:48:363
286649987,0cyclictest0-21swapper/311:18:073
286649987,0cyclictest0-21swapper/308:58:553
286649987,0cyclictest0-21swapper/308:08:463
286649986,1cyclictest3036-21lspci10:07:553
286649985,2cyclictest650-21avahi-daemon12:35:453
286649985,2cyclictest650-21avahi-daemon12:19:033
286649985,2cyclictest650-21avahi-daemon12:03:393
286649985,2cyclictest650-21avahi-daemon10:58:273
286649985,2cyclictest650-21avahi-daemon09:43:033
286649985,2cyclictest650-21avahi-daemon09:13:223
286649983,2cyclictest680-21polkitd11:07:003
286599987,0cyclictest0-21swapper/211:39:082
286599987,0cyclictest0-21swapper/211:19:292
286599986,1cyclictest14492-21lspci08:59:412
286599985,2cyclictest650-21avahi-daemon11:00:002
286599985,2cyclictest650-21avahi-daemon10:06:122
286599985,2cyclictest650-21avahi-daemon09:51:312
286539987,0cyclictest0-21swapper/112:30:091
286539987,0cyclictest0-21swapper/110:40:191
286539986,1cyclictest25-21ksoftirqd/112:15:201
286539986,1cyclictest25-21ksoftirqd/111:25:121
286539986,1cyclictest25-21ksoftirqd/110:04:591
286539985,2cyclictest650-21avahi-daemon11:46:011
286539981,2cyclictest25-21ksoftirqd/112:10:241
286539980,1cyclictest25-21ksoftirqd/109:20:021
286469986,2cyclictest5982-21kworker/0:210:15:390
286469986,2cyclictest21980-21kworker/0:112:06:110
286469986,2cyclictest19757-21kworker/0:309:16:030
286469986,2cyclictest18128-21kworker/0:109:25:220
286469986,2cyclictest16911-21kworker/0:009:40:150
286469982,3cyclictest1-21systemd07:20:000
286649976,0cyclictest0-21swapper/309:52:063
286649975,1cyclictest650-21avahi-daemon10:52:153
286649975,1cyclictest26243-21sshd09:16:303
286649974,2cyclictest686-21gdbus09:27:553
286649974,2cyclictest661-21dbus-daemon12:30:353
286649974,2cyclictest656-21systemd-logind10:15:153
286649974,2cyclictest650-21avahi-daemon12:10:203
286649974,2cyclictest17468-21kworker/u8:010:40:073
286649973,3cyclictest20727-21packagekitd12:21:093
286599976,0cyclictest0-21swapper/212:15:092
286599976,0cyclictest0-21swapper/210:31:292
286599975,1cyclictest650-21avahi-daemon12:21:432
286599975,1cyclictest650-21avahi-daemon10:13:062
286599975,1cyclictest650-21avahi-daemon09:32:252
286599974,2cyclictest650-21avahi-daemon09:38:132
286599974,2cyclictest4620-21sshd12:36:392
286599974,2cyclictest20729-21gdbus12:28:272
286599973,1cyclictest0-21swapper/210:45:552
286599973,1cyclictest0-21swapper/209:45:082
286599973,1cyclictest0-21swapper/209:29:032
286599972,2cyclictest686-21gdbus11:25:122
286539975,1cyclictest25-21ksoftirqd/110:20:241
286539975,1cyclictest14519-21lspci08:59:411
286539972,1cyclictest25-21ksoftirqd/107:14:591
286539970,1cyclictest686-21gdbus09:45:561
286539970,1cyclictest30432-21systemd-cgroups11:35:121
286539970,1cyclictest131rcu_sched08:55:011
286649965,0cyclictest0-21swapper/307:32:453
286649965,0cyclictest0-21swapper/307:20:453
286649965,0cyclictest0-21swapper/307:18:563
286649964,1cyclictest661-21dbus-daemon09:35:093
286649963,2cyclictest1013-21snmpd08:53:023
286649963,2cyclictest1013-21snmpd08:46:463
286649963,2cyclictest1013-21snmpd07:43:413
286649960,5cyclictest0-21swapper/309:09:253
286649960,5cyclictest0-21swapper/308:38:263
286599964,1cyclictest680-21polkitd09:40:112
286599964,1cyclictest680-21polkitd07:24:592
286599963,2cyclictest1013-21snmpd08:45:002
286599963,2cyclictest1013-21snmpd07:47:582
286599963,2cyclictest1013-21snmpd07:10:282
286599960,5cyclictest0-21swapper/207:34:382
286539965,0cyclictest25-21ksoftirqd/108:45:011
286539964,1cyclictest25-21ksoftirqd/109:10:001
286539963,2cyclictest1013-21snmpd08:39:071
286539963,2cyclictest1013-21snmpd08:02:351
286539963,2cyclictest1013-21snmpd07:27:501
286539963,2cyclictest1013-21snmpd07:17:431
286539960,5cyclictest3608-21kworker/1:008:19:321
286469966,0cyclictest813-21kworker/0:208:47:380
286469966,0cyclictest813-21kworker/0:208:35:220
286469966,0cyclictest813-21kworker/0:208:30:300
286469966,0cyclictest21689-21kworker/0:107:10:180
286469966,0cyclictest1329-21kworker/0:207:35:220
286469966,0cyclictest1329-21kworker/0:207:25:310
286469966,0cyclictest10431-21kworker/0:008:25:350
286469966,0cyclictest10431-21kworker/0:008:25:340
286469966,0cyclictest10431-21kworker/0:008:20:430
286469966,0cyclictest10431-21kworker/0:008:17:350
286469966,0cyclictest10431-21kworker/0:008:13:340
286469966,0cyclictest10431-21kworker/0:008:05:390
286469966,0cyclictest10431-21kworker/0:008:01:260
286469966,0cyclictest10431-21kworker/0:007:55:270
286469966,0cyclictest10431-21kworker/0:007:50:230
286469966,0cyclictest10431-21kworker/0:007:40:270
286469966,0cyclictest10008-21kworker/0:008:56:350
286469963,2cyclictest6106-21sed08:40:230
286469963,2cyclictest1013-21snmpd07:30:140
286649953,1cyclictest4261-21gltestperf07:25:273
286649953,1cyclictest29351-21cat07:10:213
286649953,1cyclictest20316-21cat08:00:233
286649953,1cyclictest1643-21cat08:30:233
286649953,1cyclictest1013-21snmpd08:25:043
286649953,1cyclictest1013-21snmpd08:25:043
286649953,1cyclictest1013-21snmpd07:36:023
286649952,2cyclictest17594-21wc07:55:193
286649952,2cyclictest1013-21snmpd08:18:363
286649950,4cyclictest5962-21sh08:40:203
286599954,0cyclictest0-21swapper/209:08:492
286599954,0cyclictest0-21swapper/208:10:082
286599953,1cyclictest27133-21mii-tool08:15:222
286599953,1cyclictest1624-21mii-tool08:30:232
286599953,1cyclictest1013-21snmpd08:41:252
286599953,1cyclictest1013-21snmpd08:26:222
286599953,1cyclictest1013-21snmpd08:26:212
286599953,1cyclictest1013-21snmpd08:20:332
286599953,1cyclictest1013-21snmpd07:55:052
286599953,1cyclictest1013-21snmpd07:42:022
286599953,1cyclictest1013-21snmpd07:26:142
286599953,1cyclictest1013-21snmpd07:15:072
286599952,2cyclictest1013-21snmpd08:50:252
286599951,3cyclictest0-21swapper/208:35:352
286599950,4cyclictest8430-21/usr/sbin/munin07:35:202
286599950,1cyclictest14936-21/usr/sbin/munin09:00:242
286599950,0cyclictest0-21swapper/208:05:092
286539953,1cyclictest650-21avahi-daemon08:05:171
286539953,1cyclictest650-21avahi-daemon07:50:291
286539953,1cyclictest646-21lsmd07:45:081
286539953,1cyclictest25-21ksoftirqd/107:55:011
286539953,1cyclictest1013-21snmpd09:01:351
286539953,1cyclictest1013-21snmpd08:46:541
286539953,1cyclictest1013-21snmpd08:30:211
286539953,1cyclictest1013-21snmpd08:25:401
286539953,1cyclictest1013-21snmpd08:25:391
286539953,1cyclictest1013-21snmpd08:20:221
286539953,1cyclictest1013-21snmpd08:10:261
286539953,1cyclictest1013-21snmpd07:40:231
286539953,1cyclictest1013-21snmpd07:39:191
286469953,1cyclictest1013-21snmpd07:20:190
286649942,1cyclictest28954-21grep08:20:213
286649942,1cyclictest13260-21sh07:45:213
286599942,1cyclictest19946-21grep08:00:212
286599942,1cyclictest15262-21chrt07:50:182
286539942,1cyclictest1803-21expr07:20:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional