You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-17 - 21:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack2slot0.osadl.org (updated Mon Jun 17, 2024 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
49572730,0sleep3391rcuc/311:42:383
319652660,0sleep30-21swapper/312:15:463
76622560,0sleep00-21swapper/010:19:200
238612560,0sleep30-21swapper/309:41:583
219332550,0sleep00-21swapper/009:25:210
216932530,0sleep10-21swapper/112:14:521
125772530,0sleep10-21swapper/109:40:481
117812530,0sleep20-21swapper/212:03:552
81612520,0sleep10-21swapper/111:39:231
273522520,0sleep20-21swapper/207:35:362
264232520,0sleep00-21swapper/009:53:010
67082510,0sleep20-21swapper/212:23:302
271132510,0sleep10-21swapper/109:35:481
125842510,0sleep30-21swapper/309:27:413
119262510,0sleep20-21swapper/209:54:592
82542500,0sleep20-21swapper/210:01:162
102382500,0sleep10-21swapper/111:10:321
277722490,0sleep00-21swapper/012:36:010
252702490,0sleep125269-21sshd10:32:071
240292490,0sleep20-21swapper/209:25:312
15192490,0sleep20-21swapper/211:20:462
81722480,0sleep20-21swapper/210:44:572
317072480,0sleep10-21swapper/107:45:281
282082480,0sleep30-21swapper/310:21:313
256372480,0sleep3391rcuc/310:35:453
72622470,0sleep00-21swapper/010:30:130
255982470,0sleep10-21swapper/112:01:541
89252450,0sleep20-21swapper/212:06:562
321022400,1sleep3401ktimersoftd/310:18:273
82272360,0sleep20-21swapper/209:10:532
1532423329,2sleep10-21swapper/107:09:371
1517623110,7sleep00-21swapper/007:07:480
152412297,7sleep30-21swapper/307:08:393
151282275,7sleep20-21swapper/207:07:142
293022230,1sleep341-21ksoftirqd/309:19:403
68832210,0sleep20-21swapper/210:19:142
124132200,1sleep112404-21sshd12:34:381
9912190,1sleep3993-21systemd-cgroups10:11:183
34782190,0sleep20-21swapper/210:29:512
197482190,0sleep00-21swapper/012:24:520
211332180,0sleep00-21swapper/010:24:210
312322170,0sleep20-21swapper/210:58:352
312022160,0sleep20-21swapper/209:36:132
248302160,0sleep20-21swapper/209:32:242
248302160,0sleep20-21swapper/209:32:242
15453991615,0cyclictest2163-21kworker/0:011:12:410
108442160,0sleep30-21swapper/310:01:333
301742150,2sleep01545399cyclictest10:10:550
15453991513,1cyclictest646-21dbus-daemon10:37:410
48652140,0sleep00-21swapper/011:39:020
15458991410,0cyclictest0-21swapper/111:54:351
64002130,0sleep30-21swapper/310:48:313
267672130,0sleep026762-21bash12:12:020
22552130,0sleep30-21swapper/311:09:493
15453991312,0cyclictest28273-21kworker/0:411:04:020
1545399130,1cyclictest646-21dbus-daemon09:16:310
41982120,0sleep00-21swapper/012:09:500
175022120,0sleep00-21swapper/011:50:520
1547099120,1cyclictest20404-21sshd12:11:233
15463991211,0cyclictest14757-21lspci09:18:082
15463991211,0cyclictest0-21swapper/212:17:412
15463991210,1cyclictest4856-21lspci09:46:512
15463991210,1cyclictest0-21swapper/211:00:212
1546399120,1cyclictest0-21swapper/210:48:222
1546399120,11cyclictest25573-21systemd-cgroups10:24:512
1546399120,11cyclictest0-21swapper/210:11:112
1546399120,0cyclictest0-21swapper/212:25:412
1545899120,1cyclictest0-21swapper/112:39:341
15453991211,0cyclictest6329-21kworker/0:111:28:070
1545399120,1cyclictest617-17auditd11:19:020
1545399120,1cyclictest24429-21sshd10:28:310
15470991110,0cyclictest0-21swapper/311:56:333
15470991110,0cyclictest0-21swapper/310:25:523
1547099110,10cyclictest0-21swapper/312:26:143
1547099110,10cyclictest0-21swapper/310:54:333
15463991110,0cyclictest18663-21lspci09:41:262
15463991110,0cyclictest0-21swapper/210:38:012
1546399110,0cyclictest0-21swapper/212:35:212
1546399110,0cyclictest0-21swapper/211:52:012
1546399110,0cyclictest0-21swapper/208:25:112
1545899119,1cyclictest2543-21bash12:23:041
1545899118,0cyclictest0-21swapper/108:02:341
15458991110,0cyclictest0-21swapper/111:48:141
15458991110,0cyclictest0-21swapper/111:16:041
15458991110,0cyclictest0-21swapper/109:56:141
1545899110,10cyclictest0-21swapper/108:50:341
1545899110,0cyclictest0-21swapper/111:43:041
1545399119,1cyclictest30677-21lspci11:24:120
1545399119,1cyclictest0-21swapper/011:06:220
15453991110,0cyclictest0-21swapper/009:30:510
15453991110,0cyclictest0-21swapper/009:30:510
1545399110,10cyclictest0-21swapper/011:30:320
1545399110,0cyclictest0-21swapper/012:16:220
1547099109,0cyclictest75550irq/24-eno1-rx-09:58:423
1547099109,0cyclictest0-21swapper/311:51:233
1547099109,0cyclictest0-21swapper/311:39:533
1547099109,0cyclictest0-21swapper/310:58:333
1547099109,0cyclictest0-21swapper/310:40:123
1547099109,0cyclictest0-21swapper/309:38:023
1547099107,2cyclictest646-21dbus-daemon12:05:083
1547099100,0cyclictest0-21swapper/312:38:433
1546399109,0cyclictest0-21swapper/212:13:412
1546399109,0cyclictest0-21swapper/210:32:512
1546399108,1cyclictest15957-21kworker/2:409:57:412
1546399100,0cyclictest121rcu_preempt11:16:012
1545899109,0cyclictest0-21swapper/112:27:041
1545899109,0cyclictest0-21swapper/112:08:141
1545899109,0cyclictest0-21swapper/111:31:341
1545899109,0cyclictest0-21swapper/111:26:241
1545899109,0cyclictest0-21swapper/110:56:341
1545899109,0cyclictest0-21swapper/110:48:341
1545899109,0cyclictest0-21swapper/110:44:341
1545899109,0cyclictest0-21swapper/110:39:241
1545899109,0cyclictest0-21swapper/110:11:241
1545899109,0cyclictest0-21swapper/108:47:341
1545899108,1cyclictest30642-21sshd12:19:051
1545899108,1cyclictest15319-21lspci09:51:441
1545899100,9cyclictest0-21swapper/107:43:341
1545899100,0cyclictest0-21swapper/107:18:331
1545399109,0cyclictest9880-21kworker/0:210:46:210
1545399108,1cyclictest24038-21lspci11:48:220
15453991010,0cyclictest1682-21kworker/0:111:59:190
1545399100,0cyclictest0-21swapper/009:59:010
154709998,0cyclictest0-21swapper/311:12:533
154709998,0cyclictest0-21swapper/310:09:233
154639998,0cyclictest26422-21lspci10:06:472
154639998,0cyclictest0-21swapper/211:34:112
154639998,0cyclictest0-21swapper/211:25:012
154639998,0cyclictest0-21swapper/208:46:512
154639997,1cyclictest7819-21lspci11:39:212
154639990,1cyclictest3081-21kworker/2:311:57:102
154589998,0cyclictest0-21swapper/109:49:241
154589998,0cyclictest0-21swapper/109:29:441
154589997,1cyclictest29118-21lspci10:29:041
154539998,0cyclictest0-21swapper/012:28:220
154539998,0cyclictest0-21swapper/010:05:110
154539997,1cyclictest1-21systemd11:42:020
154539996,2cyclictest13890-21kworker/0:409:43:310
154539994,2cyclictest9-21ksoftirqd/010:00:390
154539994,2cyclictest9-21ksoftirqd/009:11:020
154539991,1cyclictest131rcu_sched12:00:320
154709987,0cyclictest0-21swapper/311:45:033
154709987,0cyclictest0-21swapper/311:28:233
154709986,1cyclictest23010-21lspci11:23:103
154709986,1cyclictest11805-21lspci10:30:383
154709985,2cyclictest649-21avahi-daemon09:33:123
154709985,2cyclictest649-21avahi-daemon09:33:123
154709985,2cyclictest649-21avahi-daemon09:21:413
154709985,2cyclictest15682-21sshd12:31:213
154709984,3cyclictest646-21dbus-daemon11:03:333
154709983,2cyclictest646-21dbus-daemon09:14:023
154639987,0cyclictest14135-21lspci11:47:202
154639987,0cyclictest0-21swapper/211:09:312
154639987,0cyclictest0-21swapper/208:37:512
154639987,0cyclictest0-21swapper/208:16:512
154639987,0cyclictest0-21swapper/208:07:502
154639986,1cyclictest33-21ksoftirqd/212:32:222
154639986,1cyclictest33-21ksoftirqd/210:50:362
154639981,1cyclictest131rcu_sched11:42:032
154639980,1cyclictest0-21swapper/209:21:082
154589987,0cyclictest0-21swapper/111:21:141
154589987,0cyclictest0-21swapper/111:00:341
154589987,0cyclictest0-21swapper/109:17:441
154589986,1cyclictest3631-21lspci10:00:461
154589985,2cyclictest648-21systemd-logind09:34:001
154589985,2cyclictest648-21systemd-logind09:34:001
154589985,2cyclictest646-21dbus-daemon11:05:441
154539986,1cyclictest9-21ksoftirqd/010:50:560
154539986,1cyclictest23720-21/usr/sbin/munin07:25:310
154539985,1cyclictest9-21ksoftirqd/009:47:590
154539980,1cyclictest131rcu_sched10:58:400
154539980,1cyclictest131rcu_sched09:35:140
154539980,1cyclictest131rcu_sched09:21:080
154709976,0cyclictest0-21swapper/307:15:323
154709975,1cyclictest649-21avahi-daemon09:50:083
154709975,1cyclictest23213-21lspci11:15:293
154709975,1cyclictest21501-21lspci11:33:353
154709974,2cyclictest649-21avahi-daemon12:04:033
154709973,3cyclictest700-21gdbus12:22:083
154639976,0cyclictest0-21swapper/208:00:102
154639975,1cyclictest33-21ksoftirqd/211:10:162
154639970,6cyclictest0-21swapper/208:22:012
154589976,1cyclictest25418-21lspci09:22:251
154589976,0cyclictest0-21swapper/107:27:331
154589975,1cyclictest20688-21lspci09:12:081
154589975,1cyclictest18035-21sshd10:16:551
154589974,2cyclictest700-21gdbus11:58:351
154589974,2cyclictest649-21avahi-daemon10:54:201
154589974,2cyclictest649-21avahi-daemon10:20:211
154589974,2cyclictest649-21avahi-daemon10:08:521
154539975,1cyclictest9-21ksoftirqd/010:40:160
154539975,1cyclictest17299-21snmpd08:37:250
154539970,6cyclictest31084-21kworker/0:112:32:150
154709965,0cyclictest0-21swapper/307:45:323
154709964,1cyclictest684-21polkitd09:45:123
154709963,2cyclictest17299-21snmpd08:08:573
154709963,2cyclictest17299-21snmpd07:58:153
154709960,5cyclictest0-21swapper/308:14:523
154639965,0cyclictest0-21swapper/208:58:512
154639965,0cyclictest0-21swapper/207:43:102
154639965,0cyclictest0-21swapper/207:26:302
154639964,1cyclictest852-21sshd09:09:522
154639963,2cyclictest684-21polkitd07:14:552
154639963,2cyclictest17299-21snmpd08:32:222
154639963,2cyclictest17299-21snmpd07:51:082
154639960,0cyclictest0-21swapper/207:17:402
154589965,0cyclictest0-21swapper/108:44:341
154589965,0cyclictest0-21swapper/107:14:231
154589963,2cyclictest648-21systemd-logind08:20:001
154589963,2cyclictest17299-21snmpd09:06:521
154589963,2cyclictest17299-21snmpd07:51:271
154539965,0cyclictest30207-21kworker/0:308:00:270
154539965,0cyclictest0-21swapper/008:05:210
154539963,2cyclictest17299-21snmpd07:56:360
154539960,5cyclictest0-21swapper/008:11:510
154709954,0cyclictest0-21swapper/308:25:123
154709953,1cyclictest17299-21snmpd09:05:043
154709953,1cyclictest17299-21snmpd09:00:373
154709953,1cyclictest17299-21snmpd08:51:313
154709953,1cyclictest17299-21snmpd08:45:223
154709953,1cyclictest17299-21snmpd08:40:073
154709953,1cyclictest17299-21snmpd08:39:193
154709953,1cyclictest17299-21snmpd08:32:133
154709953,1cyclictest17299-21snmpd08:20:003
154709953,1cyclictest17299-21snmpd08:02:313
154709953,1cyclictest17299-21snmpd07:41:413
154709953,1cyclictest17299-21snmpd07:33:443
154709953,1cyclictest17299-21snmpd07:26:593
154709953,1cyclictest17299-21snmpd07:21:193
154709953,1cyclictest17299-21snmpd07:21:193
154709953,1cyclictest17299-21snmpd07:10:163
154709953,1cyclictest10897-21cat08:15:163
154709952,2cyclictest933-21ntp_kernel_err07:50:213
154709952,2cyclictest27325-21cut07:35:353
154709950,1cyclictest27559-21grep08:55:223
154639954,0cyclictest0-21swapper/209:03:412
154639953,1cyclictest649-21avahi-daemon08:10:002
154639953,1cyclictest25569-21timerwakeupswit07:30:282
154639953,1cyclictest2183-21sshd07:55:122
154639953,1cyclictest17299-21snmpd08:41:552
154639952,2cyclictest17299-21snmpd07:21:372
154639952,2cyclictest17299-21snmpd07:21:372
154639950,1cyclictest30456-21/usr/sbin/munin07:45:122
154589953,1cyclictest19099-21cat08:35:151
154589953,1cyclictest17965-21users08:30:341
154589953,1cyclictest17299-21snmpd09:02:521
154589953,1cyclictest17299-21snmpd08:55:101
154589953,1cyclictest17299-21snmpd08:27:031
154589953,1cyclictest17299-21snmpd08:20:301
154589953,1cyclictest17299-21snmpd08:11:211
154589953,1cyclictest17299-21snmpd08:08:181
154589953,1cyclictest17299-21snmpd07:35:411
154589953,1cyclictest17299-21snmpd07:33:381
154589953,1cyclictest17299-21snmpd07:20:131
154589953,1cyclictest17299-21snmpd07:20:131
154589952,2cyclictest3125-21ntpq07:55:231
154539953,1cyclictest17299-21snmpd08:55:220
154539953,1cyclictest17299-21snmpd08:45:070
154539953,1cyclictest17299-21snmpd08:43:160
154539953,1cyclictest17299-21snmpd08:26:240
154539953,1cyclictest17299-21snmpd07:50:410
154539953,1cyclictest17299-21snmpd07:45:020
154539953,1cyclictest17299-21snmpd07:31:200
154539953,1cyclictest17299-21snmpd07:21:010
154539953,1cyclictest17299-21snmpd07:21:010
154539953,1cyclictest16819-21df08:30:140
154539953,1cyclictest10900-21cat08:15:160
154539953,1cyclictest1058-21sendmail09:00:180
154539952,2cyclictest28763-21grep07:40:140
154539952,2cyclictest26444-21wc07:35:150
154539952,2cyclictest15729-21tr07:10:100
154539952,2cyclictest14042-21taskset08:22:200
154539950,4cyclictest0-21swapper/007:17:110
154539950,0cyclictest0-21swapper/009:05:010
154639942,1cyclictest24722-21/usr/sbin/munin08:50:122
154539944,0cyclictest20312-21kworker/0:208:51:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional