You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 06:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Fri Apr 26, 2024 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
144712990,0sleep30-21swapper/321:44:323
69352860,0sleep00-21swapper/022:56:380
76552840,0sleep20-21swapper/221:16:432
150592730,0sleep20-21swapper/221:56:042
250212600,0sleep20-21swapper/222:20:232
54012540,1sleep3692-21NetworkManager23:00:173
60022520,0sleep10-21swapper/121:55:071
54792520,0sleep00-21swapper/022:45:040
34022510,0sleep00-21swapper/022:52:250
302122510,0sleep30-21swapper/323:10:553
224822510,0sleep30-21swapper/322:24:013
209852510,0sleep10-21swapper/123:05:591
83332490,0sleep00-21swapper/022:33:510
70562480,0sleep10-21swapper/100:09:561
46432480,0sleep30-21swapper/321:50:563
191572480,0sleep00-21swapper/000:19:370
122262480,0sleep20-21swapper/200:26:522
325052470,0sleep00-21swapper/023:22:440
263562470,1sleep09-21ksoftirqd/023:44:560
140862400,0sleep30-21swapper/300:14:553
310302390,0sleep20-21swapper/223:41:342
39572340,0sleep20-21swapper/223:30:432
3023223415,7sleep30-21swapper/319:07:283
304122308,7sleep00-21swapper/019:09:450
304272287,7sleep10-21swapper/119:09:541
30551992625,0cyclictest22266-21lspci21:49:192
3007622210,7sleep20-21swapper/219:05:352
323492180,0sleep032351-21nfsd400:25:170
301942170,0sleep00-21swapper/022:17:120
300612170,0sleep230063-21bash22:59:282
129042170,0sleep3391rcuc/300:06:303
163862160,0sleep30-21swapper/322:00:103
137322160,0sleep00-21swapper/021:52:050
44872150,0sleep30-21swapper/300:25:483
30551991514,0cyclictest1237-21lspci22:25:142
240922150,0sleep124096-21needreboot20:10:141
203672150,0sleep00-21swapper/022:39:080
177552150,0sleep00-21swapper/023:05:350
157542150,0sleep20-21swapper/219:50:142
61442140,0sleep00-21swapper/000:38:340
5612140,1sleep0554-21sshd22:05:550
30551991413,0cyclictest17620-21lspci00:07:082
76032130,0sleep07602-21sshd23:19:530
30551991312,0cyclictest75650irq/25-eno1-tx-22:30:212
3055199131,0cyclictest0-21swapper/223:56:302
3055199130,1cyclictest646-21dbus-daemon00:11:012
30544991311,1cyclictest646-21dbus-daemon23:56:591
78212120,0sleep3391rcuc/323:38:543
3055599120,11cyclictest7043-21sshd23:27:223
3055599120,11cyclictest0-21swapper/322:12:323
30551991211,0cyclictest32495-21lspci23:26:322
30551991211,0cyclictest322-21lspci22:48:182
30551991211,0cyclictest28855-21lspci21:50:062
3055199120,1cyclictest1-21systemd22:19:412
3055199120,11cyclictest0-21swapper/222:50:212
3055199120,11cyclictest0-21swapper/220:45:102
3054499120,1cyclictest21185-21sshd22:00:381
3053899124,4cyclictest4802-21crond19:25:000
3053899120,1cyclictest29502-21bash23:37:360
3053899120,11cyclictest5327-21lspci21:24:160
3053899120,11cyclictest0-21swapper/023:01:060
3053899120,11cyclictest0-21swapper/021:26:450
222222120,0sleep30-21swapper/300:32:173
189392120,0sleep10-21swapper/122:27:231
30555991110,0cyclictest12490-21sshd21:36:323
30555991110,0cyclictest0-21swapper/300:16:123
3055599110,0cyclictest0-21swapper/323:42:523
3055199119,1cyclictest0-21swapper/223:11:112
3055199110,10cyclictest1-21systemd21:12:092
3055199110,10cyclictest0-21swapper/221:41:302
3054499119,1cyclictest13872-21lspci22:57:281
30544991110,0cyclictest22499-21sshd23:44:291
30544991110,0cyclictest0-21swapper/121:50:181
3054499110,1cyclictest23029-21sshd21:22:281
3054499110,10cyclictest0-21swapper/123:51:591
3054499110,10cyclictest0-21swapper/123:49:291
3054499110,10cyclictest0-21swapper/123:37:391
3054499110,10cyclictest0-21swapper/122:37:581
3054499110,10cyclictest0-21swapper/121:29:581
3054499110,0cyclictest0-21swapper/121:38:481
30538991110,0cyclictest0-21swapper/000:21:360
3053899110,10cyclictest0-21swapper/021:11:160
3053899110,10cyclictest0-21swapper/000:12:050
3053899110,0cyclictest0-21swapper/021:34:560
240322110,0sleep00-21swapper/023:29:260
3055599100,0cyclictest0-21swapper/323:23:023
3055199109,0cyclictest15197-21lspci23:51:122
3055199109,0cyclictest0-21swapper/222:40:012
3055199108,1cyclictest17514-21sshd21:33:202
3055199108,1cyclictest0-21swapper/223:15:312
3055199100,0cyclictest0-21swapper/223:46:312
3055199100,0cyclictest0-21swapper/222:41:512
3055199100,0cyclictest0-21swapper/219:49:492
3054499109,0cyclictest0-21swapper/123:17:481
3054499109,0cyclictest0-21swapper/123:13:281
3054499109,0cyclictest0-21swapper/122:51:581
3054499109,0cyclictest0-21swapper/121:15:381
3054499108,1cyclictest0-21swapper/100:17:491
3054499100,0cyclictest0-21swapper/100:37:291
3054499100,0cyclictest0-21swapper/100:34:191
3053899109,0cyclictest0-21swapper/022:44:350
3053899109,0cyclictest0-21swapper/022:11:360
3053899109,0cyclictest0-21swapper/000:31:460
3053899100,0cyclictest0-21swapper/021:17:260
305559998,0cyclictest0-21swapper/321:47:323
305559998,0cyclictest0-21swapper/321:18:223
305559998,0cyclictest0-21swapper/300:22:323
305559997,1cyclictest12215-21sshd22:30:223
305559990,8cyclictest1781-21sshd22:40:383
305519998,0cyclictest33-21ksoftirqd/223:24:112
305519998,0cyclictest22246-21lspci00:24:022
305519998,0cyclictest0-21swapper/223:03:112
305519998,0cyclictest0-21swapper/222:14:212
305519998,0cyclictest0-21swapper/200:16:412
305519997,1cyclictest0-21swapper/222:00:502
305519996,2cyclictest1850-21sshd21:35:162
305519990,1cyclictest0-21swapper/200:34:232
305519990,0cyclictest0-21swapper/219:42:502
305449999,0cyclictest0-21swapper/123:33:191
305449998,0cyclictest0-21swapper/123:26:281
305449998,0cyclictest0-21swapper/123:22:081
305449998,0cyclictest0-21swapper/122:48:181
305449998,0cyclictest0-21swapper/120:05:181
305449990,8cyclictest16792-21sshd21:14:031
305389998,0cyclictest0-21swapper/022:27:060
305389998,0cyclictest0-21swapper/022:21:460
305389996,2cyclictest646-21dbus-daemon23:12:330
305389990,5cyclictest18367-21grep21:45:000
305559987,0cyclictest0-21swapper/321:33:223
305559987,0cyclictest0-21swapper/320:36:523
305559987,0cyclictest0-21swapper/319:34:523
305559986,1cyclictest9450-21lspci21:28:353
305559986,1cyclictest27276-21lspci23:56:283
305559986,1cyclictest26008-21lspci22:28:153
305559986,1cyclictest17230-21sshd22:54:063
305559986,1cyclictest0-21swapper/300:38:233
305559980,7cyclictest1671-21sshd21:12:133
305519987,0cyclictest0-21swapper/223:05:002
305519987,0cyclictest0-21swapper/219:25:502
305519986,1cyclictest32073-21sshd00:00:512
305519986,1cyclictest12830-21sshd21:25:102
305519985,2cyclictest649-21avahi-daemon23:36:172
305519981,1cyclictest33-21ksoftirqd/222:05:552
305449987,0cyclictest0-21swapper/100:01:591
305449986,1cyclictest616-17auditd22:21:481
305449986,1cyclictest29602-21kworker/1:121:45:271
305449986,1cyclictest29260-21kworker/1:021:31:311
305449986,1cyclictest1929-21kworker/1:222:30:431
305449986,1cyclictest19107-21kworker/1:422:06:531
305449986,1cyclictest12503-21lspci00:10:281
305389987,0cyclictest0-21swapper/020:45:260
305389986,2cyclictest10424-21kworker/0:223:33:370
305389986,1cyclictest2072-21lspci21:39:130
305389986,1cyclictest16054-21lspci23:51:190
305559975,1cyclictest649-21avahi-daemon22:06:183
305559975,1cyclictest27393-21sshd22:40:003
305559974,2cyclictest646-21dbus-daemon23:50:223
305559974,2cyclictest646-21dbus-daemon23:15:433
305559974,2cyclictest646-21dbus-daemon22:58:093
305559973,3cyclictest700-21gdbus22:15:263
305559973,3cyclictest700-21gdbus00:02:073
305559973,3cyclictest649-21avahi-daemon23:46:043
305559973,1cyclictest684-21polkitd23:05:073
305559972,2cyclictest646-21dbus-daemon21:23:313
305559970,6cyclictest7308-21sshd22:49:083
305519976,1cyclictest11459-21lspci00:35:102
305519970,0cyclictest121rcu_preempt21:20:422
305449976,1cyclictest29895-21kworker/1:300:28:071
305449976,1cyclictest18480-21kworker/1:321:40:371
305449976,0cyclictest1982-21kworker/1:422:41:181
305449976,0cyclictest19107-21kworker/1:422:15:541
305449976,0cyclictest0-21swapper/100:20:591
305449975,1cyclictest649-21avahi-daemon23:00:181
305449974,2cyclictest646-21dbus-daemon22:11:291
305389976,0cyclictest0-21swapper/000:05:060
305389975,1cyclictest649-21avahi-daemon21:56:290
305389975,1cyclictest620-13audispd21:46:570
305389975,1cyclictest25434-21tr00:00:090
305389975,1cyclictest22102-21lspci22:00:440
305389970,0cyclictest0-21swapper/020:40:360
20120270,1sleep220123-21nfsd420:00:192
305559964,1cyclictest7890-21lspci21:55:163
305559964,1cyclictest646-21dbus-daemon19:55:003
305559964,1cyclictest29451-21sshd23:30:033
305559963,2cyclictest697-21gdbus20:01:013
305559963,2cyclictest17299-21snmpd20:25:343
305559963,2cyclictest17299-21snmpd19:21:373
305519965,0cyclictest0-21swapper/220:40:202
305519964,1cyclictest33-21ksoftirqd/220:30:002
305519960,5cyclictest0-21swapper/219:32:002
305449966,0cyclictest4725-21kworker/1:020:41:331
305449966,0cyclictest31527-21kworker/1:120:30:531
305449966,0cyclictest30718-21kworker/1:019:35:141
305449966,0cyclictest30718-21kworker/1:019:20:131
305449966,0cyclictest29247-21kworker/1:020:25:111
305449966,0cyclictest18781-21kworker/1:120:00:231
305449966,0cyclictest14638-21kworker/1:219:47:511
305449966,0cyclictest13435-21kworker/1:121:06:511
305449965,1cyclictest11194-21kworker/1:021:00:181
305449965,0cyclictest9118-21kworker/1:320:55:511
305449965,0cyclictest30718-21kworker/1:019:10:221
305449965,0cyclictest0-21swapper/119:40:181
305449964,1cyclictest6221-21sed19:25:251
305449963,2cyclictest17299-21snmpd20:53:561
305449960,5cyclictest0-21swapper/120:20:081
305389965,0cyclictest0-21swapper/020:59:560
305389964,1cyclictest700-21gdbus20:24:550
305389964,1cyclictest649-21avahi-daemon23:45:070
305389963,2cyclictest649-21avahi-daemon23:55:180
305389963,2cyclictest21722-21gltestperf20:05:150
305389963,2cyclictest17299-21snmpd21:03:440
305389963,2cyclictest17299-21snmpd19:52:330
305389963,2cyclictest17299-21snmpd19:32:390
305389963,2cyclictest17299-21snmpd19:29:240
305559954,0cyclictest0-21swapper/320:30:023
305559953,1cyclictest7824-21cat20:50:163
305559953,1cyclictest700-21gdbus20:40:013
305559953,1cyclictest26572-21grep20:15:213
305559953,1cyclictest17299-21snmpd21:00:123
305559953,1cyclictest17299-21snmpd20:49:553
305559953,1cyclictest17299-21snmpd20:22:093
305559953,1cyclictest17299-21snmpd20:14:013
305559953,1cyclictest17299-21snmpd20:06:523
305559953,1cyclictest17299-21snmpd19:51:093
305559953,1cyclictest17299-21snmpd19:40:093
305559953,1cyclictest17299-21snmpd19:15:323
305559953,1cyclictest13899-21cat21:05:133
305559953,1cyclictest1109-21ntpd19:45:213
305559953,1cyclictest1049-21rpcbind19:36:003
305559952,2cyclictest9778-21cut20:55:153
305559950,1cyclictest5819-21awk19:25:203
305519953,1cyclictest9959-21latency20:55:172
305519953,1cyclictest7826-21cat20:50:162
305519953,1cyclictest17299-21snmpd21:09:302
305519953,1cyclictest17299-21snmpd20:36:232
305519953,1cyclictest17299-21snmpd20:33:412
305519953,1cyclictest17299-21snmpd20:05:342
305519953,1cyclictest17299-21snmpd19:59:192
305519953,1cyclictest17299-21snmpd19:20:522
305519953,1cyclictest17299-21snmpd19:15:112
305519953,1cyclictest17299-21snmpd19:10:112
305519953,1cyclictest1109-21ntpd20:15:172
305519952,2cyclictest9118-21grep19:35:092
305519952,2cyclictest17299-21snmpd20:12:002
305449955,0cyclictest30718-21kworker/1:019:32:351
305449955,0cyclictest30718-21kworker/1:019:15:311
305449955,0cyclictest14638-21kworker/1:219:50:111
305449953,1cyclictest31527-21kworker/1:120:35:141
305449953,1cyclictest25870-21cat20:15:131
305449953,1cyclictest17730-21mii-tool19:55:131
305449953,1cyclictest1058-21sendmail20:45:071
305389954,0cyclictest0-21swapper/020:35:460
305389954,0cyclictest0-21swapper/019:16:360
305389953,1cyclictest7825-21cat20:50:160
305389953,1cyclictest697-21gdbus20:29:540
305389953,1cyclictest17299-21snmpd20:31:260
305389953,1cyclictest17299-21snmpd20:15:580
305389953,1cyclictest17299-21snmpd20:10:100
305389953,1cyclictest17299-21snmpd20:02:330
305389953,1cyclictest17299-21snmpd19:55:460
305389953,1cyclictest17299-21snmpd19:42:150
305389953,1cyclictest17299-21snmpd19:36:230
305389953,1cyclictest17299-21snmpd19:12:040
305389953,1cyclictest14335-21open_files21:05:170
305389953,1cyclictest13681-21cat19:45:170
305559942,1cyclictest304422sleep319:10:003
305519942,1cyclictest11926-21irqstats21:00:162
305519940,1cyclictest27459-21/usr/sbin/munin20:20:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional