You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-11 - 22:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Mon Nov 11, 2024 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
97762970,2sleep11437799cyclictest11:38:421
150962590,1sleep0646-21dbus-daemon11:02:280
190682560,1sleep219071-21bash11:56:252
324382540,0sleep10-21swapper/112:17:191
259472540,0sleep01-21systemd10:57:460
6962520,0sleep20-21swapper/209:50:312
69522520,0sleep06953-21bash10:40:410
247582520,1sleep324756-21sshd11:42:483
282022510,0sleep00-21swapper/012:14:090
277572510,1sleep127749-21sshd12:25:191
201222500,0sleep10-21swapper/110:18:501
6312490,1sleep0101ktimersoftd/010:33:430
312032490,0sleep00-21swapper/012:28:300
133652490,0sleep30-21swapper/309:32:153
276522480,0sleep00-21swapper/009:59:510
262752470,0sleep00-21swapper/009:49:580
56222460,0sleep15613-21sshd12:23:281
148412440,0sleep30-21swapper/310:14:563
290792410,0sleep20-21swapper/210:29:492
269472390,1sleep21095-21nfsd12:05:302
168352370,1sleep31-21systemd10:54:023
297962290,0sleep029770-21cp11:06:320
141322298,7sleep20-21swapper/207:08:232
263112240,1sleep226313-21systemd-cgroups09:16:282
1396422312,7sleep30-21swapper/307:06:163
1419622211,7sleep00-21swapper/007:09:090
96962210,0sleep1231rcuc/111:07:371
162552210,0sleep20-21swapper/210:50:482
133492219,7sleep10-21swapper/107:05:181
192012200,0sleep30-21swapper/311:53:383
27292190,0sleep30-21swapper/312:31:393
178452170,1sleep317826-21sshd11:56:173
113902170,1sleep0111rcuc/011:44:290
299282160,1sleep0101ktimersoftd/011:54:350
22862160,0sleep00-21swapper/011:12:360
1438399160,15cyclictest32657-21lspci11:23:432
239992150,0sleep223998-21sshd10:15:512
1437799156,3cyclictest25-21ksoftirqd/109:52:151
1437799155,1cyclictest25-21ksoftirqd/111:59:231
1437799155,1cyclictest25-21ksoftirqd/110:00:371
1437799154,1cyclictest25-21ksoftirqd/112:34:061
14372991514,0cyclictest2515-21lspci11:26:420
14372991513,1cyclictest13973-21lspci10:25:030
299032140,0sleep1231rcuc/109:23:281
288172140,0sleep20-21swapper/209:23:212
27302140,0sleep20-21swapper/211:43:432
262202140,0sleep10-21swapper/111:25:561
195982140,0sleep30-21swapper/311:19:493
1437799144,4cyclictest25-21ksoftirqd/111:18:591
1437799144,3cyclictest25-21ksoftirqd/109:46:081
1437799144,1cyclictest7909-21sshd10:53:091
1437799144,1cyclictest25-21ksoftirqd/112:04:241
1437799142,1cyclictest25-21ksoftirqd/110:32:081
14377991413,0cyclictest18929-21kworker/1:108:34:401
14377991413,0cyclictest18929-21kworker/1:107:58:261
14372991413,0cyclictest16351-21kworker/0:410:08:100
1438399130,12cyclictest14590-21sshd09:25:442
1438399130,0cyclictest0-21swapper/210:45:042
1437799135,2cyclictest25-21ksoftirqd/111:31:391
1437799135,0cyclictest25-21ksoftirqd/111:50:231
1437799134,1cyclictest25-21ksoftirqd/112:37:021
1437799133,3cyclictest25-21ksoftirqd/109:13:181
1437799132,1cyclictest25-21ksoftirqd/111:12:311
14377991313,0cyclictest18929-21kworker/1:108:00:091
14377991313,0cyclictest18929-21kworker/1:107:45:581
14377991313,0cyclictest18929-21kworker/1:107:37:371
14377991313,0cyclictest18929-21kworker/1:107:30:221
14377991313,0cyclictest17129-21kworker/1:008:57:321
14377991313,0cyclictest17129-21kworker/1:008:53:341
14377991312,0cyclictest12229-21kworker/1:007:10:031
14377991311,1cyclictest25-21ksoftirqd/111:40:071
1437799130,0cyclictest121rcu_preempt12:15:001
1437299130,1cyclictest12925-21bash11:16:200
1437299130,1cyclictest0-21swapper/012:22:000
106832130,0sleep30-21swapper/310:59:183
14391991210,1cyclictest0-21swapper/311:10:103
1439199120,11cyclictest27926-21lspci09:27:103
1439199120,11cyclictest21222-21/usr/sbin/munin07:25:203
14383991210,1cyclictest5270-21grep09:34:442
14383991210,1cyclictest4798-21systemd-cgroups12:12:032
14383991210,1cyclictest0-21swapper/210:06:442
1438399120,11cyclictest0-21swapper/209:46:242
1437799125,3cyclictest25-21ksoftirqd/110:06:011
1437799125,1cyclictest25-21ksoftirqd/112:06:181
1437799125,1cyclictest25-21ksoftirqd/111:24:471
1437799124,3cyclictest25-21ksoftirqd/109:30:111
1437799124,1cyclictest25-21ksoftirqd/109:55:261
1437799123,3cyclictest25-21ksoftirqd/110:41:031
1437799123,2cyclictest25-21ksoftirqd/109:27:061
1437799123,1cyclictest25-21ksoftirqd/111:46:081
1437799123,1cyclictest25-21ksoftirqd/110:55:181
1437799122,1cyclictest25-21ksoftirqd/110:46:461
1437799122,1cyclictest25-21ksoftirqd/110:35:071
1437799122,1cyclictest25-21ksoftirqd/109:17:371
1437799121,2cyclictest15326-21lspci11:02:291
14377991212,0cyclictest25314-21kworker/1:309:00:301
14377991212,0cyclictest18929-21kworker/1:108:20:481
14377991212,0cyclictest18929-21kworker/1:108:15:461
14377991212,0cyclictest18929-21kworker/1:108:05:321
14377991212,0cyclictest18929-21kworker/1:107:51:401
14377991212,0cyclictest18929-21kworker/1:107:25:101
14377991212,0cyclictest17129-21kworker/1:008:48:221
14377991212,0cyclictest17129-21kworker/1:008:48:211
14377991212,0cyclictest17129-21kworker/1:008:36:241
1437799121,1cyclictest25-21ksoftirqd/110:26:411
1437799121,1cyclictest17871-21bash09:35:501
1437799120,11cyclictest0-21swapper/110:24:171
14372991210,1cyclictest24839-21kworker/0:211:31:330
1437299120,1cyclictest16486-21bash10:18:300
1437299120,1cyclictest0-21swapper/011:49:500
1439199119,1cyclictest75550irq/24-eno1-rx-10:26:093
14391991110,0cyclictest0-21swapper/312:28:213
14391991110,0cyclictest0-21swapper/312:14:003
14391991110,0cyclictest0-21swapper/311:22:403
14391991110,0cyclictest0-21swapper/309:45:203
1439199110,10cyclictest0-21swapper/312:06:513
1439199110,10cyclictest0-21swapper/310:08:403
1439199110,0cyclictest0-21swapper/311:47:503
1439199110,0cyclictest0-21swapper/310:31:403
1439199110,0cyclictest0-21swapper/310:19:293
14383991110,0cyclictest0-21swapper/211:07:032
14383991110,0cyclictest0-21swapper/210:40:432
1438399110,10cyclictest6680-21sshd11:32:432
1438399110,10cyclictest0-21swapper/212:29:242
1438399110,10cyclictest0-21swapper/210:02:332
1438399110,0cyclictest0-21swapper/209:39:132
1437799112,1cyclictest25-21ksoftirqd/110:11:571
14377991111,0cyclictest25314-21kworker/1:309:05:421
14377991111,0cyclictest18929-21kworker/1:108:28:031
14377991111,0cyclictest18929-21kworker/1:107:41:161
14377991111,0cyclictest17129-21kworker/1:008:41:461
14377991111,0cyclictest12229-21kworker/1:007:16:301
1437799110,10cyclictest0-21swapper/108:10:171
1437299119,1cyclictest620-13audispd09:23:300
1437299119,1cyclictest0-21swapper/012:36:200
14372991110,0cyclictest31404-21lspci12:05:550
14372991110,0cyclictest0-21swapper/012:19:000
14372991110,0cyclictest0-21swapper/011:35:290
1437299110,10cyclictest0-21swapper/009:32:300
1437299110,10cyclictest0-21swapper/009:13:200
1437299110,10cyclictest0-21swapper/007:33:090
1437299110,0cyclictest0-21swapper/007:15:190
1439199109,0cyclictest0-21swapper/312:21:113
1439199109,0cyclictest0-21swapper/311:39:313
1439199100,0cyclictest0-21swapper/311:25:403
1439199100,0cyclictest0-21swapper/310:41:293
1439199100,0cyclictest0-21swapper/310:00:193
1438399108,1cyclictest1-21systemd12:19:142
1438399107,2cyclictest646-21dbus-daemon11:00:422
1437799100,1cyclictest4766-21systemd-cgroups09:41:161
1437299109,0cyclictest13871-21kworker/0:109:40:360
1437299109,0cyclictest10566-21lspci12:01:160
1437299109,0cyclictest0-21swapper/010:36:100
1437299109,0cyclictest0-21swapper/009:50:190
1437299100,9cyclictest0-21swapper/008:00:080
1437299100,1cyclictest24174-21sshd09:26:470
1437299100,0cyclictest0-21swapper/010:10:400
1437299100,0cyclictest0-21swapper/007:14:380
143919998,0cyclictest0-21swapper/311:04:503
143919998,0cyclictest0-21swapper/310:35:203
143919998,0cyclictest0-21swapper/309:22:393
143919997,1cyclictest28406-21lspci11:34:403
143839998,0cyclictest0-21swapper/212:00:442
143839998,0cyclictest0-21swapper/210:30:542
143839998,0cyclictest0-21swapper/209:14:532
143839997,1cyclictest28344-21sshd12:39:332
143779999,0cyclictest18929-21kworker/1:107:21:521
143729998,0cyclictest0-21swapper/009:37:400
143729997,1cyclictest9-21ksoftirqd/009:15:190
143729996,1cyclictest9-21ksoftirqd/010:45:160
143729991,1cyclictest131rcu_sched11:55:210
143729990,3cyclictest2448-21kworker/0:011:24:190
11956290,1sleep0646-21dbus-daemon10:50:220
143919987,0cyclictest0-21swapper/309:15:403
143919986,1cyclictest3319-21lspci10:20:203
143919985,2cyclictest649-21avahi-daemon09:37:013
143839987,0cyclictest0-21swapper/211:51:142
143839987,0cyclictest0-21swapper/208:45:042
143839987,0cyclictest0-21swapper/208:45:032
143839986,1cyclictest3316-21lspci10:20:202
143839986,1cyclictest31310-21lspci10:10:092
143839986,1cyclictest28722-21lspci09:43:402
143839985,2cyclictest649-21avahi-daemon12:34:582
143839985,2cyclictest649-21avahi-daemon11:37:002
143839985,2cyclictest649-21avahi-daemon09:55:162
143839984,3cyclictest649-21avahi-daemon11:17:092
143839984,3cyclictest646-21dbus-daemon10:56:302
143839984,3cyclictest20260-21sshd10:38:562
143729987,0cyclictest0-21swapper/009:05:400
143729987,0cyclictest0-21swapper/007:47:090
143729986,1cyclictest9-21ksoftirqd/010:01:290
143729985,1cyclictest9-21ksoftirqd/012:32:210
143919975,1cyclictest646-21dbus-daemon12:35:203
143919975,1cyclictest646-21dbus-daemon09:51:183
143919975,1cyclictest616-17auditd11:07:083
143919975,1cyclictest48-21kauditd09:55:053
143919975,1cyclictest28856-21grepconf.sh12:00:083
143919975,1cyclictest26373-21lspci12:16:463
143919975,1cyclictest0-21swapper/309:42:203
143919974,2cyclictest649-21avahi-daemon10:46:143
143839974,2cyclictest649-21avahi-daemon12:20:252
143839974,2cyclictest649-21avahi-daemon11:46:182
143839974,1cyclictest25710-21sshd11:25:532
143839974,1cyclictest10020-21sshd11:10:252
143729976,0cyclictest4950-21kworker/0:008:10:190
143729976,0cyclictest0-21swapper/008:25:080
143729975,1cyclictest9-21ksoftirqd/010:20:120
143919965,0cyclictest0-21swapper/307:41:103
143919964,1cyclictest649-21avahi-daemon09:10:293
143919964,1cyclictest646-21dbus-daemon07:30:003
143919964,1cyclictest41-21ksoftirqd/309:10:013
143919963,2cyclictest17299-21snmpd08:27:253
143919963,2cyclictest17299-21snmpd08:00:303
143919963,2cyclictest17299-21snmpd07:36:143
143919960,5cyclictest0-21swapper/308:24:403
143839965,0cyclictest0-21swapper/207:48:432
143839963,2cyclictest17299-21snmpd08:58:102
143839960,0cyclictest0-21swapper/208:21:042
143729964,1cyclictest9-21ksoftirqd/008:25:000
143729963,2cyclictest17299-21snmpd08:08:420
143919953,1cyclictest684-21polkitd07:19:593
143919953,1cyclictest19914-21cat08:40:143
143919953,1cyclictest17299-21snmpd09:02:383
143919953,1cyclictest17299-21snmpd08:55:483
143919953,1cyclictest17299-21snmpd08:48:553
143919953,1cyclictest17299-21snmpd08:48:553
143919953,1cyclictest17299-21snmpd08:30:043
143919953,1cyclictest17299-21snmpd08:11:533
143919953,1cyclictest17299-21snmpd08:05:483
143919953,1cyclictest17299-21snmpd07:57:303
143919953,1cyclictest17299-21snmpd07:45:053
143919953,1cyclictest17299-21snmpd07:18:233
143919953,1cyclictest1058-21sendmail07:52:563
143919952,2cyclictest681-21gdbus08:15:013
143919950,4cyclictest14549-21sshd07:10:063
143919950,0cyclictest0-21swapper/308:51:403
143919950,0cyclictest0-21swapper/308:35:393
143839953,1cyclictest684-21polkitd07:59:592
143839953,1cyclictest649-21avahi-daemon07:25:102
143839953,1cyclictest25293-21/usr/sbin/munin07:35:112
143839953,1cyclictest17873-21cat08:35:142
143839953,1cyclictest17299-21snmpd09:05:142
143839953,1cyclictest17299-21snmpd09:04:112
143839953,1cyclictest17299-21snmpd08:50:042
143839953,1cyclictest17299-21snmpd08:43:372
143839953,1cyclictest17299-21snmpd08:31:252
143839953,1cyclictest17299-21snmpd08:25:422
143839953,1cyclictest17299-21snmpd08:17:152
143839953,1cyclictest17299-21snmpd08:10:052
143839953,1cyclictest17299-21snmpd08:05:302
143839953,1cyclictest17299-21snmpd07:55:302
143839953,1cyclictest17299-21snmpd07:53:572
143839953,1cyclictest17299-21snmpd07:40:112
143839953,1cyclictest17299-21snmpd07:22:402
143839953,1cyclictest17299-21snmpd07:17:142
143839952,2cyclictest24337-21getsmi07:30:292
143839952,2cyclictest15914-21awk07:10:192
143729953,1cyclictest646-21dbus-daemon08:35:010
143729953,1cyclictest31690-21gltestperf07:50:120
143729953,1cyclictest27319-21crond09:00:010
143729953,1cyclictest24549-21sensors_temp08:50:190
143729953,1cyclictest17299-21snmpd08:45:190
143729953,1cyclictest17299-21snmpd08:45:180
143729953,1cyclictest17299-21snmpd08:40:360
143729953,1cyclictest17299-21snmpd08:31:040
143729953,1cyclictest17299-21snmpd08:15:200
143729953,1cyclictest17299-21snmpd07:57:420
143729953,1cyclictest17299-21snmpd07:42:330
143729953,1cyclictest17299-21snmpd07:29:040
143729953,1cyclictest17299-21snmpd07:20:230
143729953,1cyclictest0-21swapper/009:05:000
143729952,2cyclictest17299-21snmpd07:38:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional