You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 20:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack2slot0.osadl.org (updated Sat Apr 27, 2024 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
282902790,2sleep2619199cyclictest10:47:062
86932540,0sleep10-21swapper/112:25:541
212582540,0sleep20-21swapper/210:50:062
90012530,0sleep10-21swapper/112:03:231
58052530,0sleep10-21swapper/111:55:261
281552520,0sleep10-21swapper/110:18:281
27652520,0sleep20-21swapper/209:33:492
59292510,0sleep30-21swapper/309:30:213
212912510,0sleep20-21swapper/209:20:552
212912510,0sleep20-21swapper/209:20:552
53812500,0sleep20-21swapper/210:04:212
257992500,0sleep30-21swapper/312:09:093
179652500,0sleep117964-21sshd12:19:331
94822480,0sleep30-21swapper/310:45:033
312532480,0sleep00-21swapper/012:36:020
286542480,0sleep30-21swapper/311:39:303
96622470,0sleep10-21swapper/109:15:491
96622470,0sleep10-21swapper/109:15:491
258422470,0sleep2311rcuc/210:32:322
151712470,0sleep00-21swapper/010:49:240
141802470,0sleep30-21swapper/312:11:303
108032470,0sleep20-21swapper/211:48:382
260952430,0sleep00-21swapper/011:50:200
80232380,0sleep00-21swapper/010:52:170
59402298,7sleep10-21swapper/107:08:211
58832287,7sleep30-21swapper/307:07:393
58472287,6sleep20-21swapper/207:07:102
294292240,0sleep00-21swapper/011:20:480
585022210,7sleep00-21swapper/007:07:120
245332180,0sleep30-21swapper/309:47:393
212902180,0sleep20-21swapper/211:08:452
278072170,0sleep10-21swapper/109:40:201
258622170,0sleep00-21swapper/010:58:050
73132160,0sleep20-21swapper/212:14:332
6187991615,0cyclictest30214-21kworker/1:411:35:311
49762160,0sleep0101ktimersoftd/012:06:380
105102160,0sleep10-21swapper/110:41:321
20102150,1sleep20-21swapper/210:40:332
140732150,0sleep20-21swapper/209:27:362
121222150,0sleep10-21swapper/111:45:041
95042140,0sleep00-21swapper/011:59:450
83332140,0sleep10-21swapper/111:14:441
6187991413,0cyclictest32549-21kworker/1:209:39:031
6187991412,1cyclictest30214-21kworker/1:411:43:411
6187991412,1cyclictest30214-21kworker/1:411:33:271
6187991412,1cyclictest28474-21kworker/1:110:55:391
268542140,0sleep30-21swapper/310:54:323
229632140,0sleep20-21swapper/210:06:212
619799130,1cyclictest0-21swapper/311:22:153
6187991312,0cyclictest33050irq/27-ahci[00011:16:321
6187991312,0cyclictest26742-21lspci10:39:511
6187991312,0cyclictest23441-21kworker/1:209:21:431
6187991312,0cyclictest23441-21kworker/1:209:21:431
6187991312,0cyclictest12592-21kworker/1:311:23:231
6187991311,1cyclictest24946-21kworker/1:309:48:031
618799130,1cyclictest646-21dbus-daemon12:11:141
618799130,12cyclictest24232-21lspci10:54:131
618099130,1cyclictest32134-21sshd09:11:010
6197991210,1cyclictest31059-21sshd11:32:153
6197991210,1cyclictest1-21systemd11:54:353
619799120,1cyclictest648-21systemd-logind10:15:453
619799120,11cyclictest29869-21lspci10:22:153
619799120,11cyclictest22715-21sshd11:27:353
6191991211,0cyclictest0-21swapper/211:16:112
6191991210,1cyclictest12665-21bash11:22:412
6191991210,1cyclictest0-21swapper/210:16:112
619199120,1cyclictest10990-21bash11:03:512
619199120,11cyclictest28169-21sshd10:36:212
619199120,11cyclictest0-21swapper/211:29:112
6187991212,0cyclictest3122-21kworker/1:309:32:171
6187991211,0cyclictest17031-21kworker/1:209:59:411
6187991210,1cyclictest0-21swapper/111:02:231
6187991210,1cyclictest0-21swapper/108:05:121
618799120,11cyclictest0-21swapper/109:54:331
6180991210,1cyclictest19427-21lspci11:30:520
6180991210,1cyclictest0-21swapper/009:36:020
618099120,1cyclictest648-21systemd-logind09:26:520
618099120,1cyclictest15403-21sshd11:04:220
299292120,0sleep10-21swapper/111:28:261
272032120,1sleep327201-21lspci10:32:413
619799119,1cyclictest26310-21lspci12:35:253
6197991110,0cyclictest0-21swapper/311:16:553
6197991110,0cyclictest0-21swapper/311:06:553
6197991110,0cyclictest0-21swapper/309:57:353
6197991110,0cyclictest0-21swapper/309:11:543
619799110,0cyclictest0-21swapper/312:22:553
619199119,1cyclictest646-21dbus-daemon12:03:512
619199119,1cyclictest32493-21sshd09:52:212
6191991110,0cyclictest0-21swapper/211:31:302
619199110,10cyclictest0-21swapper/212:37:012
619199110,10cyclictest0-21swapper/209:55:312
619199110,0cyclictest0-21swapper/211:55:002
618799119,1cyclictest620-13audispd09:12:031
618799119,1cyclictest31098-21lspci11:54:441
6187991111,0cyclictest26699-21kworker/1:010:22:131
6187991111,0cyclictest20822-21kworker/1:009:25:211
6187991111,0cyclictest12359-21kworker/1:112:30:591
6187991110,0cyclictest6310-21kworker/1:110:13:431
618799110,10cyclictest0-21swapper/110:29:331
618799110,10cyclictest0-21swapper/107:10:131
618099119,1cyclictest25890-21sshd11:16:420
6180991110,0cyclictest0-21swapper/010:19:020
6180991110,0cyclictest0-21swapper/009:52:520
618099110,10cyclictest4086-21sshd11:06:420
618099110,10cyclictest20602-21bash12:31:020
618099110,10cyclictest0-21swapper/011:44:220
618099110,10cyclictest0-21swapper/011:29:420
618099110,0cyclictest0-21swapper/009:40:220
619799109,0cyclictest0-21swapper/312:18:453
619799109,0cyclictest0-21swapper/310:40:253
619799109,0cyclictest0-21swapper/310:01:453
619799109,0cyclictest0-21swapper/309:54:253
619799100,9cyclictest0-21swapper/307:20:243
619799100,0cyclictest0-21swapper/312:27:053
619799100,0cyclictest0-21swapper/309:40:023
619199109,0cyclictest0-21swapper/212:25:412
619199109,0cyclictest0-21swapper/207:29:002
619199100,0cyclictest0-21swapper/209:42:212
619199100,0cyclictest0-21swapper/207:44:402
618799109,0cyclictest1499-21lspci10:07:401
618799109,0cyclictest0-21swapper/110:00:431
6187991010,0cyclictest7853-21kworker/1:210:46:591
6187991010,0cyclictest29058-21kworker/1:208:17:251
618799100,0cyclictest131rcu_sched12:24:201
618799100,0cyclictest0-21swapper/108:35:231
618099109,0cyclictest0-21swapper/010:44:420
618099109,0cyclictest0-21swapper/010:05:320
618099109,0cyclictest0-21swapper/009:15:520
618099109,0cyclictest0-21swapper/009:15:520
618099108,1cyclictest22881-21sshd10:10:120
618099102,4cyclictest0-21swapper/008:10:000
618099100,9cyclictest0-21swapper/010:27:220
61979998,0cyclictest0-21swapper/312:01:053
61979998,0cyclictest0-21swapper/310:35:553
61979998,0cyclictest0-21swapper/309:25:543
61919998,0cyclictest0-21swapper/212:21:302
61919998,0cyclictest0-21swapper/210:22:412
61919998,0cyclictest0-21swapper/209:14:112
61919994,2cyclictest17807-21sshd10:28:052
61879998,0cyclictest8932-21lspci12:37:141
61879998,0cyclictest10465-21kworker/1:110:34:511
61879998,0cyclictest0-21swapper/108:10:131
61879992,1cyclictest131rcu_sched12:05:161
61809998,0cyclictest0-21swapper/012:18:320
61809998,0cyclictest0-21swapper/011:45:310
61809990,0cyclictest0-21swapper/010:35:420
61979986,1cyclictest664-21lspci11:10:073
61979985,2cyclictest41-21ksoftirqd/311:46:283
61919987,0cyclictest0-21swapper/211:35:012
61919986,1cyclictest649-21avahi-daemon11:11:192
61919986,1cyclictest26013-21lspci11:54:072
61919986,1cyclictest1326-21lspci12:17:332
61919985,2cyclictest8981-21sshd11:40:512
61919985,2cyclictest649-21avahi-daemon09:37:152
61919984,3cyclictest649-21avahi-daemon09:49:222
61919984,3cyclictest17299-21snmpd12:06:122
61879988,0cyclictest22936-21kworker/1:108:01:591
61879986,1cyclictest25-21ksoftirqd/111:06:081
61809987,0cyclictest0-21swapper/009:21:220
61809987,0cyclictest0-21swapper/009:21:220
61809986,1cyclictest31238-21sshd11:35:570
61809986,1cyclictest2123-21lspci12:28:580
61809980,4cyclictest1-21systemd09:10:000
11538280,1sleep31-21systemd09:38:353
61979975,1cyclictest646-21dbus-daemon09:17:043
61979975,1cyclictest646-21dbus-daemon09:17:043
61979975,1cyclictest24401-21sshd11:57:413
61979974,2cyclictest700-21gdbus10:25:553
61979974,2cyclictest648-21systemd-logind10:11:453
61979974,2cyclictest646-21dbus-daemon12:31:413
61979973,3cyclictest646-21dbus-daemon09:20:253
61979973,3cyclictest646-21dbus-daemon09:20:253
61979973,1cyclictest646-21dbus-daemon10:55:183
61979970,6cyclictest740-21sshd11:02:383
61919975,1cyclictest649-21avahi-daemon12:32:122
61919975,1cyclictest1292-21sshd10:11:252
61919974,2cyclictest649-21avahi-daemon10:57:502
61919974,1cyclictest6037-21sshd09:19:162
61919974,1cyclictest6037-21sshd09:19:162
61879976,1cyclictest22936-21kworker/1:107:55:231
61809975,1cyclictest9-21ksoftirqd/010:22:020
61809975,1cyclictest5894-21sshd12:10:270
61809975,1cyclictest27049-21lspci12:20:280
61809975,1cyclictest25011-21lspci09:32:370
61809975,1cyclictest14266-21lspci11:11:360
61809974,2cyclictest649-21avahi-daemon10:34:350
61809974,2cyclictest648-21systemd-logind09:49:550
61809974,2cyclictest26785-21sshd12:01:390
61809973,3cyclictest700-21gdbus09:55:180
61809970,6cyclictest21473-21sshd10:02:240
11263270,0sleep30-21swapper/310:05:023
61979965,0cyclictest0-21swapper/307:45:243
61979964,1cyclictest684-21polkitd07:15:003
61979963,2cyclictest17299-21snmpd09:04:493
61979963,2cyclictest17299-21snmpd08:23:183
61979961,2cyclictest646-21dbus-daemon11:40:103
61919965,0cyclictest0-21swapper/208:03:202
61919965,0cyclictest0-21swapper/207:59:502
61919965,0cyclictest0-21swapper/207:30:302
61919963,2cyclictest17299-21snmpd08:40:132
61919960,0cyclictest0-21swapper/208:45:102
61879966,0cyclictest2856-21kworker/1:008:26:351
61879966,0cyclictest1993-21kworker/1:307:27:091
61879966,0cyclictest14851-21kworker/1:007:48:071
61879966,0cyclictest10948-21kworker/1:208:50:411
61879964,1cyclictest649-21avahi-daemon08:24:551
61879964,1cyclictest25-21ksoftirqd/109:00:001
61809965,0cyclictest0-21swapper/007:40:320
61809964,1cyclictest646-21dbus-daemon08:50:000
61809963,2cyclictest646-21dbus-daemon07:20:000
61809960,5cyclictest0-21swapper/007:56:020
61979954,0cyclictest0-21swapper/308:55:343
61979953,1cyclictest27741-21mii-tool08:00:143
61979953,1cyclictest2244-21timerwakeupswit08:15:263
61979953,1cyclictest17299-21snmpd08:40:403
61979953,1cyclictest17299-21snmpd08:36:223
61979953,1cyclictest17299-21snmpd08:31:363
61979953,1cyclictest17299-21snmpd08:11:483
61979953,1cyclictest17299-21snmpd08:08:333
61979953,1cyclictest17299-21snmpd07:43:443
61979953,1cyclictest17299-21snmpd07:39:203
61979953,1cyclictest17299-21snmpd07:15:073
61979953,1cyclictest15914-21missed_timers08:50:133
61979953,1cyclictest13515-21cat07:25:133
61979953,1cyclictest13286-21cpu08:45:143
61979953,1cyclictest1058-21sendmail09:05:433
61979953,1cyclictest1017-21runrttasks07:55:323
61979952,2cyclictest17299-21snmpd07:30:383
61919954,0cyclictest0-21swapper/208:09:402
61919953,1cyclictest649-21avahi-daemon08:15:282
61919953,1cyclictest646-21dbus-daemon07:10:002
61919953,1cyclictest23181-21sadc09:10:002
61919953,1cyclictest21649-21cat07:45:132
61919953,1cyclictest17299-21snmpd08:56:342
61919953,1cyclictest17299-21snmpd08:30:392
61919953,1cyclictest17299-21snmpd08:22:332
61919953,1cyclictest17299-21snmpd07:51:362
61919953,1cyclictest17299-21snmpd07:36:112
61919953,1cyclictest17299-21snmpd07:20:172
61919953,1cyclictest17299-21snmpd07:18:192
61919952,2cyclictest17299-21snmpd08:51:252
61919951,3cyclictest5627-21uname08:25:182
61919950,2cyclictest10139-21proc_pri08:35:242
61919950,1cyclictest0-21swapper/209:00:182
61879954,0cyclictest0-21swapper/108:41:031
61879954,0cyclictest0-21swapper/107:15:021
61879953,1cyclictest7593-21cat08:30:131
61879953,1cyclictest649-21avahi-daemon08:45:101
61879953,1cyclictest22113-21awk09:05:161
61879953,1cyclictest1993-21kworker/1:307:20:171
61879953,1cyclictest17299-21snmpd09:02:341
61879953,1cyclictest17299-21snmpd07:41:581
61879953,1cyclictest17299-21snmpd07:38:321
61879953,1cyclictest17299-21snmpd07:31:411
61879950,0cyclictest0-21swapper/107:51:331
61809953,1cyclictest7630-21cat08:30:130
61809953,1cyclictest700-21gdbus08:25:000
61809953,1cyclictest700-21gdbus07:45:000
61809953,1cyclictest646-21dbus-daemon09:00:000
61809953,1cyclictest23688-21cat07:50:140
61809953,1cyclictest2348-21tail08:15:280
61809953,1cyclictest17299-21snmpd09:00:130
61809953,1cyclictest17299-21snmpd08:41:310
61809953,1cyclictest17299-21snmpd08:11:510
61809953,1cyclictest17299-21snmpd07:35:380
61809953,1cyclictest17299-21snmpd07:30:050
61809953,1cyclictest17299-21snmpd07:23:380
61809953,1cyclictest17299-21snmpd07:11:460
61809952,2cyclictest697-21gdbus08:50:000
61809952,2cyclictest17299-21snmpd08:02:540
61809952,2cyclictest13897-21open_files07:25:170
61809950,0cyclictest0-21swapper/008:36:120
61979942,1cyclictest23568-21head07:50:113
61979940,3cyclictest5373-21diskstats08:25:153
61919940,1cyclictest31343-21/usr/sbin/munin08:10:092
61809942,1cyclictest0-21swapper/008:20:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional