You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-16 - 00:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack2slot0.osadl.org (updated Tue Jul 15, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
307672740,0sleep20-21swapper/211:00:042
213072740,0sleep10-21swapper/110:48:461
189822630,2sleep21264099cyclictest09:50:122
172202600,0sleep20-21swapper/211:47:432
68512590,0sleep20-21swapper/211:17:462
45022590,0sleep30-21swapper/310:02:413
67272580,0sleep16719-21bash09:55:431
35882570,0sleep00-21swapper/012:20:200
30692540,0sleep10-21swapper/109:51:501
236722540,0sleep00-21swapper/011:29:230
141132540,0sleep00-21swapper/010:10:240
124712540,0sleep10-21swapper/109:38:561
156202530,0sleep30-21swapper/311:28:333
177602520,0sleep00-21swapper/011:38:160
160482520,1sleep0700-21gdbus10:38:000
112042520,0sleep10-21swapper/111:59:471
279292510,0sleep30-21swapper/310:39:223
161622510,1sleep216164-21grepconf.sh11:41:132
120542510,1sleep1231rcuc/110:27:181
246552500,0sleep224657-21systemd-cgroups12:28:292
137102500,0sleep30-21swapper/309:15:073
35032490,0sleep00-21swapper/011:17:240
190072490,0sleep318991-21rm09:36:103
17362490,0sleep10-21swapper/110:43:211
214572480,0sleep00-21swapper/012:25:100
88512470,0sleep00-21swapper/009:49:090
324442470,0sleep20-21swapper/211:26:592
53682450,0sleep10-21swapper/111:33:511
13762430,0sleep10-21swapper/109:20:351
277172390,0sleep10-21swapper/110:56:151
252752340,1sleep325262-21lspci11:02:493
154412340,0sleep20-21swapper/212:39:462
1072523114,12sleep20-21swapper/207:05:032
122932276,7sleep30-21swapper/307:07:123
121752265,7sleep00-21swapper/007:05:400
1243022513,7sleep10-21swapper/107:08:501
45512210,0sleep00-21swapper/010:40:150
39732200,0sleep0111rcuc/010:23:100
86382160,0sleep10-21swapper/109:31:441
86382160,0sleep10-21swapper/109:31:431
84322160,0sleep00-21swapper/009:56:020
190132160,0sleep20-21swapper/210:38:252
162632160,1sleep341-21ksoftirqd/312:33:453
133432160,0sleep00-21swapper/007:10:160
1263599165,3cyclictest25-21ksoftirqd/110:00:541
12635991615,0cyclictest5907-21lspci12:26:411
95442150,0sleep10-21swapper/111:53:191
29122150,0sleep32894-21sshd12:08:183
201592150,0sleep30-21swapper/311:51:083
183862150,0sleep10-21swapper/111:47:501
1263599156,1cyclictest25-21ksoftirqd/111:35:011
12635991515,0cyclictest10486-21kworker/1:107:10:191
12635991514,0cyclictest26227-21kworker/1:110:14:031
298272140,0sleep0101ktimersoftd/012:35:020
166712140,1sleep3391rcuc/311:08:433
12635991414,0cyclictest5248-21kworker/1:108:16:101
179962130,0sleep20-21swapper/209:46:382
160882130,1sleep216085-21sshd10:34:412
1264599130,1cyclictest646-21dbus-daemon11:48:293
1264099130,11cyclictest10106-21bash12:02:472
1263599136,1cyclictest25-21ksoftirqd/111:44:401
12635991313,0cyclictest1100-21kworker/1:208:00:551
12635991312,0cyclictest8321-21lspci12:08:491
12635991310,1cyclictest8982-21sshd10:30:281
1264599120,1cyclictest26635-21nfsd409:00:193
1264599120,1cyclictest1-21systemd09:22:593
1264599120,11cyclictest0-21swapper/312:36:493
1264599120,11cyclictest0-21swapper/311:57:393
12640991210,1cyclictest0-21swapper/212:10:572
1264099120,1cyclictest5113-21bash10:53:562
1264099120,1cyclictest0-21swapper/210:40:572
1264099120,11cyclictest21196-21sshd10:00:562
1264099120,11cyclictest0-21swapper/210:58:372
1264099120,11cyclictest0-21swapper/210:19:172
1263599128,1cyclictest25-21ksoftirqd/110:39:261
1263599124,1cyclictest25-21ksoftirqd/110:06:251
1263599123,1cyclictest25-21ksoftirqd/111:19:321
1263599122,1cyclictest646-21dbus-daemon12:13:511
1263599122,1cyclictest25-21ksoftirqd/111:20:341
12635991212,0cyclictest5248-21kworker/1:108:11:191
12635991212,0cyclictest25194-21kworker/1:312:38:051
12635991212,0cyclictest10556-21kworker/1:110:52:101
1263599120,1cyclictest11324-21bash11:04:471
1263599120,1cyclictest0-21swapper/112:19:581
12628991210,1cyclictest618-13audispd09:20:200
1262899120,1cyclictest27554-21id11:32:500
1262899120,1cyclictest25697-21sshd10:45:510
311732110,0sleep20-21swapper/209:44:432
303922110,1sleep330373-21rm12:16:513
1264599119,1cyclictest6019-21sshd10:47:093
1264599119,1cyclictest25226-21grep10:55:593
1264599110,10cyclictest24227-21lspci09:12:393
1264599110,10cyclictest24227-21lspci09:12:393
1264599110,10cyclictest0-21swapper/310:22:493
1264599110,10cyclictest0-21swapper/309:55:493
1264599110,0cyclictest8829-21sshd11:30:593
1264599110,0cyclictest0-21swapper/311:35:093
1264599110,0cyclictest0-21swapper/310:13:383
1264599110,0cyclictest0-21swapper/309:07:583
1264099119,1cyclictest30812-21sshd10:49:472
12640991110,0cyclictest0-21swapper/212:32:262
12640991110,0cyclictest0-21swapper/211:54:362
12640991110,0cyclictest0-21swapper/210:28:262
12640991110,0cyclictest0-21swapper/209:18:462
1263599119,1cyclictest14260-21sshd11:08:271
1263599112,1cyclictest25-21ksoftirqd/112:20:021
1263599112,1cyclictest25-21ksoftirqd/109:46:071
1263599111,3cyclictest25-21ksoftirqd/111:27:001
1263599111,2cyclictest16461-21sshd10:21:011
1263599111,1cyclictest700-21gdbus09:40:421
12635991111,0cyclictest29403-21kworker/1:007:50:401
12635991111,0cyclictest27089-21kworker/1:109:15:361
12635991110,0cyclictest0-21swapper/109:28:371
12635991110,0cyclictest0-21swapper/109:10:171
12635991110,0cyclictest0-21swapper/109:10:161
1263599110,1cyclictest121rcu_preempt11:12:211
1262899119,1cyclictest8046-21lspci10:33:510
1262899119,1cyclictest20465-21sshd12:34:110
1262899119,1cyclictest0-21swapper/011:10:510
12628991110,0cyclictest0-21swapper/010:59:210
12628991110,0cyclictest0-21swapper/010:50:300
12628991110,0cyclictest0-21swapper/009:15:090
1262899110,1cyclictest13625-21bash12:00:010
1262899110,0cyclictest0-21swapper/012:08:100
1264599109,0cyclictest0-21swapper/311:23:093
1264599109,0cyclictest0-21swapper/309:34:493
1264599109,0cyclictest0-21swapper/309:34:493
1264599108,1cyclictest0-21swapper/310:34:393
1264599100,0cyclictest0-21swapper/312:13:293
1264599100,0cyclictest0-21swapper/309:28:383
1264099109,0cyclictest0-21swapper/211:37:472
1264099109,0cyclictest0-21swapper/211:10:372
1264099109,0cyclictest0-21swapper/209:11:172
1264099109,0cyclictest0-21swapper/209:11:172
1264099109,0cyclictest0-21swapper/207:26:352
1264099100,9cyclictest0-21swapper/207:11:552
1264099100,0cyclictest0-21swapper/209:32:572
1264099100,0cyclictest0-21swapper/209:32:572
1263599109,0cyclictest9524-21kworker/1:209:05:131
1263599109,0cyclictest0-21swapper/107:20:171
1263599104,2cyclictest25-21ksoftirqd/112:34:191
1263599102,1cyclictest25-21ksoftirqd/110:15:001
12635991010,0cyclictest9524-21kworker/1:208:45:481
12635991010,0cyclictest25334-21kworker/1:107:46:531
12635991010,0cyclictest14889-21kworker/1:207:31:371
1263599100,1cyclictest648-21systemd-logind12:00:021
1262899109,0cyclictest0-21swapper/011:51:510
12628991010,0cyclictest0-21swapper/011:43:100
1262899100,0cyclictest0-21swapper/009:54:590
1262899100,0cyclictest0-21swapper/009:28:500
126459997,1cyclictest21476-21sshd11:15:483
126459997,1cyclictest18240-21lspci11:12:093
126409998,0cyclictest0-21swapper/210:10:362
126409998,0cyclictest0-21swapper/209:26:462
126409998,0cyclictest0-21swapper/209:23:572
126409998,0cyclictest0-21swapper/207:36:572
126409996,2cyclictest649-21avahi-daemon11:05:052
126409990,0cyclictest0-21swapper/207:53:362
126359999,0cyclictest9524-21kworker/1:208:54:191
126359999,0cyclictest9524-21kworker/1:208:20:081
126359999,0cyclictest25334-21kworker/1:107:42:001
126289998,0cyclictest0-21swapper/009:35:000
126289998,0cyclictest0-21swapper/009:34:590
126289998,0cyclictest0-21swapper/008:00:200
126289997,1cyclictest4047-21lspci11:04:010
126289996,2cyclictest7772-21kworker/0:310:04:250
16396280,6sleep216574-21sshd12:06:302
126459987,0cyclictest0-21swapper/308:44:083
126459986,1cyclictest30637-21lspci10:42:593
126459986,1cyclictest29335-21lspci10:19:003
126459986,1cyclictest28499-21lspci09:54:413
126459986,1cyclictest26981-21lspci10:05:023
126459986,1cyclictest18439-21lspci12:21:483
126459986,1cyclictest18036-21lspci10:27:583
126459985,2cyclictest649-21avahi-daemon12:28:183
126459985,2cyclictest649-21avahi-daemon10:50:213
126409986,1cyclictest27929-21lspci11:55:072
126409985,2cyclictest18462-21sshd11:22:242
126359988,0cyclictest9524-21kworker/1:208:57:561
126359988,0cyclictest9524-21kworker/1:208:35:451
126359988,0cyclictest9524-21kworker/1:208:30:321
126359988,0cyclictest29403-21kworker/1:007:58:511
126359988,0cyclictest14889-21kworker/1:207:38:331
126359988,0cyclictest14889-21kworker/1:207:29:221
126359988,0cyclictest1100-21kworker/1:208:07:301
126289987,0cyclictest0-21swapper/008:50:200
126289985,2cyclictest649-21avahi-daemon10:15:190
126289985,2cyclictest646-21dbus-daemon11:23:220
126459976,0cyclictest0-21swapper/308:47:093
126459975,1cyclictest700-21gdbus09:42:143
126459974,2cyclictest649-21avahi-daemon12:00:493
126459974,2cyclictest649-21avahi-daemon09:45:023
126459974,2cyclictest17299-21snmpd07:54:073
126459973,3cyclictest697-21gdbus11:41:503
126409976,0cyclictest0-21swapper/208:30:062
126409974,2cyclictest11145-21sshd10:20:252
126409973,3cyclictest611-21sshd11:30:142
126409972,2cyclictest23697-21sshd10:08:032
126409972,1cyclictest0-21swapper/212:20:202
126409970,6cyclictest18004-21sshd09:36:032
126409970,6cyclictest14815-21sshd09:56:482
126409970,6cyclictest0-21swapper/207:42:262
126409970,6cyclictest0-21swapper/207:30:562
126409970,6cyclictest0-21swapper/207:16:252
126409970,1cyclictest121rcu_preempt12:15:402
126359977,0cyclictest14889-21kworker/1:207:15:301
126359975,1cyclictest25-21ksoftirqd/108:30:001
126289975,1cyclictest700-21gdbus11:45:410
126289975,1cyclictest700-21gdbus09:40:460
126289975,1cyclictest649-21avahi-daemon12:11:120
126289975,1cyclictest649-21avahi-daemon11:07:240
126289975,1cyclictest649-21avahi-daemon09:35:320
126289974,2cyclictest700-21gdbus10:28:190
126289974,2cyclictest646-21dbus-daemon09:14:230
126289974,2cyclictest646-21dbus-daemon09:14:220
126289974,2cyclictest5462-21sshd11:55:590
126289974,2cyclictest10216-21sshd12:18:030
126459965,0cyclictest0-21swapper/307:20:183
126459963,2cyclictest17299-21snmpd07:27:063
126459960,5cyclictest0-21swapper/308:15:373
126409965,0cyclictest0-21swapper/208:14:372
126409965,0cyclictest0-21swapper/208:03:072
126409964,1cyclictest649-21avahi-daemon08:09:592
126409964,1cyclictest30642-21sshd09:07:522
126409963,2cyclictest17299-21snmpd08:50:012
126409960,0cyclictest0-21swapper/207:21:462
126359966,0cyclictest9524-21kworker/1:208:42:101
126359963,2cyclictest17299-21snmpd09:00:131
126289965,0cyclictest0-21swapper/008:09:590
126289964,1cyclictest684-21polkitd10:05:010
126289960,5cyclictest31893-21sshd09:08:230
126289960,5cyclictest25054-21sshd07:36:340
126289960,5cyclictest0-21swapper/007:45:100
126459954,0cyclictest0-21swapper/308:06:283
126459953,1cyclictest28075-21cat07:45:163
126459953,1cyclictest17299-21snmpd08:56:273
126459953,1cyclictest17299-21snmpd08:35:243
126459953,1cyclictest17299-21snmpd08:29:083
126459953,1cyclictest17299-21snmpd08:20:303
126459953,1cyclictest17299-21snmpd08:10:113
126459953,1cyclictest17299-21snmpd08:00:553
126459953,1cyclictest17299-21snmpd07:55:053
126459953,1cyclictest17299-21snmpd07:40:383
126459953,1cyclictest17299-21snmpd07:35:343
126459953,1cyclictest17299-21snmpd07:31:043
126459953,1cyclictest13891-21df_inode08:30:133
126459953,1cyclictest13167-21gltestperf07:10:143
126409953,1cyclictest17299-21snmpd08:37:242
126409953,1cyclictest17299-21snmpd08:26:122
126409953,1cyclictest17299-21snmpd08:22:182
126409953,1cyclictest17299-21snmpd08:15:292
126409953,1cyclictest17299-21snmpd07:57:592
126409953,1cyclictest1109-21ntpd08:40:172
126409952,2cyclictest20062-21sed08:45:142
126409950,4cyclictest0-21swapper/207:45:192
126409950,1cyclictest23792-21/usr/sbin/munin08:55:142
126289954,0cyclictest0-21swapper/008:39:200
126289953,1cyclictest682-21lsmd08:15:560
126289953,1cyclictest649-21avahi-daemon08:21:080
126289953,1cyclictest26551-21awk09:00:190
126289953,1cyclictest25909-21grep07:40:120
126289953,1cyclictest18540-21/usr/sbin/munin08:40:180
126289953,1cyclictest17446-21/usr/sbin/munin07:20:200
126289953,1cyclictest17299-21snmpd08:58:330
126289953,1cyclictest17299-21snmpd08:45:080
126289953,1cyclictest17299-21snmpd08:30:260
126289953,1cyclictest17299-21snmpd08:25:060
126289953,1cyclictest17299-21snmpd08:10:440
126289953,1cyclictest17299-21snmpd07:30:150
126289953,1cyclictest17299-21snmpd07:16:300
126289950,0cyclictest0-21swapper/007:56:290
126459942,1cyclictest75550irq/24-eno1-rx-07:15:013
126459942,1cyclictest21947-21expr08:50:133
126409942,1cyclictest258132sleep209:00:012
126289942,1cyclictest29799-21tr07:50:120
126289942,1cyclictest17299-21snmpd07:25:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional