You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 11:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack2slot0.osadl.org (updated Wed Apr 29, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
251802930,0sleep20-21swapper/200:39:082
15292620,1sleep11516-21sshd21:15:001
15292620,1sleep11516-21sshd21:14:591
201902600,0sleep10-21swapper/121:21:051
291722580,0sleep30-21swapper/322:34:403
32552570,1sleep33249-21df22:35:123
161832570,0sleep216184-21bash22:05:482
326042560,1sleep032607-21grep22:23:520
83672550,1sleep18349-21cp22:21:451
67472550,9sleep375750irq/24-eno1-rx-21:59:313
79942540,2sleep3703999cyclictest22:16:103
129242520,0sleep20-21swapper/222:00:032
315342510,0sleep10-21swapper/123:14:081
42102500,1sleep04208-21lspci21:56:280
179652500,1sleep217966-21bash22:44:532
313832490,1sleep131382-21bash22:32:021
262622490,0sleep10-21swapper/119:55:121
205962490,0sleep00-21swapper/000:38:340
64582480,0sleep30-21swapper/321:51:073
62152480,2sleep3703999cyclictest21:34:363
250072480,0sleep30-21swapper/323:50:063
5882470,0sleep00-21swapper/000:29:290
542224734,7sleep30-21swapper/319:05:143
143902450,0sleep0111rcuc/022:55:400
680324230,7sleep20-21swapper/219:08:412
244312400,0sleep00-21swapper/023:52:520
147692370,2sleep3703999cyclictest21:16:303
228532360,0sleep00-21swapper/022:45:150
171762360,21sleep375750irq/24-eno1-rx-22:47:333
314712340,0sleep10-21swapper/100:22:491
66272297,7sleep00-21swapper/019:06:270
66482265,7sleep10-21swapper/119:06:441
283462230,2sleep2703199cyclictest23:47:332
6372200,0sleep10-21swapper/123:59:221
20662190,2sleep3703999cyclictest22:04:403
249032180,0sleep10-21swapper/122:03:501
170012180,1sleep016999-21sshd22:08:420
301312170,0sleep00-21swapper/022:54:200
24022170,1sleep22404-21bash23:59:312
141782170,0sleep30-21swapper/322:55:393
79892160,0sleep00-21swapper/000:02:490
276792160,1sleep027678-21grepconf.sh23:58:520
137212160,0sleep313722-21hwlatdetect21:35:123
7026991514,0cyclictest23164-21lspci23:21:491
235722150,0sleep2311rcuc/200:31:392
235722150,0sleep2311rcuc/200:31:382
326382140,1sleep032641-21bash21:42:180
226442140,0sleep00-21swapper/021:33:130
88052130,0sleep20-21swapper/221:23:422
702699133,1cyclictest25-21ksoftirqd/123:02:531
702699133,1cyclictest25-21ksoftirqd/123:02:521
702699132,3cyclictest25-21ksoftirqd/122:37:031
58252130,0sleep0101ktimersoftd/021:23:190
230282130,0sleep20-21swapper/221:47:012
145682130,0sleep314570-21bash21:49:063
144242130,0sleep30-21swapper/323:23:553
7039991211,0cyclictest0-21swapper/323:58:313
703999120,1cyclictest15213-21lspci22:05:423
703999120,11cyclictest20824-21lspci21:13:223
703999120,11cyclictest20824-21lspci21:13:223
703999120,11cyclictest20719-21lspci23:46:523
703199120,1cyclictest1-21systemd22:11:362
703199120,11cyclictest11276-21sshd21:57:052
703199120,11cyclictest0-21swapper/223:24:152
703199120,11cyclictest0-21swapper/200:10:362
702699125,1cyclictest25-21ksoftirqd/121:41:561
702699125,1cyclictest25-21ksoftirqd/100:38:181
702699121,1cyclictest131rcu_sched23:25:211
7026991210,1cyclictest25-21ksoftirqd/123:15:121
702699120,1cyclictest1071-21nfsd00:29:471
7019991210,1cyclictest12369-21lspci21:28:020
7019991210,1cyclictest1-21systemd00:23:120
7019991210,1cyclictest0-21swapper/000:33:520
7019991210,1cyclictest0-21swapper/000:33:520
701999120,1cyclictest7498-21sshd23:09:120
701999120,11cyclictest1834-21sshd21:50:420
60152120,2sleep175850irq/25-eno1-tx-23:51:121
80272110,0sleep20-21swapper/221:37:282
7039991110,0cyclictest13613-21sshd23:12:323
7039991110,0cyclictest0-21swapper/321:29:423
7039991110,0cyclictest0-21swapper/300:22:123
703199119,1cyclictest0-21swapper/222:31:562
7031991110,0cyclictest8652-21sshd23:17:462
7031991110,0cyclictest4839-21lspci22:35:182
703199110,0cyclictest0-21swapper/222:46:562
702699114,1cyclictest25-21ksoftirqd/123:45:171
702699113,1cyclictest25-21ksoftirqd/122:50:261
702699113,1cyclictest25-21ksoftirqd/122:12:011
702699113,1cyclictest25-21ksoftirqd/122:07:051
702699112,1cyclictest25-21ksoftirqd/123:05:161
702699112,1cyclictest25-21ksoftirqd/100:13:261
702699111,3cyclictest25-21ksoftirqd/122:55:201
702699111,1cyclictest25-21ksoftirqd/122:49:551
702699111,1cyclictest131rcu_sched00:05:171
7026991111,0cyclictest241ktimersoftd/120:25:381
7026991110,0cyclictest0-21swapper/121:56:461
702699110,10cyclictest0-21swapper/121:18:061
701999119,1cyclictest1-21systemd21:12:520
701999119,1cyclictest1-21systemd21:12:520
701999119,1cyclictest0-21swapper/023:16:220
701999110,10cyclictest0-21swapper/023:41:520
701999110,0cyclictest0-21swapper/023:34:120
271152110,0sleep20-21swapper/223:44:412
703999109,0cyclictest0-21swapper/323:01:223
703999109,0cyclictest0-21swapper/323:01:223
703999109,0cyclictest0-21swapper/322:28:023
703999109,0cyclictest0-21swapper/300:26:123
703999108,1cyclictest4841-21lspci22:40:523
703999108,1cyclictest0-21swapper/300:16:123
703999108,1cyclictest0-21swapper/300:16:113
703999100,0cyclictest0-21swapper/323:37:123
703999100,0cyclictest0-21swapper/320:41:523
703999100,0cyclictest0-21swapper/300:36:023
703199109,0cyclictest3228-21lspci00:29:442
703199109,0cyclictest0-21swapper/223:09:462
703199109,0cyclictest0-21swapper/221:28:562
703199109,0cyclictest0-21swapper/221:11:062
703199109,0cyclictest0-21swapper/221:11:052
703199109,0cyclictest0-21swapper/220:09:552
703199108,1cyclictest674-21dbus-daemon00:08:362
703199108,1cyclictest33-21ksoftirqd/223:50:502
703199100,0cyclictest0-21swapper/200:01:462
702699109,0cyclictest0-21swapper/121:32:061
702699109,0cyclictest0-21swapper/121:25:061
702699108,1cyclictest25-21ksoftirqd/122:40:021
702699102,1cyclictest25-21ksoftirqd/122:27:551
702699101,2cyclictest25-21ksoftirqd/121:37:301
702699101,1cyclictest25-21ksoftirqd/123:40:421
702699101,1cyclictest25-21ksoftirqd/123:30:121
702699101,1cyclictest25-21ksoftirqd/100:30:261
702699101,1cyclictest25-21ksoftirqd/100:30:261
702699101,1cyclictest25-21ksoftirqd/100:00:391
702699101,1cyclictest121rcu_preempt21:50:471
7026991010,0cyclictest241ktimersoftd/120:15:261
7026991010,0cyclictest241ktimersoftd/120:07:241
7026991010,0cyclictest241ktimersoftd/120:00:421
7026991010,0cyclictest241ktimersoftd/119:47:491
7026991010,0cyclictest241ktimersoftd/119:43:591
702699100,1cyclictest25-21ksoftirqd/121:46:081
702699100,1cyclictest131rcu_sched23:35:391
702699100,1cyclictest131rcu_sched22:15:171
701999108,1cyclictest649-21polkitd23:37:020
701999108,1cyclictest12171-21sshd22:44:220
701999100,0cyclictest0-21swapper/021:15:120
39882100,0sleep33986-21sshd23:31:233
70399998,0cyclictest0-21swapper/320:59:513
70399998,0cyclictest0-21swapper/300:30:323
70399998,0cyclictest0-21swapper/300:30:323
70399996,2cyclictest674-21dbus-daemon23:16:433
70319997,1cyclictest33-21ksoftirqd/223:32:392
70319997,1cyclictest33-21ksoftirqd/223:00:172
70319997,1cyclictest33-21ksoftirqd/223:00:172
70319996,2cyclictest674-21dbus-daemon22:54:522
70319996,2cyclictest660-21avahi-daemon21:43:332
70269999,0cyclictest241ktimersoftd/120:59:361
70269999,0cyclictest241ktimersoftd/119:39:381
70269996,1cyclictest25-21ksoftirqd/100:15:251
70269996,1cyclictest25-21ksoftirqd/100:15:251
70199998,0cyclictest0-21swapper/023:46:420
70199998,0cyclictest0-21swapper/023:11:120
70199998,0cyclictest0-21swapper/022:13:020
70199998,0cyclictest0-21swapper/000:17:120
70199998,0cyclictest0-21swapper/000:17:120
70199996,2cyclictest674-21dbus-daemon22:00:390
70199996,2cyclictest660-21avahi-daemon22:31:270
70199996,2cyclictest660-21avahi-daemon00:14:140
70399987,0cyclictest0-21swapper/323:40:023
70399987,0cyclictest0-21swapper/321:02:523
70399987,0cyclictest0-21swapper/319:56:523
70399987,0cyclictest0-21swapper/319:31:523
70399986,1cyclictest9970-21lspci23:06:313
70399986,1cyclictest660-21avahi-daemon00:07:583
70399986,1cyclictest41-21ksoftirqd/300:11:513
70399986,1cyclictest14125-21cp00:03:223
70399985,2cyclictest660-21avahi-daemon22:52:443
70399985,2cyclictest660-21avahi-daemon21:41:313
70399985,2cyclictest660-21avahi-daemon21:22:393
70399984,3cyclictest649-21polkitd22:11:113
70399982,1cyclictest121rcu_preempt22:21:383
70399980,0cyclictest0-21swapper/320:20:323
70319986,1cyclictest33-21ksoftirqd/223:12:402
70319986,1cyclictest16926-21lspci23:26:552
70319985,2cyclictest660-21avahi-daemon23:37:192
70319985,2cyclictest660-21avahi-daemon22:25:372
70319985,2cyclictest660-21avahi-daemon21:33:112
70319985,2cyclictest660-21avahi-daemon21:17:512
70319980,1cyclictest1-21systemd00:18:302
70319980,1cyclictest1-21systemd00:18:302
70269988,0cyclictest241ktimersoftd/120:54:351
70269988,0cyclictest241ktimersoftd/119:52:011
70269986,1cyclictest25-21ksoftirqd/120:45:001
70199986,1cyclictest6845-21kworker/0:023:24:420
70199986,1cyclictest0-21swapper/021:37:020
70199985,2cyclictest660-21avahi-daemon23:28:350
70199985,2cyclictest660-21avahi-daemon23:03:350
70199985,2cyclictest660-21avahi-daemon23:03:350
70199985,2cyclictest660-21avahi-daemon22:19:470
70199985,2cyclictest660-21avahi-daemon21:47:100
70199980,4cyclictest11987-21perf20:40:000
70399976,0cyclictest0-21swapper/320:25:023
70399975,1cyclictest660-21avahi-daemon23:26:373
70319975,1cyclictest660-21avahi-daemon22:21:212
70319975,1cyclictest5341-21lspci22:15:562
70319975,1cyclictest33-21ksoftirqd/221:50:202
70319974,2cyclictest660-21avahi-daemon22:56:322
70319974,2cyclictest660-21avahi-daemon00:20:062
70319970,6cyclictest0-21swapper/220:25:562
70319970,0cyclictest0-21swapper/219:50:362
70269977,0cyclictest241ktimersoftd/121:01:361
70269976,0cyclictest6788-21kworker/1:219:21:081
70269976,0cyclictest5446-21kworker/1:120:20:361
70269976,0cyclictest10697-21open_inodes19:15:151
70269975,1cyclictest25-21ksoftirqd/121:10:001
70199975,1cyclictest660-21avahi-daemon00:05:210
70199974,2cyclictest660-21avahi-daemon22:35:010
70199972,4cyclictest642-21systemd-logind22:25:490
4050270,5sleep24314-21df20:20:122
70399965,0cyclictest0-21swapper/319:42:223
70399963,2cyclictest1002-21snmpd20:54:573
70399963,2cyclictest1002-21snmpd20:38:483
70399963,2cyclictest1002-21snmpd19:45:013
70399963,2cyclictest1002-21snmpd19:37:343
70399960,0cyclictest0-21swapper/319:50:423
70319963,2cyclictest1002-21snmpd21:09:312
70319963,2cyclictest1002-21snmpd19:57:522
70319960,5cyclictest0-21swapper/219:48:262
70269966,0cyclictest7536-21kworker/1:020:37:101
70269966,0cyclictest7536-21kworker/1:020:30:141
70269966,0cyclictest6788-21kworker/1:219:31:281
70269966,0cyclictest6788-21kworker/1:219:26:521
70269966,0cyclictest6788-21kworker/1:219:10:041
70269966,0cyclictest32076-21kworker/1:320:11:021
70269966,0cyclictest13782-21kworker/1:120:46:291
70199965,0cyclictest0-21swapper/019:44:520
70199964,1cyclictest6559-21mii-tool20:25:140
70199964,1cyclictest19737-21ls19:40:010
70199963,2cyclictest1002-21snmpd20:58:360
70199963,2cyclictest1002-21snmpd20:46:230
70199963,2cyclictest1002-21snmpd20:42:000
70199963,2cyclictest1002-21snmpd20:20:070
70199963,2cyclictest1002-21snmpd19:19:090
70199963,1cyclictest0-21swapper/019:14:550
70199960,5cyclictest0-21swapper/020:15:520
70399953,1cyclictest14690-21cat20:45:143
70399953,1cyclictest1002-21snmpd21:07:193
70399953,1cyclictest1002-21snmpd20:30:213
70399953,1cyclictest1002-21snmpd20:10:323
70399953,1cyclictest1002-21snmpd20:07:383
70399953,1cyclictest1002-21snmpd20:02:383
70399953,1cyclictest1002-21snmpd19:25:143
70399953,1cyclictest1002-21snmpd19:19:153
70399953,1cyclictest1002-21snmpd19:10:393
70399952,2cyclictest1002-21snmpd19:20:363
70399950,1cyclictest2782-21nfsd420:15:153
70319953,1cyclictest1705-21sendmail19:25:392
70319953,1cyclictest1088-21ntpd20:00:172
70319953,1cyclictest1002-21snmpd20:52:062
70319953,1cyclictest1002-21snmpd20:41:002
70319953,1cyclictest1002-21snmpd20:31:022
70319953,1cyclictest1002-21snmpd20:16:202
70319953,1cyclictest1002-21snmpd20:11:142
70319953,1cyclictest1002-21snmpd19:41:512
70319953,1cyclictest1002-21snmpd19:35:072
70319953,1cyclictest1002-21snmpd19:30:042
70319953,1cyclictest1002-21snmpd19:20:032
70319953,1cyclictest1002-21snmpd19:15:452
70319952,2cyclictest1002-21snmpd20:57:392
70319952,2cyclictest1002-21snmpd20:35:452
70319950,0cyclictest0-21swapper/221:03:162
70319950,0cyclictest0-21swapper/219:13:462
70199953,1cyclictest16391-21cat19:30:130
70199953,1cyclictest1088-21ntpd20:30:160
70199953,1cyclictest1082-21lldpd20:50:330
70199953,1cyclictest1002-21snmpd21:05:070
70199953,1cyclictest1002-21snmpd21:00:580
70199953,1cyclictest1002-21snmpd20:10:080
70199953,1cyclictest1002-21snmpd20:06:560
70199953,1cyclictest1002-21snmpd20:00:070
70199953,1cyclictest1002-21snmpd19:51:370
70199953,1cyclictest1002-21snmpd19:46:130
70199953,1cyclictest1002-21snmpd19:20:480
70199952,2cyclictest14214-21tail19:25:150
15927250,0sleep20-21swapper/220:48:512
70199942,1cyclictest26298-21cut19:55:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional