You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-15 - 01:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack2slot0.osadl.org (updated Fri Nov 14, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
249322630,0sleep30-21swapper/310:34:063
101102630,0sleep30-21swapper/310:03:593
112772620,1sleep30-21swapper/311:08:553
60632610,0sleep30-21swapper/309:49:243
60632610,0sleep30-21swapper/309:49:243
178552610,1sleep0111rcuc/011:56:140
178552610,1sleep0111rcuc/011:56:130
149502590,0sleep10-21swapper/112:37:401
63742560,0sleep20-21swapper/209:35:222
63742560,0sleep20-21swapper/209:35:212
243312560,1sleep2311rcuc/211:03:082
248182550,0sleep00-21swapper/010:16:080
188912540,0sleep00-21swapper/010:08:200
153302540,0sleep0111rcuc/010:33:030
316052510,0sleep30-21swapper/311:57:453
316052510,0sleep30-21swapper/311:57:443
164582480,0sleep00-21swapper/009:54:090
188472460,2sleep32494699cyclictest12:03:293
218842450,0sleep30-21swapper/311:13:403
179292450,2sleep32494699cyclictest12:37:573
47782440,1sleep04771-21bash12:05:220
77652370,0sleep07761-21sshd11:08:310
249312360,0sleep00-21swapper/009:26:430
2353023422,7sleep00-21swapper/007:05:170
245232318,7sleep30-21swapper/307:06:083
246672287,7sleep20-21swapper/207:07:552
230392219,7sleep10-21swapper/107:05:021
69252200,0sleep10-21swapper/111:48:091
201912190,0sleep10-21swapper/110:08:291
115572180,0sleep30-21swapper/309:07:143
105562170,0sleep10-21swapper/110:54:341
324412160,0sleep30-21swapper/311:18:313
235182160,1sleep123516-21lspci12:04:031
197682160,0sleep019767-21sshd09:40:160
283602150,1sleep00-21swapper/009:19:420
213482150,0sleep30-21swapper/309:40:243
197152150,0sleep00-21swapper/011:24:210
194232150,1sleep2321ktimersoftd/212:28:072
184012150,0sleep10-21swapper/110:48:061
170772150,0sleep10-21swapper/111:35:121
261522140,0sleep10-21swapper/109:58:441
2493699140,13cyclictest2459-21lspci10:35:080
2493699140,12cyclictest4279-21grep10:03:170
150892140,0sleep10-21swapper/111:31:191
144272140,0sleep30-21swapper/310:47:403
71902130,0sleep10-21swapper/111:55:111
71902130,0sleep10-21swapper/111:55:101
24945991311,1cyclictest1011-21sshd11:58:472
24945991311,1cyclictest1011-21sshd11:58:462
2494599130,1cyclictest29448-21bash12:01:062
2494599130,1cyclictest14674-21bash10:22:062
2494599130,1cyclictest1006-21sshd11:40:252
2494599130,12cyclictest0-21swapper/212:34:572
47302120,0sleep30-21swapper/310:42:443
2494699120,1cyclictest23669-21lspci11:24:483
2494699120,11cyclictest0-21swapper/312:05:083
24945991210,1cyclictest4589-21lspci09:28:062
2494599120,11cyclictest0-21swapper/210:52:452
2494299120,1cyclictest7162-21sshd10:21:181
2494299120,1cyclictest28627-21nfsd408:35:181
2494299120,11cyclictest0-21swapper/109:18:571
2493699120,11cyclictest32461-21sshd12:15:180
2493699120,11cyclictest26082-21lspci10:23:280
2493699120,11cyclictest20910-21bash12:14:090
2493699120,11cyclictest0-21swapper/011:45:480
2494699119,1cyclictest5652-21bash09:24:283
24946991110,0cyclictest0-21swapper/312:29:373
2494599119,1cyclictest33-21ksoftirqd/210:18:482
2494599119,1cyclictest18151-21sshd09:18:352
24945991110,0cyclictest0-21swapper/211:21:562
24945991110,0cyclictest0-21swapper/211:09:152
24945991110,0cyclictest0-21swapper/210:07:062
24945991110,0cyclictest0-21swapper/209:55:052
2494599110,10cyclictest0-21swapper/207:28:452
2494599110,0cyclictest0-21swapper/211:15:352
2494299119,1cyclictest0-21swapper/111:29:481
24942991110,0cyclictest0-21swapper/109:48:581
24942991110,0cyclictest0-21swapper/109:48:571
2494299110,10cyclictest0-21swapper/110:02:171
2494299110,0cyclictest0-21swapper/111:22:171
2494299110,0cyclictest0-21swapper/110:13:471
24936991110,0cyclictest0-21swapper/011:26:490
24936991110,0cyclictest0-21swapper/011:11:490
2493699110,0cyclictest0-21swapper/011:41:490
2494699109,0cyclictest0-21swapper/312:30:483
2494699109,0cyclictest0-21swapper/311:34:373
2494699109,0cyclictest0-21swapper/309:57:173
2494699109,0cyclictest0-21swapper/309:28:373
2494699100,0cyclictest0-21swapper/311:52:573
2494699100,0cyclictest0-21swapper/311:40:573
2494699100,0cyclictest0-21swapper/310:20:173
2494699100,0cyclictest0-21swapper/309:17:573
2494599109,0cyclictest0-21swapper/212:38:272
2494599109,0cyclictest0-21swapper/211:32:552
2494599108,1cyclictest33-21ksoftirqd/212:19:552
2494599108,1cyclictest33-21ksoftirqd/211:26:272
2494599108,1cyclictest33-21ksoftirqd/209:40:502
2494599108,1cyclictest33-21ksoftirqd/209:10:192
2494599108,1cyclictest28806-21sshd11:14:262
2494599107,2cyclictest33-21ksoftirqd/212:09:472
2494599107,1cyclictest33-21ksoftirqd/210:55:482
2494599107,1cyclictest33-21ksoftirqd/209:53:382
2494599100,0cyclictest0-21swapper/210:40:452
2494299109,0cyclictest0-21swapper/112:12:281
2494299109,0cyclictest0-21swapper/111:54:281
2494299109,0cyclictest0-21swapper/111:04:281
2494299109,0cyclictest0-21swapper/110:39:581
2494299100,0cyclictest0-21swapper/109:50:481
2494299100,0cyclictest0-21swapper/107:35:171
2493699109,0cyclictest0-21swapper/012:21:090
2493699109,0cyclictest0-21swapper/010:46:490
2493699109,0cyclictest0-21swapper/009:48:480
2493699109,0cyclictest0-21swapper/009:48:470
2493699109,0cyclictest0-21swapper/009:14:380
26434290,1sleep126437-21bash09:34:001
249469998,0cyclictest0-21swapper/311:47:483
249469998,0cyclictest0-21swapper/310:19:083
249469998,0cyclictest0-21swapper/310:05:183
249459997,1cyclictest33-21ksoftirqd/212:21:222
249459997,1cyclictest33-21ksoftirqd/212:13:472
249459997,1cyclictest33-21ksoftirqd/211:46:562
249459997,1cyclictest33-21ksoftirqd/210:35:142
249459997,1cyclictest33-21ksoftirqd/210:10:192
249459997,1cyclictest33-21ksoftirqd/210:02:012
249459997,1cyclictest33-21ksoftirqd/209:31:282
249459997,1cyclictest33-21ksoftirqd/209:23:132
249459996,2cyclictest33-21ksoftirqd/210:29:522
249459996,1cyclictest33-21ksoftirqd/211:35:462
249429998,0cyclictest0-21swapper/112:15:571
249429997,1cyclictest4762-21lspci12:08:571
249429996,2cyclictest700-21gdbus10:15:101
249369998,0cyclictest0-21swapper/010:51:180
249369998,0cyclictest0-21swapper/009:04:280
249369997,1cyclictest9-21ksoftirqd/010:13:290
249369996,2cyclictest7461-21kworker/0:109:39:510
249369996,2cyclictest7461-21kworker/0:109:39:510
15890290,1sleep115892-21bash11:42:081
12488290,1sleep312470-21sshd10:39:503
249469987,0cyclictest0-21swapper/311:04:373
249469987,0cyclictest0-21swapper/310:50:273
249469987,0cyclictest0-21swapper/308:09:173
249469986,1cyclictest9437-21lspci12:12:543
249469986,1cyclictest13770-21lspci12:16:473
249469984,3cyclictest15519-21sshd09:54:003
249459987,0cyclictest33-21ksoftirqd/210:30:162
249459987,0cyclictest0-21swapper/209:46:462
249459987,0cyclictest0-21swapper/209:46:452
249459987,0cyclictest0-21swapper/208:25:252
249459987,0cyclictest0-21swapper/207:55:062
249459980,7cyclictest1643-21kworker/2:111:50:212
249459980,1cyclictest33-21ksoftirqd/210:45:152
249429987,0cyclictest0-21swapper/110:41:071
249429987,0cyclictest0-21swapper/109:20:071
249429987,0cyclictest0-21swapper/109:10:381
249429987,0cyclictest0-21swapper/108:10:181
249429986,1cyclictest2254-21lspci12:29:481
249429986,1cyclictest10336-21lspci09:35:501
249429986,1cyclictest10336-21lspci09:35:491
249429985,2cyclictest649-21avahi-daemon11:16:381
249429985,2cyclictest649-21avahi-daemon09:40:061
249429985,1cyclictest30335-21sshd11:07:251
249369987,0cyclictest0-21swapper/009:58:080
249369986,1cyclictest9979-21lspci11:01:320
249369986,1cyclictest31776-21sshd11:50:480
249369986,1cyclictest25070-21lspci12:32:150
249369985,2cyclictest742-21sshd12:36:150
249369985,2cyclictest649-21avahi-daemon11:37:550
249369985,2cyclictest649-21avahi-daemon09:24:380
2003280,2sleep32494699cyclictest11:37:033
249469975,1cyclictest22939-21bash12:21:183
249469975,1cyclictest21905-21grepconf.sh09:10:213
249469975,1cyclictest16246-21lspci10:25:523
249469975,1cyclictest15137-21sshd10:11:233
249469974,2cyclictest649-21avahi-daemon10:55:153
249469974,2cyclictest648-21systemd-logind09:36:153
249469974,2cyclictest648-21systemd-logind09:36:143
249459976,0cyclictest0-21swapper/207:49:152
249459975,1cyclictest33-21ksoftirqd/209:05:012
249459975,1cyclictest33-21ksoftirqd/209:00:012
249459975,1cyclictest33-21ksoftirqd/208:25:002
249459970,6cyclictest0-21swapper/208:00:552
249429975,1cyclictest649-21avahi-daemon11:10:381
249429975,1cyclictest649-21avahi-daemon09:25:221
249429975,1cyclictest30222-21lspci10:27:301
249429975,1cyclictest25622-21latency_hist08:29:591
249429975,1cyclictest24673-21sshd10:30:261
249429975,1cyclictest11066-21sshd12:20:071
249429974,2cyclictest20425-21sshd10:55:321
249429973,3cyclictest616-13auditd12:30:081
249369976,0cyclictest0-21swapper/011:16:580
249369976,0cyclictest0-21swapper/009:07:270
249369975,1cyclictest8243-21lspci10:57:460
249369975,1cyclictest6746-21lspci10:28:310
249369975,1cyclictest649-21avahi-daemon12:02:170
249369975,1cyclictest1389-21sshd09:31:130
249369974,2cyclictest649-21avahi-daemon11:31:030
1854270,0sleep00-21swapper/012:29:460
249469964,1cyclictest26826-21sshd11:25:083
249469964,1cyclictest22921-21sshd09:30:053
249469964,1cyclictest17299-21snmpd07:42:553
249469963,2cyclictest646-21dbus-daemon08:39:593
249469963,2cyclictest17299-21snmpd08:42:473
249469960,5cyclictest27596-21sshd08:34:233
249459965,0cyclictest0-21swapper/208:54:352
249459965,0cyclictest0-21swapper/207:10:552
249459964,1cyclictest9297-21sshd09:06:182
249459963,2cyclictest17299-21snmpd07:38:092
249429965,0cyclictest0-21swapper/109:06:271
249429960,5cyclictest0-21swapper/108:30:371
249369965,0cyclictest0-21swapper/008:50:180
249369960,5cyclictest19532-21munin-run08:15:000
249369960,5cyclictest16025-21sshd10:40:110
249469954,0cyclictest0-21swapper/308:50:063
249469953,1cyclictest32230-21cat07:25:153
249469953,1cyclictest25577-21cat07:10:123
249469953,1cyclictest22242-21cat08:20:143
249469953,1cyclictest17299-21snmpd08:46:303
249469953,1cyclictest17299-21snmpd08:25:443
249469953,1cyclictest17299-21snmpd07:56:443
249469953,1cyclictest17299-21snmpd07:38:393
249469953,1cyclictest17299-21snmpd07:31:433
249469953,1cyclictest17299-21snmpd07:22:003
249469953,1cyclictest17299-21snmpd07:15:423
249469953,1cyclictest14143-21cat08:00:173
249469953,1cyclictest10039-21cat07:50:153
249469952,2cyclictest17299-21snmpd08:15:053
249469950,1cyclictest4984-21unixbench_multi08:55:213
249459954,0cyclictest33-21ksoftirqd/208:35:002
249459953,1cyclictest17299-21snmpd08:46:242
249459953,1cyclictest17299-21snmpd08:43:382
249459953,1cyclictest17299-21snmpd08:35:182
249459953,1cyclictest17299-21snmpd08:05:292
249459953,1cyclictest17299-21snmpd07:50:582
249459953,1cyclictest17299-21snmpd07:41:342
249459953,1cyclictest17299-21snmpd07:21:212
249459953,1cyclictest17299-21snmpd07:15:122
249459952,2cyclictest17299-21snmpd08:19:162
249459952,2cyclictest17299-21snmpd07:31:372
249459950,1cyclictest17725-21/usr/sbin/munin08:10:182
249429953,1cyclictest29743-21/usr/sbin/munin07:20:141
249429953,1cyclictest25319-21expr07:10:101
249429953,1cyclictest2510-21ntp_states08:50:161
249429953,1cyclictest17299-21snmpd08:55:111
249429953,1cyclictest17299-21snmpd08:41:081
249429953,1cyclictest17299-21snmpd08:20:261
249429953,1cyclictest17299-21snmpd08:15:251
249429953,1cyclictest17299-21snmpd08:07:101
249429953,1cyclictest17299-21snmpd08:00:011
249429953,1cyclictest17299-21snmpd07:56:411
249429953,1cyclictest17299-21snmpd07:52:101
249429953,1cyclictest17299-21snmpd07:44:521
249429953,1cyclictest17299-21snmpd07:16:541
249429953,1cyclictest15443-21kworker/1:208:45:121
249429952,2cyclictest9227-21sshd07:48:431
249429952,2cyclictest32115-21sed07:25:131
249429952,2cyclictest1862-21cat07:30:141
249369953,1cyclictest26351-21cat08:30:130
249369953,1cyclictest17299-21snmpd08:56:170
249369953,1cyclictest17299-21snmpd08:45:180
249369953,1cyclictest17299-21snmpd08:42:350
249369953,1cyclictest17299-21snmpd08:35:390
249369953,1cyclictest17299-21snmpd08:26:110
249369953,1cyclictest17299-21snmpd08:20:230
249369953,1cyclictest17299-21snmpd08:17:580
249369953,1cyclictest17299-21snmpd07:55:200
249369953,1cyclictest17299-21snmpd07:45:040
249369953,1cyclictest17299-21snmpd07:25:330
249369953,1cyclictest17299-21snmpd07:16:320
249369953,1cyclictest17299-21snmpd07:10:230
249369953,1cyclictest16006-21grep08:05:130
249369953,1cyclictest14146-21cat08:00:170
249369952,2cyclictest4553-21smicount07:35:180
249369952,2cyclictest30548-21cut07:20:160
249369952,2cyclictest1839-21head07:30:140
249369952,2cyclictest17299-21snmpd07:52:010
18005250,0sleep30-21swapper/308:10:143
249469942,1cyclictest7950-21sed07:45:133
249469942,1cyclictest6078-21gltestperf09:00:133
249429942,1cyclictest0-21swapper/109:00:121
249369942,1cyclictest5669-21tr07:40:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional