You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-01 - 01:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Mon Jun 30, 2025 12:44:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3165721800,3sleep31936599cyclictest10:29:223
1243021530,4sleep11936399cyclictest12:37:141
936621470,1sleep29367-21sshd11:53:272
698221420,2sleep31936599cyclictest10:03:173
1315221420,3sleep30-21swapper/312:08:193
1315221420,3sleep30-21swapper/312:08:183
729721360,2sleep21936499cyclictest09:56:422
725621360,0sleep17257-21bash11:35:541
541821190,1sleep10-21swapper/109:43:191
240021170,2sleep32399-21sshd10:46:303
3190021090,1sleep031893-21sshd09:55:480
1203821060,3sleep312027-21sshd09:44:013
409221050,1sleep11936399cyclictest11:52:561
218621030,2sleep20-21swapper/212:13:072
2061221030,1sleep10-21swapper/110:58:341
261252960,4sleep01936299cyclictest12:23:590
277652950,2sleep127764-21bash12:24:081
91012930,4sleep31936599cyclictest09:56:563
47452930,0sleep00-21swapper/010:53:350
16142900,2sleep10-21swapper/110:32:531
148462900,2sleep21847-21nfsd12:22:572
158412890,1sleep215812-21sshd12:05:332
158412890,1sleep215812-21sshd12:05:322
237662880,1sleep10-21swapper/112:09:171
237662880,1sleep10-21swapper/112:09:171
221382880,4sleep20-21swapper/209:54:592
293672870,2sleep20-21swapper/210:09:022
159522870,2sleep10-21swapper/111:33:541
1889328533,39sleep30-21swapper/307:07:233
81842840,1sleep30-21swapper/310:20:173
81842840,1sleep30-21swapper/310:20:173
1899028435,45sleep10-21swapper/107:08:381
167652840,0sleep00-21swapper/010:17:490
243232810,0sleep00-21swapper/011:43:140
205932810,1sleep120583-21sshd11:25:071
19332800,4sleep11936399cyclictest09:15:461
189832800,2sleep118966-21sshd10:48:191
301532790,5sleep21936499cyclictest10:02:202
284182790,4sleep11936399cyclictest11:15:501
38952770,1sleep11936399cyclictest11:23:271
33522770,0sleep00-21swapper/010:23:060
33522770,0sleep00-21swapper/010:23:060
256282750,4sleep31936599cyclictest09:24:583
94612740,2sleep10-21swapper/110:37:061
45772740,1sleep30-21swapper/312:30:393
265132740,1sleep30-21swapper/309:28:293
1903027434,12sleep20-21swapper/207:09:062
79752720,1sleep07973-21sshd12:36:490
270942710,1sleep30-21swapper/311:25:383
255402710,1sleep30-21swapper/309:18:113
34492690,2sleep10-21swapper/111:10:081
319292690,2sleep331918-21sshd09:35:483
1893426135,4sleep00-21swapper/007:07:530
116162510,2sleep311615-21sshd11:59:293
184612500,1sleep08-21rcu_preempt09:41:010
1936299461,7cyclictest4246-21bash10:09:560
280242440,4sleep30-21swapper/309:48:593
1936299408,5cyclictest18337-21sshd12:34:560
1936299408,4cyclictest20383-21sshd10:55:140
19362994022,12cyclictest0-21swapper/011:33:170
62182380,1sleep00-21swapper/010:26:380
1936299385,5cyclictest12550-21sshd11:47:560
1936299381,2cyclictest0-21swapper/009:50:370
1936299380,3cyclictest26944-21bash11:19:010
1936299370,3cyclictest5946-21sshd11:35:470
1936299370,15cyclictest12113-21sshd10:30:330
28552360,3sleep31936599cyclictest10:39:563
19363993624,10cyclictest0-21swapper/110:40:221
19362993614,20cyclictest9046-21bash12:16:350
19363993428,4cyclictest1848-21nfsd10:05:021
1936299346,3cyclictest32264-21sshd12:07:040
1936299346,3cyclictest32264-21sshd12:07:030
1936299345,4cyclictest29971-21cp10:49:330
1936299340,3cyclictest24331-21sshd09:48:360
19363993328,3cyclictest1847-21nfsd12:19:301
19363993316,8cyclictest1845-21nfsd10:27:531
19363993228,2cyclictest1848-21nfsd10:53:011
19363993225,4cyclictest0-21swapper/112:33:291
1936299326,4cyclictest3060-21sshd12:01:330
1936299320,13cyclictest0-21swapper/010:41:190
301852310,1sleep11936399cyclictest11:55:181
19365993110,19cyclictest44-21ksoftirqd/311:12:543
19363993123,6cyclictest15734-21sshd09:50:551
19363993123,4cyclictest13074-21sshd10:24:081
19363993123,4cyclictest13074-21sshd10:24:071
19363993111,10cyclictest135650irq/27-eth012:03:071
1936299314,7cyclictest9346-21sshd11:53:260
1936399308,10cyclictest135650irq/27-eth009:59:421
19363993026,2cyclictest1848-21nfsd11:02:011
19363993025,3cyclictest1848-21nfsd10:02:001
19363993025,3cyclictest0-21swapper/110:16:521
19363993023,5cyclictest23229-21bash12:26:321
19363993022,5cyclictest10664-21sshd11:47:461
19363993012,7cyclictest26950irq/26-ahci[00009:25:061
1936299301,9cyclictest0-21swapper/011:10:440
1936299301,8cyclictest0-21swapper/009:16:320
1936299301,6cyclictest6080-21sshd11:55:590
1936299301,11cyclictest0-21swapper/012:28:210
1936299300,14cyclictest20618-21bash10:14:550
56712297,20sleep310950irq/23-ehci_hcd11:50:163
19363992925,2cyclictest1846-21nfsd11:43:041
19363992923,5cyclictest687-21sshd09:32:431
19363992921,5cyclictest32417-21sshd10:12:451
19363992916,5cyclictest15974-21sshd09:47:451
19363992914,12cyclictest1901-21nscd12:12:361
1936299290,14cyclictest0-21swapper/011:03:580
124182290,2sleep30-21swapper/310:50:543
1936599282,3cyclictest5073-21bash11:23:343
19363992820,5cyclictest26031-21sshd09:35:181
19362992814,2cyclictest32534-21bash11:26:110
1936299281,16cyclictest17771-21sshd11:08:160
76442270,25sleep2135650irq/27-eth010:33:342
211872270,6sleep21936499cyclictest12:35:112
1936599274,21cyclictest44-21ksoftirqd/312:04:533
19364992721,4cyclictest27963-21sshd11:15:472
19363992723,2cyclictest3515-21sshd11:06:461
19363992717,5cyclictest10684-21sshd09:13:221
1936299270,8cyclictest0-21swapper/009:11:040
75512260,24sleep2135650irq/27-eth010:47:062
310732260,2sleep20-21swapper/209:15:272
1936599263,1cyclictest431ktimersoftd/311:04:433
1936599262,3cyclictest17292-21sshd10:31:063
19364992619,5cyclictest1915-21snmpd09:22:042
19364992612,3cyclictest17007-21sshd11:27:532
1936399266,6cyclictest16413-21sshd09:23:571
1936299261,6cyclictest26491-21sshd09:21:320
19362992614,8cyclictest3-21ksoftirqd/010:01:270
19362992614,11cyclictest0-21swapper/011:21:200
250482250,1sleep20-21swapper/209:41:522
1936599253,19cyclictest44-21ksoftirqd/309:10:093
1936599252,21cyclictest44-21ksoftirqd/311:40:043
1936599252,20cyclictest44-21ksoftirqd/312:35:313
19365992517,7cyclictest135650irq/27-eth011:06:073
1936599250,22cyclictest44-21ksoftirqd/311:37:093
303192240,2sleep330318-21sshd12:24:223
278032240,3sleep227798-21rm10:59:192
1936599242,20cyclictest44-21ksoftirqd/310:41:223
1936599241,20cyclictest44-21ksoftirqd/309:30:313
1936599240,4cyclictest1959-21sshd09:52:003
1936599240,1cyclictest0-21swapper/312:16:463
1936499248,6cyclictest10950irq/23-ehci_hcd11:35:532
19362992410,3cyclictest5878-21sshd09:36:270
1936599232,19cyclictest44-21ksoftirqd/310:12:153
19365992316,5cyclictest27747-21sshd11:46:223
1936599231,20cyclictest44-21ksoftirqd/311:16:523
1936599230,20cyclictest44-21ksoftirqd/311:31:063
1936299231,10cyclictest0-21swapper/010:35:410
19365992217,2cyclictest10950irq/23-ehci_hcd10:55:403
1936599220,6cyclictest0-21swapper/312:10:013
1936599220,20cyclictest44-21ksoftirqd/310:06:483
1936599220,19cyclictest44-21ksoftirqd/310:15:383
19364992217,4cyclictest32252-21sshd11:43:582
19364992215,4cyclictest27963-21sshd12:26:592
1936499220,10cyclictest0-21swapper/211:13:132
1936399225,6cyclictest2693-21idleruntime-cro07:44:591
131982221,19sleep2135650irq/27-eth012:02:292
1936599210,19cyclictest44-21ksoftirqd/312:25:403
19364992116,3cyclictest16548-21sshd11:45:232
19364992115,3cyclictest1847-21nfsd11:32:152
1936299218,7cyclictest0-21swapper/009:26:370
1936299210,17cyclictest0-21swapper/012:11:340
153852211,18sleep2135650irq/27-eth009:10:312
1936499207,5cyclictest11009-21sshd10:17:122
1936499201,17cyclictest33-21ksoftirqd/210:23:052
1936499201,17cyclictest33-21ksoftirqd/210:23:042
1936399204,6cyclictest11075-21switchtime08:00:271
19363992011,7cyclictest9210-21runrttasks07:56:391
19363992010,8cyclictest29710-21chrt08:42:041
202012190,2sleep220107-21sshd09:27:492
1936499199,3cyclictest15468-21sshd12:17:112
19364991915,3cyclictest4879-21sshd11:06:552
19364991912,3cyclictest135650irq/27-eth011:55:412
1936399195,3cyclictest26950irq/26-ahci[00007:34:591
1936499189,2cyclictest10950irq/23-ehci_hcd10:38:362
1936499188,4cyclictest30009-21sshd11:22:492
1936499186,5cyclictest1846-21nfsd09:49:182
19364991814,3cyclictest21315-21sshd10:51:542
19364991812,4cyclictest15399-21sshd10:27:382
1936499180,14cyclictest23042-21bash09:35:022
1936399183,5cyclictest10950irq/23-ehci_hcd07:10:261
1936399182,5cyclictest144550irq/28-eth1-rx-07:24:441
1936399182,12cyclictest144550irq/28-eth1-rx-09:00:191
19365991716,1cyclictest0-21swapper/307:14:163
1936499176,2cyclictest26496-21sshd10:12:062
1936499172,5cyclictest17747-21sshd10:44:502
19364991712,4cyclictest30004-21sshd12:30:082
1936499171,14cyclictest9514-21sshd11:04:112
1936399175,6cyclictest135650irq/27-eth008:25:151
1936399174,6cyclictest25476-21latency_hist08:35:001
1936399173,7cyclictest135650irq/27-eth008:50:241
1936399172,6cyclictest135650irq/27-eth007:25:211
1936399172,11cyclictest135650irq/27-eth008:10:141
1936399170,6cyclictest135650irq/27-eth007:45:151
1936399170,15cyclictest19804-21munin-node08:20:211
1936499160,14cyclictest1848-21nfsd08:30:222
1936399169,6cyclictest135650irq/27-eth008:57:051
19363991614,1cyclictest0-21swapper/108:35:151
1936399160,14cyclictest7195-21taskset07:54:491
1936399160,14cyclictest1848-21nfsd07:35:131
1936299162,11cyclictest0-21swapper/007:55:040
1936299160,7cyclictest0-21swapper/008:29:000
1936299160,4cyclictest0-21swapper/009:33:100
19365991511,3cyclictest10950irq/23-ehci_hcd07:26:213
1936499159,5cyclictest135650irq/27-eth008:05:392
1936499153,9cyclictest0-21swapper/208:27:062
19364991510,3cyclictest15880-21sshd09:30:422
1936499150,13cyclictest0-21swapper/208:49:212
1936399155,8cyclictest22631-21cut07:15:201
1936399155,8cyclictest17028-21fschecks_count08:15:161
1936399150,6cyclictest32090-21runrttasks08:48:301
1936399150,6cyclictest1848-21nfsd09:05:361
1936299155,9cyclictest15559-21munin-node08:10:200
1936299150,1cyclictest0-21swapper/008:05:240
1936299150,12cyclictest0-21swapper/008:17:370
1936599143,10cyclictest10950irq/23-ehci_hcd09:07:363
19365991411,2cyclictest0-21swapper/309:04:003
19365991410,3cyclictest10950irq/23-ehci_hcd08:48:393
1936499143,7cyclictest10950irq/23-ehci_hcd08:50:012
1936499142,11cyclictest135650irq/27-eth007:35:242
19364991411,2cyclictest10950irq/23-ehci_hcd08:22:262
1936399145,7cyclictest12621-21fschecks_time08:05:151
1936299148,2cyclictest0-21swapper/008:45:210
1936299144,9cyclictest0-21swapper/007:13:470
1936299143,1cyclictest0-21swapper/007:44:410
1936299142,3cyclictest0-21swapper/008:59:100
1936299140,1cyclictest0-21swapper/008:00:260
1936299140,13cyclictest0-21swapper/009:00:270
1936299140,13cyclictest0-21swapper/007:30:330
1936599139,2cyclictest0-21swapper/308:16:083
1936599137,5cyclictest0-21swapper/307:20:143
19365991310,2cyclictest0-21swapper/308:34:243
1936599130,5cyclictest0-21swapper/307:45:403
1936599130,12cyclictest135650irq/27-eth007:56:033
1936599130,12cyclictest0-21swapper/308:55:133
1936599130,12cyclictest0-21swapper/308:35:343
1936599130,12cyclictest0-21swapper/308:28:073
1936599130,12cyclictest0-21swapper/308:20:103
1936599130,12cyclictest0-21swapper/308:10:023
1936599130,12cyclictest0-21swapper/308:09:053
1936599130,12cyclictest0-21swapper/308:01:583
1936599130,12cyclictest0-21swapper/307:42:253
1936499138,3cyclictest0-21swapper/207:10:132
1936499138,1cyclictest26941-21cat07:25:152
1936499137,3cyclictest10950irq/23-ehci_hcd07:47:522
1936499132,6cyclictest135650irq/27-eth009:03:242
1936499132,10cyclictest0-21swapper/209:09:352
1936499130,12cyclictest0-21swapper/208:40:322
1936499130,12cyclictest0-21swapper/208:16:222
1936499130,12cyclictest0-21swapper/207:57:012
1936499130,12cyclictest0-21swapper/207:30:192
1936499130,12cyclictest0-21swapper/207:21:072
1936499130,12cyclictest0-21swapper/207:18:522
1936499130,11cyclictest9998-21df08:00:142
1936499130,11cyclictest5949-21sh07:50:192
1936499130,11cyclictest26512-21memory08:35:192
1936499130,11cyclictest1248-21hddtemp_smartct07:40:162
1936499130,10cyclictest135650irq/27-eth008:10:502
1936299137,5cyclictest0-21swapper/007:46:230
19362991311,1cyclictest0-21swapper/007:35:320
1936299130,2cyclictest0-21swapper/008:50:590
1936299130,12cyclictest0-21swapper/008:22:390
1936299130,12cyclictest0-21swapper/007:25:520
1936299130,12cyclictest0-21swapper/007:17:080
1936599127,4cyclictest31474-21if_err_eth007:35:143
1936599122,1cyclictest0-21swapper/307:15:093
1936599120,3cyclictest5516-21diskstats07:50:173
1936599120,11cyclictest135650irq/27-eth008:50:073
1936599120,11cyclictest0-21swapper/307:30:133
1936599120,10cyclictest28692-21irqstats08:40:213
1936499120,3cyclictest2620-21df08:55:182
1936299128,2cyclictest0-21swapper/008:42:050
1936299124,4cyclictest0-21swapper/008:30:210
1936299120,11cyclictest0-21swapper/009:05:260
1936299120,11cyclictest0-21swapper/008:35:450
1936299120,11cyclictest0-21swapper/007:51:150
1936299120,11cyclictest0-21swapper/007:22:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional