You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-10 - 17:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Mon Nov 10, 2025 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2746021680,1sleep3120399cyclictest12:36:063
679921380,0sleep00-21swapper/011:51:500
301621330,2sleep0119099cyclictest12:05:010
1027821260,4sleep1119499cyclictest12:15:441
1393421210,2sleep2119999cyclictest11:52:362
1076421140,3sleep0119099cyclictest11:00:590
1338021120,4sleep113378-21bash09:41:531
1846721040,3sleep2119999cyclictest10:14:122
33921030,1sleep10-21swapper/111:23:461
179902990,3sleep01848-21nfsd11:35:580
86462970,1sleep20-21swapper/212:28:072
35132950,1sleep21989-21lldpd09:11:472
300032920,2sleep31846-21nfsd11:06:203
111282880,0sleep311130-21sshd11:21:183
238072870,2sleep323803-21sshd12:03:473
315212860,2sleep20-21swapper/209:54:242
315212860,2sleep20-21swapper/209:54:232
105952850,1sleep01915-21snmpd09:23:280
63482830,2sleep21915-21snmpd09:30:032
58222830,2sleep10-21swapper/111:07:141
3272810,3sleep10-21swapper/109:47:291
308722810,2sleep31989-21lldpd10:05:113
127162810,1sleep10-21swapper/112:09:341
223172800,2sleep122315-21sshd12:13:511
105722800,3sleep10-21swapper/110:54:201
297602790,2sleep20-21swapper/209:43:412
148392790,2sleep214837-21bash11:56:012
318452780,2sleep21989-21lldpd09:15:082
309822780,4sleep3120399cyclictest09:58:023
283092770,2sleep0119099cyclictest10:18:440
105302760,1sleep00-21swapper/011:24:560
269672750,3sleep0119099cyclictest10:01:080
226812730,3sleep2119999cyclictest11:36:292
184082720,3sleep0119099cyclictest11:08:380
152942710,0sleep10-21swapper/111:39:211
310492680,1sleep30-21swapper/312:07:563
104752670,4sleep2119999cyclictest12:09:202
275362610,0sleep127534-21sshd10:32:111
24332590,2sleep32432-21id10:56:463
90542580,1sleep30-21swapper/311:52:053
83572570,1sleep3120399cyclictest11:35:063
275242560,1sleep11847-21nfsd11:47:181
8512541,50sleep10-21swapper/107:08:171
8922431,39sleep30-21swapper/307:08:463
251742410,2sleep30-21swapper/312:20:193
101632411,37sleep3135650irq/27-eth010:10:023
1190993811,5cyclictest29474-21sshd10:39:190
99322370,2sleep31848-21nfsd11:14:303
119099372,9cyclictest13646-21sshd11:42:290
1190993611,23cyclictest6406-21sshd12:08:480
144722351,32sleep1135650irq/27-eth011:28:481
1190993412,19cyclictest1845-21nfsd10:28:530
34222330,2sleep13391-21munin-run10:40:001
119099336,26cyclictest1847-21nfsd10:46:590
119099331,7cyclictest27934-21sshd11:33:430
259412320,29sleep2135650irq/27-eth012:14:142
119099325,26cyclictest570-21sshd09:15:130
1190993228,3cyclictest15043-21cp10:51:180
119099321,11cyclictest17953-21sshd09:49:250
1190993210,5cyclictest20107-21sshd10:41:410
160142310,2sleep116012-21sshd09:30:581
119099310,18cyclictest21799-21id10:58:490
114922310,1sleep00-21swapper/009:41:400
193942300,1sleep019393-21sshd12:13:340
119999300,5cyclictest0-21swapper/212:34:462
119099307,20cyclictest3-21ksoftirqd/012:18:580
119099301,19cyclictest26435-21sshd12:39:000
119999296,17cyclictest33-21ksoftirqd/211:27:052
1199992911,6cyclictest27598-21sshd11:23:112
119099299,17cyclictest5638-21sshd11:48:260
119099298,9cyclictest8488-21sshd12:31:150
119099296,8cyclictest521-21seq11:10:100
119099294,18cyclictest6772-21sshd10:30:040
119099287,4cyclictest27409-21sshd11:26:390
1190992814,12cyclictest3-21ksoftirqd/010:14:470
118122280,1sleep01989-21lldpd09:12:400
320522270,2sleep10-21swapper/112:24:101
150732270,4sleep2119999cyclictest09:20:202
120399270,4cyclictest6268-21head12:15:213
119099275,10cyclictest21918-21sshd10:21:180
119099274,3cyclictest1848-21nfsd12:25:100
119099274,14cyclictest1846-21nfsd11:19:260
1190992712,12cyclictest1846-21nfsd12:24:290
1190992711,7cyclictest32235-21sshd09:36:280
1199992619,5cyclictest1927-21snmpd11:11:352
119099266,18cyclictest1989-21lldpd09:31:400
119099266,14cyclictest28465-21nfsd09:25:220
73892250,3sleep20-21swapper/210:30:072
313782250,23sleep3135650irq/27-eth009:15:053
274732250,2sleep327472-21sshd10:28:523
1199992517,6cyclictest27856-21sshd10:01:142
1199992517,4cyclictest27290-21rm12:04:092
1199992514,5cyclictest31735-21sshd10:46:202
1199992513,4cyclictest10953-21bash12:37:342
119099251,17cyclictest17553-21sshd10:07:120
288782240,1sleep30-21swapper/310:42:393
25312240,2sleep12525-21sshd09:19:001
173922240,4sleep1119499cyclictest11:52:581
1203992411,5cyclictest1915-21snmpd09:52:573
1203992411,5cyclictest1915-21snmpd09:52:563
119999240,21cyclictest21676-21sshd10:21:172
119499248,7cyclictest10950irq/23-ehci_hcd12:37:391
119099249,9cyclictest5215-21sshd11:58:260
119099247,13cyclictest1915-21snmpd09:51:180
119099247,13cyclictest1915-21snmpd09:51:170
38202230,0sleep00-21swapper/007:15:110
311112230,21sleep1135650irq/27-eth011:34:041
119999233,5cyclictest135650irq/27-eth010:43:262
1199992312,3cyclictest19464-21sshd09:35:092
1199992311,3cyclictest4236-21sshd11:34:402
1194992310,4cyclictest10950irq/23-ehci_hcd09:24:521
119099234,12cyclictest3-21ksoftirqd/009:58:110
72902220,18sleep1135650irq/27-eth009:26:331
63282220,2sleep26327-21sshd11:17:252
181542220,2sleep21989-21lldpd09:27:472
120399229,5cyclictest135650irq/27-eth010:21:113
1203992212,6cyclictest10287-21sshd09:45:093
1203992210,6cyclictest10950irq/23-ehci_hcd10:36:393
1199992216,4cyclictest9394-21sshd11:00:512
1199992216,4cyclictest12364-21sshd12:22:132
1199992215,4cyclictest31198-21sshd11:06:272
1199992215,4cyclictest2064-21sshd10:50:032
1199992214,5cyclictest22302-21sshd11:43:262
1199992210,10cyclictest1848-21nfsd12:16:202
1194992211,9cyclictest1848-21nfsd12:04:101
120399215,4cyclictest135650irq/27-eth012:30:223
1203992111,5cyclictest1989-21lldpd09:39:273
120399210,12cyclictest0-21swapper/310:01:593
119999212,16cyclictest135650irq/27-eth008:24:292
1199992115,4cyclictest7752-21sshd10:57:192
1199992114,5cyclictest6381-21sshd09:48:092
1199992114,4cyclictest2710-21sshd10:15:462
1199992112,4cyclictest12723-21sshd10:37:312
119999210,19cyclictest33-21ksoftirqd/210:05:232
119499219,5cyclictest135650irq/27-eth010:08:111
119499218,3cyclictest28922-21sshd11:19:531
1194992116,3cyclictest4954-21bash10:43:341
1194992110,1cyclictest29111-21sshd11:40:421
119499210,12cyclictest18849-21bash12:32:181
120399206,6cyclictest1847-21nfsd11:19:053
1203992012,5cyclictest25534-21sshd09:43:153
1203992012,4cyclictest135650irq/27-eth011:40:533
1203992011,1cyclictest30306-21sshd12:11:273
120399200,12cyclictest0-21swapper/309:33:313
119999209,4cyclictest11183-21sshd09:55:382
1199992014,4cyclictest13912-21sshd11:45:482
119499204,6cyclictest0-21swapper/110:11:001
119499203,6cyclictest1848-21nfsd10:17:411
1194992010,5cyclictest10950irq/23-ehci_hcd10:49:111
119499200,10cyclictest0-21swapper/109:11:401
119099202,11cyclictest1915-21snmpd07:40:150
7922193,5sleep21915-21snmpd07:07:332
120399199,4cyclictest1845-21nfsd11:58:473
120399198,4cyclictest30448-21sshd09:25:323
120399194,6cyclictest1989-21lldpd09:14:563
120399192,8cyclictest4724-21sshd10:19:403
120399191,8cyclictest1989-21lldpd09:22:573
1203991912,4cyclictest5721-21cp10:53:483
1203991910,2cyclictest135650irq/27-eth011:32:403
120399190,6cyclictest1847-21nfsd11:48:103
1199991912,3cyclictest0-21swapper/210:25:032
119499197,5cyclictest135650irq/27-eth010:28:111
119499196,4cyclictest135650irq/27-eth011:11:401
119499191,9cyclictest1989-21lldpd09:53:521
119499191,9cyclictest1989-21lldpd09:53:521
1194991912,4cyclictest1959-21sshd12:28:401
120399183,5cyclictest0-21swapper/311:27:193
1203991810,2cyclictest4588-21sshd11:00:213
120399180,16cyclictest10950irq/23-ehci_hcd07:10:203
120399180,14cyclictest0-21swapper/312:26:033
119499187,7cyclictest12448-21sshd11:59:171
119499183,9cyclictest16116-21sshd09:56:121
119499183,3cyclictest1959-21sshd10:21:441
1194991810,4cyclictest10950irq/23-ehci_hcd11:02:181
119499180,8cyclictest1989-21lldpd09:39:331
119499180,3cyclictest32139-21sshd10:01:431
120399174,1cyclictest1915-21snmpd08:25:133
120399170,6cyclictest16327-21sshd10:30:563
120399170,15cyclictest0-21swapper/308:35:053
120399170,15cyclictest0-21swapper/308:35:043
119999172,11cyclictest1915-21snmpd08:18:182
119499176,0cyclictest0-21swapper/110:56:081
119499170,15cyclictest0-21swapper/107:19:461
119099171,10cyclictest3-21ksoftirqd/007:30:420
84222160,14sleep1135650irq/27-eth008:35:161
84222160,14sleep1135650irq/27-eth008:35:161
120399168,6cyclictest0-21swapper/308:52:053
120399167,3cyclictest10950irq/23-ehci_hcd10:46:233
120399161,13cyclictest1989-21lldpd07:50:133
120399160,4cyclictest1989-21lldpd08:05:173
119999167,7cyclictest0-21swapper/207:38:552
119999167,5cyclictest1848-21nfsd08:25:412
1199991612,3cyclictest1915-21snmpd08:46:222
1199991612,3cyclictest1915-21snmpd08:12:352
119999161,14cyclictest0-21swapper/207:58:302
119499167,7cyclictest0-21swapper/107:30:471
119499167,3cyclictest0-21swapper/108:30:141
119499162,3cyclictest135650irq/27-eth007:21:041
119499160,14cyclictest1989-21lldpd07:45:361
119099161,9cyclictest0-21swapper/008:50:080
119099160,1cyclictest0-21swapper/007:20:390
190362152,11sleep3135650irq/27-eth007:46:103
120399158,5cyclictest6183-21df07:20:113
120399157,7cyclictest0-21swapper/308:04:053
120399157,6cyclictest0-21swapper/308:45:093
120399152,11cyclictest31648-21perl08:15:143
120399152,11cyclictest1915-21snmpd07:30:163
1203991511,3cyclictest1989-21lldpd08:44:453
120399150,6cyclictest1915-21snmpd09:01:553
120399150,13cyclictest29863-21ntpq08:10:213
120399150,13cyclictest1989-21lldpd08:20:393
120399150,13cyclictest1915-21snmpd07:55:193
120399150,13cyclictest0-21swapper/308:31:203
120399150,10cyclictest1915-21snmpd07:25:163
119999152,4cyclictest0-21swapper/208:56:572
1199991512,2cyclictest0-21swapper/208:34:532
119999151,12cyclictest17965-21tune2fs07:45:142
1199991510,4cyclictest1989-21lldpd07:34:332
119999150,6cyclictest0-21swapper/207:51:492
119999150,14cyclictest1989-21lldpd07:10:262
119999150,14cyclictest0-21swapper/209:02:202
119999150,11cyclictest18806-21bash09:10:012
119499157,6cyclictest1915-21snmpd08:45:081
119499157,3cyclictest0-21swapper/108:05:141
119499156,7cyclictest1989-21lldpd07:10:111
119499155,9cyclictest0-21swapper/108:40:371
119499155,5cyclictest1989-21lldpd07:55:191
119499154,10cyclictest10950irq/23-ehci_hcd08:11:481
119499151,13cyclictest0-21swapper/109:05:051
119499150,3cyclictest0-21swapper/107:52:341
119499150,14cyclictest0-21swapper/107:37:401
119499150,13cyclictest1989-21lldpd08:52:061
119499150,13cyclictest1989-21lldpd08:16:241
119499150,13cyclictest0-21swapper/109:00:501
119499150,13cyclictest0-21swapper/108:56:341
119099150,2cyclictest0-21swapper/008:34:090
119099150,11cyclictest0-21swapper/008:45:310
69621410,2sleep00-21swapper/007:06:190
120399147,3cyclictest1989-21lldpd07:35:033
120399140,13cyclictest0-21swapper/309:05:473
120399140,13cyclictest0-21swapper/308:57:063
120399140,12cyclictest1989-21lldpd07:40:173
119999148,5cyclictest1915-21snmpd08:41:002
119999141,12cyclictest1915-21snmpd08:00:262
1199991410,2cyclictest1989-21lldpd07:40:212
119999140,6cyclictest0-21swapper/207:28:102
119999140,13cyclictest1989-21lldpd08:51:222
119999140,13cyclictest1989-21lldpd08:05:432
119999140,13cyclictest1915-21snmpd08:35:492
119999140,13cyclictest1915-21snmpd08:35:482
119999140,13cyclictest0-21swapper/207:17:292
119999140,12cyclictest1915-21snmpd07:22:182
119499148,4cyclictest1989-21lldpd08:00:201
119499140,5cyclictest1989-21lldpd07:40:121
119499140,1cyclictest1989-21lldpd08:22:551
119499140,13cyclictest1989-21lldpd08:25:051
119499140,13cyclictest0-21swapper/107:25:111
1190991412,1cyclictest0-21swapper/007:38:450
119099140,3cyclictest0-21swapper/008:10:090
119099140,13cyclictest0-21swapper/007:57:540
119099140,13cyclictest0-21swapper/007:54:140
119099140,13cyclictest0-21swapper/007:13:300
119099140,11cyclictest1915-21snmpd07:28:030
120399130,4cyclictest1989-21lldpd07:15:073
119099138,4cyclictest0-21swapper/007:45:190
119099134,8cyclictest3-21ksoftirqd/008:55:160
119099131,4cyclictest1915-21snmpd08:16:500
119099131,4cyclictest1915-21snmpd08:00:110
119099130,5cyclictest0-21swapper/008:06:490
119099130,12cyclictest0-21swapper/008:35:210
119099130,12cyclictest0-21swapper/008:35:200
119099130,12cyclictest0-21swapper/008:26:250
119099130,12cyclictest0-21swapper/008:24:320
119099120,9cyclictest0-21swapper/009:06:270
119099120,11cyclictest0-21swapper/009:00:040
119099120,11cyclictest0-21swapper/008:40:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional