You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-15 - 22:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Sat Nov 15, 2025 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1694621500,1sleep30-21swapper/312:27:533
1665721490,1sleep316630-21sshd11:41:133
2504221340,4sleep1135650irq/27-eth012:22:541
121921310,4sleep31712899cyclictest11:56:243
2259721260,2sleep01711499cyclictest09:25:100
1544021200,1sleep11711999cyclictest11:01:221
57421190,2sleep20-21swapper/211:46:052
2603421180,3sleep21712399cyclictest12:37:112
1665329728,40sleep30-21swapper/307:07:263
90082940,0sleep11847-21nfsd11:27:111
22482930,3sleep01711499cyclictest11:46:140
1669029333,48sleep10-21swapper/107:07:521
221492920,0sleep00-21swapper/012:31:080
320762900,2sleep20-21swapper/209:16:032
262432890,1sleep00-21swapper/010:15:410
69862870,3sleep20-21swapper/211:13:502
35382860,3sleep10-21swapper/112:29:361
19622860,2sleep10-21swapper/109:29:451
164942860,1sleep00-21swapper/011:51:120
276032850,2sleep327602-21bash10:49:093
238852850,2sleep123870-21sshd11:22:101
230092850,1sleep023007-21sshd12:39:500
137992850,2sleep113785-21sshd11:54:171
115622850,3sleep30-21swapper/311:04:203
305872840,2sleep21846-21nfsd10:22:472
189172840,2sleep20-21swapper/212:10:532
171202840,0sleep00-21swapper/012:27:540
151382840,2sleep315133-21sshd12:22:003
163512830,4sleep30-21swapper/310:31:223
142172830,2sleep21712399cyclictest09:58:062
28712820,3sleep31712899cyclictest11:49:533
124892820,1sleep00-21swapper/010:47:340
183662800,4sleep11711999cyclictest09:55:141
100102730,2sleep01711499cyclictest09:47:390
31822710,1sleep11711999cyclictest10:33:211
13682710,1sleep21846-21nfsd12:06:252
234052700,4sleep21712399cyclictest10:05:252
61962690,2sleep20-21swapper/210:03:432
257692690,3sleep21712399cyclictest10:52:332
139292690,2sleep20-21swapper/211:07:482
139292690,2sleep20-21swapper/211:07:482
71202680,1sleep10-21swapper/109:36:571
50592660,3sleep31712899cyclictest09:47:063
95352640,1sleep30-21swapper/310:10:383
1662725936,11sleep20-21swapper/207:07:062
285242580,52sleep1135650irq/27-eth011:09:211
285242580,52sleep1135650irq/27-eth011:09:201
222932480,1sleep11846-21nfsd10:45:121
157752460,0sleep315773-21sshd11:37:523
82042420,1sleep10-21swapper/111:46:521
1667524134,4sleep00-21swapper/007:07:430
59142390,37sleep3135650irq/27-eth010:06:583
283022360,2sleep10-21swapper/110:15:541
17123993228,3cyclictest3384-21bash10:30:092
113302320,2sleep20-21swapper/212:24:362
67162310,3sleep30-21swapper/309:43:523
301412310,3sleep130137-21bash09:46:151
299002310,0sleep329899-21sshd11:16:043
299002310,0sleep329899-21sshd11:16:033
24672310,4sleep21712399cyclictest09:26:202
87632300,2sleep18751-21sshd10:57:211
17128992925,3cyclictest1848-21nfsd11:12:593
17119992924,4cyclictest1846-21nfsd12:39:341
17123992810,8cyclictest24915-21sshd09:49:152
225302270,3sleep30-21swapper/309:21:443
1712399275,17cyclictest33-21ksoftirqd/211:54:462
8302260,2sleep20-21swapper/210:13:092
77132260,23sleep1135650irq/27-eth010:10:301
34972260,2sleep13493-21sshd10:36:411
1711499264,15cyclictest23234-21kworker/0:010:06:050
95622250,3sleep29561-21bash09:44:122
35592250,2sleep33558-21sshd10:50:033
17123992513,5cyclictest25-21rcuop/111:40:102
76862240,22sleep2135650irq/27-eth011:33:422
17123992419,3cyclictest11697-21sshd12:33:062
17123992413,4cyclictest36-21rcuop/210:57:292
1711499242,14cyclictest29604-21sshd11:12:480
17114992414,3cyclictest3-21ksoftirqd/010:30:250
120152240,22sleep2135650irq/27-eth009:30:382
92462230,21sleep3135650irq/27-eth009:50:513
32562230,21sleep1135650irq/27-eth010:53:341
211152230,3sleep10-21swapper/109:18:131
17123992315,6cyclictest4481-21sshd10:46:462
1712399230,3cyclictest32241-21bash11:36:092
1711499230,21cyclictest8932-21bash12:24:220
162622230,1sleep10-21swapper/110:08:031
17128992220,1cyclictest0-21swapper/311:51:193
17119992213,5cyclictest10950irq/23-ehci_hcd10:29:411
1711499229,5cyclictest3-21ksoftirqd/012:17:210
39062210,1sleep03901-21sshd10:00:180
17123992117,2cyclictest17253-21bash12:01:262
17123992116,3cyclictest16537-21sshd09:24:342
17123992116,2cyclictest30164-21sshd11:19:372
17123992116,2cyclictest30164-21sshd11:19:362
17123992115,4cyclictest1847-21nfsd10:43:472
17123992113,5cyclictest30758-21sshd12:26:132
17123992112,6cyclictest12598-21users09:10:252
1712399210,19cyclictest33-21ksoftirqd/211:56:502
1712399210,19cyclictest33-21ksoftirqd/211:25:422
1711999219,5cyclictest15401-21bash12:30:311
1711999219,4cyclictest135650irq/27-eth011:32:241
17114992115,5cyclictest32572-21sshd10:36:140
17114992111,6cyclictest3-21ksoftirqd/011:28:150
1711499211,13cyclictest0-21swapper/011:35:320
293152200,2sleep329314-21sshd12:31:473
177762200,1sleep30-21swapper/310:38:123
17123992017,2cyclictest24507-21cp10:35:242
17123992015,3cyclictest6758-21sshd12:18:272
17119992015,3cyclictest6326-21grep11:40:121
17119992014,4cyclictest7549-21bash09:13:331
1711499206,2cyclictest3-21ksoftirqd/012:05:200
1711499201,16cyclictest0-21swapper/009:40:230
17114992011,4cyclictest3-21ksoftirqd/009:58:200
1711499201,12cyclictest24818-21sshd09:21:580
1711499200,18cyclictest23050-21sshd10:12:050
1711499200,18cyclictest22285-21bash12:11:120
1711499200,13cyclictest17375-21sshd10:24:580
1711499200,11cyclictest22733-21sshd11:02:100
148062200,18sleep3135650irq/27-eth011:31:033
5982190,2sleep30-21swapper/312:03:163
1712899197,5cyclictest10950irq/23-ehci_hcd12:11:063
1712899197,4cyclictest2214-21cpuspeed_turbos12:15:143
1712899195,3cyclictest10950irq/23-ehci_hcd09:33:383
1712899190,9cyclictest19650-21sshd10:55:133
17123991915,2cyclictest30172-21sshd11:22:492
17123991913,3cyclictest14421-21bash09:51:232
17123991912,6cyclictest25-21rcuop/110:29:262
17123991912,5cyclictest25-21rcuop/111:02:362
17119991915,3cyclictest17467-21sshd10:41:211
17119991913,4cyclictest22070-21sshd12:02:001
1711499194,3cyclictest8564-21sshd11:57:090
17114991912,2cyclictest0-21swapper/010:28:220
164032192,16sleep1135650irq/27-eth008:19:371
120742190,0sleep112073-21bash10:04:221
297032180,16sleep1135650irq/27-eth009:32:331
1712899180,16cyclictest0-21swapper/312:38:553
1712899180,15cyclictest22442-21sshd10:21:573
1712899180,12cyclictest23656-21sshd12:08:313
17123991813,3cyclictest1959-21sshd10:19:552
1711999187,2cyclictest6592-21bash10:23:441
1711999186,4cyclictest10950irq/23-ehci_hcd09:21:411
1711999185,7cyclictest135650irq/27-eth012:13:391
1711999181,4cyclictest22415-21sshd11:58:331
1711999180,9cyclictest12243-21sshd11:37:301
1711999180,13cyclictest31219-21sshd12:17:441
1711499187,4cyclictest0-21swapper/009:51:320
1711499186,2cyclictest25818-21sshd09:35:250
1711499181,6cyclictest0-21swapper/009:17:020
17114991814,3cyclictest3-21ksoftirqd/009:30:110
1711499181,10cyclictest32379-21sshd10:59:460
1711499180,16cyclictest32322-21id11:16:200
1711499180,16cyclictest32322-21id11:16:190
1711499180,16cyclictest0-21swapper/012:01:450
1711499180,12cyclictest0-21swapper/011:22:480
1712899177,5cyclictest0-21swapper/310:03:533
1712899176,5cyclictest135650irq/27-eth009:17:083
17128991713,3cyclictest1848-21nfsd09:14:203
17128991712,3cyclictest3122-21sshd10:40:023
1712899170,15cyclictest135650irq/27-eth009:55:333
1712899170,12cyclictest30815-21sshd09:25:533
17123991713,2cyclictest1847-21nfsd09:35:292
1711999178,4cyclictest9288-21sshd11:10:321
17119991714,1cyclictest0-21swapper/108:55:161
1711999170,14cyclictest135650irq/27-eth007:55:141
1711499178,2cyclictest0-21swapper/009:12:050
1712899167,4cyclictest20570-21sshd09:35:013
1712899162,6cyclictest0-21swapper/310:25:043
1712899160,5cyclictest18336-21sshd10:18:163
1712899160,14cyclictest24813-21sshd11:08:563
1712899160,14cyclictest24813-21sshd11:08:553
1712899160,13cyclictest0-21swapper/311:27:403
1712399162,8cyclictest0-21swapper/208:04:022
1711999167,4cyclictest19220-21sshd12:05:071
1711999163,2cyclictest23025-21bash09:52:181
1711999160,14cyclictest3084-21sshd09:40:121
1711999160,14cyclictest0-21swapper/111:15:161
1711999160,14cyclictest0-21swapper/111:15:161
1711999160,14cyclictest0-21swapper/107:45:041
1711499168,1cyclictest32463-21sshd10:53:150
1711499161,9cyclictest28868-21bash10:42:320
1711499161,7cyclictest0-21swapper/011:43:110
17114991612,4cyclictest1904-21nscd11:34:030
1711499160,8cyclictest0-21swapper/011:05:180
1711499160,8cyclictest0-21swapper/011:05:170
1711499160,13cyclictest0-21swapper/008:39:010
1712899150,6cyclictest3215-21sshd11:20:093
1712899150,13cyclictest0-21swapper/307:47:503
1712399159,5cyclictest135650irq/27-eth007:30:182
1712399157,4cyclictest10950irq/23-ehci_hcd08:15:002
1711499150,14cyclictest20263-21smart_sda08:25:210
1711499150,12cyclictest0-21swapper/007:57:420
201242140,1sleep30-21swapper/307:15:173
17128991410,3cyclictest10950irq/23-ehci_hcd08:33:423
1712899140,13cyclictest0-21swapper/308:55:383
17123991410,1cyclictest135650irq/27-eth007:46:032
1712399140,13cyclictest0-21swapper/208:16:542
1711999149,0cyclictest0-21swapper/108:25:291
1711999148,5cyclictest27457-21pmu-power07:30:211
1711999147,6cyclictest0-21swapper/108:40:151
1711999143,1cyclictest0-21swapper/107:24:471
1711999141,8cyclictest0-21swapper/109:00:161
1711999140,13cyclictest1848-21nfsd08:05:551
1711999140,12cyclictest1959-21sshd09:10:001
1711999140,12cyclictest1927-21snmpd07:12:401
1711999140,11cyclictest0-21swapper/108:21:431
1711499146,5cyclictest0-21swapper/008:16:210
1711499140,13cyclictest0-21swapper/008:56:440
1711499140,13cyclictest0-21swapper/007:45:200
1712899138,4cyclictest0-21swapper/308:15:363
1712899137,5cyclictest0-21swapper/307:25:093
17128991311,1cyclictest0-21swapper/308:02:553
1712899130,5cyclictest30824-21munin-node07:40:243
1712899130,5cyclictest0-21swapper/307:23:243
1712899130,12cyclictest0-21swapper/309:08:383
1712899130,12cyclictest0-21swapper/308:48:363
1712899130,12cyclictest0-21swapper/308:42:073
1712899130,12cyclictest0-21swapper/308:35:403
1712899130,12cyclictest0-21swapper/308:05:343
1712899130,12cyclictest0-21swapper/307:50:503
1712899130,12cyclictest0-21swapper/307:35:103
1712899130,12cyclictest0-21swapper/307:30:343
1712899130,12cyclictest0-21swapper/307:12:143
1712399138,3cyclictest5606-21diskstats07:55:142
1712399137,5cyclictest0-21swapper/207:16:102
1712399131,8cyclictest11230-21ls08:05:222
1712399131,11cyclictest135650irq/27-eth007:40:012
1712399131,11cyclictest0-21swapper/208:46:142
17123991311,1cyclictest0-21swapper/207:35:162
17123991311,1cyclictest0-21swapper/207:20:282
1712399130,12cyclictest0-21swapper/209:07:402
1712399130,12cyclictest0-21swapper/209:01:542
1712399130,12cyclictest0-21swapper/208:31:182
1712399130,11cyclictest26124-21df_inode08:40:132
1712399130,11cyclictest24200-21hddtemp_smartct08:35:152
1712399130,11cyclictest17943-21wc08:20:322
1712399130,11cyclictest1590-21awk08:55:232
1711999137,5cyclictest0-21swapper/107:15:051
1711999136,3cyclictest21294-21cut08:30:121
1711999132,3cyclictest135650irq/27-eth008:10:141
1711999130,12cyclictest0-21swapper/108:35:121
1711999130,12cyclictest0-21swapper/108:04:081
1711999130,12cyclictest0-21swapper/107:43:541
1711999130,12cyclictest0-21swapper/107:35:171
1711999130,11cyclictest28761-21munin-node08:45:161
1711499137,4cyclictest0-21swapper/009:07:040
17114991311,1cyclictest0-21swapper/007:13:430
1711499130,8cyclictest27369-21cut07:30:200
1711499130,5cyclictest0-21swapper/008:51:100
1711499130,1cyclictest0-21swapper/009:00:450
1711499130,1cyclictest0-21swapper/008:30:500
1711499130,12cyclictest0-21swapper/008:45:530
1711499130,12cyclictest0-21swapper/008:40:290
1711499130,12cyclictest0-21swapper/008:13:230
1711499130,12cyclictest0-21swapper/008:09:420
1711499130,12cyclictest0-21swapper/007:42:090
1711499130,12cyclictest0-21swapper/007:36:480
1711499130,12cyclictest0-21swapper/007:20:000
1712899120,3cyclictest13426-21smart_sda08:10:213
1712899120,11cyclictest31516-21sh08:50:203
1712899120,11cyclictest17481-21munin-node08:20:193
1712899120,11cyclictest0-21swapper/309:00:353
1712899120,11cyclictest0-21swapper/307:55:283
1712899120,10cyclictest0-21swapper/308:25:173
1712399128,3cyclictest3688-21hddtemp_smartct07:50:152
1712399128,1cyclictest26265-40kipmi007:25:162
1712399120,3cyclictest17419-21df07:10:122
1712399120,11cyclictest19641-21hddtemp_smartct08:25:142
1712399120,11cyclictest135650irq/27-eth008:50:182
1711999120,11cyclictest0-21swapper/107:25:171
1711999120,10cyclictest30690-21df_inode08:50:121
1711999120,10cyclictest0-21swapper/107:50:131
1711499127,3cyclictest0-21swapper/007:20:190
17114991210,1cyclictest2405-21runrttasks07:25:090
1711499120,8cyclictest0-21swapper/008:20:200
1711499120,1cyclictest0-21swapper/008:00:320
1711499120,11cyclictest0-21swapper/007:50:320
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional