You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 23:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Wed Nov 26, 2025 12:44:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
135221470,5sleep02843299cyclictest10:02:520
834721420,4sleep02843299cyclictest09:12:140
1661321270,2sleep316603-21sshd09:13:093
2154321210,2sleep20-21swapper/210:54:442
1318921170,1sleep11848-21nfsd09:33:151
1979021110,3sleep11846-21nfsd10:15:031
142921000,0sleep00-21swapper/010:06:080
326872990,1sleep032681-21bash09:55:510
2793129736,57sleep10-21swapper/107:07:161
260582960,1sleep126061-21sshd10:05:221
177632930,3sleep20-21swapper/209:33:442
124492920,1sleep20-21swapper/209:36:452
89452910,2sleep28941-21sshd10:36:572
230772910,2sleep10-21swapper/111:07:541
48332900,2sleep31847-21nfsd09:42:473
209272890,0sleep00-21swapper/010:11:460
186642870,2sleep018658-21sshd12:34:460
280902850,2sleep30-21swapper/311:34:533
64432840,2sleep26410-21sshd11:22:462
66862830,2sleep30-21swapper/311:06:123
313412830,2sleep30-21swapper/311:28:403
230482830,1sleep323045-21sshd09:24:073
107312830,2sleep310728-21sshd11:49:443
2793328236,42sleep30-21swapper/307:07:183
305012810,1sleep230495-21sshd11:31:482
126182810,2sleep10-21swapper/110:04:041
321352800,4sleep30-21swapper/309:49:123
7222790,2sleep3720-21sshd12:20:143
49262790,1sleep00-21swapper/010:30:050
319052790,1sleep20-21swapper/210:49:112
14162770,2sleep20-21swapper/212:14:202
297522760,2sleep10-21swapper/110:35:391
55472740,2sleep35535-21sshd11:55:373
55472740,2sleep35535-21sshd11:55:373
237852740,0sleep00-21swapper/009:30:580
83342730,2sleep20-21swapper/207:35:152
323892730,2sleep332376-21sshd11:41:433
7592660,2sleep30-21swapper/311:38:383
2795025933,23sleep00-21swapper/007:07:310
2780824933,12sleep20-21swapper/207:05:432
261832440,1sleep00-21swapper/011:37:550
118332400,3sleep10-21swapper/110:14:151
154092390,0sleep015410-21sshd12:27:570
16852360,34sleep3135650irq/27-eth010:59:153
28435993513,18cyclictest44-21ksoftirqd/310:00:353
144072340,3sleep10-21swapper/110:24:331
28435993226,4cyclictest18298-21bash09:30:213
2843599312,5cyclictest16857-21sshd10:31:103
51612302,26sleep1135650irq/27-eth009:49:471
28434993011,6cyclictest10950irq/23-ehci_hcd10:31:522
157422290,2sleep12405-21runrttasks11:17:041
8262280,26sleep3135650irq/27-eth012:14:183
2843599262,4cyclictest1959-21sshd10:24:563
28435992613,4cyclictest32738-21sshd12:35:573
2843599260,21cyclictest44-21ksoftirqd/310:45:463
28432992619,2cyclictest7365-21sshd12:20:480
2843299261,16cyclictest0-21swapper/011:11:190
305412250,3sleep20-21swapper/211:35:082
2843599250,4cyclictest15951-21sshd09:54:153
2843599250,21cyclictest44-21ksoftirqd/310:26:363
272632250,2sleep227252-21sshd11:05:062
80092240,2sleep18006-21sshd10:53:191
74222240,3sleep10-21swapper/110:56:281
2843599241,4cyclictest26233-21cp10:41:563
28435992413,3cyclictest0-21swapper/310:15:173
28435992412,5cyclictest0-21swapper/310:35:353
214272240,1sleep021420-21sshd11:04:320
101992240,2sleep310200-21sshd11:03:193
28435992310,11cyclictest44-21ksoftirqd/311:16:593
2843599230,19cyclictest44-21ksoftirqd/309:25:113
2843599230,12cyclictest44-21ksoftirqd/312:33:193
2843399230,21cyclictest21131-21sshd12:38:031
2843599222,17cyclictest44-21ksoftirqd/309:35:533
2843499221,7cyclictest1847-21nfsd09:11:302
2843499221,19cyclictest33-21ksoftirqd/212:00:542
2843499221,19cyclictest33-21ksoftirqd/212:00:542
2843299229,10cyclictest3-21ksoftirqd/011:34:590
2843299222,12cyclictest3-21ksoftirqd/011:54:320
2843299222,12cyclictest3-21ksoftirqd/011:54:320
28432992212,2cyclictest3-21ksoftirqd/010:46:290
2843299221,12cyclictest19682-21sshd10:44:380
211222220,2sleep221116-21sshd11:04:302
210522220,3sleep221044-21sshd09:27:192
9462210,3sleep2944-21bash11:15:282
28435992114,5cyclictest135650irq/27-eth010:10:483
28435992113,5cyclictest18267-21bash09:16:363
28435992113,4cyclictest31348-21sshd10:05:523
28435992111,7cyclictest0-21swapper/309:58:073
28435992110,8cyclictest0-21swapper/312:03:473
28435992110,8cyclictest0-21swapper/312:03:473
2843599210,7cyclictest10213-21sshd12:27:273
2843599210,16cyclictest44-21ksoftirqd/311:11:003
2843499211,7cyclictest0-21swapper/212:20:572
28433992117,3cyclictest1848-21nfsd12:20:571
2843399210,8cyclictest1846-21nfsd12:29:031
28432992110,4cyclictest3-21ksoftirqd/010:16:560
212632210,17sleep1135650irq/27-eth011:30:511
300312200,2sleep20-21swapper/210:16:012
2843599206,12cyclictest44-21ksoftirqd/312:15:073
28435992014,3cyclictest28073-21cp10:51:593
2843499209,4cyclictest1847-21nfsd10:08:102
2843499208,2cyclictest0-21swapper/209:41:502
2843499200,2cyclictest0-21swapper/209:45:112
2843399206,3cyclictest15691-21bash11:43:201
28433992015,4cyclictest13779-21sshd10:47:181
28433992015,3cyclictest11549-21id10:43:481
2843299200,11cyclictest0-21swapper/011:44:560
103792200,2sleep110365-21sshd11:13:191
2843599199,3cyclictest16718-21sshd11:50:163
2843599199,3cyclictest16718-21sshd11:50:163
2843599196,10cyclictest0-21swapper/308:23:473
28435991911,5cyclictest17508-21missed_timers07:55:173
2843499191,6cyclictest0-21swapper/211:51:022
2843499191,6cyclictest0-21swapper/211:51:022
2843499191,4cyclictest8766-21sshd10:03:402
2843499191,11cyclictest8572-21sshd12:30:332
2843499191,10cyclictest6690-21bash12:39:472
2843499191,10cyclictest0-21swapper/212:27:362
28433991915,2cyclictest30714-21sshd12:10:421
28433991910,2cyclictest25042-21sshd12:00:531
28433991910,2cyclictest25042-21sshd12:00:531
2843399190,8cyclictest31171-21sshd09:35:131
2843399190,12cyclictest9647-21sshd11:36:101
28432991911,6cyclictest3-21ksoftirqd/010:25:370
2843299190,17cyclictest1848-21nfsd12:11:540
2843299190,12cyclictest2624-21sshd12:05:040
230742190,17sleep1135650irq/27-eth009:58:331
144212190,1sleep214417-21sshd10:44:062
112982190,17sleep3135650irq/27-eth012:05:483
76452180,1sleep27640-21ls09:15:252
2843599185,3cyclictest135650irq/27-eth011:22:573
2843499189,2cyclictest3291-21sshd10:20:012
2843499182,2cyclictest135650irq/27-eth011:42:192
2843499181,3cyclictest31613-21sshd10:55:372
2843499181,3cyclictest10467-21sshd09:50:152
2843499181,2cyclictest0-21swapper/212:06:572
2843499181,15cyclictest0-21swapper/208:55:142
2843499181,10cyclictest20334-21bash11:10:552
2843499180,2cyclictest0-21swapper/207:19:002
2843399187,3cyclictest0-21swapper/109:14:001
28433991813,3cyclictest1848-21nfsd11:50:391
28433991813,3cyclictest1848-21nfsd11:50:391
28433991811,5cyclictest1848-21nfsd09:41:251
2843399181,11cyclictest135650irq/27-eth010:31:581
2843399180,8cyclictest14478-21sshd10:27:441
2843399180,8cyclictest0-21swapper/109:21:161
2843399180,7cyclictest15134-21sshd11:46:301
2843399180,4cyclictest3477-21sshd11:02:371
2843299181,2cyclictest22053-21sshd09:17:000
2843299181,14cyclictest22239-21sshd12:00:370
2843299181,14cyclictest22239-21sshd12:00:370
2843299180,9cyclictest31642-21bash09:28:250
2843299180,14cyclictest0-21swapper/011:45:200
216092180,4sleep00-21swapper/012:35:020
2843499178,3cyclictest16571-21sshd11:46:392
2843499172,6cyclictest0-21swapper/212:16:502
2843499171,3cyclictest8551-21bash10:10:242
2843499171,2cyclictest0-21swapper/208:35:592
2843499171,15cyclictest20999-21sshd10:28:262
28434991711,4cyclictest18982-21sshd11:27:182
2843399177,8cyclictest0-21swapper/108:10:161
2843399177,8cyclictest0-21swapper/108:10:151
2843399176,4cyclictest10950irq/23-ehci_hcd09:25:561
28433991711,3cyclictest16180-21sshd09:50:451
28433991711,1cyclictest17329-21cp12:18:461
2843399170,9cyclictest0-21swapper/111:59:471
2843399170,9cyclictest0-21swapper/111:59:471
2843399170,13cyclictest3217-21sshd11:22:261
2843299174,6cyclictest3229-21sshd09:35:360
2843299173,5cyclictest4427-21sshd10:36:260
28432991713,2cyclictest3-21ksoftirqd/009:51:540
2843299171,13cyclictest0-21swapper/011:56:420
2843299171,13cyclictest0-21swapper/011:56:420
28432991710,6cyclictest0-21swapper/010:56:060
2843299170,12cyclictest21156-21sshd09:44:340
2843499168,6cyclictest0-21swapper/208:40:222
2843499163,3cyclictest1848-21nfsd11:57:592
2843499163,3cyclictest1848-21nfsd11:57:592
2843499162,13cyclictest1848-21nfsd09:55:522
2843499161,2cyclictest0-21swapper/208:20:592
28434991612,3cyclictest1848-21nfsd09:21:172
2843499160,10cyclictest0-21swapper/208:12:172
2843499160,10cyclictest0-21swapper/208:12:172
2843399163,12cyclictest10950irq/23-ehci_hcd07:20:281
2843399163,0cyclictest0-21swapper/109:15:091
2843399160,8cyclictest0-21swapper/112:31:501
2843399160,5cyclictest732-21id12:07:591
2843399160,14cyclictest0-21swapper/107:45:161
28432991611,4cyclictest3-21ksoftirqd/011:25:120
2843299160,4cyclictest0-21swapper/011:19:110
2843299160,13cyclictest29208-21sshd10:52:070
2843299160,10cyclictest29533-21bash09:45:200
2843499159,5cyclictest6989-21seq07:32:102
2843499158,5cyclictest0-21swapper/207:43:532
2843499153,2cyclictest0-21swapper/208:31:102
2843499151,6cyclictest1848-21nfsd08:25:032
2843499151,1cyclictest0-21swapper/209:04:352
2843499150,5cyclictest135650irq/27-eth007:55:002
2843499150,13cyclictest0-21swapper/209:05:292
28433991511,3cyclictest10950irq/23-ehci_hcd08:06:551
2843399150,14cyclictest0-21swapper/111:27:201
2843399150,13cyclictest13346-21taskset08:56:461
2843399150,12cyclictest27779-21munin-run08:20:011
2843299152,6cyclictest0-21swapper/011:21:370
28432991513,1cyclictest0-21swapper/010:24:350
2843299150,5cyclictest0-21swapper/008:59:550
2843299150,14cyclictest0-21swapper/007:55:030
2843299150,13cyclictest889-21sshd09:21:410
2843299150,13cyclictest0-21swapper/009:00:180
2843299150,13cyclictest0-21swapper/008:02:160
2843599140,13cyclictest0-21swapper/307:10:173
2843499141,5cyclictest135650irq/27-eth007:56:242
2843499141,5cyclictest0-21swapper/208:45:222
2843499141,11cyclictest2912-21munin-node07:25:182
2843399147,5cyclictest0-21swapper/108:25:141
2843399147,5cyclictest0-21swapper/107:15:181
2843399144,1cyclictest0-21swapper/107:25:541
28433991410,3cyclictest10950irq/23-ehci_hcd08:00:191
2843399140,12cyclictest0-21swapper/109:05:141
2843299147,5cyclictest0-21swapper/008:47:590
28432991412,1cyclictest0-21swapper/007:32:180
2843299140,7cyclictest0-21swapper/011:07:240
2843299140,13cyclictest0-21swapper/008:13:430
2843299140,13cyclictest0-21swapper/008:13:420
2843299140,12cyclictest0-21swapper/008:07:500
2843299140,10cyclictest0-21swapper/012:16:040
2843599139,3cyclictest135650irq/27-eth008:26:433
2843599135,4cyclictest10950irq/23-ehci_hcd08:55:223
2843599132,9cyclictest0-21swapper/307:15:243
2843599132,3cyclictest135650irq/27-eth008:50:003
28435991311,1cyclictest0-21swapper/308:41:453
28435991311,1cyclictest0-21swapper/307:34:543
2843599130,5cyclictest0-21swapper/308:10:133
2843599130,5cyclictest0-21swapper/308:10:123
2843599130,12cyclictest0-21swapper/309:06:423
2843599130,12cyclictest0-21swapper/309:00:193
2843599130,12cyclictest0-21swapper/308:48:393
2843599130,12cyclictest0-21swapper/308:09:313
2843599130,12cyclictest0-21swapper/307:25:093
2843599130,12cyclictest0-21swapper/307:20:453
2843599130,11cyclictest32758-21cpuspeed_turbos08:30:133
2843599130,11cyclictest2792-21df_inode08:35:123
2843599130,11cyclictest26479-21iostat_ios08:15:163
2843599130,11cyclictest20025-21open_files08:00:193
2843499139,3cyclictest9581-21df08:50:112
2843499139,3cyclictest1848-21nfsd07:20:002
2843499138,4cyclictest29282-21latency07:10:182
2843499138,4cyclictest0-21swapper/208:00:132
2843499132,3cyclictest26045-21diskstats08:15:122
2843499131,10cyclictest21926-21iostat_ios08:05:152
2843499130,12cyclictest0-21swapper/207:47:132
2843399132,10cyclictest135650irq/27-eth008:31:091
2843399131,3cyclictest28867-21grep07:10:141
2843399131,11cyclictest135650irq/27-eth008:45:551
2843399130,6cyclictest3610-21ntpq08:35:171
2843399130,12cyclictest0-21swapper/108:41:061
2843399130,12cyclictest0-21swapper/107:56:371
2843399130,12cyclictest0-21swapper/107:42:351
2843399130,12cyclictest0-21swapper/107:33:091
2843399130,11cyclictest8619-21ntp_states07:35:191
2843399130,11cyclictest28003-21munin-node08:20:131
2843399130,11cyclictest14548-21hddtemp_smartct09:00:121
2843299137,5cyclictest0-21swapper/007:48:220
2843299137,5cyclictest0-21swapper/007:10:140
28432991311,1cyclictest0-21swapper/008:15:180
28432991311,1cyclictest0-21swapper/007:51:210
2843299130,1cyclictest0-21swapper/007:35:550
2843299130,12cyclictest3683-21proc_pri08:35:190
2843299130,12cyclictest0-21swapper/008:50:160
2843299130,12cyclictest0-21swapper/008:33:110
2843299130,12cyclictest0-21swapper/008:29:160
2843299130,12cyclictest0-21swapper/007:40:530
2843299130,12cyclictest0-21swapper/007:27:350
2843299130,10cyclictest0-21swapper/009:06:000
2843599127,4cyclictest135650irq/27-eth007:50:373
2843599120,11cyclictest0-21swapper/307:45:043
2843599120,10cyclictest0-21swapper/307:40:133
2843599120,10cyclictest0-21swapper/307:35:123
2843399128,3cyclictest26950irq/26-ahci[00007:50:131
2843399127,3cyclictest9989-21hddtemp_smartct08:50:131
2843299127,2cyclictest0-21swapper/008:20:100
2843299120,1cyclictest2405-21runrttasks07:16:580
2843299120,1cyclictest0-21swapper/008:40:560
2843299110,10cyclictest0-21swapper/007:20:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional