You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 14:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Tue Dec 02, 2025 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1240121840,1sleep02062699cyclictest09:51:060
623121570,1sleep10-21swapper/111:06:261
2609421520,2sleep126092-21latency11:25:171
2609421520,2sleep126092-21latency11:25:171
2520721450,1sleep20-21swapper/211:01:492
2734721410,0sleep00-21swapper/010:42:120
1894321390,2sleep12063199cyclictest09:55:061
1981221340,1sleep10-21swapper/111:21:211
197921290,2sleep21978-21sshd09:43:052
3220921130,0sleep00-21swapper/010:19:390
2712921130,1sleep30-21swapper/310:32:243
2509921110,0sleep00-21swapper/011:18:340
1089221090,4sleep10-21swapper/112:23:491
170121080,1sleep30-21swapper/309:46:363
1643521020,0sleep116428-21sshd10:14:311
1977821000,1sleep20-21swapper/211:37:572
130232990,2sleep00-21swapper/012:04:000
287062970,2sleep20-21swapper/212:25:232
195332950,1sleep11848-21nfsd09:17:361
59012920,2sleep30-21swapper/311:03:113
36142920,1sleep30-21swapper/310:09:553
100352870,3sleep20-21swapper/209:13:192
141232860,2sleep21848-21nfsd11:40:342
2024628533,42sleep30-21swapper/307:08:203
130462840,3sleep30-21swapper/310:54:043
126412830,2sleep02062699cyclictest10:54:010
2035528233,45sleep10-21swapper/107:09:381
163662820,2sleep22405-21runrttasks11:10:522
174512810,3sleep12063199cyclictest12:07:501
35982780,3sleep32064199cyclictest11:29:403
35982780,3sleep32064199cyclictest11:29:393
250462780,0sleep00-21swapper/012:28:130
60602770,2sleep31847-21nfsd12:32:373
46222760,2sleep34616-21sshd09:19:263
305202750,1sleep330519-21sshd10:25:583
154742750,2sleep10-21swapper/111:00:491
129212740,1sleep212918-21sshd10:24:182
35142690,2sleep33502-21sshd11:09:403
320842690,2sleep132077-21cp12:19:241
310272690,1sleep041ktimersoftd/011:09:090
204892680,1sleep10-21swapper/111:51:151
132032680,1sleep11848-21nfsd09:51:101
164132640,2sleep316414-21sshd11:24:223
1912926233,16sleep20-21swapper/207:05:182
80142590,2sleep12063199cyclictest11:36:431
53322580,2sleep35321-21sshd10:13:213
2016225633,11sleep00-21swapper/007:07:160
73972440,4sleep10-21swapper/110:56:441
2064199409,8cyclictest1847-21nfsd09:54:263
20641993911,2cyclictest27560-21sshd10:15:333
113572390,0sleep011358-21bash11:03:440
149852380,2sleep214988-21sshd11:57:202
20641993725,9cyclictest1848-21nfsd11:51:163
264352360,0sleep00-21swapper/010:22:200
20641993625,6cyclictest6112-21sshd11:46:293
2062699363,19cyclictest3-21ksoftirqd/011:35:440
20626993611,16cyclictest3-21ksoftirqd/012:38:010
20641993521,8cyclictest30644-21sshd10:59:093
20641993426,3cyclictest1847-21nfsd12:37:193
20641993422,7cyclictest1848-21nfsd09:21:453
20641993419,8cyclictest20555-21sshd11:41:153
185492340,2sleep218548-21sshd09:51:432
20641993328,3cyclictest14826-21sshd10:47:313
20641993327,4cyclictest22349-21munin-node12:15:143
20641993325,5cyclictest31438-21sshd11:15:483
94802320,3sleep20-21swapper/209:05:192
20641993224,6cyclictest7311-21sshd11:56:323
20641993223,5cyclictest8287-21sshd11:10:103
20641993222,6cyclictest2701-21sshd09:36:193
20641993221,7cyclictest1847-21nfsd12:11:383
20641993220,7cyclictest1847-21nfsd12:25:423
20641993219,9cyclictest31844-21sshd11:32:303
20641993218,10cyclictest15334-21bash12:07:353
20641993217,6cyclictest14648-21sshd12:00:323
2062699325,15cyclictest28334-21sshd12:09:020
2062699324,22cyclictest0-21swapper/009:44:540
20626993212,15cyclictest3-21ksoftirqd/009:22:440
20626993211,8cyclictest3-21ksoftirqd/010:36:420
20641993119,8cyclictest20601-21perl09:55:143
20641993115,11cyclictest7360-21sshd10:36:593
2062699316,7cyclictest3-21ksoftirqd/010:49:000
2062699314,3cyclictest3-21ksoftirqd/010:59:450
20626993110,9cyclictest3-21ksoftirqd/010:30:550
11602310,1sleep010-21rcuc/010:09:400
20641993027,2cyclictest0-21swapper/312:24:393
20641993022,5cyclictest15248-21bash10:40:563
20641993020,7cyclictest30867-21sshd11:35:413
20641993019,5cyclictest24399-21sshd09:42:023
20641993018,9cyclictest12614-21bash09:10:123
20641993017,9cyclictest28567-21seq10:22:323
20641993013,7cyclictest12055-21sshd10:00:443
2062699309,7cyclictest3-21ksoftirqd/011:27:160
2062699309,7cyclictest3-21ksoftirqd/011:27:160
2062699303,17cyclictest9815-21sshd11:56:480
20626993022,4cyclictest23278-21sshd12:34:190
20635992915,6cyclictest25-21rcuop/110:32:272
2062699298,3cyclictest3-21ksoftirqd/011:31:570
2062699295,14cyclictest3-21ksoftirqd/009:16:350
127502290,3sleep20-21swapper/210:37:322
93182280,3sleep19312-21sshd10:00:281
20641992821,4cyclictest2088-21bash09:32:493
20641992819,5cyclictest0-21swapper/309:26:423
20631992814,5cyclictest10950irq/23-ehci_hcd12:39:111
20631992720,5cyclictest4219-21sshd11:59:361
20641992620,4cyclictest10631-21latency_hist09:10:003
20635992612,11cyclictest13253-21rm09:47:582
2063199260,22cyclictest22-21ksoftirqd/110:54:331
20626992610,8cyclictest3-21ksoftirqd/009:12:410
2062699260,23cyclictest0-21swapper/009:57:170
277242250,2sleep20-21swapper/209:32:082
20631992516,6cyclictest17760-21sshd09:20:371
2062699259,7cyclictest3-21ksoftirqd/010:14:120
2062699258,2cyclictest3-21ksoftirqd/010:02:390
2062699257,2cyclictest1846-21nfsd11:24:460
20626992512,6cyclictest3-21ksoftirqd/009:38:000
2062699251,10cyclictest27911-21sshd11:12:080
20626992510,6cyclictest3-21ksoftirqd/011:51:370
103302250,23sleep2135650irq/27-eth012:07:042
6652240,2sleep2663-21bash10:59:252
280002240,2sleep127994-21sshd09:49:301
20635992414,8cyclictest135650irq/27-eth011:26:032
20635992414,8cyclictest135650irq/27-eth011:26:022
20631992412,4cyclictest4805-21sshd11:42:591
20631992411,4cyclictest11656-21sshd10:07:221
2062699249,5cyclictest0-21swapper/012:22:100
2062699247,11cyclictest3-21ksoftirqd/012:11:180
2062699246,17cyclictest3-21ksoftirqd/011:49:150
2062699242,8cyclictest15705-21sshd10:27:530
2062699241,14cyclictest1845-21nfsd09:33:400
2062699240,21cyclictest32447-21sshd09:49:570
16942240,2sleep21848-21nfsd09:39:452
20635992320,2cyclictest0-21swapper/211:49:252
20631992315,4cyclictest0-21swapper/109:31:281
2063199230,18cyclictest22-21ksoftirqd/110:33:451
20635992214,2cyclictest135650irq/27-eth011:30:312
20635992212,3cyclictest1959-21sshd11:20:352
20635992211,4cyclictest14765-21sshd10:04:282
2063599220,19cyclictest33-21ksoftirqd/211:54:172
20631992214,4cyclictest2224-21sshd11:49:301
20631992211,7cyclictest26527-21sshd10:48:421
2063199220,19cyclictest22-21ksoftirqd/110:37:231
20626992218,3cyclictest3-21ksoftirqd/012:15:110
20626992213,8cyclictest3-21ksoftirqd/011:42:210
2062699220,6cyclictest0-21swapper/009:29:130
81762211,18sleep110950irq/23-ehci_hcd09:43:461
20635992117,3cyclictest13143-21sshd09:16:562
20635992116,3cyclictest12012-21sshd12:17:272
20635992113,5cyclictest22958-21sshd11:18:222
2063599210,4cyclictest1844-21nfsd12:23:452
2063599210,3cyclictest1847-21nfsd09:24:502
20631992114,5cyclictest1846-21nfsd12:03:361
20631992114,4cyclictest28356-21bash10:42:171
20631992114,4cyclictest26192-21sshd10:19:021
20631992114,4cyclictest1846-21nfsd11:13:371
2063199211,19cyclictest135650irq/27-eth011:19:301
2063599208,3cyclictest23049-21bash10:25:162
20635992014,4cyclictest1845-21nfsd10:44:402
20635992014,3cyclictest36-21rcuop/209:55:262
20635992012,5cyclictest15803-21sshd12:00:402
20631992015,3cyclictest27564-21sshd10:22:251
20631992014,3cyclictest12362-21rm09:37:221
20631992013,5cyclictest135650irq/27-eth009:14:021
20631992012,4cyclictest31022-21sshd09:25:271
20631992011,6cyclictest28769-21sshd10:25:491
20631992011,6cyclictest23291-21sshd12:34:191
170962200,17sleep1135650irq/27-eth012:11:111
116212200,1sleep10-21swapper/112:26:551
2063599198,7cyclictest3647-21sshd10:06:322
20635991916,2cyclictest23535-21bash10:51:422
20635991915,2cyclictest5196-21sshd10:46:312
20635991915,2cyclictest14652-21sshd11:07:222
20635991914,3cyclictest1959-21sshd10:16:442
20635991912,5cyclictest4706-21sshd12:35:362
20631991915,2cyclictest17478-21chrt08:12:211
2062699196,9cyclictest0-21swapper/007:33:010
2062699196,9cyclictest0-21swapper/007:33:000
2064199189,6cyclictest26239-21nfsd407:20:183
2064199188,8cyclictest0-21swapper/307:55:233
20635991814,3cyclictest31153-21sshd12:31:522
20635991813,3cyclictest1847-21nfsd12:11:322
20635991811,4cyclictest21529-21sshd10:11:382
20631991813,3cyclictest8356-21sshd11:30:091
20626991811,5cyclictest3-21ksoftirqd/007:55:250
2062699180,16cyclictest0-21swapper/008:30:210
2062699180,15cyclictest0-21swapper/007:43:190
20641991713,2cyclictest6096-21chrt07:47:383
2064199170,2cyclictest0-21swapper/307:11:243
20635991713,3cyclictest23408-21sshd09:28:082
2063599170,14cyclictest135650irq/27-eth008:28:532
2062699177,7cyclictest0-21swapper/009:03:200
2063199161,14cyclictest144550irq/28-eth1-rx-09:07:211
20626991612,3cyclictest7200-21hddtemp_smartct07:50:120
2062699160,1cyclictest0-21swapper/008:36:020
2062699160,15cyclictest0-21swapper/007:15:180
2062699160,13cyclictest0-21swapper/008:02:590
22532150,13sleep2135650irq/27-eth007:40:132
2064199156,1cyclictest24060-21unixbench_multi08:25:233
2064199152,11cyclictest16606-21grep08:10:183
2064199151,13cyclictest1848-21nfsd09:00:493
20641991511,2cyclictest17923-21munin-node08:15:203
20641991510,3cyclictest0-21swapper/308:35:133
2064199150,13cyclictest7398-21grep07:50:153
2064199150,13cyclictest3802-21munin-node08:55:233
2064199150,13cyclictest1313-21taskset07:35:453
2064199150,13cyclictest0-21swapper/308:08:243
2064199150,13cyclictest0-21swapper/307:18:463
2063599158,3cyclictest0-21swapper/208:35:562
2063599154,3cyclictest10950irq/23-ehci_hcd08:20:252
2063599152,8cyclictest135650irq/27-eth008:06:422
2063599152,5cyclictest1131-21jbd2/dm-2-808:45:212
2063599152,11cyclictest0-21swapper/207:30:512
2063599152,11cyclictest0-21swapper/207:30:502
2063599150,13cyclictest22199-21unixbench-2d07:10:222
20631991511,3cyclictest10950irq/23-ehci_hcd07:15:451
2063199150,6cyclictest0-21swapper/107:50:171
2063199150,13cyclictest0-21swapper/107:35:171
2063199150,10cyclictest0-21swapper/108:25:111
2062699159,1cyclictest0-21swapper/007:37:590
2062699157,7cyclictest0-21swapper/008:29:120
2062699157,7cyclictest0-21swapper/007:45:450
2062699156,8cyclictest0-21swapper/008:51:380
2062699156,6cyclictest0-21swapper/008:20:440
20626991510,4cyclictest21976-21munin-node07:10:190
2062699150,1cyclictest0-21swapper/009:05:220
2062699150,10cyclictest0-21swapper/007:29:100
2064199145,0cyclictest0-21swapper/308:45:223
2064199140,2cyclictest144550irq/28-eth1-rx-08:30:463
2064199140,12cyclictest29531-21taskset07:29:513
2064199140,12cyclictest2405-21runrttasks08:02:253
2063599149,4cyclictest19586-21vmstat08:15:212
2063599148,4cyclictest0-21swapper/208:13:512
2063599143,7cyclictest135650irq/27-eth007:53:332
2063599143,7cyclictest135650irq/27-eth007:18:502
2063599142,5cyclictest135650irq/27-eth007:58:052
2063599142,11cyclictest135650irq/27-eth009:00:062
2063599142,11cyclictest135650irq/27-eth007:35:502
2063599142,11cyclictest135650irq/27-eth007:26:132
2063599141,12cyclictest135650irq/27-eth008:52:572
2063199140,13cyclictest0-21swapper/107:55:191
2063199140,12cyclictest0-21swapper/107:20:161
2062699148,1cyclictest0-21swapper/008:05:070
2062699146,7cyclictest0-21swapper/008:45:020
2062699146,7cyclictest0-21swapper/008:18:110
2062699145,4cyclictest0-21swapper/007:20:180
2062699145,3cyclictest0-21swapper/008:40:210
2062699140,13cyclictest0-21swapper/008:10:030
2062699140,10cyclictest0-21swapper/008:55:440
2064199138,4cyclictest2099-21cpu07:40:113
2064199130,12cyclictest0-21swapper/307:31:033
2064199130,12cyclictest0-21swapper/307:31:033
2064199130,11cyclictest30092-21iostat08:40:163
2064199130,11cyclictest20526-21df_inode08:20:123
2064199130,11cyclictest1449-21munin-node08:50:253
2063599132,7cyclictest135650irq/27-eth008:00:542
20635991311,1cyclictest0-21swapper/207:20:292
2063599130,12cyclictest0-21swapper/208:56:312
2063599130,12cyclictest0-21swapper/208:32:112
2063599130,12cyclictest0-21swapper/207:46:242
2063199139,3cyclictest6081-21munin-node09:00:211
2063199138,4cyclictest1848-21nfsd08:56:531
2063199133,2cyclictest10950irq/23-ehci_hcd08:32:271
20631991311,1cyclictest0-21swapper/108:40:051
2063199130,5cyclictest0-21swapper/108:35:081
2063199130,4cyclictest0-21swapper/107:30:571
2063199130,4cyclictest0-21swapper/107:30:571
2063199130,12cyclictest1848-21nfsd08:01:271
2063199130,12cyclictest0-21swapper/108:15:041
2063199130,12cyclictest0-21swapper/108:07:461
2063199130,12cyclictest0-21swapper/107:45:581
2063199130,11cyclictest28192-21hddtemp_smartct07:25:151
2063599120,11cyclictest0-21swapper/208:40:002
2063199127,4cyclictest31745-21cpu08:45:141
2063199127,4cyclictest135650irq/27-eth008:20:011
2063199120,3cyclictest2749-21iostat_ios07:40:161
2063199120,3cyclictest1734-21df08:50:121
2063199120,11cyclictest20762-21atenall_r5power07:10:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional