You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-14 - 21:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Mon Jul 14, 2025 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2463721540,1sleep10-21swapper/110:27:231
1022221500,4sleep22798999cyclictest12:28:102
1267921440,1sleep20-21swapper/210:53:152
313221410,3sleep32799099cyclictest09:35:393
3091621360,0sleep00-21swapper/010:28:030
2595921290,4sleep02798799cyclictest12:39:050
43821250,0sleep00-21swapper/012:02:070
1949021250,5sleep019488-21bash09:27:100
352421200,0sleep23515-21bash09:45:282
2489421200,1sleep30-21swapper/310:47:343
1067021200,1sleep310671-21id11:06:453
2101721180,1sleep121003-21sshd09:40:381
2924821140,2sleep30-21swapper/311:22:203
2172921070,4sleep22798999cyclictest10:00:352
2222021020,1sleep10-21swapper/109:50:401
549121000,1sleep22798999cyclictest11:16:342
3061321000,2sleep030614-21sshd11:02:100
17752990,1sleep30-21swapper/311:02:323
121502980,1sleep30-21swapper/309:19:433
2770929634,49sleep10-21swapper/107:09:481
130942960,2sleep20-21swapper/210:09:492
110222960,1sleep30-21swapper/310:35:593
103172960,0sleep3431ktimersoftd/310:06:093
295502950,0sleep01847-21nfsd11:45:460
171222950,1sleep017099-21strings09:30:230
213982930,1sleep32799099cyclictest11:57:523
46622920,4sleep32799099cyclictest11:30:023
41162910,2sleep21847-21nfsd09:25:322
307142900,3sleep32799099cyclictest11:42:503
143962900,2sleep314398-21bash12:31:393
127472890,2sleep30-21swapper/312:12:433
153472880,2sleep20-21swapper/210:29:532
300592860,0sleep030044-21sshd12:17:330
169442850,1sleep10-21swapper/111:47:441
317802840,2sleep131774-21rm09:38:331
2749728435,45sleep30-21swapper/307:07:113
204742840,0sleep00-21swapper/012:07:110
318162820,0sleep00-21swapper/010:21:250
183132820,2sleep30-21swapper/310:23:243
89012810,3sleep02798799cyclictest12:12:200
116422810,2sleep20-21swapper/211:40:512
97652800,0sleep00-21swapper/009:22:490
70982800,1sleep027986-21cyclictest10:32:190
285772800,3sleep30-21swapper/310:11:143
148142800,2sleep214811-21bash12:31:422
63662770,1sleep20-21swapper/209:19:062
124852760,0sleep00-21swapper/011:53:480
268842750,2sleep20-21swapper/209:21:112
231862720,4sleep12798899cyclictest11:21:421
103162720,2sleep110314-21sshd12:34:291
223372690,1sleep00-21swapper/010:04:140
186412680,2sleep318635-21cp12:03:573
20612670,3sleep32799099cyclictest11:19:403
257242650,2sleep11848-21nfsd12:04:391
209842640,1sleep20-21swapper/209:43:592
2744026034,4sleep00-21swapper/007:06:270
133792590,0sleep313380-21sshd10:32:583
302182550,2sleep230214-21sshd09:14:492
2768425433,12sleep20-21swapper/207:09:342
230772490,47sleep3135650irq/27-eth010:27:143
51432420,2sleep22405-21runrttasks11:30:052
2798999411,4cyclictest0-21swapper/211:57:482
2798899391,27cyclictest9637-21sshd11:59:561
2798999381,3cyclictest0-21swapper/211:08:032
2798899370,25cyclictest9577-21sshd11:43:581
2798899370,24cyclictest31374-21sshd09:55:101
2798899370,24cyclictest1893-21nscd12:05:551
2798899370,21cyclictest1847-21nfsd10:49:511
43602360,0sleep00-21swapper/009:39:040
2798999361,3cyclictest0-21swapper/211:36:192
2798899360,31cyclictest9591-21sshd10:52:531
2798899360,22cyclictest31578-21sshd09:31:521
2798899360,22cyclictest135650irq/27-eth012:12:341
2798899351,30cyclictest29967-21sshd11:15:411
2798899351,21cyclictest27526-21sshd09:28:031
2798899350,26cyclictest1845-21nfsd10:12:471
2798899350,24cyclictest18869-21sshd10:57:281
2798899350,24cyclictest18869-21sshd10:57:281
235602350,2sleep10-21swapper/110:40:341
2798899347,22cyclictest32398-21sshd09:45:121
2798899340,29cyclictest1959-21sshd09:15:361
2798899340,28cyclictest12635-21bash11:53:501
2798899340,24cyclictest1959-21sshd10:30:291
2798999331,8cyclictest0-21swapper/210:40:422
2798999331,5cyclictest0-21swapper/210:18:142
2798899331,20cyclictest135650irq/27-eth010:18:271
2798899330,30cyclictest25947-21bash12:39:051
2798899330,28cyclictest2218-21sshd11:26:111
2798899330,28cyclictest16096-21sshd12:25:311
2798899330,24cyclictest135650irq/27-eth011:35:451
2798899330,24cyclictest11612-21sshd09:23:001
27990993213,17cyclictest44-21ksoftirqd/311:45:463
2799099320,1cyclictest29828-21sshd09:54:593
2798899320,30cyclictest1847-21nfsd12:22:511
2798899320,22cyclictest135650irq/27-eth011:08:071
2798899320,22cyclictest0-21swapper/110:00:071
2798899320,21cyclictest25887-21sshd11:32:171
2798899320,21cyclictest135650irq/27-eth012:15:091
2798899320,20cyclictest135650irq/27-eth011:10:051
70352310,0sleep00-21swapper/011:16:440
281582310,3sleep328159-21sshd12:07:583
2798899310,26cyclictest24977-21sshd10:37:291
2799099305,17cyclictest44-21ksoftirqd/310:59:223
2799099305,17cyclictest44-21ksoftirqd/310:59:223
27990993018,4cyclictest7531-21bash11:13:203
2799099301,19cyclictest44-21ksoftirqd/311:52:093
2798899300,27cyclictest1847-21nfsd10:05:051
2798899300,26cyclictest17305-21sshd10:23:181
2798899300,13cyclictest10974-21sshd11:03:301
98892290,1sleep39878-21sshd12:21:543
306232290,1sleep030619-21rm11:32:480
27990992923,3cyclictest17801-21sshd10:43:293
27990992915,4cyclictest28266-21sshd10:51:263
2798999291,6cyclictest0-21swapper/210:57:542
2798999291,6cyclictest0-21swapper/210:57:542
2798899290,7cyclictest26290-21bash09:10:521
2798999282,4cyclictest0-21swapper/212:07:262
2798999282,3cyclictest0-21swapper/212:01:042
2798999280,4cyclictest0-21swapper/209:30:182
27990992719,5cyclictest31399-21sshd12:36:253
27990992712,5cyclictest26843-21sshd09:24:413
2798999272,5cyclictest0-21swapper/211:29:572
2798999272,5cyclictest0-21swapper/210:36:192
2798999272,0cyclictest0-21swapper/212:10:332
2798999270,4cyclictest0-21swapper/210:12:422
2798999270,3cyclictest0-21swapper/211:54:072
26822270,25sleep3135650irq/27-eth009:25:263
2799099260,19cyclictest44-21ksoftirqd/311:28:393
2798999265,2cyclictest0-21swapper/212:20:122
2798999264,2cyclictest0-21swapper/210:47:252
2798999261,3cyclictest0-21swapper/212:37:492
2798999261,3cyclictest0-21swapper/210:31:422
2798999260,3cyclictest0-21swapper/211:45:412
2798999260,3cyclictest0-21swapper/209:35:152
27987992620,4cyclictest3-21ksoftirqd/010:56:290
27987992620,4cyclictest3-21ksoftirqd/010:56:290
27990992518,4cyclictest1455-21sshd09:32:063
27990992510,3cyclictest135650irq/27-eth009:56:073
2798999252,5cyclictest0-21swapper/209:57:332
2798999252,4cyclictest0-21swapper/211:23:322
2798999251,4cyclictest0-21swapper/210:20:242
2798999251,3cyclictest0-21swapper/209:53:302
2798999250,6cyclictest0-21swapper/211:00:212
2798899250,21cyclictest1112-21cut07:20:231
2798799255,13cyclictest0-21swapper/010:15:310
2798799250,16cyclictest14914-21cp11:41:120
83102240,0sleep00-21swapper/011:06:300
6472240,3sleep30-21swapper/312:27:143
27990992415,7cyclictest135650irq/27-eth012:17:213
2798999241,3cyclictest0-21swapper/212:16:512
2798999241,3cyclictest0-21swapper/211:14:322
2798799241,22cyclictest1846-21nfsd09:42:210
27990992316,5cyclictest1846-21nfsd10:17:153
27990992315,5cyclictest1959-21sshd11:37:203
27990992315,5cyclictest10458-21sshd09:42:543
27990992314,6cyclictest1847-21nfsd09:49:423
2798899230,21cyclictest16076-21munin-node07:55:141
2798799231,14cyclictest0-21swapper/010:45:390
2798799231,13cyclictest0-21swapper/010:05:220
2798799230,13cyclictest18677-21sshd12:29:000
27990992217,3cyclictest5609-21bash09:12:063
27990992212,7cyclictest135650irq/27-eth010:00:053
2798899220,14cyclictest30651-21grep07:15:181
2798799222,11cyclictest23805-21sshd09:54:140
27987992214,2cyclictest6696-21bash11:37:010
2798799221,13cyclictest0-21swapper/012:34:240
2798799220,20cyclictest0-21swapper/012:22:210
2798799220,1cyclictest15395-21bash10:13:150
2798999219,9cyclictest10950irq/23-ehci_hcd08:27:152
2798899210,19cyclictest24155-21munin-node08:10:231
2798899210,19cyclictest18351-21munin-node08:00:221
2798899210,16cyclictest10692-21timerandwakeup07:40:281
2798899210,13cyclictest28422-21sort07:10:121
2798899210,12cyclictest16259-21if_err_eth009:05:161
2798799212,18cyclictest0-21swapper/011:26:110
2798799210,17cyclictest10159-21sshd10:35:530
2798999207,11cyclictest16822-21if_eth007:55:142
2798999200,18cyclictest0-21swapper/208:30:122
2798899207,11cyclictest30942-21munin-node08:25:211
2798899200,18cyclictest4763-21munin-node07:30:121
2798899200,18cyclictest2405-21runrttasks09:04:391
2798899200,18cyclictest1576-21avahi-daemon08:07:501
2798899200,18cyclictest12964-21runrttasks08:59:311
2798899200,11cyclictest4381-21taskset07:28:471
2798899200,11cyclictest1848-21nfsd07:46:531
2798899200,11cyclictest1290-21runrttasks08:31:241
2798799201,12cyclictest0-21swapper/010:50:230
2798799200,15cyclictest19016-21sshd09:47:080
2798999198,8cyclictest10950irq/23-ehci_hcd08:05:492
2798999197,2cyclictest0-21swapper/208:12:422
2798999190,2cyclictest0-21swapper/207:40:142
2798999190,1cyclictest0-21swapper/208:01:152
2798999190,1cyclictest0-21swapper/207:15:492
2798899190,9cyclictest135650irq/27-eth008:40:001
2798799197,10cyclictest26842-21bash11:11:540
2798799191,10cyclictest0-21swapper/011:57:340
2798799190,9cyclictest21754-21find10:40:240
2798799190,11cyclictest0-21swapper/011:24:110
2798999187,2cyclictest0-21swapper/209:00:142
2798999187,2cyclictest0-21swapper/208:40:192
2798999187,1cyclictest0-21swapper/207:45:132
2798999180,9cyclictest0-21swapper/208:45:182
2798999180,9cyclictest0-21swapper/208:35:392
2798999180,9cyclictest0-21swapper/207:30:012
2798999180,9cyclictest0-21swapper/207:10:112
2798999180,8cyclictest0-21swapper/209:05:252
2798999180,8cyclictest0-21swapper/207:50:152
2798999180,8cyclictest0-21swapper/207:24:082
2798999180,1cyclictest0-21swapper/208:15:462
2798999180,1cyclictest0-21swapper/207:35:022
2798999180,1cyclictest0-21swapper/207:25:192
2798899185,11cyclictest7129-21cat08:45:171
2798899180,17cyclictest1848-21nfsd08:21:501
2798899180,17cyclictest10370-21runrttasks08:50:291
2798899180,16cyclictest1848-21nfsd08:16:251
2798899180,16cyclictest1848-21nfsd07:36:541
2798799189,2cyclictest0-21swapper/009:56:210
2798799188,6cyclictest21501-21sshd09:17:170
2798799187,2cyclictest23986-21sshd09:10:330
2798999177,9cyclictest0-21swapper/208:55:302
2798999177,1cyclictest0-21swapper/208:20:172
2798999170,9cyclictest0-21swapper/208:50:042
2798899177,9cyclictest1848-21nfsd08:41:411
2798899170,16cyclictest1131-21jbd2/dm-2-807:50:041
2799099152,12cyclictest10950irq/23-ehci_hcd07:15:263
27990991511,3cyclictest10950irq/23-ehci_hcd08:37:193
2799099151,12cyclictest0-21swapper/308:25:213
2799099150,13cyclictest0-21swapper/308:30:183
2799099150,13cyclictest0-21swapper/307:20:213
27987991513,1cyclictest0-21swapper/008:25:050
2798799150,14cyclictest0-21swapper/007:15:010
2798799150,12cyclictest5870-21ntp_states07:30:180
8682140,2sleep02798799cyclictest07:20:210
2799099147,6cyclictest0-21swapper/309:07:333
2799099143,10cyclictest10950irq/23-ehci_hcd07:55:103
27990991410,3cyclictest10950irq/23-ehci_hcd08:55:453
2799099140,13cyclictest135650irq/27-eth007:30:183
2798799148,5cyclictest0-21swapper/008:32:000
2798799148,5cyclictest0-21swapper/008:15:040
2798799140,5cyclictest0-21swapper/007:29:520
2798799140,4cyclictest0-21swapper/007:59:130
2798799140,13cyclictest0-21swapper/007:52:400
2798799140,12cyclictest0-21swapper/008:05:020
2799099137,5cyclictest0-21swapper/308:51:153
2799099137,5cyclictest0-21swapper/308:04:373
2799099130,5cyclictest0-21swapper/308:06:003
2799099130,5cyclictest0-21swapper/307:35:353
2799099130,12cyclictest1848-21nfsd07:10:173
2799099130,12cyclictest135650irq/27-eth008:10:353
2799099130,12cyclictest11096-21runrttasks07:42:333
2799099130,12cyclictest0-21swapper/309:02:453
2799099130,12cyclictest0-21swapper/308:45:293
2799099130,12cyclictest0-21swapper/308:18:593
2799099130,12cyclictest0-21swapper/307:25:533
2799099130,11cyclictest14130-21df_inode07:50:113
2799099130,10cyclictest10950irq/23-ehci_hcd08:22:333
2798799139,1cyclictest0-21swapper/008:01:000
2798799137,5cyclictest0-21swapper/008:50:240
2798799137,5cyclictest0-21swapper/007:36:260
2798799134,8cyclictest0-21swapper/009:06:250
27987991311,1cyclictest0-21swapper/008:56:020
2798799130,5cyclictest0-21swapper/008:40:440
2798799130,1cyclictest0-21swapper/009:04:210
2798799130,1cyclictest0-21swapper/008:23:320
2798799130,12cyclictest12221-21smartctl07:45:170
2798799130,12cyclictest0-21swapper/007:14:290
2798799130,10cyclictest0-21swapper/008:45:220
2799099120,10cyclictest0-21swapper/308:40:153
2798799128,4cyclictest0-21swapper/008:36:090
2798799128,3cyclictest0-21swapper/008:10:270
2798799120,1cyclictest0-21swapper/007:40:160
2799099118,2cyclictest11812-21munin-node07:45:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional