You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 22:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Tue Nov 25, 2025 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3121921570,2sleep13094799cyclictest11:31:401
2826421430,3sleep03094699cyclictest09:27:580
2826421430,3sleep03094699cyclictest09:27:580
55421310,3sleep33094999cyclictest09:38:273
3175921290,1sleep131757-21bash10:44:591
2760021290,4sleep23094899cyclictest11:47:512
2669721290,6sleep10-21swapper/109:10:281
86021270,4sleep13094799cyclictest11:18:331
3244521210,1sleep20-21swapper/209:25:082
3244521210,1sleep20-21swapper/209:25:072
342421160,2sleep23094899cyclictest09:59:182
1853121160,3sleep23094899cyclictest10:53:382
2094021120,4sleep23094899cyclictest09:44:082
2565921090,1sleep025654-21sshd11:31:030
2672721070,2sleep126718-21sshd10:08:231
16232980,0sleep00-21swapper/012:36:400
219332940,1sleep221915-21sshd10:27:282
211732940,2sleep31848-21nfsd10:47:093
242922930,1sleep024278-21sshd09:34:150
91872900,2sleep10-21swapper/111:45:551
216692890,2sleep10-21swapper/112:00:301
33322880,1sleep030945-21cyclictest11:52:030
249422870,2sleep12405-21runrttasks12:22:581
103192860,2sleep010306-21sshd11:59:290
187072850,0sleep00-21swapper/012:22:210
3052428433,47sleep30-21swapper/307:08:143
190602840,1sleep219057-21sshd11:23:562
152192840,2sleep215211-21cp09:36:332
262402830,3sleep10-21swapper/111:37:441
177532830,1sleep00-21swapper/010:50:110
153722830,2sleep10-21swapper/109:19:491
2864828233,44sleep10-21swapper/107:05:111
133432820,2sleep31847-21nfsd12:09:223
226192810,1sleep00-21swapper/012:29:150
282952800,3sleep10-21swapper/109:51:361
274672800,0sleep00-21swapper/010:05:090
159502800,4sleep23094899cyclictest09:12:442
82442780,2sleep10-21swapper/109:46:071
77792760,4sleep13094799cyclictest10:03:051
44292760,1sleep04416-21sshd10:45:220
173072750,2sleep10-21swapper/109:20:021
278212740,3sleep03094699cyclictest09:48:090
165102740,1sleep10-21swapper/111:43:221
3066027334,9sleep20-21swapper/207:09:382
281002660,2sleep20-21swapper/209:48:122
70272640,2sleep10-21swapper/112:11:481
295712640,1sleep041ktimersoftd/012:01:210
278712640,1sleep33094999cyclictest09:41:243
283412620,1sleep20-21swapper/212:39:222
16602530,2sleep20-21swapper/212:17:342
30946994311,5cyclictest3-21ksoftirqd/009:37:020
260692430,1sleep00-21swapper/009:54:550
3094699421,1cyclictest1847-21nfsd10:28:200
3035824234,4sleep00-21swapper/007:06:060
3094699371,23cyclictest8661-21sshd10:13:140
30949993614,20cyclictest44-21ksoftirqd/312:14:383
30949993614,20cyclictest44-21ksoftirqd/309:26:353
30949993614,20cyclictest44-21ksoftirqd/309:26:353
265272350,0sleep026528-21sshd10:37:480
257692350,32sleep1135650irq/27-eth010:54:251
3094699346,26cyclictest0-21swapper/011:21:340
3094699344,22cyclictest30411-1kworker/0:1H12:31:430
246942340,0sleep024695-21id10:18:040
26792330,30sleep1135650irq/27-eth012:33:461
3094699327,22cyclictest0-21swapper/010:41:550
3094699321,28cyclictest21335-21id09:20:210
3094699321,19cyclictest12422-21bash10:20:070
30946993211,16cyclictest3-21ksoftirqd/011:39:120
49632310,2sleep14962-21bash10:38:531
30946993113,6cyclictest7381-21bash12:08:470
30946993111,8cyclictest2249-21bash09:55:370
30949993014,11cyclictest11995-21bash11:19:483
3094699306,9cyclictest12311-21sshd11:03:130
3094699302,21cyclictest31338-21sshd11:15:070
113422300,0sleep111338-21sshd10:59:461
30946992916,12cyclictest25723-21id11:07:520
243062290,27sleep3135650irq/27-eth011:27:453
3094699288,9cyclictest27820-21sshd09:44:550
3094699286,12cyclictest28879-21sshd09:10:410
30946992810,5cyclictest17934-21sshd10:04:100
186152280,2sleep318617-21bash09:16:353
30949992714,3cyclictest1339-21sshd11:35:163
3094699274,17cyclictest22343-21sshd12:13:170
3094699274,11cyclictest11815-21sshd11:26:240
3094699273,18cyclictest1846-21nfsd10:58:130
30946992714,2cyclictest3-21ksoftirqd/009:16:330
277832270,3sleep30-21swapper/312:04:333
276732270,3sleep30-21swapper/309:48:083
30949992616,8cyclictest135650irq/27-eth011:11:323
30949992614,4cyclictest24978-21sshd12:35:453
30949992613,11cyclictest47-21rcuop/311:23:413
3094699267,15cyclictest1848-21nfsd12:19:320
3094699260,19cyclictest29247-21sshd11:11:270
24132260,2sleep32412-21bash11:02:043
194402260,3sleep30-21swapper/310:07:363
30949992517,4cyclictest19594-21id10:00:543
30949992513,3cyclictest0-21swapper/310:28:053
3094999251,21cyclictest44-21ksoftirqd/310:14:193
3094999250,22cyclictest44-21ksoftirqd/311:31:423
3094799254,7cyclictest0-21swapper/111:05:091
3094799250,9cyclictest0-21swapper/111:00:351
250002250,4sleep20-21swapper/210:04:562
232782250,2sleep123280-21id09:57:531
30949992413,4cyclictest1847-21nfsd10:20:513
30949992411,3cyclictest1844-21nfsd12:26:503
30949992411,3cyclictest0-21swapper/310:36:123
3094999240,20cyclictest44-21ksoftirqd/312:19:473
30947992411,7cyclictest10950irq/23-ehci_hcd09:43:051
306992240,2sleep230698-21bash12:14:102
83082230,3sleep20-21swapper/211:26:042
3094999239,6cyclictest135650irq/27-eth010:33:343
30949992316,3cyclictest0-21swapper/310:40:253
30949992315,5cyclictest29851-21sshd09:34:513
3094999230,20cyclictest44-21ksoftirqd/312:22:053
3094999230,20cyclictest44-21ksoftirqd/310:17:543
30948992311,8cyclictest135650irq/27-eth009:34:132
30947992311,5cyclictest1847-21nfsd10:46:461
3094699238,8cyclictest0-21swapper/010:31:580
30949992216,3cyclictest15580-21id09:50:173
30949992214,5cyclictest31429-21sshd09:10:583
30949992214,5cyclictest23443-21sshd11:40:373
30949992214,3cyclictest26950irq/26-ahci[00010:51:033
30949992214,2cyclictest44-21ksoftirqd/309:57:223
3094999220,20cyclictest44-21ksoftirqd/309:20:173
3094899223,9cyclictest16904-21sshd10:20:272
30948992215,5cyclictest9685-21sshd10:16:302
3094799229,1cyclictest17661-21sshd09:36:501
3094999218,4cyclictest20767-21sshd11:07:193
30949992114,5cyclictest0-21swapper/311:51:253
30949992113,5cyclictest17296-21sshd11:46:483
30949992112,6cyclictest7418-21sshd10:59:203
3094899218,5cyclictest135650irq/27-eth009:51:112
3094799213,15cyclictest20668-21cp11:14:021
231012210,19sleep1135650irq/27-eth010:34:141
57092200,17sleep2135650irq/27-eth010:42:162
30949992012,6cyclictest14432-21sshd12:31:323
3094899201,8cyclictest19617-21sshd12:00:202
30948992013,5cyclictest10306-21bash12:31:082
3094899200,12cyclictest30036-21sshd11:05:032
30946992013,3cyclictest3-21ksoftirqd/011:44:360
264402201,17sleep2135650irq/27-eth011:14:392
30949991912,2cyclictest5530-21sshd11:55:293
3094899194,8cyclictest18168-21sshd11:50:132
3094899194,3cyclictest20260-21sshd10:33:552
30948991915,3cyclictest2218-21sshd10:55:152
3094799199,6cyclictest5202-21sshd12:17:551
3094799190,9cyclictest4261-21sshd11:55:241
3094699191,15cyclictest0-21swapper/011:46:220
30948991814,3cyclictest30092-21sshd12:30:002
30948991813,4cyclictest12559-21sshd10:10:152
30948991813,3cyclictest9898-21sshd10:45:562
30948991813,3cyclictest1848-21nfsd12:21:322
30948991812,4cyclictest670-21sshd09:21:432
3094799189,6cyclictest17087-21sshd11:20:161
3094799187,4cyclictest27798-21sshd12:36:031
3094799183,3cyclictest8031-21sshd10:25:591
30947991816,1cyclictest0-21swapper/107:27:461
30947991816,1cyclictest0-21swapper/107:27:461
30947991812,4cyclictest32186-21sshd09:31:381
30947991810,2cyclictest10950irq/23-ehci_hcd12:26:481
3094799180,15cyclictest135650irq/27-eth010:13:291
3094899174,3cyclictest3424-21sshd11:41:592
3094899174,2cyclictest29473-21sshd09:17:442
3094899173,3cyclictest26351-21sshd11:31:062
30948991712,4cyclictest0-21swapper/211:17:412
30948991712,3cyclictest8532-21bash12:05:412
30948991711,1cyclictest3154-21sshd10:05:522
3094799179,5cyclictest21339-21sshd09:27:151
3094799179,5cyclictest21339-21sshd09:27:141
3094799175,3cyclictest0-21swapper/111:28:031
3094799171,7cyclictest20259-21id12:06:511
3094799170,11cyclictest24307-21sshd10:18:011
3094999161,6cyclictest5688-21sort08:35:153
3094899162,9cyclictest23983-21sshd11:00:542
3094899162,7cyclictest27754-21sshd11:37:552
3094799164,11cyclictest10950irq/23-ehci_hcd07:42:241
3094799161,6cyclictest3177-21bash10:22:211
3094799160,11cyclictest0-21swapper/111:50:541
19642162,12sleep2135650irq/27-eth010:35:192
94212150,7sleep2135650irq/27-eth007:31:062
30949991511,3cyclictest0-21swapper/308:28:453
3094999150,7cyclictest0-21swapper/308:30:133
3094899150,6cyclictest0-21swapper/208:30:132
3094899150,6cyclictest0-21swapper/208:20:212
3094899150,13cyclictest0-21swapper/211:56:082
3094899150,12cyclictest0-21swapper/207:25:412
3094899150,12cyclictest0-21swapper/207:25:402
3094799150,13cyclictest0-21swapper/107:37:521
3094699150,14cyclictest0-21swapper/008:06:100
3094699150,12cyclictest0-21swapper/007:13:400
3094999146,6cyclictest0-21swapper/308:05:143
3094999146,4cyclictest135650irq/27-eth008:00:263
30949991410,3cyclictest10950irq/23-ehci_hcd08:21:503
3094999140,13cyclictest0-21swapper/307:45:113
3094999140,12cyclictest8449-21if_eth007:30:163
3094999140,10cyclictest30290-21dump-pmu-power08:20:003
3094899141,12cyclictest144550irq/28-eth1-rx-09:02:282
3094899140,2cyclictest0-21swapper/208:57:042
3094799147,3cyclictest10950irq/23-ehci_hcd08:15:161
3094799143,3cyclictest26950irq/26-ahci[00008:20:421
30947991410,3cyclictest10950irq/23-ehci_hcd08:02:431
3094799140,13cyclictest0-21swapper/107:23:591
30946991410,1cyclictest0-21swapper/007:23:330
3094699140,4cyclictest0-21swapper/008:30:560
3094699140,3cyclictest17603-21irqstats07:50:140
3094699140,1cyclictest0-21swapper/008:25:220
3094699140,13cyclictest0-21swapper/009:05:270
3094699140,13cyclictest0-21swapper/008:50:100
3094699140,13cyclictest0-21swapper/008:35:220
3094999139,3cyclictest10950irq/23-ehci_hcd08:41:033
3094999130,5cyclictest135650irq/27-eth008:52:243
3094999130,4cyclictest6186-21grep07:25:163
3094999130,4cyclictest6186-21grep07:25:153
3094999130,12cyclictest2405-21runrttasks07:17:113
3094999130,12cyclictest19397-21if_err_eth009:05:143
3094999130,12cyclictest161172sleep308:59:483
3094999130,12cyclictest10950irq/23-ehci_hcd08:45:403
3094999130,12cyclictest0-21swapper/309:01:123
3094999130,12cyclictest0-21swapper/307:40:053
3094899137,5cyclictest0-21swapper/207:49:232
3094899133,9cyclictest144550irq/28-eth1-rx-07:12:352
3094899133,2cyclictest0-21swapper/208:25:032
3094899132,2cyclictest0-21swapper/207:20:492
3094899131,9cyclictest0-21swapper/208:18:452
3094899131,11cyclictest135650irq/27-eth008:42:312
3094899130,1cyclictest135650irq/27-eth008:01:262
3094899130,12cyclictest12817-21munin-node08:50:182
3094899130,12cyclictest0-21swapper/208:37:062
3094899130,12cyclictest0-21swapper/208:05:492
3094899130,12cyclictest0-21swapper/207:56:222
3094899130,12cyclictest0-21swapper/207:51:212
3094899130,12cyclictest0-21swapper/207:40:522
3094899130,12cyclictest0-21swapper/207:35:352
3094899130,11cyclictest2405-21runrttasks08:46:012
3094799132,10cyclictest135650irq/27-eth008:35:541
30947991311,1cyclictest0-21swapper/108:10:221
3094799130,4cyclictest31228-21df07:10:121
3094799130,4cyclictest19809-21ntp_states09:05:201
3094799130,12cyclictest0-21swapper/109:01:031
3094799130,12cyclictest0-21swapper/108:55:561
3094799130,12cyclictest0-21swapper/108:25:201
3094799130,12cyclictest0-21swapper/108:07:201
3094799130,12cyclictest0-21swapper/107:59:281
3094799130,12cyclictest0-21swapper/107:30:031
3094799130,12cyclictest0-21swapper/107:15:171
3094799130,11cyclictest16826-21munin-node07:50:101
3094799130,10cyclictest10950irq/23-ehci_hcd07:45:381
3094699136,6cyclictest0-21swapper/008:45:160
30946991311,1cyclictest3-21ksoftirqd/008:55:170
30946991311,1cyclictest3-21ksoftirqd/007:55:180
30946991311,1cyclictest0-21swapper/009:00:450
30946991311,1cyclictest0-21swapper/007:35:000
3094699130,1cyclictest0-21swapper/008:00:450
3094699130,1cyclictest0-21swapper/007:17:260
3094699130,12cyclictest0-21swapper/008:16:500
3094699130,12cyclictest0-21swapper/007:41:440
3094699130,12cyclictest0-21swapper/007:30:480
3094999120,11cyclictest17583-21iostat07:50:133
3094999120,11cyclictest11101-21munin-node07:35:183
3094999120,11cyclictest0-21swapper/308:10:073
3094999120,11cyclictest0-21swapper/307:55:053
3094999120,10cyclictest4026-21munin-node07:20:163
3094999120,10cyclictest0-21swapper/307:10:143
3094899120,3cyclictest26711-21iostat_ios08:10:142
3094899120,11cyclictest20251-21munin-node09:05:232
3094899120,10cyclictest1050-21df07:15:152
3094799127,3cyclictest7593-21df_inode08:40:151
3094799127,3cyclictest0-21swapper/108:45:221
3094799120,3cyclictest3035-21diskstats08:30:121
3094799120,10cyclictest12967-21ntp_states08:50:181
3094699127,4cyclictest0-21swapper/008:20:440
3094699120,11cyclictest0-21swapper/008:40:020
3094699120,11cyclictest0-21swapper/007:45:210
3094699120,11cyclictest0-21swapper/007:25:160
3094699120,11cyclictest0-21swapper/007:25:150
3094699110,1cyclictest0-21swapper/008:10:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional