You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-03 - 14:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Thu Jul 03, 2025 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1705721880,6sleep02150399cyclictest09:55:180
1159121640,2sleep02150399cyclictest11:52:060
133821610,0sleep01337-21bash09:53:450
2713821550,2sleep225-21rcuop/111:34:012
1838121550,0sleep21847-21nfsd10:45:302
2924521530,1sleep02150399cyclictest12:18:360
2545721520,1sleep30-21swapper/311:47:093
1285021460,1sleep22151199cyclictest12:05:112
989621440,1sleep02150399cyclictest12:10:510
750821430,3sleep22151199cyclictest11:35:162
2378821420,4sleep32151399cyclictest09:14:443
2378821420,4sleep32151399cyclictest09:14:443
87921410,0sleep00-21swapper/011:00:440
2362321400,0sleep223624-21sshd11:23:182
375421390,1sleep01847-21nfsd11:34:580
2416221390,4sleep10-21swapper/112:12:111
711421370,0sleep01848-21nfsd10:51:170
2822421350,1sleep10-21swapper/111:50:301
1406921350,2sleep214067-21sshd10:31:232
976221280,1sleep10-21swapper/110:41:001
466621250,3sleep22151199cyclictest11:51:252
379721220,1sleep10-21swapper/109:33:391
2766021220,2sleep10-21swapper/110:39:361
2941521190,1sleep11848-21nfsd11:30:421
2289221130,1sleep30-21swapper/310:29:033
3098121110,3sleep22151199cyclictest10:20:002
1729921100,2sleep217298-21sshd12:38:142
2270921080,4sleep32151399cyclictest09:59:133
1776821020,2sleep02150399cyclictest10:08:360
1709121000,2sleep317089-21sshd12:08:373
207692990,1sleep020750-21sshd09:35:220
242942980,2sleep11848-21nfsd10:19:201
244582970,1sleep124447-21smart_sda11:40:251
2113129739,54sleep10-21swapper/107:08:331
303702960,1sleep31848-21nfsd12:33:343
284482960,2sleep20-21swapper/211:44:182
272252960,2sleep20-21swapper/209:35:592
73842950,5sleep02150399cyclictest12:07:420
2102029435,55sleep30-21swapper/307:07:113
201622940,0sleep21847-21nfsd11:02:532
316672930,2sleep331652-21sshd11:34:293
176082920,1sleep30-21swapper/310:15:163
305632900,2sleep130562-21sshd10:33:111
236542900,4sleep02150399cyclictest10:29:080
219762890,1sleep021973-21sshd12:38:410
137782890,1sleep013772-21bash10:55:220
137782890,1sleep013772-21bash10:55:220
82072880,0sleep20-21swapper/212:10:402
119082880,2sleep311907-21sshd09:20:173
305332860,3sleep32151399cyclictest11:41:023
279782860,1sleep10-21swapper/112:36:121
109872860,2sleep20-21swapper/212:28:532
94242850,2sleep39423-21sshd11:35:253
41612820,1sleep20-21swapper/209:12:382
41612820,1sleep20-21swapper/209:12:382
237812810,4sleep22151199cyclictest10:02:412
310402790,2sleep20-21swapper/212:15:422
78692770,0sleep041ktimersoftd/009:00:190
19792770,2sleep00-21swapper/011:48:020
118932770,2sleep111891-21bash10:27:531
69562760,1sleep30-21swapper/310:51:163
275062760,1sleep00-21swapper/010:46:280
255192750,2sleep32151399cyclictest10:42:513
198092730,2sleep10-21swapper/112:17:401
254612720,5sleep32151399cyclictest07:15:273
138182720,70sleep126950irq/26-ahci[00011:12:231
58082710,12sleep0135650irq/27-eth009:23:140
290032710,5sleep02150399cyclictest10:36:180
169682710,4sleep32151399cyclictest10:45:243
123252710,3sleep32151399cyclictest12:01:393
293342690,3sleep02150399cyclictest09:18:510
264212690,1sleep00-21swapper/011:26:490
158222660,2sleep315821-21sshd11:29:293
316592650,1sleep10-21swapper/112:03:421
293242650,6sleep12150699cyclictest11:17:161
110172600,0sleep311012-21sshd12:20:003
205482590,6sleep010-21rcuc/012:32:400
2101225735,11sleep00-21swapper/007:07:040
2124725235,12sleep20-21swapper/207:09:582
168162480,5sleep32151399cyclictest10:21:473
248692440,2sleep10-21swapper/111:06:451
196882420,1sleep10-21swapper/110:52:381
291822370,4sleep20-21swapper/210:39:442
2150399378,25cyclictest3-21ksoftirqd/011:41:240
21503993611,24cyclictest3-21ksoftirqd/011:36:150
21503993513,12cyclictest3-21ksoftirqd/011:14:570
139192350,4sleep32151399cyclictest08:05:003
123132350,0sleep112314-21bash10:14:431
311962340,4sleep20-21swapper/210:16:402
2150399332,20cyclictest0-21swapper/009:13:410
2150399332,20cyclictest0-21swapper/009:13:410
21503993310,20cyclictest18634-21id11:06:050
2150399330,24cyclictest3352-21id12:28:100
266082320,4sleep22151199cyclictest11:47:152
21513993227,3cyclictest0-21swapper/312:22:443
21503993215,14cyclictest3-21ksoftirqd/011:20:070
21503993212,18cyclictest3-21ksoftirqd/010:20:220
2150399320,1cyclictest20523-21sshd12:02:290
2150399315,24cyclictest3-21ksoftirqd/010:32:140
2150399301,28cyclictest0-21swapper/009:31:540
2150399301,25cyclictest0-21swapper/010:16:480
21506992926,1cyclictest0-21swapper/109:22:021
21503992919,5cyclictest5460-21bash10:10:330
21503992915,12cyclictest3-21ksoftirqd/011:15:430
21503992912,15cyclictest3-21ksoftirqd/010:44:180
109422290,0sleep041ktimersoftd/010:04:440
49112280,26sleep1135650irq/27-eth009:19:401
278662280,2sleep227865-21sshd09:32:422
21506992812,4cyclictest21102-21sshd11:56:111
21506992811,4cyclictest135650irq/27-eth009:29:061
209392280,2sleep10-21swapper/112:08:591
131132280,0sleep30-21swapper/309:44:513
21506992718,2cyclictest135650irq/27-eth012:30:171
21506992710,10cyclictest22-21ksoftirqd/111:38:371
2150399279,13cyclictest3-21ksoftirqd/009:46:420
21503992713,12cyclictest3-21ksoftirqd/012:20:260
2150399271,2cyclictest1847-21nfsd11:57:250
21503992710,8cyclictest3-21ksoftirqd/009:41:070
16702270,3sleep30-21swapper/311:07:443
124182270,3sleep20-21swapper/210:55:172
124182270,3sleep20-21swapper/210:55:162
117702271,24sleep3135650irq/27-eth011:15:263
2150399269,16cyclictest3-21ksoftirqd/009:27:430
151212260,2sleep30-21swapper/311:02:233
21513992518,4cyclictest1847-21nfsd09:32:583
2150699259,3cyclictest11641-21bash11:28:541
2150699249,3cyclictest10950irq/23-ehci_hcd10:21:271
2150699246,6cyclictest10950irq/23-ehci_hcd09:43:251
2150699241,22cyclictest22-21ksoftirqd/109:57:121
98332230,1sleep20-21swapper/209:44:292
79642230,18sleep3135650irq/27-eth010:30:453
2151399237,8cyclictest135650irq/27-eth010:56:563
2151399237,8cyclictest135650irq/27-eth010:56:563
21511992320,2cyclictest1845-21nfsd09:53:282
2150699237,6cyclictest16545-21sshd09:45:111
2150699236,3cyclictest27383-21chrt12:24:301
2150699232,7cyclictest0-21swapper/112:29:351
21506992312,8cyclictest135650irq/27-eth011:04:171
164592230,1sleep32151399cyclictest11:55:423
46302220,0sleep30-21swapper/310:07:153
2151399229,5cyclictest10950irq/23-ehci_hcd09:17:003
2150699229,5cyclictest14038-21sshd10:05:001
2150699229,10cyclictest0-21swapper/110:02:081
2150699226,6cyclictest135650irq/27-eth011:45:011
2150699226,3cyclictest28084-21bash11:20:241
2150699223,4cyclictest5683-21sshd09:50:471
2150699221,9cyclictest0-21swapper/110:48:211
21506992210,9cyclictest22-21ksoftirqd/109:12:591
21506992210,9cyclictest22-21ksoftirqd/109:12:591
87682210,2sleep38766-21sshd11:51:493
2151399211,10cyclictest0-21swapper/310:14:023
2151199219,5cyclictest10950irq/23-ehci_hcd12:22:142
2151199218,5cyclictest10950irq/23-ehci_hcd11:55:382
21511992113,5cyclictest1845-21nfsd10:07:072
2150699212,6cyclictest32601-21sshd09:36:331
2150699211,5cyclictest10965-21sshd10:58:331
2150699211,5cyclictest10965-21sshd10:58:331
2151399208,3cyclictest15164-21sshd12:29:153
21513992014,4cyclictest6027-21bash11:21:283
21513992011,4cyclictest9445-21sshd09:27:083
2151399200,17cyclictest135650irq/27-eth009:47:283
2151199208,10cyclictest27835-21sshd11:07:062
2151199204,6cyclictest10950irq/23-ehci_hcd09:15:212
21511992014,4cyclictest11424-21sshd10:27:512
21511992013,6cyclictest6953-21sshd12:01:052
21511992010,5cyclictest10950irq/23-ehci_hcd10:53:592
231862190,17sleep3135650irq/27-eth010:35:423
2151399199,2cyclictest11343-21sshd09:37:493
2151399195,5cyclictest0-21swapper/310:02:123
2151399192,6cyclictest31999-21bash12:10:013
21513991913,4cyclictest135650irq/27-eth012:39:163
2151199199,2cyclictest11544-21sshd09:23:562
2151199197,8cyclictest24334-21sshd11:10:092
2151199192,8cyclictest0-21swapper/211:25:062
21511991912,2cyclictest10950irq/23-ehci_hcd11:16:432
2151199190,17cyclictest10387-21sshd12:31:422
2150699192,3cyclictest2611-21latency_hist07:40:011
211672190,2sleep22405-21runrttasks08:20:132
2151399186,3cyclictest135650irq/27-eth009:51:533
2151199187,4cyclictest10950irq/23-ehci_hcd09:26:002
21511991812,4cyclictest28965-21bash09:46:222
21511991812,4cyclictest25624-21sshd09:56:062
21511991810,5cyclictest19389-21sshd10:12:032
2150399186,9cyclictest0-21swapper/008:26:110
2150399180,17cyclictest0-21swapper/007:35:110
2150399180,14cyclictest0-21swapper/008:50:150
2151399170,5cyclictest27851-21sshd11:13:513
21511991714,2cyclictest27224-21sshd10:43:022
21511991713,3cyclictest1848-21nfsd08:46:442
2150399170,7cyclictest0-21swapper/008:42:580
2150399170,16cyclictest0-21swapper/009:07:260
2150399170,16cyclictest0-21swapper/008:30:510
2150399170,14cyclictest0-21swapper/007:40:030
2150399167,4cyclictest5118-21atenall_r5power07:45:130
2150399161,12cyclictest0-21swapper/007:55:000
2150399160,1cyclictest0-21swapper/008:02:480
2150399160,15cyclictest0-21swapper/008:35:340
2150399160,15cyclictest0-21swapper/008:15:530
2150399160,15cyclictest0-21swapper/007:55:200
2150399160,15cyclictest0-21swapper/007:20:180
2150399160,14cyclictest0-21swapper/008:56:230
2151399156,3cyclictest10950irq/23-ehci_hcd08:40:173
2151399150,13cyclictest17090-21grep08:10:143
2151399150,13cyclictest0-21swapper/307:55:213
2151199150,14cyclictest144550irq/28-eth1-rx-08:42:172
2150699157,5cyclictest28122-21munin-run07:25:001
2150699154,1cyclictest0-21swapper/108:44:221
2150699151,12cyclictest0-21swapper/107:50:231
2150399157,7cyclictest0-21swapper/008:10:590
2150399156,3cyclictest30890-21df07:30:140
2150399151,2cyclictest28780-21fschecks_count07:25:140
2150399150,9cyclictest0-21swapper/008:05:130
2150399150,14cyclictest0-21swapper/008:49:590
2150399150,12cyclictest0-21swapper/008:21:030
2150399150,12cyclictest0-21swapper/007:16:120
2151399148,5cyclictest0-21swapper/308:30:343
2151399143,10cyclictest1915-21snmpd07:28:133
21513991410,3cyclictest10950irq/23-ehci_hcd08:21:163
21513991410,3cyclictest10950irq/23-ehci_hcd08:18:443
2151399140,12cyclictest25049-21chrt08:27:153
2151399140,12cyclictest1729-21runrttasks08:47:333
2151199141,1cyclictest0-21swapper/208:27:402
2151199140,13cyclictest0-21swapper/208:10:162
2151199140,13cyclictest0-21swapper/207:50:162
2151199140,12cyclictest11017-21sshd09:09:132
2151199140,11cyclictest0-21swapper/208:05:312
2150699141,4cyclictest24385-21ntp_states08:25:221
21506991412,1cyclictest0-21swapper/108:15:371
2150699141,12cyclictest0-21swapper/108:56:411
2150699141,12cyclictest0-21swapper/108:31:221
2150699141,12cyclictest0-21swapper/108:21:141
2150699141,12cyclictest0-21swapper/108:11:481
2150699141,12cyclictest0-21swapper/108:08:291
2150699141,12cyclictest0-21swapper/107:33:141
2150399143,10cyclictest0-21swapper/007:11:260
2151399139,3cyclictest10950irq/23-ehci_hcd07:10:173
2151399137,5cyclictest0-21swapper/307:32:253
2151399137,4cyclictest4532-21atenall_r5power08:55:123
2151399137,2cyclictest29444-21taskset08:35:303
2151399135,4cyclictest10950irq/23-ehci_hcd07:50:133
21513991311,1cyclictest0-21swapper/307:38:223
2151399130,5cyclictest0-21swapper/307:44:013
2151399130,4cyclictest1927-21snmpd09:08:103
2151399130,11cyclictest6206-21ntp_states07:45:203
2151399130,11cyclictest26395-21df_inode07:20:123
2151399130,11cyclictest14933-21irqstats08:05:173
2151199139,4cyclictest144550irq/28-eth1-rx-07:38:482
2151199139,3cyclictest135650irq/27-eth008:55:212
2151199139,3cyclictest135650irq/27-eth008:51:122
2151199139,3cyclictest135650irq/27-eth008:32:242
2151199139,3cyclictest135650irq/27-eth007:55:132
2151199134,8cyclictest144550irq/28-eth1-rx-07:12:412
2151199133,7cyclictest144550irq/28-eth1-rx-07:30:212
2151199131,11cyclictest144550irq/28-eth1-rx-08:35:412
21511991311,1cyclictest0-21swapper/209:00:462
2151199130,4cyclictest23827-21atenall_r5power07:15:122
2151199130,12cyclictest0-21swapper/208:15:342
2151199130,12cyclictest0-21swapper/208:02:462
2151199130,12cyclictest0-21swapper/207:47:012
2151199130,12cyclictest0-21swapper/207:25:132
2151199130,11cyclictest26661-21fschecks_time07:20:132
2150699138,3cyclictest24471-21hddtemp_smartct07:15:151
2150699135,5cyclictest10788-21pmu-power07:55:201
2150699132,10cyclictest10950irq/23-ehci_hcd08:35:341
2150699131,11cyclictest3866-21users08:50:251
2150699131,11cyclictest0-21swapper/109:00:411
2150699131,11cyclictest0-21swapper/108:47:251
2150699131,10cyclictest0-21swapper/108:00:131
2150699131,10cyclictest0-21swapper/107:45:281
2150699131,10cyclictest0-21swapper/107:25:121
2150699130,4cyclictest9824-21irqstats09:05:141
2150699130,11cyclictest1847-21nfsd07:40:221
2151399120,1cyclictest1848-21nfsd08:50:153
2151399120,10cyclictest0-21swapper/309:00:143
2151199126,3cyclictest10950irq/23-ehci_hcd07:40:142
2150699121,2cyclictest0-21swapper/107:14:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional