You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-08 - 23:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Sat Nov 08, 2025 12:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2933421500,0sleep029316-21sshd09:51:360
1752821440,1sleep010-21rcuc/012:30:460
1960121340,1sleep01104399cyclictest11:02:550
2377721270,2sleep21989-21lldpd11:43:182
568321250,2sleep35684-21sshd11:04:503
858521220,0sleep00-21swapper/011:19:060
3021021220,0sleep00-21swapper/011:21:150
2753621210,3sleep10-21swapper/112:28:481
1097121200,0sleep210972-21sshd10:02:372
1139321190,2sleep211387-21sshd12:09:162
2650021180,2sleep21847-21nfsd11:58:382
2218521090,2sleep222177-21sshd09:28:302
882621000,2sleep01844-21nfsd10:29:080
38842990,1sleep23883-21bash12:38:392
954329733,44sleep30-21swapper/307:05:153
291392970,0sleep01848-21nfsd11:27:400
1061929733,51sleep10-21swapper/107:07:381
158382960,2sleep10-21swapper/109:11:271
14832960,2sleep20-21swapper/209:13:232
89902950,2sleep28975-21sshd09:40:002
170232940,1sleep11105099cyclictest11:05:521
65512920,2sleep10-21swapper/109:43:001
194452910,3sleep119440-21rm10:53:141
99102880,1sleep01848-21nfsd12:06:010
267792880,2sleep10-21swapper/112:07:381
9842850,2sleep30-21swapper/310:44:553
215862850,1sleep01915-21snmpd11:33:220
186472850,1sleep018493-21sshd10:56:170
266782840,2sleep31989-21lldpd11:33:533
136782840,7sleep21915-21snmpd12:27:272
86112830,3sleep01104399cyclictest09:49:400
175232820,1sleep01104399cyclictest12:39:570
29482810,2sleep20-21swapper/209:58:372
211412810,2sleep21105699cyclictest10:40:202
157962800,2sleep115792-21bash11:12:511
23092790,1sleep30-21swapper/311:11:203
178942790,5sleep11105099cyclictest11:29:491
58822780,2sleep30-21swapper/310:05:183
221912780,5sleep31106199cyclictest12:04:163
230102770,1sleep30-21swapper/310:23:583
249222750,4sleep11105099cyclictest12:22:291
303382740,3sleep21105699cyclictest09:51:432
298332740,0sleep00-21swapper/009:12:570
32642730,2sleep10-21swapper/110:11:381
62502680,2sleep36162-21sshd10:11:563
248222660,1sleep30-21swapper/310:00:413
104402580,3sleep31106199cyclictest10:19:093
1065225434,8sleep20-21swapper/207:08:032
1076424133,4sleep00-21swapper/007:09:290
1104399398,7cyclictest3461-21sshd10:54:550
1104399372,33cyclictest4293-21sshd11:56:300
148912360,1sleep041ktimersoftd/009:21:060
1104399369,26cyclictest1959-21sshd11:47:260
1104399363,8cyclictest32447-21sshd11:40:520
1104399356,9cyclictest7022-21sshd10:02:120
1104399354,29cyclictest5936-21sshd12:23:470
1104399342,9cyclictest27817-21bash11:10:320
11061993325,6cyclictest1989-21lldpd12:31:473
1104399336,10cyclictest0-21swapper/011:06:180
1104399330,31cyclictest41ktimersoftd/010:18:570
11043993216,15cyclictest1846-21nfsd10:38:050
11043993216,15cyclictest1846-21nfsd10:38:040
1104399321,5cyclictest1847-21nfsd12:11:310
306202310,4sleep11105099cyclictest10:21:031
11056993115,5cyclictest26950irq/26-ahci[00012:24:172
1104399315,24cyclictest4667-21sshd10:11:460
1104399312,1cyclictest18096-21bash09:28:050
1104399311,29cyclictest1915-21snmpd11:53:550
60182300,28sleep1135650irq/27-eth011:56:401
50732300,2sleep30-21swapper/311:28:313
14112300,4sleep30-21swapper/309:32:443
142012290,4sleep31106199cyclictest11:05:343
11043992918,9cyclictest1848-21nfsd09:38:090
11043992910,7cyclictest135650irq/27-eth010:23:490
11043992910,18cyclictest0-21swapper/010:09:240
1104399290,2cyclictest0-21swapper/012:25:080
50322280,1sleep20-21swapper/210:25:212
150182280,26sleep3135650irq/27-eth012:09:373
11061992814,3cyclictest135650irq/27-eth012:20:293
1104399288,10cyclictest1989-21lldpd11:36:210
1104399283,22cyclictest31100-21sshd10:41:200
1104399282,20cyclictest1915-21snmpd12:01:190
1104399281,16cyclictest41ktimersoftd/010:31:420
130022270,24sleep1135650irq/27-eth012:36:251
120222270,25sleep3135650irq/27-eth011:22:443
111812270,25sleep2135650irq/27-eth012:33:192
11043992715,9cyclictest1847-21nfsd12:15:210
1104399270,7cyclictest1846-21nfsd10:47:550
11061992613,3cyclictest135650irq/27-eth011:53:183
11056992614,3cyclictest1959-21sshd11:11:532
11050992616,3cyclictest10950irq/23-ehci_hcd12:14:581
284812250,23sleep3135650irq/27-eth009:29:083
19812250,0sleep31971-21sshd12:26:213
175822250,1sleep041ktimersoftd/009:18:180
11061992511,6cyclictest135650irq/27-eth010:59:173
1105699255,4cyclictest144550irq/28-eth1-rx-11:18:302
1105699254,3cyclictest10950irq/23-ehci_hcd10:55:142
11056992520,4cyclictest26221-21sshd10:20:372
1105699250,22cyclictest33-21ksoftirqd/210:33:312
11050992513,4cyclictest1915-21snmpd12:04:041
1104399255,11cyclictest12332-21sshd09:40:160
82882240,2sleep18277-21sshd11:38:321
68872240,21sleep1135650irq/27-eth009:55:431
1106199249,5cyclictest135650irq/27-eth012:12:033
1105699246,3cyclictest26950irq/26-ahci[00011:25:042
1105699242,20cyclictest33-21ksoftirqd/211:46:062
1105699241,3cyclictest21401-21sshd11:03:062
1105699240,22cyclictest33-21ksoftirqd/211:38:382
11050992421,2cyclictest0-21swapper/110:08:451
1104399246,8cyclictest0-21swapper/009:31:210
1104399245,10cyclictest2887-21cp09:58:360
11056992315,5cyclictest27974-21sshd10:17:332
11056992312,3cyclictest31755-21sshd11:24:462
1105699231,20cyclictest33-21ksoftirqd/209:43:452
1105699230,21cyclictest33-21ksoftirqd/211:50:222
1105699230,21cyclictest33-21ksoftirqd/211:09:552
1105099238,7cyclictest135650irq/27-eth011:20:471
11050992319,2cyclictest0-21swapper/110:04:571
11043992316,3cyclictest28654-21awk09:00:000
39492223,17sleep1135650irq/27-eth011:47:301
1106199222,10cyclictest19722-21sshd10:37:053
1106199222,10cyclictest19722-21sshd10:37:043
11056992216,4cyclictest22149-21bash12:04:152
11056992216,4cyclictest19122-21sshd10:53:132
11056992215,4cyclictest22133-21bash11:30:122
11056992214,5cyclictest2773-21sshd10:35:202
11056992214,5cyclictest2773-21sshd10:35:192
11056992213,3cyclictest0-21swapper/209:34:082
1105699221,18cyclictest33-21ksoftirqd/212:11:402
1105699220,19cyclictest3953-21sshd10:45:112
11050992213,7cyclictest1848-21nfsd10:43:491
11050992213,5cyclictest0-21swapper/112:34:531
11050992212,4cyclictest7034-21sshd12:17:511
11050992211,5cyclictest135650irq/27-eth010:28:581
170212210,0sleep31846-21nfsd10:53:003
11061992118,2cyclictest0-21swapper/312:35:193
1105699212,17cyclictest33-21ksoftirqd/212:16:152
11056992112,7cyclictest27005-21bash10:10:432
11056992110,4cyclictest13814-21bash10:06:042
1105099217,5cyclictest1915-21snmpd11:32:061
11050992114,5cyclictest1989-21lldpd11:50:121
296182200,18sleep3135650irq/27-eth009:58:023
1106199209,5cyclictest10950irq/23-ehci_hcd09:23:213
1106199209,2cyclictest1989-21lldpd11:20:003
1106199203,8cyclictest23113-21cp11:40:023
1106199201,8cyclictest1989-21lldpd11:47:203
11056992015,3cyclictest31607-21sshd09:22:492
11056992011,3cyclictest13446-21rm09:46:512
1105099202,3cyclictest1847-21nfsd11:00:171
226892191,16sleep3135650irq/27-eth009:12:133
1106199192,15cyclictest135650irq/27-eth011:57:053
1106199190,8cyclictest1915-21snmpd11:39:373
1105099198,9cyclictest0-21swapper/109:50:391
11050991913,5cyclictest11160-21sshd09:33:411
11050991911,5cyclictest1989-21lldpd11:41:191
1105099190,9cyclictest13581-21sshd10:36:251
1105099190,9cyclictest13581-21sshd10:36:241
1105099190,6cyclictest2056-21sshd10:18:131
1106199181,14cyclictest773-21bash10:48:083
1106199180,12cyclictest0-21swapper/310:27:043
1105099183,2cyclictest27514-21sshd09:25:441
1105099181,11cyclictest0-21swapper/111:15:411
1105099180,7cyclictest135650irq/27-eth010:33:031
269222170,15sleep1135650irq/27-eth009:38:331
1106199179,1cyclictest0-21swapper/309:40:253
1106199176,1cyclictest26257-21bash09:51:183
11061991712,3cyclictest27981-21sshd09:19:203
1106199170,5cyclictest135650irq/27-eth012:15:393
1106199170,12cyclictest21502-21sshd09:37:583
1105099176,6cyclictest144550irq/28-eth1-rx-10:46:551
11050991713,3cyclictest10950irq/23-ehci_hcd09:17:211
11050991713,2cyclictest5902-21sshd09:46:051
1106199163,4cyclictest26195-21bash10:30:493
1106199163,12cyclictest10950irq/23-ehci_hcd08:37:393
1106199160,14cyclictest0-21swapper/309:05:183
1105699166,9cyclictest16062-21ls08:30:182
1105699164,10cyclictest14180-21munin-node07:15:152
11056991612,3cyclictest47-21rcuop/309:16:592
1105099163,4cyclictest1902-21nscd09:23:391
11050991611,3cyclictest1847-21nfsd10:59:011
1106199153,4cyclictest10950irq/23-ehci_hcd08:46:593
11061991511,3cyclictest10216-21seq08:17:563
11061991510,0cyclictest0-21swapper/309:46:113
11056991511,3cyclictest10950irq/23-ehci_hcd08:57:002
11050991511,2cyclictest0-21swapper/107:45:151
1104399150,14cyclictest0-21swapper/007:15:120
1106199143,8cyclictest0-21swapper/307:48:203
1106199143,10cyclictest10950irq/23-ehci_hcd08:51:563
11061991411,2cyclictest10950irq/23-ehci_hcd08:02:073
11061991410,3cyclictest22463-21runrttasks07:35:013
1106199140,4cyclictest135650irq/27-eth008:57:003
1106199140,12cyclictest26680-21sshd07:43:403
1106199140,12cyclictest0-21swapper/308:40:133
11056991410,3cyclictest10950irq/23-ehci_hcd08:20:282
1105699140,13cyclictest0-21swapper/208:05:182
1105699140,12cyclictest0-21swapper/207:55:162
1105099143,10cyclictest10950irq/23-ehci_hcd08:35:221
1105099143,10cyclictest10950irq/23-ehci_hcd08:03:201
11050991410,3cyclictest10950irq/23-ehci_hcd08:08:251
1104399147,1cyclictest0-21swapper/008:00:000
1104399145,1cyclictest3-21ksoftirqd/008:25:230
1104399144,1cyclictest3-21ksoftirqd/008:20:000
11043991412,1cyclictest3-21ksoftirqd/008:39:240
1106199132,10cyclictest135650irq/27-eth007:21:093
11061991311,1cyclictest0-21swapper/307:30:183
1106199130,5cyclictest0-21swapper/308:10:343
1106199130,2cyclictest0-21swapper/308:20:503
1106199130,12cyclictest4057-21sh08:05:133
1106199130,12cyclictest0-21swapper/309:00:423
1106199130,12cyclictest0-21swapper/308:30:463
1106199130,12cyclictest0-21swapper/308:26:173
1106199130,12cyclictest0-21swapper/307:55:413
1106199130,12cyclictest0-21swapper/307:54:583
1106199130,11cyclictest19227-21munin-node07:25:223
1106199130,11cyclictest12245-21ntp_states07:10:193
1105699139,3cyclictest135650irq/27-eth009:07:082
1105699131,1cyclictest135650irq/27-eth007:31:572
11056991311,1cyclictest0-21swapper/208:15:252
11056991311,1cyclictest0-21swapper/207:48:332
1105699130,5cyclictest0-21swapper/208:25:162
1105699130,5cyclictest0-21swapper/207:35:282
1105699130,12cyclictest0-21swapper/209:03:082
1105699130,12cyclictest0-21swapper/208:50:282
1105699130,12cyclictest0-21swapper/208:45:062
1105699130,12cyclictest0-21swapper/208:41:082
1105699130,12cyclictest0-21swapper/208:35:362
1105699130,12cyclictest0-21swapper/208:13:562
1105699130,12cyclictest0-21swapper/207:40:312
1105699130,12cyclictest0-21swapper/207:20:182
1105699130,11cyclictest18097-21cpuspeed_turbos07:25:142
1105099137,5cyclictest0-21swapper/108:56:211
1105099137,4cyclictest20979-21iostat_ios07:30:191
1105099133,10cyclictest10950irq/23-ehci_hcd07:53:051
1105099130,12cyclictest32294-21hwlatdetect07:55:181
1105099130,12cyclictest1848-21nfsd08:45:031
1105099130,12cyclictest1848-21nfsd07:26:461
1105099130,12cyclictest12581-21timerwakeupswit07:10:221
1105099130,12cyclictest0-21swapper/109:08:391
1105099130,12cyclictest0-21swapper/108:26:301
1105099130,12cyclictest0-21swapper/108:20:431
1105099130,12cyclictest0-21swapper/107:21:021
1105099130,12cyclictest0-21swapper/107:17:241
1105099130,11cyclictest8666-21df_inode08:15:151
1105099130,11cyclictest6347-21df08:10:151
1105099130,11cyclictest25090-21df_inode07:40:131
1105099130,11cyclictest24625-21df_inode08:50:131
1105099130,11cyclictest0-21swapper/107:35:171
1104399139,1cyclictest0-21swapper/008:50:200
1104399137,6cyclictest0-21swapper/009:09:440
11043991311,1cyclictest0-21swapper/008:10:240
1104399130,8cyclictest0-21swapper/007:50:090
1104399130,3cyclictest0-21swapper/009:00:180
1104399130,1cyclictest0-21swapper/008:06:250
1104399130,12cyclictest18840-21munin-node07:25:180
1104399130,12cyclictest0-21swapper/008:40:010
1104399130,12cyclictest0-21swapper/008:33:510
1104399130,12cyclictest0-21swapper/008:04:000
1104399130,12cyclictest0-21swapper/007:20:470
1104399130,12cyclictest0-21swapper/007:13:330
1104399130,11cyclictest0-21swapper/008:45:100
1106199120,11cyclictest0-21swapper/307:15:333
1105699127,4cyclictest29328-21aten_r5power_fr07:50:132
1105699121,10cyclictest135650irq/27-eth008:00:362
1105699120,10cyclictest11368-21df07:10:122
1105099120,11cyclictest15458-21df08:30:141
1105099120,11cyclictest0-21swapper/109:00:101
1105099120,11cyclictest0-21swapper/108:40:041
1104399126,3cyclictest0-21swapper/007:35:180
11043991210,1cyclictest0-21swapper/008:20:420
1104399120,1cyclictest0-21swapper/007:45:480
1104399120,1cyclictest0-21swapper/007:43:550
1104399120,1cyclictest0-21swapper/007:30:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional