You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-03 - 13:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackaslot0.osadl.org (updated Sat May 03, 2025 00:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
116772870,0sleep30-21swapper/321:37:513
207852840,0sleep30-21swapper/300:29:173
124742810,1sleep112473-21sshd21:46:111
183912570,1sleep218384-21sshd21:16:072
11532550,0sleep30-21swapper/321:56:173
294812540,1sleep129456-21sshd00:36:121
201552540,1sleep30-21swapper/322:28:303
192592530,1sleep319258-21sshd21:30:143
173972530,0sleep20-21swapper/221:21:392
218392520,1sleep119-21rcuc/100:23:101
141662520,0sleep214161-21sshd23:34:352
117752520,0sleep30-21swapper/322:50:423
316952510,1sleep131677-21sshd21:58:571
253112510,1sleep125310-21sshd21:52:521
121742510,0sleep30-21swapper/322:05:273
4512500,1sleep2444-21sshd23:47:462
327602500,1sleep232749-21sshd21:39:422
293162500,0sleep228-21rcuc/221:47:392
272482500,0sleep20-21swapper/223:58:472
79732490,1sleep00-21swapper/021:12:290
70392490,0sleep00-21swapper/000:02:580
316342490,1sleep331630-21bash22:21:013
1786824926,19sleep20-21swapper/219:06:522
15972490,0sleep110924-21diskmemload22:41:101
145562490,0sleep114512-21sshd23:20:121
145562490,0sleep114512-21sshd23:20:121
327112480,0sleep00-21swapper/023:44:550
227802480,0sleep122776-21bash22:54:401
311282470,0sleep00-21swapper/021:42:160
1783724724,19sleep30-21swapper/319:06:283
1781924724,19sleep00-21swapper/019:06:120
1599224624,18sleep10-21swapper/119:05:101
295632440,2sleep21836399cyclictest00:01:522
167182440,0sleep016720-21bash21:57:390
156822430,0sleep30-21swapper/300:03:483
36422360,1sleep01835799cyclictest22:35:320
205442310,0sleep10-21swapper/122:48:391
13432270,0sleep31342-21sshd21:14:433
178442230,4sleep1115950irq/25-eth022:00:251
1836899210,1cyclictest115950irq/25-eth022:48:143
1836899209,7cyclictest0-21swapper/300:18:203
18363992018,1cyclictest0-21swapper/200:32:152
18360992019,1cyclictest19508-21bash22:39:591
1836899197,8cyclictest4327-21sshd22:44:223
1836899194,14cyclictest1539-21id23:27:413
1836899193,7cyclictest10924-21diskmemload23:06:043
1836899191,1cyclictest115950irq/25-eth000:30:373
1836899190,2cyclictest6081-21sshd23:13:343
1836899190,2cyclictest1055-21sshd21:17:293
1836899190,1cyclictest0-21swapper/321:43:113
1836899190,1cyclictest0-21swapper/321:29:553
18357991918,1cyclictest19862-21sshd00:32:150
1836899188,5cyclictest2751-21sshd23:47:583
1836899188,5cyclictest0-21swapper/322:12:443
1836899181,1cyclictest27642-21bash21:50:183
1836899181,1cyclictest10150irq/24-ahci[00023:23:503
1836899181,1cyclictest10150irq/24-ahci[00023:23:503
1836899180,9cyclictest27290-21apache_volume23:50:123
1836899180,2cyclictest28197-21bash23:00:553
1836899180,2cyclictest18551-21bash21:21:463
1836899180,2cyclictest10198-21sshd22:02:333
1836899180,1cyclictest2392-21sshd23:30:343
1836899180,1cyclictest0-21swapper/322:39:063
1836899180,1cyclictest0-21swapper/322:30:553
65752170,1sleep21722-21runrttasks22:56:022
18368991711,5cyclictest0-21swapper/322:56:563
1836899170,9cyclictest5636-21sshd00:05:483
1836899170,9cyclictest2602-21sshd23:16:063
1836899170,9cyclictest0-21swapper/300:36:083
1836899170,2cyclictest19730-21sshd23:35:053
1836899170,1cyclictest115950irq/25-eth023:44:363
1836899170,1cyclictest0-21swapper/322:16:343
1836899170,16cyclictest0-21swapper/300:12:023
1836899170,15cyclictest0-21swapper/300:23:293
77352160,1sleep07696-21sshd21:18:060
281572160,0sleep228156-21bash22:18:012
1836899161,8cyclictest0-21swapper/323:55:223
1836899161,1cyclictest115950irq/25-eth021:45:263
18360991615,1cyclictest25006-21sshd23:47:031
277072150,0sleep10-21swapper/121:11:211
18492150,0sleep20-21swapper/222:46:572
18368991512,2cyclictest19593-21perf20:19:593
1836899151,1cyclictest0-21swapper/320:25:153
1836399150,14cyclictest3634-21sshd21:42:422
18360991512,2cyclictest32035-21sshd00:30:191
1835799151,1cyclictest0-21swapper/022:30:530
1835799150,1cyclictest1505-21nfsd23:10:330
1835799150,14cyclictest25216-21sshd21:30:390
1835799150,14cyclictest15596-21sshd22:03:030
1835799150,11cyclictest0-21swapper/021:46:010
24402140,1sleep20-21swapper/200:15:102
1836399148,1cyclictest0-21swapper/221:13:492
1836399140,13cyclictest30963-21sshd23:12:522
1836099147,1cyclictest0-21swapper/100:27:201
1836099141,1cyclictest115950irq/25-eth023:55:431
1836099140,5cyclictest0-21swapper/121:27:321
1836099140,13cyclictest0-21swapper/123:44:171
1835799149,4cyclictest28955-21sshd23:35:480
1835799148,5cyclictest22439-21sshd23:46:490
1835799148,4cyclictest0-21swapper/023:55:430
1835799140,5cyclictest0-21swapper/000:09:230
1835799140,13cyclictest25535-21bash23:26:540
1835799140,13cyclictest25529-21bash23:03:390
1835799140,13cyclictest0-21swapper/022:26:560
1835799140,13cyclictest0-21swapper/022:11:500
163212140,1sleep016296-21sshd22:19:500
1836399139,3cyclictest0-21swapper/221:28:372
1836399138,4cyclictest0-21swapper/221:32:582
1836399130,4cyclictest32654-21cp23:36:082
1836399130,12cyclictest25751-21cat23:15:172
1836399130,12cyclictest18132-21sshd00:07:042
1836399130,12cyclictest0-21swapper/223:23:412
1836399130,12cyclictest0-21swapper/223:23:412
1836099139,1cyclictest16933-21sshd23:11:321
1836099139,1cyclictest0-21swapper/123:36:031
1836099139,1cyclictest0-21swapper/122:27:171
1836099139,1cyclictest0-21swapper/122:17:431
1836099139,1cyclictest0-21swapper/100:05:561
1836099133,1cyclictest1988-21sshd23:33:301
1836099132,1cyclictest115950irq/25-eth022:32:501
1836099131,1cyclictest115950irq/25-eth023:52:241
1836099131,1cyclictest115950irq/25-eth021:42:511
1836099131,1cyclictest115950irq/25-eth021:38:211
1836099131,1cyclictest115950irq/25-eth021:33:251
18360991311,1cyclictest19962-21sshd00:00:571
1836099130,2cyclictest27585-21sshd23:27:041
1836099130,2cyclictest18928-21sshd23:00:111
1836099130,2cyclictest1722-21runrttasks23:07:531
1836099130,1cyclictest8137-21sshd22:10:411
1836099130,12cyclictest0-21swapper/121:20:541
1836099130,12cyclictest0-21swapper/121:15:251
1836099130,12cyclictest0-21swapper/120:05:191
1836099130,10cyclictest115950irq/25-eth000:10:351
1835799139,3cyclictest0-21swapper/023:34:130
1835799132,10cyclictest0-21swapper/023:50:150
18357991311,1cyclictest23712-21kworker/0:022:45:510
1835799130,3cyclictest0-21swapper/022:53:260
1835799130,1cyclictest17094-21sshd22:05:530
1835799130,1cyclictest115950irq/25-eth000:14:140
1835799130,13cyclictest16010-21sshd21:24:250
1835799130,12cyclictest25866-21sshd23:24:060
1835799130,12cyclictest25866-21sshd23:24:060
1835799130,12cyclictest0-21swapper/022:41:140
1835799130,12cyclictest0-21swapper/021:54:480
1835799130,12cyclictest0-21swapper/000:21:200
1836899120,8cyclictest17219-21munin-run20:15:003
1836399128,3cyclictest32222-21sshd00:24:122
1836399128,3cyclictest17193-21sshd22:39:472
18363991212,0cyclictest10924-21diskmemload22:50:022
18363991211,1cyclictest30-21ksoftirqd/221:57:022
1836399121,10cyclictest12023-21sshd22:30:332
1836399121,10cyclictest0-21swapper/223:41:002
1836399121,10cyclictest0-21swapper/223:05:302
1836399121,10cyclictest0-21swapper/222:00:272
1836399121,10cyclictest0-21swapper/200:11:032
18363991210,1cyclictest26691-21id22:40:302
1836399120,3cyclictest21128-21sshd00:26:082
1836399120,1cyclictest24275-21cp21:52:462
1836399120,11cyclictest14971-21sshd22:05:422
1836399120,11cyclictest0-21swapper/223:50:482
1836399120,11cyclictest0-21swapper/223:25:442
1836399120,11cyclictest0-21swapper/222:26:182
1836099129,2cyclictest0-21swapper/122:20:161
1836099129,2cyclictest0-21swapper/119:15:011
1836099128,1cyclictest0-21swapper/100:16:061
1836099120,9cyclictest31728-21bash22:55:221
1836099120,12cyclictest0-21swapper/122:05:221
1836099120,12cyclictest0-21swapper/119:30:171
1836099120,11cyclictest0-21swapper/123:15:121
1835799129,2cyclictest0-21swapper/000:35:190
1835799128,3cyclictest27858-21sshd23:06:420
1835799122,9cyclictest20711-21munin-node19:15:000
1835799120,9cyclictest0-21swapper/023:15:180
1835799120,3cyclictest21438-21sshd21:35:520
1835799120,12cyclictest0-21swapper/022:57:170
1835799120,12cyclictest0-21swapper/000:15:310
1835799120,11cyclictest924-21bash21:25:500
1835799120,11cyclictest15387-21sshd00:25:330
1835799120,11cyclictest0-21swapper/022:20:030
1836899118,2cyclictest0-21swapper/319:15:013
1836899115,5cyclictest6871-21ntp_kernel_pll_19:50:233
1836899115,5cyclictest5478-21munin-node20:55:253
1836899115,5cyclictest1722-21runrttasks20:05:153
1836899115,5cyclictest10751-21taskset21:08:553
1836899114,6cyclictest31633-21chrt20:45:083
1836899113,7cyclictest7487-21nfsd421:00:273
1836899112,8cyclictest24263-21munin-node19:20:173
1836899111,9cyclictest0-21swapper/319:40:203
1836899110,1cyclictest18405-21apache_volume19:10:153
1836899110,1cyclictest0-21swapper/320:50:253
1836399119,2cyclictest0-21swapper/222:20:112
1836399111,9cyclictest0-21swapper/220:45:192
18363991110,1cyclictest0-21swapper/219:29:342
18363991110,1cyclictest0-21swapper/219:21:332
1836399110,2cyclictest0-21swapper/222:10:032
1836399110,2cyclictest0-21swapper/219:15:012
1836399110,1cyclictest0-21swapper/220:29:512
1836399110,1cyclictest0-21swapper/220:00:552
1836399110,1cyclictest0-21swapper/219:53:292
1836399110,11cyclictest0-21swapper/220:39:512
1836399110,11cyclictest0-21swapper/220:30:332
1836399110,11cyclictest0-21swapper/219:58:422
1836399110,11cyclictest0-21swapper/219:45:502
1836399110,11cyclictest0-21swapper/219:40:012
1836399110,10cyclictest19391-21perl00:35:182
1836399110,10cyclictest0-21swapper/223:00:312
1836399110,10cyclictest0-21swapper/220:53:192
1836099119,1cyclictest0-21swapper/120:15:211
18360991110,1cyclictest0-21swapper/119:25:451
1836099110,2cyclictest0-21swapper/119:50:191
1836099110,11cyclictest0-21swapper/119:10:261
1836099110,10cyclictest0-21swapper/121:09:021
1835799110,11cyclictest0-21swapper/020:31:320
1836899108,1cyclictest31705-21sh19:35:203
1836899104,5cyclictest29346-21fw_forwarded_lo19:30:193
1836899103,6cyclictest8277-21cstates19:55:173
1836899103,6cyclictest31620-21sed20:45:003
1836899103,6cyclictest1574-21snmpd19:49:123
1836899103,6cyclictest10882-21fschecks_count20:00:163
1836899100,9cyclictest27659-21grep20:35:193
1836899100,1cyclictest26952-21fschecks_time19:25:153
1836399109,1cyclictest0-21swapper/220:07:462
1836399108,1cyclictest29234-21perl19:30:192
18363991010,0cyclictest0-21swapper/220:55:252
1836099109,1cyclictest1451-21fschecks_time19:40:191
1836099109,1cyclictest0-21swapper/120:25:281
1836099109,1cyclictest0-21swapper/120:21:521
1836099108,1cyclictest31625-21perl19:35:181
1836099108,1cyclictest29981-21grep20:40:181
1836099108,1cyclictest27626-21perl20:35:191
18360991010,0cyclictest0-21swapper/119:21:271
1836099100,9cyclictest0-21swapper/119:45:181
1836099100,1cyclictest11105-21perl20:00:171
1836099100,1cyclictest0-21swapper/120:10:151
1836099100,10cyclictest0-21swapper/120:53:421
1836099100,10cyclictest0-21swapper/120:31:171
1835799109,1cyclictest0-21swapper/020:53:500
1835799108,2cyclictest0-21swapper/019:30:190
1835799100,9cyclictest0-21swapper/019:55:180
1835799100,1cyclictest24584-21fschecks_time19:20:170
1835799100,10cyclictest0-21swapper/021:01:590
1835799100,10cyclictest0-21swapper/020:56:510
1835799100,10cyclictest0-21swapper/020:48:290
1835799100,10cyclictest0-21swapper/020:43:300
1835799100,10cyclictest0-21swapper/020:04:210
1835799100,10cyclictest0-21swapper/019:53:300
1835799100,10cyclictest0-21swapper/019:49:360
1835799100,10cyclictest0-21swapper/019:38:200
1835799100,10cyclictest0-21swapper/019:29:580
183689990,1cyclictest24600-21munin-node20:30:173
183689990,1cyclictest20264-21forks20:20:173
183639998,1cyclictest0-21swapper/221:00:382
183639998,1cyclictest0-21swapper/220:21:012
183639998,1cyclictest0-21swapper/219:12:292
183609998,1cyclictest0-21swapper/120:48:211
183579998,1cyclictest0-21swapper/020:35:190
183579998,1cyclictest0-21swapper/020:25:150
183579998,1cyclictest0-21swapper/019:41:280
183579998,1cyclictest0-21swapper/019:11:560
183639987,1cyclictest0-21swapper/220:44:502
183639986,1cyclictest31697-21perl19:35:192
183639986,1cyclictest0-21swapper/221:05:192
183639980,7cyclictest0-21swapper/220:20:002
183609987,1cyclictest0-21swapper/120:57:461
183609986,1cyclictest8667-21cut19:55:191
183609980,8cyclictest0-21swapper/121:03:181
183579987,1cyclictest0-21swapper/021:06:030
183579980,7cyclictest0-21swapper/020:22:040
183579976,1cyclictest0-21swapper/020:18:170
183639965,1cyclictest0-21swapper/220:11:092
183579965,1cyclictest0-21swapper/020:10:010
183579960,1cyclictest0-21swapper/020:05:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional