You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-11-28 - 10:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack8slot0.osadl.org (updated Tue Nov 28, 2023 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
483221390,1sleep01303999cyclictest20:51:410
1833921240,2sleep31304299cyclictest23:47:223
51092830,0sleep3431ktimersoftd/323:09:383
86802770,1sleep18677-21sshd23:35:181
24182770,0sleep00-21swapper/021:01:110
225792760,1sleep022576-21sshd23:06:140
78352750,1sleep11843-21nfsd21:30:431
64052740,0sleep10-21swapper/121:06:541
296442740,1sleep029635-21sshd22:12:110
242532740,1sleep024246-21sshd22:03:290
326482730,0sleep20-21swapper/222:36:062
32232730,0sleep30-21swapper/321:22:073
310592730,1sleep031057-21bash22:40:170
57812720,1sleep0141rcuc/021:05:280
174252720,1sleep117401-21sshd23:11:361
257962710,1sleep025780-21sshd23:25:590
73382700,0sleep00-21swapper/021:39:080
62242700,1sleep26219-21sshd21:01:212
257212700,0sleep025720-21bash22:46:580
232122700,0sleep3421rcuc/320:57:543
159842700,0sleep01846-21nfsd21:21:160
68562690,0sleep00-21swapper/022:22:210
326432690,0sleep30-21swapper/323:39:163
211182690,0sleep11846-21nfsd21:49:311
306122680,1sleep2857-21dbus-daemon23:37:432
219942680,0sleep10-21swapper/121:53:401
219942680,0sleep10-21swapper/121:53:401
209002680,0sleep3421rcuc/321:14:293
209002680,0sleep3421rcuc/321:14:293
204542680,0sleep00-21swapper/023:32:480
43292670,2sleep392150irq/27-p4p1-tx-21:55:423
43292670,2sleep392150irq/27-p4p1-tx-21:55:423
285932670,1sleep028572-21sshd22:31:430
273782670,0sleep20-21swapper/222:56:422
271782670,1sleep1241rcuc/122:55:171
25662670,0sleep30-21swapper/322:16:353
241062670,1sleep30-21swapper/321:37:063
3392660,1sleep2341ktimersoftd/222:38:542
243002660,0sleep10-21swapper/121:00:441
232112660,0sleep30-21swapper/320:52:283
110392660,0sleep30-21swapper/322:58:443
75792640,1sleep07567-21sshd21:11:100
49932640,0sleep10-21swapper/121:26:221
76642630,0sleep20-21swapper/222:11:122
89382620,0sleep10-21swapper/122:44:511
48832620,1sleep14884-21bash21:39:011
302792620,0sleep30-21swapper/323:02:253
89362610,0sleep20-21swapper/223:15:262
89362610,0sleep20-21swapper/223:15:262
253672610,1sleep025348-21sshd23:21:460
220252610,0sleep20-21swapper/223:04:482
1274726126,28sleep10-21swapper/118:41:481
212992600,0sleep30-21swapper/323:46:023
93732590,0sleep20-21swapper/221:18:092
158172590,0sleep115818-21bash21:36:441
71012580,0sleep20-21swapper/221:25:032
3992580,0sleep20-21swapper/221:13:362
3992580,0sleep20-21swapper/221:13:362
298602580,0sleep30-21swapper/322:20:313
223722580,0sleep30-21swapper/321:04:473
195792580,0sleep30-21swapper/300:03:253
83462570,0sleep20-21swapper/222:02:472
254992560,0sleep20-21swapper/219:02:352
313272550,0sleep331331-21bash22:31:503
1263825326,8sleep00-21swapper/018:40:270
1257625327,8sleep30-21swapper/318:39:423
138762520,1sleep01303999cyclictest21:53:190
138762520,1sleep01303999cyclictest21:53:190
1269425225,8sleep20-21swapper/218:41:092
165412450,0sleep10-21swapper/121:43:461
223892380,1sleep1251ktimersoftd/122:59:141
146612330,2sleep11304099cyclictest23:22:391
13041993126,2cyclictest35-21ksoftirqd/200:04:052
62832300,0sleep30-21swapper/321:22:153
193712250,0sleep219345-21sshd00:02:002
143482250,1sleep314330-21sshd22:45:053
13040992513,1cyclictest26-21ksoftirqd/121:20:131
13022250,0sleep01301-21grep21:13:380
13022250,0sleep01301-21grep21:13:380
62332240,0sleep06217-21sshd23:58:250
165842240,2sleep31304299cyclictest22:08:453
1304199245,11cyclictest35-21ksoftirqd/223:37:052
13041992412,1cyclictest35-21ksoftirqd/200:07:542
107452240,0sleep10-21swapper/120:43:291
317542230,0sleep20-21swapper/220:51:272
297752230,0sleep10-21swapper/122:34:321
293912230,1sleep1241rcuc/121:14:511
293912230,1sleep1241rcuc/121:14:511
218982230,2sleep11304099cyclictest20:49:381
169902230,1sleep3431ktimersoftd/321:47:573
1304199232,2cyclictest35-21ksoftirqd/223:30:472
13041992316,4cyclictest35-21ksoftirqd/222:27:342
13041992311,2cyclictest35-21ksoftirqd/223:07:332
13041992310,3cyclictest35-21ksoftirqd/223:54:442
1304099239,3cyclictest26-21ksoftirqd/122:27:141
125982230,0sleep012600-21grep22:14:110
1304199227,3cyclictest35-21ksoftirqd/223:26:352
13041992210,2cyclictest35-21ksoftirqd/222:57:182
1304099229,1cyclictest26-21ksoftirqd/100:06:431
79602210,0sleep0141rcuc/023:41:060
241212210,1sleep224114-21bash22:42:432
1304199219,1cyclictest35-21ksoftirqd/221:49:212
1304199219,1cyclictest35-21ksoftirqd/221:37:002
1304199217,3cyclictest35-21ksoftirqd/221:52:392
1304199217,3cyclictest35-21ksoftirqd/221:52:392
1304199216,4cyclictest35-21ksoftirqd/223:19:222
1304199216,2cyclictest35-21ksoftirqd/221:28:182
13041992116,1cyclictest35-21ksoftirqd/221:09:442
13041992112,1cyclictest35-21ksoftirqd/222:21:062
13041992112,1cyclictest35-21ksoftirqd/222:12:562
13041992111,1cyclictest35-21ksoftirqd/222:48:592
13041992110,4cyclictest35-21ksoftirqd/223:48:402
13041992110,3cyclictest35-21ksoftirqd/221:58:352
13041992110,1cyclictest35-21ksoftirqd/221:43:062
1304199210,1cyclictest121rcu_sched21:42:112
1304099219,1cyclictest26-21ksoftirqd/123:29:271
1304099219,1cyclictest26-21ksoftirqd/123:02:361
1304099217,1cyclictest26-21ksoftirqd/122:01:121
1304099216,11cyclictest26-21ksoftirqd/123:57:411
13040992112,1cyclictest26-21ksoftirqd/122:22:141
66422200,0sleep00-21swapper/023:51:120
1304199209,1cyclictest35-21ksoftirqd/222:22:522
1304199209,1cyclictest35-21ksoftirqd/221:02:292
1304199207,4cyclictest35-21ksoftirqd/220:42:182
1304199207,1cyclictest35-21ksoftirqd/220:55:042
1304099209,1cyclictest26-21ksoftirqd/122:18:331
1304099208,1cyclictest26-21ksoftirqd/122:37:491
1304099207,1cyclictest26-21ksoftirqd/120:56:411
13040992018,1cyclictest26-21ksoftirqd/122:12:441
13040992010,1cyclictest26-21ksoftirqd/123:46:551
82262190,1sleep0857-21dbus-daemon21:23:400
325982190,0sleep10-21swapper/121:09:261
277202190,2sleep3421rcuc/322:51:103
275302190,0sleep10-21swapper/123:41:591
207702190,0sleep320764-21sshd23:25:453
187242190,0sleep00-21swapper/000:06:230
1304199190,1cyclictest111rcu_preempt23:43:402
1304099199,1cyclictest26-21ksoftirqd/100:08:011
1304099198,1cyclictest26-21ksoftirqd/122:08:441
1304099195,1cyclictest26-21ksoftirqd/123:21:241
13040991910,1cyclictest26-21ksoftirqd/123:15:041
13040991910,1cyclictest26-21ksoftirqd/123:15:041
1304099190,1cyclictest5377-21sshd22:02:401
1304099188,1cyclictest26-21ksoftirqd/120:42:111
1304099187,4cyclictest26-21ksoftirqd/123:47:401
13040991816,1cyclictest26-21ksoftirqd/122:49:331
252572170,0sleep30-21swapper/322:04:563
16772170,1sleep00-21swapper/022:34:440
13042991714,2cyclictest10461-21sshd20:47:423
1304099176,3cyclictest26-21ksoftirqd/123:52:471
309872160,0sleep00-21swapper/022:49:550
167442160,0sleep016741-21sshd20:56:180
13042991614,1cyclictest606-21systemd-journal20:43:113
13042991613,1cyclictest925-21gdbus23:33:533
106002160,1sleep00-21swapper/023:01:330
79962150,0sleep30-21swapper/300:11:433
33312150,1sleep33330-21sshd21:40:233
138032150,1sleep313797-21sshd22:22:363
13042991513,1cyclictest606-21systemd-journal22:35:093
13042991513,1cyclictest606-21systemd-journal21:12:093
13042991513,1cyclictest32027-21sshd23:19:133
13042991512,2cyclictest31273-21sshd23:56:433
13039991513,1cyclictest30202-21bash23:14:560
13039991513,1cyclictest30202-21bash23:14:560
13039991512,1cyclictest18094-21sshd21:50:470
13039991511,2cyclictest15646-21bash23:53:020
13039991511,1cyclictest18858-21sshd22:20:030
1303999150,14cyclictest4848-21grepconf.sh21:27:430
1304299142,10cyclictest15865-21id23:28:203
13042991412,1cyclictest7111-21sshd00:01:263
13042991412,1cyclictest19836-21sshd21:59:083
13042991412,1cyclictest15146-21sshd21:43:423
1303999142,10cyclictest29615-21grepconf.sh23:27:330
13039991412,1cyclictest7925-21bash22:00:010
13039991412,1cyclictest1943-21sshd00:11:260
13039991412,1cyclictest12823-21sshd22:54:390
13042991311,1cyclictest11946-21sshd21:30:533
1304299131,10cyclictest923-21polkitd22:52:373
1304299130,12cyclictest0-21swapper/322:37:213
1304299130,10cyclictest28100-21sshd23:13:263
1304299130,10cyclictest28100-21sshd23:13:263
1304199130,1cyclictest111rcu_preempt20:42:112
13039991310,1cyclictest13544-21sshd23:44:120
1304299129,1cyclictest0-21swapper/319:32:383
1304299120,1cyclictest0-21swapper/319:32:113
13041991211,0cyclictest30270-21kworker/2:218:51:152
13041991211,0cyclictest26407-21kworker/2:119:50:012
13041991210,1cyclictest26407-21kworker/2:120:16:012
1303999128,2cyclictest24268-21grepconf.sh23:07:390
1303999120,2cyclictest19627-21sshd21:43:540
1303999120,10cyclictest13794-21sshd20:42:160
1304199119,1cyclictest26407-21kworker/2:119:35:592
1304199119,1cyclictest26407-21kworker/2:119:20:332
1304199116,4cyclictest92050irq/26-p4p1-rx-19:39:362
1304099110,9cyclictest0-21swapper/120:22:391
1304099110,1cyclictest24483-21nfsd420:02:361
1303999110,9cyclictest0-21swapper/020:07:340
1303999110,2cyclictest19868-21perl18:52:320
1303999110,1cyclictest8977-21ntp_states19:32:380
1303999110,1cyclictest1987-21perl20:22:320
1303999110,1cyclictest16146-21fw_forwarded_lo19:47:320
1303999110,1cyclictest0-21swapper/019:52:340
1303999110,10cyclictest17774-21perl21:32:350
1303999110,10cyclictest0-21swapper/019:58:010
1304299108,1cyclictest0-21swapper/318:57:313
1304299108,1cyclictest0-21swapper/318:57:313
1304299100,9cyclictest0-21swapper/320:07:343
1304299100,9cyclictest0-21swapper/319:57:383
1304299100,9cyclictest0-21swapper/319:47:323
1304299100,9cyclictest0-21swapper/319:20:413
1304299100,1cyclictest1915-21perl20:22:323
1304299100,1cyclictest13938-21ls19:42:353
1304299100,0cyclictest0-21swapper/319:41:423
1304299100,0cyclictest0-21swapper/318:54:253
1304199108,1cyclictest30270-21kworker/2:218:59:352
1304199108,1cyclictest30270-21kworker/2:218:59:352
1304199108,1cyclictest30270-21kworker/2:218:44:192
1304199108,1cyclictest26407-21kworker/2:120:07:412
1304199108,1cyclictest26407-21kworker/2:119:25:452
1304199108,1cyclictest26407-21kworker/2:119:08:252
1304199108,1cyclictest0-21swapper/219:42:322
1304199100,9cyclictest23923-21perl20:02:322
1304199100,9cyclictest2324-21memory20:22:352
1304199100,1cyclictest0-21swapper/219:57:332
1304199100,0cyclictest0-21swapper/219:16:002
1304099108,1cyclictest21257-21perl19:57:321
1304099108,1cyclictest0-21swapper/119:32:321
1304099100,1cyclictest3139-21fw_forwarded_lo19:22:341
1304099100,1cyclictest15726-21grep18:47:111
1304099100,1cyclictest13540-21fw_conntrack19:42:321
1303999108,1cyclictest14074-21grep19:42:360
1303999100,9cyclictest0-21swapper/020:37:350
1303999100,9cyclictest0-21swapper/020:31:080
1303999100,9cyclictest0-21swapper/020:13:220
1303999100,9cyclictest0-21swapper/020:05:270
130429998,0cyclictest0-21swapper/320:37:353
130429998,0cyclictest0-21swapper/320:34:203
130429998,0cyclictest0-21swapper/319:22:323
130429998,0cyclictest0-21swapper/319:12:543
130429998,0cyclictest0-21swapper/319:06:023
130429990,0cyclictest0-21swapper/319:52:333
130419998,0cyclictest0-21swapper/220:35:072
130419998,0cyclictest0-21swapper/220:29:532
130419998,0cyclictest0-21swapper/218:53:062
130419990,8cyclictest0-21swapper/220:21:102
130409998,0cyclictest0-21swapper/120:12:321
130409997,1cyclictest7298-21smartctl20:32:321
130409997,1cyclictest16068-21perl19:47:321
130409990,0cyclictest0-21swapper/120:07:371
130409990,0cyclictest0-21swapper/119:27:391
130399998,0cyclictest0-21swapper/019:40:150
130399998,0cyclictest0-21swapper/019:17:080
130399998,0cyclictest0-21swapper/019:11:120
130399990,0cyclictest0-21swapper/019:27:330
130399990,0cyclictest0-21swapper/019:26:180
130399990,0cyclictest0-21swapper/018:57:310
130399990,0cyclictest0-21swapper/018:57:310
130429987,0cyclictest0-21swapper/320:19:493
130419986,1cyclictest26407-21kworker/2:119:53:392
130419986,1cyclictest0-21swapper/219:27:332
130409987,0cyclictest19387-21ntpq19:52:411
130409987,0cyclictest0-21swapper/119:17:291
130399987,0cyclictest0-21swapper/020:20:060
130399987,0cyclictest0-21swapper/019:06:120
130399987,0cyclictest0-21swapper/018:46:480
130429976,0cyclictest0-21swapper/320:12:303
130429976,0cyclictest0-21swapper/318:50:073
130429975,1cyclictest23849-21grep20:02:323
130429970,1cyclictest28944-21seq19:08:143
130409972,2cyclictest26-21ksoftirqd/119:02:321
130409971,3cyclictest26-21ksoftirqd/119:02:111
130409971,3cyclictest26-21ksoftirqd/119:02:111
130409970,1cyclictest32249-21awk20:17:371
130409970,1cyclictest27371-21diskstats19:07:331
130409970,1cyclictest19849-21perl18:52:311
130409970,1cyclictest0-21swapper/118:42:391
130399976,0cyclictest0-21swapper/018:50:520
130399970,1cyclictest7711-21awk20:32:350
130429960,0cyclictest0-21swapper/320:27:303
130429960,0cyclictest0-21swapper/318:44:583
130409965,0cyclictest0-21swapper/119:12:151
130409961,2cyclictest121rcu_sched19:37:331
130409960,3cyclictest121rcu_sched20:32:111
130399964,1cyclictest1072-21awk19:17:370
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional