You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-07 - 21:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack8slot0.osadl.org (updated Thu Dec 07, 2023 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3083121440,0sleep00-21swapper/011:37:360
2926521220,1sleep00-21swapper/010:29:060
422421080,0sleep11846-21nfsd11:56:571
69092810,1sleep06826-21sshd12:05:140
133942810,1sleep113397-21grepconf.sh11:17:371
28292760,1sleep30-21swapper/308:54:533
258172760,0sleep10-21swapper/112:06:031
285652740,1sleep328568-21bash12:02:043
39262730,1sleep127039-21kworker/1:111:36:331
242902730,3sleep22326899cyclictest10:05:392
218762730,1sleep11846-21nfsd09:31:311
39402720,0sleep20-21swapper/210:13:572
194032710,0sleep2331rcuc/211:04:592
60132700,1sleep10-21swapper/108:56:361
202182700,1sleep020201-21sshd09:20:400
74622690,1sleep37431-21sshd11:48:533
325062690,0sleep1241rcuc/110:32:151
309552690,1sleep330940-21bash10:12:093
224022690,1sleep022398-21grepconf.sh10:17:590
144312690,0sleep00-21swapper/011:06:130
31202680,1sleep23123-21id10:52:162
231172680,1sleep20-21swapper/210:28:482
192162680,0sleep00-21swapper/010:05:250
10542680,0sleep2331rcuc/211:25:392
268742670,0sleep226870-21bash08:48:192
19222670,1sleep1241rcuc/111:31:041
203552660,2sleep392150irq/27-p4p1-tx-10:00:473
176802660,0sleep00-21swapper/010:06:530
188552650,0sleep118851-21sshd12:07:071
135232650,1sleep113495-21sshd11:01:531
74392640,0sleep00-21swapper/009:30:500
326972640,1sleep232666-21sshd08:43:542
140422640,1sleep01845-21nfsd11:28:500
185492630,0sleep30-21swapper/311:31:463
174412630,0sleep00-21swapper/009:32:460
60702620,0sleep30-21swapper/309:55:303
250172620,1sleep025010-21bash10:31:580
186842620,1sleep11846-21nfsd10:30:071
182372620,0sleep318239-21uname10:54:383
171382620,1sleep00-21swapper/010:45:170
312662610,0sleep10-21swapper/110:02:491
165182610,0sleep10-21swapper/110:12:591
308972600,1sleep230899-21sshd09:36:372
208602600,1sleep020856-21grepconf.sh09:09:410
127912600,1sleep312762-21cp08:49:123
60712590,0sleep10-21swapper/109:33:471
246202590,1sleep126-21ksoftirqd/108:49:461
171932590,0sleep00-21swapper/008:43:080
210082580,0sleep0141rcuc/011:42:370
215622570,0sleep20-21swapper/212:08:332
2277125327,8sleep10-21swapper/106:38:521
5542480,0sleep3431ktimersoftd/311:11:213
327202460,0sleep00-21swapper/011:36:240
2106124523,15sleep20-21swapper/206:37:082
2298724430,8sleep00-21swapper/006:41:360
2267324429,9sleep30-21swapper/306:37:383
325022290,1sleep00-21swapper/008:57:470
32932280,0sleep23297-21bash08:53:202
186632260,1sleep10-21swapper/110:25:381
34262250,1sleep33419-21sshd10:09:173
23267992513,1cyclictest26-21ksoftirqd/109:42:151
23267992513,1cyclictest26-21ksoftirqd/109:42:151
56962240,1sleep35697-21sshd09:36:583
23267992413,1cyclictest26-21ksoftirqd/109:49:251
23266992411,8cyclictest5009-21sshd09:23:000
100852240,0sleep210071-21sshd10:43:232
23267992312,1cyclictest26-21ksoftirqd/109:10:451
103852230,0sleep1241rcuc/109:38:441
290682220,0sleep20-21swapper/211:14:012
278982220,1sleep027894-21sshd09:16:150
278982220,1sleep027894-21sshd09:16:150
2326799228,3cyclictest26-21ksoftirqd/110:18:131
2326799228,1cyclictest26-21ksoftirqd/109:20:051
155582220,1sleep2331rcuc/209:25:072
37722210,2sleep392150irq/27-p4p1-tx-10:21:513
290882210,1sleep2331rcuc/211:49:492
277652210,0sleep20-21swapper/206:47:142
2326799218,1cyclictest26-21ksoftirqd/111:01:211
2326799218,1cyclictest26-21ksoftirqd/109:15:561
2326799218,1cyclictest26-21ksoftirqd/109:15:561
2326799210,1cyclictest111rcu_preempt09:02:131
167092210,0sleep1952-21sshd11:42:261
42812200,0sleep24203-21sshd10:07:432
21702200,1sleep32175-21bash10:47:333
209602200,0sleep3857-21dbus-daemon11:57:353
44662190,1sleep04464-21bash09:53:510
23269991915,1cyclictest14702-21sshd09:26:343
2326799198,1cyclictest26-21ksoftirqd/111:48:131
2326799198,1cyclictest26-21ksoftirqd/111:08:311
2326799198,1cyclictest26-21ksoftirqd/110:08:251
2326799198,1cyclictest26-21ksoftirqd/109:59:121
2326699191,2cyclictest0-21swapper/010:22:060
2326699190,17cyclictest857-21dbus-daemon11:22:130
2326699190,12cyclictest0-21swapper/011:56:520
180002190,0sleep217966-21sshd09:11:082
135222190,1sleep20-21swapper/209:37:172
118822190,1sleep211883-21grepconf.sh10:19:062
311312180,0sleep30-21swapper/311:45:493
281892180,0sleep228111-21sshd11:40:152
2326899187,1cyclictest35-21ksoftirqd/211:20:062
2326799189,1cyclictest26-21ksoftirqd/109:24:431
2326799187,1cyclictest26-21ksoftirqd/109:56:061
2326799186,1cyclictest26-21ksoftirqd/111:23:271
2326799186,1cyclictest26-21ksoftirqd/109:01:331
23267991816,1cyclictest26-21ksoftirqd/110:52:131
23267991816,1cyclictest26-21ksoftirqd/110:39:511
23267991811,1cyclictest26-21ksoftirqd/111:37:091
2326699189,8cyclictest606-21systemd-journal09:45:010
2326699189,8cyclictest606-21systemd-journal09:45:010
2326699189,7cyclictest17330-21sshd09:03:160
23266991811,6cyclictest1796-21sshd11:47:160
2326699180,2cyclictest923-21polkitd08:52:150
2326699180,2cyclictest30195-21grep10:47:210
2326699180,1cyclictest19936-21cp12:07:100
2326699180,1cyclictest0-21swapper/011:12:570
2326699180,1cyclictest0-21swapper/010:15:020
2326699180,16cyclictest16879-21sshd10:37:360
2326699180,10cyclictest925-21gdbus11:55:440
2326699180,10cyclictest11075-21grepconf.sh11:20:260
224542180,1sleep022450-21sshd10:56:230
156342180,0sleep315630-21bash09:31:133
140912180,0sleep30-21swapper/311:11:583
117632180,0sleep21845-21nfsd09:06:112
70412170,0sleep20-21swapper/209:55:332
23269991715,1cyclictest2213-21sshd11:02:453
23268991715,1cyclictest10625-21sshd11:57:122
2326799179,1cyclictest26-21ksoftirqd/110:45:191
2326799173,2cyclictest26-21ksoftirqd/111:52:121
2326799171,1cyclictest121rcu_sched10:46:491
23266991711,5cyclictest606-21systemd-journal09:48:000
2326699170,1cyclictest7567-21bash11:00:090
2326699170,10cyclictest27438-21grep09:37:580
124092170,0sleep30-21swapper/309:12:213
124092170,0sleep30-21swapper/309:12:213
8392160,0sleep30-21swapper/310:20:073
323262160,0sleep00-21swapper/007:57:180
275732160,0sleep30-21swapper/310:29:013
23269991614,1cyclictest15746-21sshd12:08:183
23268991614,1cyclictest35-21ksoftirqd/211:42:082
23268991613,2cyclictest35-21ksoftirqd/210:01:482
2326799163,3cyclictest26-21ksoftirqd/108:46:481
2326799160,15cyclictest17300-21sshd11:12:061
2326699166,2cyclictest4148-21sshd09:56:580
2326699160,1cyclictest27768-21sshd11:06:490
2326699160,1cyclictest0-21swapper/008:47:020
72892150,0sleep37288-21sshd09:18:223
2326999152,12cyclictest11254-21sshd10:57:213
23269991513,1cyclictest879-21systemd-logind10:45:073
23269991513,1cyclictest24613-21sshd09:42:303
23269991513,1cyclictest24613-21sshd09:42:303
23268991513,1cyclictest35-21ksoftirqd/210:24:112
23268991513,1cyclictest18077-21sshd09:46:512
23268991513,1cyclictest15549-21sshd09:45:102
23268991513,1cyclictest15549-21sshd09:45:102
23268991513,1cyclictest15256-21sshd10:59:032
23268991512,2cyclictest35-21ksoftirqd/210:40:012
23268991512,1cyclictest35-21ksoftirqd/210:49:422
23268991511,3cyclictest35-21ksoftirqd/211:09:002
2326699157,2cyclictest27433-21grep06:47:110
2326699150,1cyclictest0-21swapper/008:41:480
23269991412,1cyclictest23191-21sshd11:23:523
23269991412,1cyclictest16090-21bash11:39:443
23269991411,2cyclictest30597-21sshd11:34:563
2326999140,1cyclictest16650-21sshd09:06:263
23268991412,1cyclictest35-21ksoftirqd/211:33:192
23268991412,1cyclictest30087-21sshd11:30:532
23268991412,1cyclictest29889-21sshd12:03:262
23268991412,1cyclictest29643-21sshd09:17:522
23268991411,2cyclictest29599-21sshd09:16:202
23268991411,2cyclictest29599-21sshd09:16:202
23267991410,2cyclictest7670-21kworker/1:207:02:081
2326999138,2cyclictest4917-21cp11:18:413
2326999133,1cyclictest857-21dbus-daemon10:38:393
2326999132,10cyclictest857-21dbus-daemon11:54:573
23269991311,1cyclictest28805-21sshd10:32:083
23269991311,1cyclictest16272-21sshd09:32:433
23269991311,1cyclictest13694-21sshd08:42:593
23269991310,2cyclictest1068-21bash10:02:563
2326999130,1cyclictest28032-21sshd09:50:223
2326999130,11cyclictest20999-21sshd08:58:463
23268991311,1cyclictest35-21ksoftirqd/211:54:572
23268991311,1cyclictest12237-21sshd08:56:532
23268991310,2cyclictest0-21swapper/209:27:012
2326899130,3cyclictest952-21sshd10:34:132
2326699139,0cyclictest0-21swapper/006:58:460
2326999120,10cyclictest839-21bash09:07:123
2326699129,0cyclictest0-21swapper/007:29:330
2326699120,11cyclictest0-21swapper/007:12:000
2326699120,0cyclictest0-21swapper/007:37:270
2326899110,10cyclictest0-21swapper/207:14:012
2326899110,10cyclictest0-21swapper/206:52:462
2326799118,2cyclictest28112-21awk06:47:151
2326799110,10cyclictest0-21swapper/108:29:271
2326699110,0cyclictest0-21swapper/006:42:160
2326999109,0cyclictest0-21swapper/308:09:413
2326999100,9cyclictest0-21swapper/306:46:493
2326999100,0cyclictest0-21swapper/308:12:073
2326999100,0cyclictest0-21swapper/307:32:173
2326899109,0cyclictest0-21swapper/207:38:112
2326899103,1cyclictest29856-21kworker/2:107:53:162
2326899100,9cyclictest0-21swapper/208:32:262
2326899100,9cyclictest0-21swapper/206:57:242
2326899100,0cyclictest0-21swapper/208:28:112
2326899100,0cyclictest0-21swapper/208:12:062
2326899100,0cyclictest0-21swapper/207:36:402
2326899100,0cyclictest0-21swapper/207:21:202
2326899100,0cyclictest0-21swapper/206:42:302
2326799109,0cyclictest0-21swapper/107:22:111
2326799109,0cyclictest0-21swapper/106:57:191
2326699108,1cyclictest9937-21/usr/sbin/munin07:17:140
2326699100,9cyclictest0-21swapper/008:07:460
2326699100,9cyclictest0-21swapper/007:05:510
2326699100,9cyclictest0-21swapper/006:52:150
2326699100,0cyclictest0-21swapper/008:02:180
232699998,0cyclictest0-21swapper/308:00:513
232699990,0cyclictest0-21swapper/308:31:393
232699990,0cyclictest0-21swapper/307:03:353
232689998,0cyclictest0-21swapper/207:23:332
232689998,0cyclictest0-21swapper/207:07:522
232689998,0cyclictest0-21swapper/207:02:382
232689990,0cyclictest0-21swapper/208:39:592
232689990,0cyclictest0-21swapper/208:19:052
232689990,0cyclictest0-21swapper/208:05:082
232689990,0cyclictest0-21swapper/207:48:102
232679997,1cyclictest26-21ksoftirqd/108:41:481
232669997,1cyclictest0-21swapper/008:17:110
232669990,0cyclictest0-21swapper/008:15:400
232669990,0cyclictest0-21swapper/007:24:190
232699987,0cyclictest0-21swapper/308:18:313
232699987,0cyclictest0-21swapper/307:27:033
232699980,0cyclictest0-21swapper/308:33:093
232699980,0cyclictest0-21swapper/307:50:313
232699980,0cyclictest0-21swapper/307:44:083
232689987,0cyclictest0-21swapper/207:27:512
232679987,0cyclictest0-21swapper/108:20:301
232679987,0cyclictest0-21swapper/106:56:231
232679980,7cyclictest0-21swapper/107:49:151
232669985,2cyclictest23915-21cat07:42:080
232669980,7cyclictest28623-21df_inode07:52:070
232699976,0cyclictest0-21swapper/307:40:113
232699976,0cyclictest0-21swapper/306:42:473
232699975,1cyclictest7904-21cut07:12:153
232699975,1cyclictest5630-21/usr/sbin/munin07:07:103
232699972,1cyclictest0-21swapper/306:57:083
232699970,6cyclictest0-21swapper/307:51:543
232699970,1cyclictest12667-21grep07:22:063
232689970,1cyclictest3988-21expr08:07:092
232689970,1cyclictest32047-21awk07:57:152
232689970,1cyclictest23782-21fw_packets07:42:072
232689970,1cyclictest0-21swapper/208:22:062
232679976,0cyclictest0-21swapper/107:08:491
232679974,2cyclictest0-21swapper/108:09:521
232679972,1cyclictest25849-21cat06:46:481
232679970,1cyclictest7797-21diskstats07:12:141
232679970,1cyclictest6177-21chrt08:12:011
232679970,1cyclictest29957-21ls07:52:191
232679970,1cyclictest18190-21entropy07:32:081
232679970,1cyclictest18026-21ntp_states08:32:131
232679970,1cyclictest15123-21proftpd07:27:021
232679970,1cyclictest0-21swapper/108:02:161
232679970,1cyclictest0-21swapper/107:59:391
232669975,1cyclictest25560-21sshd07:47:000
232669975,1cyclictest17717-21sshd07:32:010
232669970,1cyclictest19544-21httpd07:07:350
232669970,1cyclictest12037-21fschecks_time08:22:080
232699965,0cyclictest0-21swapper/306:53:213
232699964,1cyclictest19390-21ls08:37:063
232699964,1cyclictest1555-21grep08:02:103
232699964,1cyclictest11787-21grep08:22:063
232679964,1cyclictest25331-21latency_hist07:46:481
232679960,1cyclictest0-21swapper/107:17:151
232679960,0cyclictest0-21swapper/108:21:541
232669964,1cyclictest17025-21df_inode08:32:060
232669964,1cyclictest15621-21/usr/sbin/munin08:27:180
232699950,5cyclictest0-21swapper/307:16:563
232679950,0cyclictest0-21swapper/107:36:511
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional